Examples of antlr.TokenStreamHiddenTokenFilter

antlr.TokenStreamHiddenTokenFilter
This object filters a token stream coming from a lexer or another TokenStream so that only certain token channels get transmitted to the parser. Any of the channels can be filtered off as "hidden" channels whose tokens can be accessed from the parser.

        lexer.setCommentListener(aContents);
        lexer.setTreatAssertAsKeyword(true);
        lexer.setTreatEnumAsKeyword(true);
        lexer.setTokenObjectClass("antlr.CommonHiddenStreamToken");


        final TokenStreamHiddenTokenFilter filter =
                new TokenStreamHiddenTokenFilter(lexer);
        filter.hide(TokenTypes.SINGLE_LINE_COMMENT);
        filter.hide(TokenTypes.BLOCK_COMMENT_BEGIN);


        final GeneratedJavaRecognizer parser =
            new GeneratedJavaRecognizer(filter);
        parser.setFilename(aContents.getFilename());
        parser.setASTNodeClass(DetailAST.class.getName());

View Full Code Here

                                                                           location,
                                                                           includeResolver,
                                                                           defineState);
            IDLLexer lexer = new IDLLexer(new java.io.LineNumberReader(preprocessor));
            lexer.setTokenObjectClass("antlr.CommonHiddenStreamToken");
            TokenStreamHiddenTokenFilter filter =
                new TokenStreamHiddenTokenFilter(lexer);
            filter.discard(IDLTokenTypes.WS);
            filter.hide(IDLTokenTypes.SL_COMMENT);
            filter.hide(IDLTokenTypes.ML_COMMENT);
            parser = new IDLParser(filter);
            parser.setASTNodeClass("antlr.CommonASTWithHiddenTokens");
            parser.specification();
        } catch (Exception ex) {
            throw new ToolException(ex);

View Full Code Here

                                                                           location,
                                                                           includeResolver,
                                                                           defineState);
            IDLLexer lexer = new IDLLexer(new java.io.LineNumberReader(preprocessor));
            lexer.setTokenObjectClass("antlr.CommonHiddenStreamToken");
            TokenStreamHiddenTokenFilter filter =
                new TokenStreamHiddenTokenFilter(lexer);
            filter.discard(IDLTokenTypes.WS);
            filter.hide(IDLTokenTypes.SL_COMMENT);
            filter.hide(IDLTokenTypes.ML_COMMENT);
            parser = new IDLParser(filter);
            parser.setASTNodeClass("antlr.CommonASTWithHiddenTokens");
            parser.specification();
        } catch (Exception ex) {
            throw new ToolException(ex);

View Full Code Here

TOP

Related Classes of antlr.TokenStreamHiddenTokenFilter

antlr.collections.impl.BitSet

com.puppycrawl.tools.checkstyle.TreeWalker

org.apache.cxf.tools.corba.processors.idl.IDLProcessor

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.