Examples of org.apache.maven.index.context.NexusAnalyzer$NoopTokenizer

org.apache.maven.index.context.NexusAnalyzer
A Nexus specific analyzer. Only difference from Lucene's SimpleAnalyzer is that we use LetterOrDigitTokenizer instead of LowerCaseTokenizer. LetterOrDigitTokenizer does pretty much the same as LowerCaseTokenizer, it normalizes to lower case letter, but it takes letters and numbers too (as opposed to LowerCaseTokenizer) as token chars. @author Eugene Kuleshov @author cstamas

        IndexWriter w = null;
        IndexReader r = null;
        try
        {
            r = IndexReader.open( sourcedir );
            w = new NexusIndexWriter( targetdir, new NexusAnalyzer(), true );


            for ( int i = 0; i < r.maxDoc(); i++ )
            {
                if ( !r.isDeleted( i ) )
                {

View Full Code Here


        IndexWriter w = null;
        try
        {
            // analyzer is unimportant, since we are not adding/searching to/on index, only reading/deleting
            w = new NexusIndexWriter( directory, new NexusAnalyzer(), false );


            w.optimize();


            w.commit();
        }

View Full Code Here

     * @param ics a collection of index creators for updating unpacked documents.
     */
    public static Date unpackIndexData( final InputStream is, final Directory d, final IndexingContext context )
        throws IOException
    {
        NexusIndexWriter w = new NexusIndexWriter( d, new NexusAnalyzer(), true );
        try
        {
            IndexDataReader dr = new IndexDataReader( is );


            IndexDataReadResult result = dr.readIndex( w, context );

View Full Code Here

            // these are special untokenized fields, kept for use cases like TreeView is (exact matching).
            result = legacyConstructQuery( field, query );
        }
        else
        {
            QueryParser qp = new QueryParser( Version.LUCENE_24, field, new NexusAnalyzer() );


            // small cheap trick
            // if a query is not "expert" (does not contain field:val kind of expression)
            // but it contains star and/or punctuation chars, example: "common-log*"
            if ( !query.contains( ":" ) )

View Full Code Here

        {
            if ( JarFileContentsIndexCreator.FLD_CLASSNAMES.equals( indexerField ) )
            {
                String qpQuery = query.toLowerCase().replaceAll( "\\.", " " ).replaceAll( "/", " " );
                // tokenization should happen against the field!
                QueryParser qp = new QueryParser( Version.LUCENE_30, indexerField.getKey(), new NexusAnalyzer() );
                qp.setDefaultOperator( Operator.AND );
                return qp.parse( qpQuery );
            }
            else if ( indexerField.isKeyword() )
            {
                // no tokenization should happen against the field!
                if ( query.contains( "*" ) || query.contains( "?" ) )
                {
                    return new WildcardQuery( new Term( indexerField.getKey(), query ) );
                }
                else
                {
                    BooleanQuery bq = new BooleanQuery();


                    Term t = new Term( indexerField.getKey(), query );


                    bq.add( new TermQuery( t ), Occur.SHOULD );


                    PrefixQuery pq = new PrefixQuery( t );
                    pq.setBoost( 0.8f );


                    bq.add( pq, Occur.SHOULD );


                    return bq;
                }
            }
            else
            {
                // to save "original" query
                String qpQuery = query;


                // tokenization should happen against the field!
                QueryParser qp = new QueryParser( Version.LUCENE_30, indexerField.getKey(), new NexusAnalyzer() );
                qp.setDefaultOperator( Operator.AND );


                // small cheap trick
                // if a query is not "expert" (does not contain field:val kind of expression)
                // but it contains star and/or punctuation chars, example: "common-log*"

View Full Code Here

TOP

Related Classes of org.apache.maven.index.context.NexusAnalyzer$NoopTokenizer

org.apache.maven.index.DefaultQueryCreator

org.apache.maven.index.updater.DefaultIndexUpdater

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.