List of updateIndexer() Examples

Examples of updateIndexer()

com.ngdata.hbaseindexer.model.api.WriteableIndexerModel.updateIndexer()
Updates an indexer.
Due to the optimistic concurrency control (see {@link IndexerDefinition#getOccVersion()}, the update will only succeed if it was not modified since it was read. This situation can be avoided either by disabling the occ check (by setting the OCC version to -1), but also by taking a lock on the index before reading it. In fact, usage of the lock is obliged.

The canonical flow to update an indexer is:
- Obtain a lock by calling {@link #lockIndexer(String)}
- Read existing state using {@link #getFreshIndexer(String)}
- Create an updated IndexerDefinition using the {@link IndexerDefinitionBuilder}
- Call this update method
- In a finally block, release the lock using {@link #unlockIndexer(String)}. Note that the lock will expire in case the client process gets killed (it's a ZooKeeper ephemeral node).

Examples of com.ngdata.hbaseindexer.model.api.WriteableIndexerModel.updateIndexer()

                .configuration(Bytes.toBytes("<indexer table='table1'>" +
                        "<field name='field1_s' value='family1:qualifier1'/>" +
                        "<field name='field2_s' value='family1:qualifier2'/>" +
                        "</indexer>"))
                .build();
        indexerModel.updateIndexer(indexerDef, lock);
        indexerModel.unlockIndexer(lock);
        waitOnEventsProcessed(1);


        put = new Put(b("row3"));
        put.add(b("family1"), b("qualifier2"), b("value1"));

View Full Code Here

Examples of com.ngdata.hbaseindexer.model.api.WriteableIndexerModel.updateIndexer()

        String lock = indexerModel.lockIndexer("indexer1");
        indexerDef = new IndexerDefinitionBuilder()
                .startFrom(indexerModel.getFreshIndexer("indexer1"))
                .incrementalIndexingState(IncrementalIndexingState.DO_NOT_SUBSCRIBE)
                .build();
        indexerModel.updateIndexer(indexerDef, lock);
        indexerModel.unlockIndexer(lock);
        waitOnEventsProcessed(1);


        // Verify master removed the SEP subscription and unassigned the subscription ID
        SepTestUtil.waitOnReplicationPeerStopped(peerId("indexer1"));

View Full Code Here

Examples of com.ngdata.hbaseindexer.model.api.WriteableIndexerModel.updateIndexer()

        lock = indexerModel.lockIndexer("indexer1");
        indexerDef = new IndexerDefinitionBuilder()
                .startFrom(indexerModel.getFreshIndexer("indexer1"))
                .incrementalIndexingState(IncrementalIndexingState.SUBSCRIBE_DO_NOT_CONSUME)
                .build();
        indexerModel.updateIndexer(indexerDef, lock);
        indexerModel.unlockIndexer(lock);
        waitOnEventsProcessed(1);


        // Verify master registered the SEP subscription and assigned the subscription ID
        SepTestUtil.waitOnReplicationPeerReady(peerId("indexer1"));

View Full Code Here

Examples of com.ngdata.hbaseindexer.model.api.WriteableIndexerModel.updateIndexer()

        lock = indexerModel.lockIndexer("indexer1");
        indexerDef = new IndexerDefinitionBuilder()
                .startFrom(indexerModel.getFreshIndexer("indexer1"))
                .incrementalIndexingState(IncrementalIndexingState.SUBSCRIBE_AND_CONSUME)
                .build();
        indexerModel.updateIndexer(indexerDef, lock);
        indexerModel.unlockIndexer(lock);
        waitOnEventsProcessed(1);


        // Verify supervisor started the indexer
        assertEquals(1, main.getIndexerSupervisor().getRunningIndexers().size());

View Full Code Here

Examples of com.ngdata.hbaseindexer.model.api.WriteableIndexerModel.updateIndexer()

        String lock = indexerModel.lockIndexer("indexer1");
        indexerDef = new IndexerDefinitionBuilder()
                .startFrom(indexerModel.getFreshIndexer("indexer1"))
                .lifecycleState(IndexerDefinition.LifecycleState.DELETE_REQUESTED)
                .build();
        indexerModel.updateIndexer(indexerDef, lock);
        indexerModel.unlockIndexer(lock);
        waitOnEventsProcessed(1);


        // Check index was removed
        try {

View Full Code Here

Examples of com.ngdata.hbaseindexer.model.api.WriteableIndexerModel.updateIndexer()

                IndexerDefinition.LifecycleState.valueOf(json.get("lifecycleState").getTextValue()) : null;


        String lock = model.lockIndexer(indexName);
        try {
            if (!oldIndexer.equals(indexerDefinition)) {
                model.updateIndexer(indexerDefinition, lock);
                //System.out.println("Index updated: " + indexName);
            } else {
                //System.out.println("Index already matches the specified settings, did not update it.");
            }
        } finally {

View Full Code Here

Examples of com.ngdata.hbaseindexer.model.api.WriteableIndexerModel.updateIndexer()

                    .startFrom(indexer1)
                    .configuration("foo1".getBytes(Charsets.UTF_8))
                    .build();


            try {
                model2.updateIndexer(indexer1, lock + "foo");
                fail("Expected exception");
            } catch (IndexerUpdateException e) {
                // verify the exception says something about locks
                assertTrue(e.getMessage().contains("lock"));
            }

View Full Code Here

Examples of com.ngdata.hbaseindexer.model.api.WriteableIndexerModel.updateIndexer()

            String subscriptionId;
            try {
                IndexerDefinition index = indexerModel.getIndexer(indexName);
                subscriptionId = index.getSubscriptionId();


                indexerModel.updateIndexer(new IndexerDefinitionBuilder()
                        .startFrom(index)
                        .incrementalIndexingState(IndexerDefinition.IncrementalIndexingState.DO_NOT_SUBSCRIBE)
                        .build(), lock);
            } finally {
                indexerModel.unlockIndexer(lock);

View Full Code Here

Examples of com.ngdata.hbaseindexer.model.api.WriteableIndexerModel.updateIndexer()

                IndexerDefinition index = model.getIndexer(indexName);
                IndexerDefinitionBuilder builder = new IndexerDefinitionBuilder()
                        .startFrom(index)
                        .batchIndexingState(IndexerDefinition.BatchIndexingState.BUILD_REQUESTED)
                        .batchIndexCliArguments(batchCliArgs);
                model.updateIndexer(builder.build(), lock);
            } finally {
                model.unlockIndexer(lock);
            }
        } catch (Exception e) {
            throw new Exception("Error launching batch index build.", e);

View Full Code Here

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.