Examples of HBaseCountersBatchBolt

backtype.storm.contrib.hbase.bolts.HBaseCountersBatchBolt

b.com/nathanmarz/storm/wiki/Transactional-topologies}

This bolt stores the counter and the latest transaction ID (txid) together in the HBase table. The counter is only incremented if the txid in the table is different from the txid of the Tuple being processed. E.g:

If the txids are different, because of Storm's strong ordering of transactions, we know that the current Tuple hasn't been represented in the counter, so the counter is incremented and its latest txid updated
If the txids are the same, we know that the current Tuple is represented in the counter so it is skipped. The Tuple must have failed after previously incrementing the counter but before reporting success back to Storm, so it was replayed

@see BatchBoltExecutor @see HTableConnector @see TupleTableConfig

    TupleTableConfig ttConfig = new TupleTableConfig("shorturl", "shortid");
    ttConfig.setBatch(false);
    ttConfig.addColumn("data", "clicks");
    ttConfig.addColumn("daily", "date");


    builder.setBolt("hbase-counters", new HBaseCountersBatchBolt(ttConfig), 2)
        .fieldsGrouping("spout", new Fields("shortid"));


    LocalCluster cluster = new LocalCluster();


    Config stormConfig = new Config();

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.

Examples of HBaseCountersBatchBolt

Examples of backtype.storm.contrib.hbase.bolts.HBaseCountersBatchBolt