Examples of org.kiji.schema.layout.impl.ZooKeeperMonitor

org.kiji.schema.layout.impl.ZooKeeperMonitor
Monitor tracking table layouts.
The monitor roles include:
- Reporting new layout updates to active users of a table: When a table's layout is being updated, users of that table will receive a notification and will automatically reload the table layout.
- Reporting active users of a table to table management client processes: Every user of a table will advertise itself as such and report the version of the table layout it currently uses. This makes it possible for a process to ensure that table users have a consistent view on the table layout before applying further updates.
ZooKeeper node tree structure

The monitor manages a tree of ZooKeeper nodes organized as follows:
- {@code /kiji-schema} : Root ZooKeeper node for all Kiji instances.
- {@code /kiji-schema/instances/[instance-name]} :Root ZooKeeper node for the Kiji instance with name "instance-name".
- {@code /kiji-schema/instances/[instance-name]/tables/[table-name]} :Root ZooKeeper node for the Kiji table with name "table-name" belonging to the Kiji instance named "instance-name".
ZooKeeper nodes for a Kiji table
Every table is associated with three ZooKeeper nodes:
- {@code /kiji-schema/instances/[instance-name]/tables/[table-name]/layout} :this node contains the most recent version of the table layout. Clients should watch this node for changes to be notified of table layout updates.
- {@code /kiji-schema/instances/[instance-name]/tables/[table-name]/users} :this directory contains a node for each user of the table; each user's node contains the version of the layout as seen by the client. Management tools should watch these users' nodes to ensure that all clients have a consistent view on a table's layout before/after pushing new updates.
- {@code /kiji-schema/instances/[instance-name]/tables/[table-name]/layout_update_lock} :this directory node is used to acquire exclusive lock for table layout updates. Layout management tools are required to acquire this lock before proceeding with any table layout update.
@deprecated use the ZooKeeper recipes in the {@link org.kiji.schema.zookeeper} package instead.Will be removed in KijiSchema 2.0.

  @Test
  public void testLayoutTrackerUpdatesHandlerInResponsetoZKMLayoutChange() throws Exception {
    final KijiURI tableURI = KijiURI.newBuilder().withInstanceName("i").withTableName("t").build();
    final String layout1 = "layout-id-1";
    final String layout2 = "layout-id-2";
    ZooKeeperMonitor zkMonitor =
        new ZooKeeperMonitor(ZooKeeperClient.getZooKeeperClient(getZKAddress()));


    zkMonitor.notifyNewTableLayout(tableURI, Bytes.toBytes(layout1), -1);


    BlockingQueue<String> layoutQueue = Queues.newSynchronousQueue();
    TableLayoutTracker tracker = new TableLayoutTracker(mZKClient, tableURI,
        new QueuingTableLayoutUpdateHandler(layoutQueue));
    try {
      tracker.start();
      Assert.assertEquals(layout1, layoutQueue.poll(5, TimeUnit.SECONDS));


      zkMonitor.notifyNewTableLayout(tableURI, Bytes.toBytes(layout2), -1);
      Assert.assertEquals(layout2, layoutQueue.poll(5, TimeUnit.SECONDS));
    } finally {
      tracker.close();
    }
  }

View Full Code Here

  public void testZKMLayoutTrackerRespondsToZooKeeperUtilsSetTableLayout() throws Exception {
    final KijiURI tableURI = KijiURI.newBuilder().withInstanceName("i").withTableName("t").build();
    final String layout1 = "layout-id-1";
    final String layout2 = "layout-id-2";


    ZooKeeperMonitor zkMonitor =
        new ZooKeeperMonitor(ZooKeeperClient.getZooKeeperClient(getZKAddress()));


    ZooKeeperUtils.setTableLayout(mZKClient, tableURI, layout1);


    BlockingQueue<byte[]> layoutQueue = Queues.newSynchronousQueue();
    LayoutTracker tracker =
        zkMonitor.newTableLayoutTracker(tableURI, new QueueingLayoutUpdateHandler(layoutQueue));
    try {
      tracker.open();
      Assert.assertEquals(layout1, Bytes.toString(layoutQueue.poll(5, TimeUnit.SECONDS)));


      ZooKeeperUtils.setTableLayout(mZKClient, tableURI, layout2);

View Full Code Here

    final String layout1 = "layout-id-1";
    final String layout2 = "layout-id-2";


    BlockingQueue<Multimap<String, String>> usersQueue = Queues.newSynchronousQueue();


    ZooKeeperMonitor zkMonitor =
        new ZooKeeperMonitor(ZooKeeperClient.getZooKeeperClient(getZKAddress()));


    UsersTracker tracker =
        ZooKeeperUtils.newTableUsersTracker(mZKClient, tableURI)
        .registerUpdateHandler(new QueueingUsersUpdateHandler(usersQueue));
    try {
      tracker.start();
      Assert.assertEquals(ImmutableSetMultimap.<String, String>of(),
          usersQueue.poll(5, TimeUnit.SECONDS));


      ZooKeeperMonitor.TableUserRegistration userRegistration =
          zkMonitor.newTableUserRegistration(userID, tableURI);


      try {
        userRegistration.updateRegisteredLayout(layout1);
        Assert.assertEquals(ImmutableSetMultimap.of(userID, layout1),
            usersQueue.poll(5, TimeUnit.SECONDS));

View Full Code Here

    final String layout1 = "layout-id-1";
    final String layout2 = "layout-id-2";


    BlockingQueue<Multimap<String, String>> usersQueue = Queues.newSynchronousQueue();


    ZooKeeperMonitor zkMonitor =
        new ZooKeeperMonitor(ZooKeeperClient.getZooKeeperClient(getZKAddress()));


    ZooKeeperMonitor.UsersTracker tracker =
        zkMonitor.newTableUsersTracker(tableURI,
            new org.kiji.schema.layout.impl.TestZooKeeperMonitor
                .QueueingUsersUpdateHandler(usersQueue));
    try {
      tracker.open();
      Assert.assertEquals(ImmutableSetMultimap.<String, String>of(),

View Full Code Here

TOP

Related Classes of org.kiji.schema.layout.impl.ZooKeeperMonitor

org.apache.zookeeper.data.Stat

org.kiji.schema.InternalKijiError

org.kiji.schema.util.ZooKeeperLock

org.kiji.schema.zookeeper.TestTableLayoutTracker

org.kiji.schema.zookeeper.TestUsersTracker

java.io.IOException

java.io.File

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.

Examples of org.kiji.schema.layout.impl.ZooKeeperMonitor

ZooKeeper node tree structure

ZooKeeper nodes for a Kiji table

Related Classes of org.kiji.schema.layout.impl.ZooKeeperMonitor