Examples of org.apache.zookeeper_voltpatches.ZooKeeper

Package org.apache.zookeeper_voltpatches

Examples of org.apache.zookeeper_voltpatches.ZooKeeper

org.apache.zookeeper_voltpatches.ZooKeeper
This is the main class of ZooKeeper client library. To use a ZooKeeper service, an application must first instantiate an object of ZooKeeper class. All the iterations will be done by calling the methods of ZooKeeper class. The methods of this class are thread-safe unless otherwise noted.
Once a connection to a server is established, a session ID is assigned to the client. The client will send heart beats to the server periodically to keep the session valid.
The application can call ZooKeeper APIs through a client as long as the session ID of the client remains valid.
If for some reason, the client fails to send heart beats to the server for a prolonged period of time (exceeding the sessionTimeout value, for instance), the server will expire the session, and the session ID will become invalid. The client object will no longer be usable. To make ZooKeeper API calls, the application must create a new client object.
If the ZooKeeper server the client currently connects to fails or otherwise does not respond, the client will automatically try to connect to another server before its session ID expires. If successful, the application can continue to use the client.
Some successful ZooKeeper API calls can leave watches on the "data nodes" in the ZooKeeper server. Other successful ZooKeeper API calls can trigger those watches. Once a watch is triggered, an event will be delivered to the client which left the watch at the first place. Each watch can be triggered only once. Thus, up to one event will be delivered to a client for every watch it leaves.
A client needs an object of a class implementing Watcher interface for processing the events delivered to the client. When a client drops current connection and re-connects to a server, all the existing watches are considered as being triggered but the undelivered events are lost. To emulate this, the client will generate a special event to tell the event handler a connection has been dropped. This special event has type EventNone and state sKeeperStateDisconnected.

    int readDeploymentAndCreateStarterCatalogContext() {
        /*
         * Debate with the cluster what the deployment file should be
         */
        try {
            ZooKeeper zk = m_messenger.getZK();
            byte deploymentBytes[] = null;


            try {
                deploymentBytes = org.voltcore.utils.CoreUtils.urlToBytes(m_config.m_pathToDeployment);
            } catch (Exception ex) {

View Full Code Here

        String[] lines = pp.toLogLines().split("\n");
        for (String line : lines) {
            hostLog.info(line.trim());
        }


        final ZooKeeper zk = m_messenger.getZK();
        ZKUtil.ByteArrayCallback operationModeFuture = new ZKUtil.ByteArrayCallback();
        /*
         * Publish our cluster metadata, and then retrieve the metadata
         * for the rest of the cluster
         */
        try {
            zk.create(
                    VoltZK.cluster_metadata + "/" + m_messenger.getHostId(),
                    getLocalMetadata().getBytes("UTF-8"),
                    Ids.OPEN_ACL_UNSAFE,
                    CreateMode.EPHEMERAL,
                    new ZKUtil.StringCallback(),
                    null);
            zk.getData(VoltZK.operationMode, false, operationModeFuture, null);
        } catch (Exception e) {
            VoltDB.crashLocalVoltDB("Error creating \"/cluster_metadata\" node in ZK", true, e);
        }


        Map<Integer, String> clusterMetadata = new HashMap<Integer, String>(0);
        /*
         * Spin and attempt to retrieve cluster metadata for all nodes in the cluster.
         */
        Set<Integer> metadataToRetrieve = new HashSet<Integer>(m_messenger.getLiveHostIds());
        metadataToRetrieve.remove(m_messenger.getHostId());
        while (!metadataToRetrieve.isEmpty()) {
            Map<Integer, ZKUtil.ByteArrayCallback> callbacks = new HashMap<Integer, ZKUtil.ByteArrayCallback>();
            for (Integer hostId : metadataToRetrieve) {
                ZKUtil.ByteArrayCallback cb = new ZKUtil.ByteArrayCallback();
                zk.getData(VoltZK.cluster_metadata + "/" + hostId, false, cb, null);
                callbacks.put(hostId, cb);
            }


            for (Map.Entry<Integer, ZKUtil.ByteArrayCallback> entry : callbacks.entrySet()) {
                try {

View Full Code Here

                    " megabytes transferred at a rate of " +
                    megabytesPerSecond + " megabytes/sec");
        }


        try {
            final ZooKeeper zk = m_messenger.getZK();
            boolean logRecoveryCompleted = false;
            if (getCommandLog().getClass().getName().equals("org.voltdb.CommandLogImpl")) {
                String requestNode = zk.create(VoltZK.request_truncation_snapshot_node, null,
                        Ids.OPEN_ACL_UNSAFE, CreateMode.PERSISTENT_SEQUENTIAL);
                if (m_rejoinTruncationReqId == null) {
                    m_rejoinTruncationReqId = requestNode;
                }
            } else {

View Full Code Here

            }
            else {
                // If we saw some other truncation request ID, then try the same one again.  As long as we
                // don't flip the m_rejoining state, all truncation snapshot completions will call back to here.
                try {
                    final ZooKeeper zk = m_messenger.getZK();
                    String requestNode = zk.create(VoltZK.request_truncation_snapshot_node, null,
                            Ids.OPEN_ACL_UNSAFE, CreateMode.PERSISTENT_SEQUENTIAL);
                    if (m_rejoinTruncationReqId == null) {
                        m_rejoinTruncationReqId = requestNode;
                    }
                }

View Full Code Here

                latestChildren.set(children);
                sem.release();
            }
        };


        ZooKeeper zk = getClient(0);
        zk.create("/babysitterroot", new byte[0], Ids.OPEN_ACL_UNSAFE, CreateMode.PERSISTENT);
        final String node6 = zk.create("/babysitterroot/6_", new byte[0], Ids.OPEN_ACL_UNSAFE, CreateMode.EPHEMERAL_SEQUENTIAL);
        zk.create("/babysitterroot/7_", new byte[0], Ids.OPEN_ACL_UNSAFE, CreateMode.EPHEMERAL_SEQUENTIAL);
        zk.create("/babysitterroot/10_", new byte[0], Ids.OPEN_ACL_UNSAFE, CreateMode.EPHEMERAL_SEQUENTIAL);
        Pair<BabySitter, List<String>> pair = BabySitter.blockingFactory(zk, "/babysitterroot", cb);
        BabySitter bs = pair.getFirst();


        sem.acquire();
        assertEquals(Lists.newArrayList(6l, 7l, 10l), VoltZK.childrenToReplicaHSIds(latestChildren.get()));


        zk.delete(node6, -1);


        sem.acquire();
        assertEquals(Lists.newArrayList(7l, 10l), VoltZK.childrenToReplicaHSIds(latestChildren.get()));


        bs.shutdown();

View Full Code Here

    }


    @Test
    public void testInitialCache() throws Exception
    {
        ZooKeeper zk = getClient(0);
        configure("/cache01", zk);


        MapCache dut = new  MapCache(zk, "/cache01");
        dut.start(true);
        Map<String, JSONObject> cache = dut.pointInTimeCache();


        assertEquals("3 items cached.", 3, cache.size());
        assertEquals("aaval", cache.get("/cache01/aa").get("key"));
        assertEquals("bbval", cache.get("/cache01/bb").get("key"));
        assertEquals("ccval", cache.get("/cache01/cc").get("key"));


        dut.shutdown();
        zk.close();
    }

View Full Code Here

    }


    @Test
    public void testInitialCacheWithCallback() throws Exception
    {
        ZooKeeper zk = getClient(0);
        configure("/cache01", zk);


        TestCallback cb = new TestCallback();
        MapCache dut = new  MapCache(zk, "/cache01", cb);
        dut.start(true);


        assertEquals("3 items cached.", 3, cb.m_cache.size());
        assertEquals("aaval", cb.m_cache.get("/cache01/aa").get("key"));
        assertEquals("bbval", cb.m_cache.get("/cache01/bb").get("key"));
        assertEquals("ccval", cb.m_cache.get("/cache01/cc").get("key"));


        dut.shutdown();
        zk.close();
    }

View Full Code Here

    }


    @Test
    public void testModifyChild() throws Exception
    {
        ZooKeeper zk = getClient(0);
        configure("/cache03", zk);


        MapCache dut = new  MapCache(zk, "/cache03");
        dut.start(true);
        Map<String, JSONObject> cache = dut.pointInTimeCache();


        assertEquals("3 items cached.", 3, cache.size());
        assertEquals("aaval", cache.get("/cache03/aa").get("key"));


        JSONObject aa = new JSONObject("{key:aaval2}");
        zk.setData("/cache03/aa", aa.toString().getBytes(), -1);
        while(true) {
            cache = dut.pointInTimeCache();
            if (cache.get("/cache03/aa").get("key").equals("aaval2")) {
                break;
            }
        }
        assertEquals("3 items cached.", 3, cache.size());
        assertEquals("aaval2", cache.get("/cache03/aa").get("key"));
        assertEquals("bbval", cache.get("/cache03/bb").get("key"));
        assertEquals("ccval", cache.get("/cache03/cc").get("key"));


        dut.shutdown();
        zk.close();
    }

View Full Code Here

    }


    @Test
    public void testModifyChildWithCallback() throws Exception
    {
        ZooKeeper zk = getClient(0);
        configure("/cache03", zk);


        TestCallback cb = new TestCallback();
        MapCache dut = new  MapCache(zk, "/cache03", cb);
        dut.start(true);
        Map<String, JSONObject> cache = cb.m_cache;


        assertEquals("3 items cached.", 3, cache.size());
        assertEquals("aaval", cache.get("/cache03/aa").get("key"));


        JSONObject aa = new JSONObject("{key:aaval2}");
        zk.setData("/cache03/aa", aa.toString().getBytes(), -1);
        while(true) {
            cache = cb.m_cache;
            if (cache.get("/cache03/aa").get("key").equals("aaval2")) {
                break;
            }
        }
        assertEquals("3 items cached.", 3, cache.size());
        assertEquals("aaval2", cache.get("/cache03/aa").get("key"));
        assertEquals("bbval", cache.get("/cache03/bb").get("key"));
        assertEquals("ccval", cache.get("/cache03/cc").get("key"));


        dut.shutdown();
        zk.close();
    }

View Full Code Here

    }


    @Test
    public void testDeleteChild() throws Exception
    {
        ZooKeeper zk = getClient(0);
        configure("/cache02", zk);


        MapCache dut = new MapCache(zk, "/cache02");
        dut.start(true);
        Map<String, JSONObject> cache = dut.pointInTimeCache();
        assertEquals("3 items cached.", 3, cache.size());


        zk.delete("/cache02/bb", -1);
        while(true) {
            cache = dut.pointInTimeCache();
            if (cache.size() == 3) {
                Thread.sleep(1);
            }
            else {
                break;
            }
        }
        assertEquals("Item removed", 2, cache.size());
        assertEquals(null, cache.get("/cache02/bb"));
        assertEquals("aaval", cache.get("/cache02/aa").get("key"));
        assertEquals("ccval", cache.get("/cache02/cc").get("key"));


        dut.shutdown();
        zk.close();
    }

View Full Code Here

0 1 2 3

TOP

Related Classes of org.apache.zookeeper_voltpatches.ZooKeeper

org.apache.zookeeper_voltpatches.proto.CreateRequest

org.apache.zookeeper_voltpatches.proto.CreateResponse

org.apache.zookeeper_voltpatches.proto.DeleteRequest

org.apache.zookeeper_voltpatches.proto.ExistsRequest

org.apache.zookeeper_voltpatches.proto.GetACLRequest

org.apache.zookeeper_voltpatches.proto.GetACLResponse

org.apache.zookeeper_voltpatches.proto.GetChildren2Request

org.apache.zookeeper_voltpatches.proto.GetChildren2Response

org.apache.zookeeper_voltpatches.proto.GetChildrenRequest

org.apache.zookeeper_voltpatches.proto.GetChildrenResponse

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.