Examples of org.voltdb.client.Client

org.voltdb.client.Client

A Client that connects to one or more nodes in a volt cluster and provides methods for invoking stored procedures and receiving responses. Client applications that are resource constrained (memory, CPU) or high performance (process hundreds of thousands of transactions per second) will want to pay attention to the hints that can be provided via {@link ClientFactory#createClient(int,int[],boolean,StatsUploaderSettings)} and{@link #callProcedure(ProcedureCallback,int,String,Object)}. Most Client applications will not need to generate enough load for these optimizations to matter.

A stored procedure invocation contains approximately 24 bytes of data per invocation plus the serialized sized of the procedure name and any parameters. The size of any specific procedure and parameter set can be calculated using {@link #calculateInvocationSerializedSize(String,Object) calculateInvocationSerializedSize}. This method serializes the invocation and returns the serialized size and is computationally intensive and not suitable for use on a per invocation basis.

The expected serialized message size parameter provided to {@link ClientFactory#createClient(int,int[],boolean,StatsUploaderSettings) createClient}determines the default size of the initial memory allocation used when serializing stored procedure invocations. If the initial allocation is insufficient then the allocation is doubled necessitating an extra allocation and copy If the allocation is excessively small it may be doubled and copied several times when serializing large parameter sets.

{@link #callProcedure(ProcedureCallback,int,String,Object)} allows the initial allocation to be hinted on aper procedure invocation basis. This is useful when an application invokes procedures where the size can vary significantly between invocations or procedures.

The Client performs aggressive memory pooling of {@link java.nio.DirectByteBuffer DirectByteBuffers}. The pool contains arenas with buffers that are sized to powers of 2 from 2^4 to 2^18. Java does not reliably garbage collect {@link java.nio.DirectByteBuffer DirectByteBuffers} so the pool never returns a buffer to theheap. The maxArenaSizes array passed to {@link ClientFactory#createClient(int,int[],boolean,StatsUploaderSettings)} can be usedto specify the maximum size each arena will be allowed to grow to. The client will continue to function even if the an arena is no longer able to grow. It will fall back to using slower {@link java.nio.HeapByteBuffer HeapByteBuffers} for serializing invocations.

        }
    }


    public void testUpdateToNull() throws IOException, ProcCallException
    {
        final Client client = this.getClient();


        final Object params[] = new Object[COLS + 2];


        for (int k=0; k < COLS; ++k) {


            // build the parameter list as described above
            // Fill the row with non-null data and insert
            params[0] = "";
            params[1] = pkey.incrementAndGet();
            for (int i = 0; i < COLS; i++) {
                params[i+2] = m_midValues[i];
                assert(params[i+2] != null);
            }
            params[0] = "ALLOW_NULLS";
            client.callProcedure("Insert", params);




            for (int i = 0; i < COLS; i++) {
                params[i+2] = (i == k) ? m_nullValues[i] : m_midValues[i];
                assert(params[i+2] != null);
            }


            try {
                client.callProcedure("Update", params);
            } catch (final ProcCallException e) {
                e.printStackTrace();
                fail();
            } catch (final NoConnectionsException e) {
                e.printStackTrace();
                fail();
            }


            // verify that the row was updated
            final VoltTable[] result = client.callProcedure("Select", "ALLOW_NULLS", pkey.get()).getResults();
            final VoltTableRow row = result[0].fetchRow(0);
            for (int i=0; i < COLS; ++i) {
                final Object obj = row.get(i+1, m_types[i]);
                if (i == k) {
                    assertTrue(row.wasNull());

View Full Code Here

    }


    public void testUpdateFromNull()
    throws NoConnectionsException, ProcCallException, IOException
    {
        final Client client = this.getClient();


        final Object params[] = new Object[COLS + 2];


        for (int k=0; k < COLS; ++k) {


            // build the parameter list as described above
            // Fill the row with diagonal null data and insert
            params[0] = "";
            params[1] = pkey.incrementAndGet();
            for (int i = 0; i < COLS; i++) {
                params[i+2] = (i == k) ? m_nullValues[i] : m_midValues[i];
                assert(params[i+2] != null);
            }
            params[0] = "ALLOW_NULLS";
            client.callProcedure("Insert", params);


            for (int i = 0; i < COLS; i++) {
                params[i+2] = m_midValues[i];
                assert(params[i+2] != null);
            }


            try {
                client.callProcedure("Update", params);
            } catch (final ProcCallException e) {
                e.printStackTrace();
                fail();
            } catch (final NoConnectionsException e) {
                e.printStackTrace();
                fail();
            }


            // verify that the row was updated
            final VoltTable[] result = client.callProcedure("Select", "ALLOW_NULLS", pkey.get()).getResults();
            final VoltTableRow row = result[0].fetchRow(0);
            for (int i=0; i < COLS; ++i) {
                final Object obj = row.get(i+1, m_types[i]);
                assertTrue( comparisonHelper(obj, params[i+2], m_types[i]) );
            }

View Full Code Here

    }


    public void testDeleteNulls()
    throws NoConnectionsException, ProcCallException, IOException
    {
        final Client client = this.getClient();


        // Insert a NULL value for each column. For the first
        // row, insert null in the first column, for the 5th row
        // in the 5 column, etc.


        final Object params[] = new Object[COLS + 2];


        for (int k=0; k < COLS; ++k) {


            // build the parameter list as described above
            // Fill the row with diagonal null data and insert
            params[0] = "ALLOW_NULLS";
            params[1] = pkey.incrementAndGet();
            for (int i = 0; i < COLS; i++) {
                params[i+2] = (i == k) ? m_nullValues[i] : m_midValues[i];
                assert(params[i+2] != null);
            }
            client.callProcedure("Insert", params);
            VoltTable[] result = client.callProcedure("Select", "ALLOW_NULLS", pkey.get()).getResults();
            System.out.println(result[0]);


            try {
                client.callProcedure("Delete", "ALLOW_NULLS", pkey.get());
            } catch (final ProcCallException e) {
                e.printStackTrace();
                fail();
            } catch (final NoConnectionsException e) {
                e.printStackTrace();
                fail();
            }


            // verify that the row was deleted
            result = client.callProcedure("Select", "ALLOW_NULLS", pkey.get()).getResults();
            assertEquals(0, result[0].getRowCount());
        }
     }

View Full Code Here

     }


    public void testMissingAttributeInsert_With_Defaults()
    throws NoConnectionsException, ProcCallException, IOException
    {
        Client client = this.getClient();


        Object params[] = new Object[COLS + 2];


        params[0] = "WITH_DEFAULTS";
        params[1] = pkey.incrementAndGet();
        for (int i = 0; i < COLS; i++) {
            params[i+2] = m_defaultValues[i];
            assert(params[i+2] != null);
        }


        try {
            client.callProcedure("Insert", params);
        } catch (ProcCallException e) {
            e.printStackTrace();
            fail();
        } catch (NoConnectionsException e) {
            e.printStackTrace();
            fail();
        }


        VoltTable[] result = client.callProcedure("Select", "WITH_DEFAULTS", pkey.get()).getResults();
        VoltTableRow row = result[0].fetchRow(0);
        for (int i=0; i < COLS; ++i) {
            Object obj = row.get(i+1, m_types[i]);
            assertTrue( comparisonHelper(obj, params[i+2], m_types[i]) );
        }

View Full Code Here

    }


    public void testMissingAttributeInsert_With_Null_Defaults()
    throws NoConnectionsException, ProcCallException, IOException
    {
        Client client = this.getClient();


        Object params[] = new Object[COLS + 2];


        params[0] = "WITH_NULL_DEFAULTS";
        params[1] = pkey.incrementAndGet();
        for (int i = 0; i < COLS; i++) {
            params[i+2] = m_nullValues[i];
            assert(params[i+2] != null);
        }


        try {
            client.callProcedure("Insert", params);
        } catch (ProcCallException e) {
            e.printStackTrace();
            fail();
        } catch (NoConnectionsException e) {
            e.printStackTrace();
            fail();
        }


        VoltTable[] result = client.callProcedure("Select", "WITH_NULL_DEFAULTS", pkey.get()).getResults();
        VoltTableRow row = result[0].fetchRow(0);
        for (int i=0; i < COLS; ++i) {
            Object obj = row.get(i+1, m_types[i]);
            assertTrue( comparisonHelper(obj, params[i+2], m_types[i]) );
        }

View Full Code Here

    // Round trip the maximum value
    //
    public void testInsertMaxValues_No_Nulls()
    throws NoConnectionsException, ProcCallException, IOException
    {
        final Client client = this.getClient();


        // Insert a MAX value for each column. For the first
        // row, insert MAX in the first column, for the 5th row
        // in the 5 column, etc.


        final Object params[] = new Object[COLS + 2];


        for (int k=0; k < COLS; ++k) {


            // build the parameter list as described above
            params[0] = "";
            params[1] = pkey.incrementAndGet();
            for (int i = 0; i < COLS; i++) {
                params[i+2] = (i == k) ? m_maxValues[i] : m_midValues[i];
                assert(params[i+2] != null);
            }


            // Perform the inserts and execute selects, verifying the
            // content of the select matches the parameters passed to
            // insert


            System.out.println("testInsertMaxValues: " + k + " MAX type is " + m_types[k]);
            params[0] = "NO_NULLS";
            client.callProcedure("Insert", params);
            // verify that the row was updated
            final VoltTable[] result = client.callProcedure("Select", "NO_NULLS", pkey.get()).getResults();
            final VoltTableRow row = result[0].fetchRow(0);
            for (int i=0; i < COLS; ++i) {
                final Object obj = row.get(i+1, m_types[i]);
                assertTrue (!row.wasNull());
                assertTrue( comparisonHelper(obj, params[i+2], m_types[i]) );

View Full Code Here

    // Round trip the minimum value.
    //
    public void testInsertMinValues_No_Nulls()
        throws NoConnectionsException, ProcCallException, IOException
    {
        final Client client = this.getClient();


        // Insert a MIN value for each column. For the first
        // row, insert null in the first column, for the 5th row
        // in the 5 column, etc.


        final Object params[] = new Object[COLS + 2];


        for (int k=0; k < COLS; ++k) {


            // build the parameter list as described above
            params[0] = "";
            params[1] = pkey.incrementAndGet();
            for (int i = 0; i < COLS; i++) {
                params[i+2] = (i == k) ? m_minValues[i] : m_midValues[i];
                assert(params[i+2] != null);
            }


            // Perform the inserts and execute selects, verifying the
            // content of the select matches the parameters passed to
            // insert


            System.out.println("testInsertMinValues: " + k + " MIN type is " + m_types[k]);
            params[0] = "NO_NULLS";
            client.callProcedure("Insert", params);
            final VoltTable[] result = client.callProcedure("Select", "NO_NULLS", pkey.get()).getResults();
            final VoltTableRow row = result[0].fetchRow(0);
            for (int i=0; i < COLS; ++i) {
                final Object obj = row.get(i+1, m_types[i]);
                assertTrue (!row.wasNull());
                assertTrue( comparisonHelper(obj, params[i+2], m_types[i]) );

View Full Code Here

//            assertEquals(expect, got);
//        }
//    }


    public void testJumboRow() throws Exception {
        final Client client = getClient();
        byte firstStringBytes[] = new byte[1048576];
        java.util.Arrays.fill(firstStringBytes, (byte)'c');
        String firstString = new String(firstStringBytes, "UTF-8");
        byte secondStringBytes[] = new byte[1048564];
        java.util.Arrays.fill(secondStringBytes, (byte)'a');
        String secondString = new String(secondStringBytes, "UTF-8");


        Object params[] = new Object[] {
                "JUMBO_ROW",
                0,
                0,
                0,
                0,
                0,
                0.0,
                new TimestampType(0),
                firstString,
                secondString,
                "",
                "",
                VoltType.NULL_DECIMAL
        };
        VoltTable results[] = client.callProcedure("Insert", params).getResults();
        params = null;
        firstString = null;
        secondString = null;


        assertEquals(results.length, 1);
        assertEquals( 1, results[0].asScalarLong());


        results = client.callProcedure("Select", "JUMBO_ROW", 0).getResults();
        assertEquals(results.length, 1);
        assertTrue(results[0].advanceRow());
        assertTrue(java.util.Arrays.equals( results[0].getStringAsBytes(1), firstStringBytes));
        assertTrue(java.util.Arrays.equals( results[0].getStringAsBytes(2), secondStringBytes));


        java.util.Arrays.fill(firstStringBytes, (byte)'q');
        firstString = new String(firstStringBytes, "UTF-8");
        java.util.Arrays.fill(secondStringBytes, (byte)'r');
        secondString = new String(secondStringBytes, "UTF-8");


        params = new Object[] {
                "JUMBO_ROW",
                0,
                0,
                0,
                0,
                0,
                0.0,
                new TimestampType(0),
                firstString,
                secondString,
                "",
                "",
                VoltType.NULL_DECIMAL
        };


        results = client.callProcedure("Update", params).getResults();
        params = null;
        firstString = null;
        secondString = null;


        assertEquals(results.length, 1);
        assertEquals( 1, results[0].asScalarLong());


        results = client.callProcedure("Select", "JUMBO_ROW", 0).getResults();
        assertEquals(results.length, 1);
        assertTrue(results[0].advanceRow());
        assertTrue(java.util.Arrays.equals( results[0].getStringAsBytes(1), firstStringBytes));
        assertTrue(java.util.Arrays.equals( results[0].getStringAsBytes(2), secondStringBytes));
    }

View Full Code Here


        deleteTestFiles();
        setUpSnapshotDir();


        VoltTable results[] = null;
        Client client = this.getClient();
        CatalogContext cc = this.getCatalogContext();       
        
        // Load database
        try {
            initializeTPCCDatabase(cc, client, false);
        } catch (Exception e) {
            e.printStackTrace();
        }
 
        // Take Snapshot
        results = null;
        results = saveTables(client);


        validateSnapshot(true);
 
        final String MOCK_ARGS[] = { "HOST=localhost", "NUMCLIENTS=1",
                // XXX HACK to find catalog jar
                "CATALOG=" + "./obj/release/testobjects/" + projectJAR, "" };


        MOCK_ARGS[MOCK_ARGS.length - 1] = HStoreConstants.BENCHMARK_PARAM_PREFIX;


        TPCCClient tpccClient = new TPCCClient(MOCK_ARGS);


        // Run transactions
        long k_itr = 0;
        long numTransactions = NUM_TRANSACTIONS;
        long period = numTransactions / 10;


        for (k_itr = 0; k_itr < numTransactions; k_itr++) {
            boolean response = tpccClient.runOnce();
            assertEquals(response, true);


            if (k_itr % period == 0)
                System.out.println(String.format("Transactions Processed: %6d / %d", k_itr, numTransactions));
        }
        
        // Statistics         
        results = client.callProcedure("@Statistics", "table", 0).getResults();
        System.out.println(results[0]);


        VoltTable[] results_tmp = null;
        results_tmp = client.callProcedure("@Statistics", "table", 0).getResults();


        System.out.println("@Statistics before restart :");
        System.out.println(results_tmp[0]);
                
        // Kill and restart all the execution sites.
        m_config.shutDown();
        m_config.startUp();
        client = getClient();


        Calendar calendar;
        long t1,t2;


        calendar = Calendar.getInstance();                    
        t1 = calendar.getTimeInMillis();
        
        // LOGICAL : SNAPSHOT + CMD LOG
        try {
            results = client.callProcedure("@SnapshotRestore", TMPDIR, TESTNONCE, ALLOWEXPORT).getResults();


            System.out.println(results[0]);
            while (results[0].advanceRow()) {
                if (results[0].getString("RESULT").equals("FAILURE")) {
                    fail(results[0].getString("ERR_MSG"));
                }
            }
        } catch (Exception ex) {
            ex.printStackTrace();
            fail("SnapshotRestore exception: " + ex.getMessage());
        }        
        
        validateSnapshot(true);
        
        System.out.println("@Statistics after LOGICAL snapshot restore:");
        results = client.callProcedure("@Statistics", "table", 0).getResults();
        System.out.println(results[0]);
                
        //File logDir = new File("/mnt/pmfs" + File.separator + "cmdlog");                               
        File logDir = new File("./obj" + File.separator + "cmdlog");

View Full Code Here

        }


        int ctr = 0;
        Iterator<LogEntry> log_itr = reader.iterator();
        ClientResponse cresponse = null;
        Client client = this.getClient();
        CatalogContext cc = this.getCatalogContext();
        VoltTable results[] = null;


        while (log_itr.hasNext()) {
            LogEntry entry = log_itr.next();


            assert(entry != null);
            //System.err.println("REDO :: TXN ID :" + entry.getTransactionId().longValue());
            //System.err.println("REDO :: PROC ID :" + entry.getProcedureId());


            Object[] entryParams = entry.getProcedureParams().toArray();
        
            String procName = cc.getProcedureById(entry.getProcedureId()).fullName();
            Procedure catalog_proc = cc.procedures.getIgnoreCase(procName);


            if(catalog_proc.getReadonly() == false){
                // System.out.println("Invoking procedure ::" + procName);


                cresponse = client.callProcedure(procName, entryParams);
                assertEquals(cresponse.getStatus(), Status.OK);
                
                // results = cresponse.getResults();
                // assertEquals(results.length, 1);
            }

View Full Code Here

0 1 2 3 4 5 6 7 8 9

TOP

Related Classes of org.voltdb.client.Client

edu.brown.api.BenchmarkComponent

edu.brown.api.BenchmarkController

edu.brown.benchmark.seats.TestSEATSSuite

genqa.AsyncExportClient

org.voltdb.catalog.TestLiveTableSchemaMigration

org.voltdb.jdbc.JDBC4ClientConnection

org.voltdb.ProcedureCallMicrobench

org.voltdb.regressionsuites.RegressionSuite

org.voltdb.regressionsuites.TestAdminMode

org.voltdb.regressionsuites.TestAntiCacheSuite

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.