Examples of org.jets3t.service.multithread.S3ServiceMulti.listObjects()

Class org.jets3t.service.multithread.S3ServiceMulti

Examples of org.jets3t.service.multithread.S3ServiceMulti.listObjects()

org.jets3t.service.multithread.S3ServiceMulti.listObjects()
Lists the objects in a bucket based on an array of prefix strings, and sends {@link ListObjectsEvent} notification events. The objects that match each prefix are listed in a separate background thread, potentially allowing you to list the contents of large buckets more quickly than if you had to list all the objects in sequence.
Objects in the bucket that do not match one of the prefixes will not be listed. @param bucketName the name of the bucket in which the objects are stored. @param prefixes an array of prefix strings. A separate listing thread will be run for each of these prefix strings, and the method will only complete once the entire object listing for each prefix has been obtained (unless the operation is cancelled, or an error occurs) @param delimiter an optional delimiter string to apply to each listing operation. This parameter should be null if you do not wish to apply a delimiter. @param maxListingLength the maximum number of objects to list in each iteration. This should be a value between 1 and 1000, where 1000 will be the best choice in almost all circumstances. Regardless of this value, all the objects in the bucket that match the criteria will be returned.
The maximum number of threads is controlled by the JetS3t configuration property s3service.admin-max-thread-count. @return true if all the threaded tasks completed successfully, false otherwise.

             * Perform a multi-threaded listing, where each prefix string
             * will be used as a unique partition to be listed in a separate thread.
             */ 
            (new Thread() {
                public void run() {
                    s3Multi.listObjects(bucketName, finalPrefixes, 
                        finalDelimiter, Constants.DEFAULT_OBJECT_LIST_CHUNK_SIZE);
                };
            }).run();
            // Throw any exceptions that occur inside the threads.
            if (s3ServiceExceptions[0] != null) {

View Full Code Here

             * Perform a multi-threaded listing, where each common prefix string
             * will be used as the prefix for a separate listing thread.
             */ 
            (new Thread() {
                public void run() {
                    s3Multi.listObjects(bucketName, commonPrefixes, null, 1000);
                };
            }).run();
            
            long threadedElapsedTime = System.currentTimeMillis() - startTime;
            totalElapsedTime += threadedElapsedTime;

View Full Code Here

             * Perform a multi-threaded listing, where each prefix string
             * will be used as a unique partition to be listed in a separate thread.
             */ 
            (new Thread() {
                public void run() {
                    s3Multi.listObjects(bucketName, finalPrefixes, 
                        finalDelimiter, Constants.DEFAULT_OBJECT_LIST_CHUNK_SIZE);
                };
            }).run();
            // Throw any exceptions that occur inside the threads.
            if (s3ServiceExceptions[0] != null) {

View Full Code Here

             * will be used as the prefix for a separate listing thread.
             */
            (new Thread() {
                @Override
                public void run() {
                    s3Multi.listObjects(bucketName, commonPrefixes, null, 1000);
                };
            }).run();


            long threadedElapsedTime = System.currentTimeMillis() - startTime;
            totalElapsedTime += threadedElapsedTime;

View Full Code Here

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.