Examples of org.apache.storm.hdfs.bolt.rotation.FileRotationPolicy

Package org.apache.storm.hdfs.bolt.rotation

Examples of org.apache.storm.hdfs.bolt.rotation.FileRotationPolicy

org.apache.storm.hdfs.bolt.rotation.FileRotationPolicy
Used by the HdfsBolt to decide when to rotate files. The HdfsBolt will call the mark() method for every tuple received. If the mark() method returns true the HdfsBolt will perform a file rotation. After file rotation, the HdfsBolt will call the reset() method.


        // sync the filesystem after every 1k tuples
        SyncPolicy syncPolicy = new CountSyncPolicy(1000);


        // rotate files when they reach 5MB
        FileRotationPolicy rotationPolicy = new TimedRotationPolicy(1.0f, TimedRotationPolicy.TimeUnit.MINUTES);


        FileNameFormat fileNameFormat = new DefaultFileNameFormat()
                .withPath("/foo/")
                .withExtension(".txt");

View Full Code Here


        // sync the filesystem after every 1k tuples
        SyncPolicy syncPolicy = new CountSyncPolicy(1000);


        // rotate files when they reach 5MB
        FileRotationPolicy rotationPolicy = new FileSizeRotationPolicy(5.0f, Units.MB);


        FileNameFormat fileNameFormat = new DefaultFileNameFormat()
                .withPath("/source/")
                .withExtension(".seq");

View Full Code Here

TOP

Related Classes of org.apache.storm.hdfs.bolt.rotation.FileRotationPolicy

org.apache.storm.hdfs.bolt.HdfsFileTopology

org.apache.storm.hdfs.bolt.SequenceFileTopology

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.