Package org.apache.storm.hdfs.common.rotation

Examples of org.apache.storm.hdfs.common.rotation.MoveFileAction

41
42
43
44
45
46
47
48
49
50
51
        HdfsState.Options seqOpts = new HdfsState.SequenceFileOptions()
                .withFileNameFormat(fileNameFormat)
                .withSequenceFormat(new DefaultSequenceFormat("key", "sentence"))
                .withRotationPolicy(rotationPolicy)
                .withFsUrl(hdfsUrl)
                .addRotationAction(new MoveFileAction().toDestination("/dest2/"));

        StateFactory factory = new HdfsStateFactory().withOptions(seqOpts);

        TridentState state = stream
                .partitionPersist(factory, hdfsFields, new HdfsUpdater(), new Fields());
View Full Code Here
88
89
90
91
92
93
94
95
96
97
98
                .withFsUrl(args[0])
                .withFileNameFormat(fileNameFormat)
                .withRecordFormat(format)
                .withRotationPolicy(rotationPolicy)
                .withSyncPolicy(syncPolicy)
                .addRotationAction(new MoveFileAction().toDestination("/dest2/"));

        TopologyBuilder builder = new TopologyBuilder();

        builder.setSpout(SENTENCE_SPOUT_ID, spout, 1);
        // SentenceSpout --> MyBolt
View Full Code Here
75
76
77
78
79
80
81
82
83
84
85
                .withSequenceFormat(format)
                .withRotationPolicy(rotationPolicy)
                .withSyncPolicy(syncPolicy)
                .withCompressionType(SequenceFile.CompressionType.RECORD)
                .withCompressionCodec("deflate")
                .addRotationAction(new MoveFileAction().toDestination("/dest/"));




        TopologyBuilder builder = new TopologyBuilder();
View Full Code Here
TOP

Related Classes of org.apache.storm.hdfs.common.rotation.MoveFileAction

  • org.apache.hadoop.fs.Path
  • org.apache.storm.hdfs.bolt.HdfsFileTopology
  • org.apache.storm.hdfs.bolt.SequenceFileTopology
  • org.apache.storm.hdfs.trident.TridentSequenceTopology
    • Copyright © 2018 www.massapicom. All rights reserved.
    All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.