Examples of com.datasalt.trident.FakeTweetsBatchSpout

com.datasalt.trident.FakeTweetsBatchSpout
A Spout that emits fake tweets. It calculates a random probability distribution for hashtags and actor activity. It uses a dataset of 500 english sentences. It has a fixed set of actors and subjects which you can also modify at your own will. Tweet text is one of the random 500 sentences followed by a hashtag of one subject. @author pere

      return filter;
    }
  }


  public static StormTopology buildTopology(LocalDRPC drpc) throws IOException {
    FakeTweetsBatchSpout spout = new FakeTweetsBatchSpout();


    TridentTopology topology = new TridentTopology();
    topology.newStream("spout", spout)
        .parallelismHint(2)
        .partitionBy(new Fields("actor"))

View Full Code Here

      collector.emit(new Values(val));
    }
  }
  
  public static StormTopology buildTopology(LocalDRPC drpc) throws IOException {
    FakeTweetsBatchSpout spout = new FakeTweetsBatchSpout(100);


    TridentTopology topology = new TridentTopology();
    topology.newStream("spout", spout)
      .aggregate(new Fields("location"), new LocationAggregator(), new Fields("location_counts"))
      .each(new Fields("location_counts"), new Utils.PrintFilter());

View Full Code Here

 * @author pere
 */
public class PerLocationCounts2 {


  public static StormTopology buildTopology(LocalDRPC drpc) throws IOException {
    FakeTweetsBatchSpout spout = new FakeTweetsBatchSpout(100);


    TridentTopology topology = new TridentTopology();
    topology.newStream("spout", spout)
      .groupBy(new Fields("location"))
      .aggregate(new Fields("location"), new Count(), new Fields("count"))

View Full Code Here

TOP

Related Classes of com.datasalt.trident.FakeTweetsBatchSpout

backtype.storm.Config

backtype.storm.tuple.Fields

backtype.storm.tuple.Values

com.datasalt.trident.examples.ParallelismExample1

com.datasalt.trident.examples.PerLocationCounts1

com.datasalt.trident.examples.PerLocationCounts2

java.util.Random

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.