Examples of org.apache.hadoop.chukwa.analysis.salsa.fsm.FSMBuilder

org.apache.hadoop.chukwa.analysis.salsa.fsm.FSMBuilder

FSM Builder Input: start/end pairs i.e. JobHistory data Input handling is controlled by choosing a custom mapper that is able to parse the desired input format (e.g. JobHistory lines) One map class is provided for each type of input data provided Each map class "standardizes" the different input log types to the standardized internal FSMIntermedEntry representation Currently available mapper classes: DataNodeClientTraceMapper TaskTrackerClientTraceMapper JobHistoryTaskDataMapper Parameterizing choice of mapper class - read in as config parameter Output is standardized, regardless of input, and is generated by the common reducer

          fsmConf.set("chukwa.salsa.fsm.mapclass", mapper);
          args[k]=outputDir+mapper;
          Path outputPath = new Path(args[k]);
          outputPaths.add(outputPath);
          if(hasData) {
            int res = ToolRunner.run(fsmConf, new FSMBuilder(), args);
            log.debug("Job Status: "+res);
          }
        }
      }
      // Find the mapreduce output and load to MDL.

          fsmConf.set("chukwa.salsa.fsm.mapclass", mapper);
          args[k]=outputDir+mapper;
          Path outputPath = new Path(args[k]);
          outputPaths.add(outputPath);
          if(hasData) {
            int res = ToolRunner.run(fsmConf, new FSMBuilder(), args);
          }
        }
      }
      // Find the mapreduce output and load to MDL.
      for(Path outputPath : outputPaths) {

Examples of org.apache.hadoop.chukwa.analysis.salsa.fsm.FSMBuilder

Related Classes of org.apache.hadoop.chukwa.analysis.salsa.fsm.FSMBuilder