Package org.apache.tez.test

Examples of org.apache.tez.test.MiniTezCluster

137
138
139
140
141
142
143
144
145
146
147
    } catch (IOException io) {
      throw new RuntimeException("problem starting mini dfs cluster", io);
    }
   
    if (mrrTezCluster == null) {
      mrrTezCluster = new MiniTezCluster(TestMRRJobsDAGApi.class.getName(),
          1, 1, 1);
      Configuration conf = new Configuration();
      conf.set("fs.defaultFS", remoteFs.getUri().toString()); // use HDFS
      conf.setInt("yarn.nodemanager.delete.debug-delay-sec", 20000);
      mrrTezCluster.init(conf);
View Full Code Here
204
205
206
207
208
209
210
211
212
213
214
      Configuration tezConf = new Configuration( defaultConf );
      tezConf.set( "fs.defaultFS", fileSys.getUri().toString() ); // use HDFS
      tezConf.set( MRJobConfig.MR_AM_STAGING_DIR, "/apps_staging_dir" );

      miniTezCluster = new MiniTezCluster( getClass().getName(), 1, 4, 4 ); // todo: set to 4
      miniTezCluster.init( tezConf );
      miniTezCluster.start();

      configuration = miniTezCluster.getConfig();
View Full Code Here
TOP

Related Classes of org.apache.tez.test.MiniTezCluster

  • cascading.platform.tez.Hadoop2TezPlatform
  • org.apache.hadoop.conf.Configuration
  • org.apache.hadoop.fs.FileContext
  • org.apache.hadoop.fs.FileSystem
  • org.apache.hadoop.fs.Path
  • org.apache.hadoop.fs.permission.FsPermission
  • org.apache.hadoop.hive.shims.Hadoop23Shims$MiniTezShim
  • org.apache.tez.mapreduce.TestMRRJobs
  • org.apache.tez.mapreduce.TestMRRJobsDAGApi
  • java.io.FileOutputStream
    • Copyright © 2018 www.massapicom. All rights reserved.
    All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.