Package io.druid.indexer

Examples of io.druid.indexer.HadoopDruidIndexerJob

289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
      final HadoopDruidIndexerConfig config = HadoopDruidIndexerConfig.fromSchema(
          theSchema
              .withTuningConfig(theSchema.getTuningConfig().withVersion(version))
      );

      HadoopDruidIndexerJob job = new HadoopDruidIndexerJob(
          config,
          injector.getInstance(MetadataStorageUpdaterJobHandler.class)
      );

      log.info("Starting a hadoop index generator job...");
      if (job.run()) {
        return HadoopDruidIndexerConfig.jsonMapper.writeValueAsString(job.getPublishedSegments());
      }

      return null;
    }
View Full Code Here
100
101
102
103
104
105
106
107
108
109
110
      Preconditions.checkNotNull(metadataSpec.getType(), "type in metadataUpdateSpec must not be null");
      injector.getInstance(Properties.class).setProperty("druid.metadata.storage.type", metadataSpec.getType());

      List<Jobby> jobs = Lists.newArrayList();
      jobs.add(new HadoopDruidDetermineConfigurationJob(config));
      jobs.add(new HadoopDruidIndexerJob(config, injector.getInstance(MetadataStorageUpdaterJobHandler.class)));
      JobHelper.runJobs(jobs, config);

    }
    catch (Exception e) {
      throw Throwables.propagate(e);
View Full Code Here
TOP

Related Classes of io.druid.indexer.HadoopDruidIndexerJob

  • io.druid.cli.CliInternalHadoopIndexer
  • io.druid.indexing.common.task.HadoopIndexTask$HadoopIndexGeneratorInnerProcessing
    • Copyright © 2018 www.massapicom. All rights reserved.
    All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.