Examples of org.springframework.yarn.am.container.ContainerRequestHint

Package org.springframework.yarn.am.container

Examples of org.springframework.yarn.am.container.ContainerRequestHint

org.springframework.yarn.am.container.ContainerRequestHint
Helper class used to add request data hints. None of the parameters set here are not guaranteed to be used. For example setting an array of hosts and racks just tells user of this class that we'd like to localise into those locations. @author Janne Valkealahti

    Map<StepExecution, ContainerRequestHint> requests = new HashMap<StepExecution, ContainerRequestHint>();
    for (StepExecution execution : stepExecutions) {
      String locations = execution.getExecutionContext().getString(getKeySplitLocations());
      String[] hosts = StringUtils.delimitedListToStringArray(locations, ",");
      String[] racks = new String[0];
      requests.put(execution, new ContainerRequestHint(execution, null, hosts, racks, null));
    }
    return requests;
  }

View Full Code Here

    ContainerAllocateData containerAllocateData = new ContainerAllocateData();
    int countNeeded = 0;
    HashSet<String> hostUnion = new HashSet<String>();
    for (Entry<StepExecution, ContainerRequestHint> entry : resourceRequests.entrySet()) {
      StepExecution se = entry.getKey();
      ContainerRequestHint crd = entry.getValue();


      requestData.put(se, crd);
      remoteStepNames.put(se, remoteStepName);


      countNeeded++;
      for (String host : crd.getHosts()) {
        hostUnion.add(host);
      }
    }


    while (countNeeded > 0) {

View Full Code Here

TOP

Related Classes of org.springframework.yarn.am.container.ContainerRequestHint

org.springframework.yarn.batch.am.AbstractBatchAppmaster

org.springframework.yarn.batch.partition.SplitterPartitionHandler

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.