Package org.apache.spark.network.yarn.util

Examples of org.apache.spark.network.yarn.util.HadoopConfigProvider


      rpcHandler = new SaslRpcHandler(rpcHandler, secretManager);
    }

    int port = conf.getInt(
      SPARK_SHUFFLE_SERVICE_PORT_KEY, DEFAULT_SPARK_SHUFFLE_SERVICE_PORT);
    TransportConf transportConf = new TransportConf(new HadoopConfigProvider(conf));
    TransportContext transportContext = new TransportContext(transportConf, rpcHandler);
    shuffleServer = transportContext.createServer(port);
    String authEnabledString = authEnabled ? "enabled" : "not enabled";
    logger.info("Started YARN shuffle service for Spark on port {}. " +
      "Authentication is {}.", port, authEnabledString);
View Full Code Here

TOP

Related Classes of org.apache.spark.network.yarn.util.HadoopConfigProvider

Copyright © 2018 www.massapicom. All rights reserved.
All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.