List of makeQualified() Examples

Examples of makeQualified()

org.apache.hadoop.fs.FileContext.makeQualified()
Make the path fully qualified if it is isn't. A Fully-qualified path has scheme and authority specified and an absolute path. Use the default file system and working dir in this FileContext to qualify. @param path @return qualified path
org.apache.hadoop.fs.FileStatus.makeQualified()
Make the path fully qualified @param fs the file system that the path belongs to
org.apache.hadoop.fs.FileSystem.makeQualified()
Make sure that a path specifies a FileSystem.
org.apache.hadoop.fs.LocalFileSystem.makeQualified()
org.apache.hadoop.fs.LocatedBlockFileStatus.makeQualified()
org.apache.hadoop.fs.LocatedFileStatus.makeQualified()
org.apache.hadoop.fs.Path.makeQualified()
Returns a qualified path object. Deprecated - use {@link #makeQualified(URI,Path)}
org.apache.hadoop.hdfs.protocol.HdfsFileStatus.makeQualified()

Examples of org.apache.hadoop.fs.Path.makeQualified()

   */
  private void configureOutputFormat(Job job) throws IOException {
    final Configuration configuration = job.getConfiguration();
    Path targetPath = inputOptions.getTargetPath();
    FileSystem targetFS = targetPath.getFileSystem(configuration);
    targetPath = targetPath.makeQualified(targetFS.getUri(),
                                          targetFS.getWorkingDirectory());


    if (inputOptions.shouldAtomicCommit()) {
      Path workDir = inputOptions.getAtomicWorkPath();
      if (workDir == null) {

View Full Code Here

Examples of org.apache.hadoop.fs.Path.makeQualified()

  private Path getTaskOutputPath(JobConf conf) {
    Path p = new Path(conf.getOutputPath(), 
      (MRConstants.TEMP_DIR_NAME + Path.SEPARATOR + "_" + taskId));
    try {
      FileSystem fs = p.getFileSystem(conf);
      return p.makeQualified(fs);
    } catch (IOException ie) {
      LOG.warn(StringUtils.stringifyException(ie));
      return p;
    }
  }

View Full Code Here

Examples of org.apache.hadoop.fs.Path.makeQualified()

    }
        
    Path path = new Path(uriString);


    try {
      path = path.makeQualified(path.getFileSystem(conf));
    } catch (IOException e) {
      throw new InvalidJobConfException
        ("Invalid file system in distributed cache for the URI: "
         + uriString, e);
    }

View Full Code Here

Examples of org.apache.hadoop.fs.Path.makeQualified()

        //default to the local file system
        //check if the file exists or not first
        if (!localFs.exists(path)) {
          throw new FileNotFoundException("File " + tmp + " does not exist.");
        }
        finalPath = path.makeQualified(localFs).toString();
      }
      else {
        // check if the file exists in this file system
        // we need to recreate this filesystem object to copy
        // these files to the file system jobtracker is running

View Full Code Here

Examples of org.apache.hadoop.fs.Path.makeQualified()

        // on.
        FileSystem fs = path.getFileSystem(conf);
        if (!fs.exists(path)) {
          throw new FileNotFoundException("File " + tmp + " does not exist.");
        }
        finalPath = path.makeQualified(fs).toString();
        try {
          fs.close();
        } catch(IOException e){};
      }
      finalArr[i] = finalPath;

View Full Code Here

Examples of org.apache.hadoop.hdfs.protocol.HdfsFileStatus.makeQualified()

      @Override
      public FileStatus doCall(final Path p) throws IOException,
          UnresolvedLinkException {
        HdfsFileStatus fi = dfs.getFileLinkInfo(getPathName(p));
        if (fi != null) {
          return fi.makeQualified(getUri(), p);
        } else {
          throw new FileNotFoundException("File does not exist: " + p);
        }
      }
      @Override

View Full Code Here

0 1 2 3 4 5

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.