Examples of org.apache.hadoop.fs.FileSystem.listFiles()

org.apache.hadoop.fs.FileSystem.listFiles()
List the statuses and block locations of the files in the given path. If the path is a directory, if recursive is false, returns files in the directory; if recursive is true, return files in the subtree rooted at the path. If the path is a file, return the file's status and block locations. @param f is the path @param recursive if the subdirectories need to be traversed recursively @return an iterator that traverses statuses of the files @throws FileNotFoundException when the path does not exist;IOException see specific implementation

    try {
      Path libPath = new Path(libPathStr);


      FileSystem fs = FileSystem.get(config);


      RemoteIterator<LocatedFileStatus> itr = fs.listFiles(libPath, true);


      while (itr.hasNext()) {
        LocatedFileStatus f = itr.next();


        if (!f.isDirectory() && f.getPath().getName().endsWith("jar")) {

View Full Code Here

    FileSystem fs = inputDir.getFileSystem(conf);


    // obtain input data file statuses
    long dataSize = 0;
    long fileCount = 0;
    RemoteIterator<LocatedFileStatus> iter = fs.listFiles(inputDir, true);
    PathFilter filter = new Utils.OutputFileUtils.OutputFilesFilter();
    while (iter.hasNext()) {
      LocatedFileStatus lStatus = iter.next();
      if (filter.accept(lStatus.getPath())) {
        dataSize += lStatus.getLen();

View Full Code Here

0 1

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.