List of listStatus() Examples

Examples of listStatus()

eu.stratosphere.core.fs.FileSystem.listStatus()
List the statuses of the files/directories in the given path if the path is a directory. @param f given path @return the statuses of the files/directories in the given patch @throws IOException
org.apache.accumulo.server.fs.VolumeManager.listStatus()
org.apache.flink.core.fs.FileSystem.listStatus()
List the statuses of the files/directories in the given path if the path is a directory. @param f given path @return the statuses of the files/directories in the given patch @throws IOException
org.apache.flink.core.fs.local.LocalFileSystem.listStatus()
org.apache.hadoop.fs.FileContext.listStatus()
List the statuses of the files/directories in the given path if the path is a directory. @param f is the path @return an iterator that traverses statuses of the files/directories in the given path @throws AccessControlException If access is denied @throws FileNotFoundException If f does not exist @throws UnsupportedFileSystemException If file system for f isnot supported @throws IOException If an I/O error occurredExceptions applicable to file systems accessed over RPC: @throws RpcClientException If an exception occurred in the RPC client @throws RpcServerException If an exception occurred in the RPC server @throws UnexpectedServerException If server implementation throws undeclared exception to RPC server
org.apache.hadoop.fs.FileSystem.listStatus()
List the statuses of the files/directories in the given path if the path is a directory. @param f given path @return the statuses of the files/directories in the given patch @throws IOException
org.apache.hadoop.fs.HarFileSystem.listStatus()
liststatus returns the children of a directory after looking up the index files.
org.apache.hadoop.fs.InMemoryFileSystem.listStatus()
Directory operations are not supported
org.apache.hadoop.fs.LocalFileSystem.listStatus()
org.apache.hadoop.hdfs.DistributedFileSystem.listStatus()
List all the entries of a directory Note that this operation is not atomic for a large directory. The entries of a directory may be fetched from NameNode multiple times. It only guarantees that each name occurs once if a directory undergoes changes between the calls.
org.apache.hadoop.hdfs.web.WebHdfsFileSystem.listStatus()
org.apache.hadoop.mapreduce.test.system.JTClient.listStatus()
org.apache.hadoop.mapreduce.test.system.TTClient.listStatus()
org.apache.pig.piggybank.storage.partition.PathPartitionHelper.listStatus()
This method is called by the FileInputFormat to find the input paths for which splits should be calculated.
If applyDateRanges == true: Then the HiveRCDateSplitter is used to apply filtering on the input files.
Else the default FileInputFormat listStatus method is used. @param ctx JobContext @param loaderClass this is chosen to be a subclass of LoadFunc to maintain some consistency.
tachyon.client.TachyonFS.listStatus()
If the path is a directory, return all the direct entries in it. If the path is a file, return its ClientFileInfo. @param path the target directory/file path @return A list of ClientFileInfo, null if the file or folder does not exist. @throws IOException

Examples of org.apache.hadoop.fs.FileSystem.listStatus()

        }


        Stack<Path> pathstack = new Stack<Path>();
        pathstack.push(p);
        while (!pathstack.empty()) {
          for (FileStatus stat : fs.listStatus(pathstack.pop())) {
            ++srcCount;


            if (stat.isDir()) {
              pathstack.push(stat.getPath());
            }

View Full Code Here

Examples of org.apache.hadoop.fs.FileSystem.listStatus()

    }


    public void ls(String folder) throws IOException {
        Path path = new Path(folder);
        FileSystem fs = FileSystem.get(URI.create(hdfsPath), conf);
        FileStatus[] list = fs.listStatus(path);
        System.out.println("ls: " + folder);
        System.out.println("==========================================================");
        for (FileStatus f : list) {
            System.out.printf("name: %s, folder: %s, size: %d\n", f.getPath(), f.isDir(), f.getLen());
        }

View Full Code Here

Examples of org.apache.hadoop.fs.FileSystem.listStatus()

    assertEquals(0,job.getBadRecords());
    assertEquals(4,job.getOutput());
    
    FileSystem outputFS=getFileSystem();
    Path outputPath = new Path(outputFS.getHomeDirectory(), "output");
    FileStatus[] status = outputFS.listStatus(outputPath, getOutputPathFilter()); 
    assertTrue(outputFS.exists(outputPath));
    List<String> expectedOutput = new ArrayList<String>();
    expectedOutput.add("Macon Kent,6269 Aenean St.,1-247-399-1051,08253");
    expectedOutput.add("Dale Zamora,521-7792 Mauris Rd.,1-214-625-6970,90510");
    expectedOutput.add("Charles Wood,525-9709 In Rd.,1-370-528-4758,62714");

View Full Code Here

Examples of org.apache.hadoop.fs.FileSystem.listStatus()

    assertEquals(0,job.getBadRecords());
    assertEquals(5,job.getOutput());
    
    FileSystem outputFS=getFileSystem();
    Path outputPath = new Path(outputFS.getHomeDirectory(), "output");
    FileStatus[] status = outputFS.listStatus(outputPath, getOutputPathFilter()); 
    assertTrue(outputFS.exists(outputPath));
    List<String> expectedOutput = new ArrayList<String>();
    expectedOutput.add("Macon Kent,6269 Aenean St.,1-247-399-1051,08253");
    expectedOutput.add("Dale Zamora,521-7792 Mauris Rd.,1-214-625-6970,90510");
    expectedOutput.add("Charles Wood,525-9709 In Rd.,1-370-528-4758,62714");

View Full Code Here

Examples of org.apache.hadoop.fs.FileSystem.listStatus()

    assertEquals(0,job.getBadRecords());
    assertEquals(5,job.getOutput());
    
    FileSystem outputFS=getFileSystem();
    Path outputPath = new Path(outputFS.getHomeDirectory(), "output");
    FileStatus[] status = outputFS.listStatus(outputPath, getOutputPathFilter()); 
    assertTrue(outputFS.exists(outputPath));
    List<String> expectedOutput = new ArrayList<String>();
    expectedOutput.add("Macon Kent,6269 Aenean St.,1-247-399-1051,08253");
    expectedOutput.add("Dale Zamora,521-7792 Mauris Rd.,1-214-625-6970,90510");
    expectedOutput.add("Charles Wood,525-9709 In Rd.,1-370-528-4758,62714");

View Full Code Here

Examples of org.apache.hadoop.fs.FileSystem.listStatus()

    assertEquals(0,job.getBadRecords());
    assertEquals(4,job.getOutput());
    
    FileSystem outputFS=getFileSystem();
    Path outputPath = new Path(outputFS.getHomeDirectory(), "output");
    FileStatus[] status = outputFS.listStatus(outputPath, getOutputPathFilter()); 
    assertTrue(outputFS.exists(outputPath));
    List<String> expectedOutput = new ArrayList<String>();
    expectedOutput.add("Macon Kent,6269 Aenean St.,1-247-399-1051,08253");
    expectedOutput.add("Dale Zamora,521-7792 Mauris Rd.,1-214-625-6970,90510");
    expectedOutput.add("Charles Wood,525-9709 In Rd.,1-370-528-4758,62714");

View Full Code Here

Examples of org.apache.hadoop.fs.FileSystem.listStatus()

    assertEquals(0,job.getBadRecords());
    assertEquals(5,job.getOutput());
    
    FileSystem outputFS=getFileSystem();
    Path outputPath = new Path(outputFS.getHomeDirectory(), "output");
    FileStatus[] status = outputFS.listStatus(outputPath, getOutputPathFilter()); 
    assertTrue(outputFS.exists(outputPath));
    List<String> expectedOutput = new ArrayList<String>();
    expectedOutput.add("Macon Kent,6269 Aenean St.,1-247-399-1051,08253");
    expectedOutput.add("Dale Zamora,521-7792 Mauris Rd.,1-214-625-6970,90510");
    expectedOutput.add("Charles Wood,525-9709 In Rd.,1-370-528-4758,62714");

View Full Code Here

Examples of org.apache.hadoop.fs.FileSystem.listStatus()

    assertEquals(5, job.getOutput());
    assertEquals(1, job.getDuplicateRecords());
    
    FileSystem outputFS = getFileSystem();
    Path outputPath = new Path(outputFS.getHomeDirectory(), "output");
    FileStatus[] status = outputFS.listStatus(outputPath, getOutputPathFilter()); 
    assertTrue(outputFS.exists(outputPath));
    List<String> expectedOutput = new ArrayList<String>();
    expectedOutput.add("Xavier Wilson,Mason Holloway,Carlos Johnston,Martin Noel,Drake Mckinney");
    expectedOutput.add("Zephania Bauer,Jermaine Gordon,Vincent Moon,Steven Pierce,Jasper Campos");
    expectedOutput.add("Drake Mckinney,Murphy Baird,Theodore Lindsey,Nehru Wilcox,Harper Klein");

View Full Code Here

Examples of org.apache.hadoop.fs.FileSystem.listStatus()

    assertEquals(5, job.getOutput());
    assertEquals(1, job.getDuplicateRecords());
    
    FileSystem outputFS = getFileSystem();
    Path outputPath = new Path(outputFS.getHomeDirectory(), "output");
    FileStatus[] status = outputFS.listStatus(outputPath, getOutputPathFilter()); 
    assertTrue(outputFS.exists(outputPath));
    List<String> expectedOutput = new ArrayList<String>();
    expectedOutput.add("Xavier Wilson,Mason Holloway,Carlos Johnston,Martin Noel,Drake Mckinney");
    expectedOutput.add("Zephania Bauer,Jermaine Gordon,Vincent Moon,Steven Pierce,Jasper Campos");
    expectedOutput.add("Drake Mckinney,Murphy Baird,Theodore Lindsey,Nehru Wilcox,Harper Klein");

View Full Code Here

Examples of org.apache.hadoop.fs.FileSystem.listStatus()

    assertEquals(5, job.getOutput());
    assertEquals(1, job.getDuplicateRecords());
    
    FileSystem outputFS = getFileSystem();
    Path outputPath = new Path(outputFS.getHomeDirectory(), "output");
    FileStatus[] status = outputFS.listStatus(outputPath, getOutputPathFilter()); 
    assertTrue(outputFS.exists(outputPath));
    List<String> expectedOutput = new ArrayList<String>();
    expectedOutput.add("Xavier Wilson,Mason Holloway,Carlos Johnston,Martin Noel,Drake Mckinney");
    expectedOutput.add("Kennedy Bailey,Jerome Perry,David Cabrera,Edan Fleming,Orlando Tyson");
    expectedOutput.add("Drake Mckinney,Murphy Baird,Theodore Lindsey,Nehru Wilcox,Harper Klein");

View Full Code Here

0 1 2 3 4 5 6

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.