List of listStatus() Examples

Examples of listStatus()

eu.stratosphere.core.fs.FileSystem.listStatus()
List the statuses of the files/directories in the given path if the path is a directory. @param f given path @return the statuses of the files/directories in the given patch @throws IOException
org.apache.accumulo.server.fs.VolumeManager.listStatus()
org.apache.flink.core.fs.FileSystem.listStatus()
List the statuses of the files/directories in the given path if the path is a directory. @param f given path @return the statuses of the files/directories in the given patch @throws IOException
org.apache.flink.core.fs.local.LocalFileSystem.listStatus()
org.apache.hadoop.fs.FileContext.listStatus()
List the statuses of the files/directories in the given path if the path is a directory. @param f is the path @return an iterator that traverses statuses of the files/directories in the given path @throws AccessControlException If access is denied @throws FileNotFoundException If f does not exist @throws UnsupportedFileSystemException If file system for f isnot supported @throws IOException If an I/O error occurredExceptions applicable to file systems accessed over RPC: @throws RpcClientException If an exception occurred in the RPC client @throws RpcServerException If an exception occurred in the RPC server @throws UnexpectedServerException If server implementation throws undeclared exception to RPC server
org.apache.hadoop.fs.FileSystem.listStatus()
List the statuses of the files/directories in the given path if the path is a directory. @param f given path @return the statuses of the files/directories in the given patch @throws IOException
org.apache.hadoop.fs.HarFileSystem.listStatus()
liststatus returns the children of a directory after looking up the index files.
org.apache.hadoop.fs.InMemoryFileSystem.listStatus()
Directory operations are not supported
org.apache.hadoop.fs.LocalFileSystem.listStatus()
org.apache.hadoop.hdfs.DistributedFileSystem.listStatus()
List all the entries of a directory Note that this operation is not atomic for a large directory. The entries of a directory may be fetched from NameNode multiple times. It only guarantees that each name occurs once if a directory undergoes changes between the calls.
org.apache.hadoop.hdfs.web.WebHdfsFileSystem.listStatus()
org.apache.hadoop.mapreduce.test.system.JTClient.listStatus()
org.apache.hadoop.mapreduce.test.system.TTClient.listStatus()
org.apache.pig.piggybank.storage.partition.PathPartitionHelper.listStatus()
This method is called by the FileInputFormat to find the input paths for which splits should be calculated.
If applyDateRanges == true: Then the HiveRCDateSplitter is used to apply filtering on the input files.
Else the default FileInputFormat listStatus method is used. @param ctx JobContext @param loaderClass this is chosen to be a subclass of LoadFunc to maintain some consistency.
tachyon.client.TachyonFS.listStatus()
If the path is a directory, return all the direct entries in it. If the path is a file, return its ClientFileInfo. @param path the target directory/file path @return A list of ClientFileInfo, null if the file or folder does not exist. @throws IOException

Examples of org.apache.hadoop.fs.FileSystem.listStatus()

    }


    sink.stop();


    // loop through all the files generated and check their contains
    FileStatus[] dirStat = fs.listStatus(dirPath);
    Path fList[] = FileUtil.stat2Paths(dirStat);


    // check that the roll happened correctly for the given data
    long expectedFiles = totalEvents / rollCount;
    if (totalEvents % rollCount > 0) expectedFiles++;

View Full Code Here

Examples of org.apache.hadoop.fs.FileSystem.listStatus()

    String applicationBaseDir = springYarnProperties.getApplicationBaseDir();
    Path path = new Path(applicationBaseDir);
    FileSystem fs = path.getFileSystem(yarnConfiguration);
    FileStatus[] listStatus = new FileStatus[0];
    if (fs.exists(path)) {
      listStatus = fs.listStatus(path);
    }
    return ApplicationsReport.installedReportBuilder()
        .add(InstalledField.NAME)
        .add(InstalledField.PATH)
        .from(listStatus)

View Full Code Here

Examples of org.apache.hadoop.fs.FileSystem.listStatus()

          for (FileStatus status : fileStatus) {
            results.put(status.getPath(), srcFs.getContentSummary(status.getPath()).getLength());
          }
        }
        else {
          FileStatus items[] = srcFs.listStatus(FileUtil.stat2Paths(fileStatus, srcPath));
          if (ObjectUtils.isEmpty(items) && (!srcFs.exists(srcPath))) {
            throw new HadoopException("Cannot access " + src + ": No such file or directory.");
          }
          for (FileStatus status : items) {
            Long size = (status.isDir() ? srcFs.getContentSummary(status.getPath()).getLength() : status.getLen());

View Full Code Here

Examples of org.apache.hadoop.fs.FileSystem.listStatus()

            te.printStackTrace();
            logger.error("Error thrown while trying to get Hadoop filesystem");
            System.exit(-1);
        }


        FileStatus status = fs.listStatus(p)[0];
        long size = status.getLen();
        HdfsFetcher fetcher = new HdfsFetcher(null,
                                              maxBytesPerSec,
                                              VoldemortConfig.REPORTING_INTERVAL_BYTES,
                                              VoldemortConfig.DEFAULT_BUFFER_SIZE,

View Full Code Here

Examples of org.apache.hadoop.fs.FileSystem.listStatus()

    private List<FileStatus> getAllSubFileStatus(JobConf inputConf, Path filterMemberPath)
            throws IOException {
        List<FileStatus> list = new ArrayList<FileStatus>();


        FileSystem fs = filterMemberPath.getFileSystem(inputConf);
        FileStatus[] subFiles = fs.listStatus(filterMemberPath);


        if(null != subFiles) {
            if(fs.isDirectory(filterMemberPath)) {
                for(FileStatus subFile: subFiles) {
                    if(!HadoopUtils.shouldPathBeIgnored(subFile.getPath())) {

View Full Code Here

Examples of org.apache.hadoop.fs.FileSystem.listStatus()

        }


        final FileSystem fs = path.getFileSystem(conf);


        if(fs.exists(path)) {
            for(FileStatus status: fs.listStatus(path)) {
                if(!shouldPathBeIgnored(status.getPath())) {
                    if(status.isDir()) {
                        addAllSubPaths(conf, status.getPath());
                    } else {
                        FileInputFormat.addInputPath(conf, status.getPath());

View Full Code Here

Examples of org.apache.hadoop.fs.FileSystem.listStatus()

    FileStatus status2 = mock(FileStatus.class);
    Path path2 = mock(Path.class);
    when(path2.getName()).thenReturn("part-yyyyy");
    when(status2.getPath()).thenReturn(path2);
    FileSystem fs = mock(FileSystem.class);
    when(fs.listStatus(path)).thenReturn(
        new FileStatus[] { status1, status2 });
    when(path.getFileSystem(conf)).thenReturn(fs);
    when(conf.get(HIHOConf.EXTERNAL_TABLE_DML))
        .thenReturn(
            "create table age(  i   Number,  n   Varchar(20),  a   Number)organization external (  type  oracle_loader default directory ext_dir access parameters (records delimited  by newlinefields  terminated by ','missing field values are null )location  (/home/nube/:file.txt) reject' limit unlimited;");

View Full Code Here

Examples of org.apache.hadoop.fs.FileSystem.listStatus()

    //lets verify the result now
    FileSystem outputFS = getFileSystem();
    //Path outputPath = getOutputDir();
    
    Path outputPath = new Path(outputFS.getHomeDirectory(), "testBasicTableImport");
    FileStatus[] status = outputFS.listStatus(outputPath, getOutputPathFilter()); 
    assertTrue(outputFS.exists(outputPath));
    List<String> expectedOutput = new ArrayList<String>();
    expectedOutput.add("/aDELIM1000");
    expectedOutput.add("/bDELIM2000");
    expectedOutput.add("/cDELIM3000");

View Full Code Here

Examples of org.apache.hadoop.fs.FileSystem.listStatus()

    //lets verify the result now
    FileSystem outputFS = getFileSystem();
    //Path outputPath = getOutputDir();
    
    Path outputPath = new Path(outputFS.getHomeDirectory(), "testBasicTableImport");
    FileStatus[] status = outputFS.listStatus(outputPath, getOutputPathFilter()); 
    assertTrue(outputFS.exists(outputPath));
  /*  List<String> expectedOutput = new ArrayList<String>();
    expectedOutput.add("/aDELIM1000");
    expectedOutput.add("/bDELIM2000");
    expectedOutput.add("/cDELIM3000");

View Full Code Here

Examples of org.apache.hadoop.fs.FileSystem.listStatus()

    int res = ToolRunner.run(createJobConf(), job, args); 
    assertEquals(0, res);
    //lets verify the result now
    FileSystem outputFS = getFileSystem();
    Path outputPath = new Path(outputFS.getHomeDirectory(), "testQueryBasedImport");
    FileStatus[] status = outputFS.listStatus(outputPath, getOutputPathFilter()); 
    assertTrue(outputFS.exists(outputPath));
    List<String> expectedOutput = new ArrayList<String>();
    expectedOutput.add("/aDELIM1000DELIM10");
    expectedOutput.add("/bDELIM2000DELIM10");
    expectedOutput.add("/cDELIM3000DELIM10");

View Full Code Here

0 1 2 3 4 5 6

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.