List of listStatus() Examples

Examples of listStatus()

eu.stratosphere.core.fs.FileSystem.listStatus()
List the statuses of the files/directories in the given path if the path is a directory. @param f given path @return the statuses of the files/directories in the given patch @throws IOException
org.apache.accumulo.server.fs.VolumeManager.listStatus()
org.apache.flink.core.fs.FileSystem.listStatus()
List the statuses of the files/directories in the given path if the path is a directory. @param f given path @return the statuses of the files/directories in the given patch @throws IOException
org.apache.flink.core.fs.local.LocalFileSystem.listStatus()
org.apache.hadoop.fs.FileContext.listStatus()
List the statuses of the files/directories in the given path if the path is a directory. @param f is the path @return an iterator that traverses statuses of the files/directories in the given path @throws AccessControlException If access is denied @throws FileNotFoundException If f does not exist @throws UnsupportedFileSystemException If file system for f isnot supported @throws IOException If an I/O error occurredExceptions applicable to file systems accessed over RPC: @throws RpcClientException If an exception occurred in the RPC client @throws RpcServerException If an exception occurred in the RPC server @throws UnexpectedServerException If server implementation throws undeclared exception to RPC server
org.apache.hadoop.fs.FileSystem.listStatus()
List the statuses of the files/directories in the given path if the path is a directory. @param f given path @return the statuses of the files/directories in the given patch @throws IOException
org.apache.hadoop.fs.HarFileSystem.listStatus()
liststatus returns the children of a directory after looking up the index files.
org.apache.hadoop.fs.InMemoryFileSystem.listStatus()
Directory operations are not supported
org.apache.hadoop.fs.LocalFileSystem.listStatus()
org.apache.hadoop.hdfs.DistributedFileSystem.listStatus()
List all the entries of a directory Note that this operation is not atomic for a large directory. The entries of a directory may be fetched from NameNode multiple times. It only guarantees that each name occurs once if a directory undergoes changes between the calls.
org.apache.hadoop.hdfs.web.WebHdfsFileSystem.listStatus()
org.apache.hadoop.mapreduce.test.system.JTClient.listStatus()
org.apache.hadoop.mapreduce.test.system.TTClient.listStatus()
org.apache.pig.piggybank.storage.partition.PathPartitionHelper.listStatus()
This method is called by the FileInputFormat to find the input paths for which splits should be calculated.
If applyDateRanges == true: Then the HiveRCDateSplitter is used to apply filtering on the input files.
Else the default FileInputFormat listStatus method is used. @param ctx JobContext @param loaderClass this is chosen to be a subclass of LoadFunc to maintain some consistency.
tachyon.client.TachyonFS.listStatus()
If the path is a directory, return all the direct entries in it. If the path is a file, return its ClientFileInfo. @param path the target directory/file path @return A list of ClientFileInfo, null if the file or folder does not exist. @throws IOException

Examples of org.apache.hadoop.fs.FileSystem.listStatus()

    protected int run(CommandLine cmd) throws Exception {
        User user = getUser();
        FileSystem fs = getFileSystem();


        Path dictionaryPath = new Path(directory);
        FileStatus[] files = fs.listStatus(dictionaryPath, new DictionaryPathFilter(this.extension));
        for (FileStatus fileStatus : files) {
            LOGGER.info("Importing dictionary file: " + fileStatus.getPath().toString());
            String conceptName = FilenameUtils.getBaseName(fileStatus.getPath().toString());
            conceptName = URLDecoder.decode(conceptName, "UTF-8");
            Concept concept = ontologyRepository.getConceptByIRI(conceptName);

View Full Code Here

Examples of org.apache.hadoop.fs.FileSystem.listStatus()

        final List<Path> segments = new ArrayList<Path>();
        for (int i = 4; i < args.length; i++) {
          if (args[i].equals("-dir")) {
            Path dir = new Path(args[++i]);
            FileSystem fs = dir.getFileSystem(getConf());
            FileStatus[] fstats = fs.listStatus(dir,
                    HadoopFSUtil.getPassDirectoriesFilter(fs));
            Path[] files = HadoopFSUtil.getPaths(fstats);
            for (Path p : files) {
              segments.add(p);
            }

View Full Code Here

Examples of org.apache.hadoop.fs.FileSystem.listStatus()

    Assert.assertEquals(status2.getModificationTime(), status1.getModificationTime());
    Assert.assertEquals(status2.getOwner(), status1.getOwner());
    Assert.assertEquals(status2.getGroup(), status1.getGroup());
    Assert.assertEquals(status2.getLen(), status1.getLen());


    FileStatus[] stati = fs.listStatus(path.getParent());
    Assert.assertEquals(stati.length, 1);
    Assert.assertEquals(stati[0].getPath().getName(), path.getName());
  }


  private void testWorkingdirectory() throws Exception {

View Full Code Here

Examples of org.apache.hadoop.fs.FileSystem.listStatus()

      // test getVisbileLen
      DFSDataInputStream fin = (DFSDataInputStream)fs.open(file1);
      assertEquals(status.getLen(), fin.getVisibleLength());
      
      // test listStatus on a file
      FileStatus[] stats = fs.listStatus(file1);
      assertEquals(1, stats.length);
      status = stats[0];
      assertTrue(file1 + " should be a file", 
          status.isDir() == false);
      assertTrue(status.getBlockSize() == blockSize);

View Full Code Here

Examples of org.apache.hadoop.fs.FileSystem.listStatus()


      // test file status on a directory
      Path dir = new Path("/test/mkdirs");


      // test listStatus on a non-existent file/directory
      stats = fs.listStatus(dir);
      assertEquals(null, stats);
      try {
        status = fs.getFileStatus(dir);
        fail("getFileStatus of non-existent path should fail");
      } catch (FileNotFoundException fe) {

View Full Code Here

Examples of org.apache.hadoop.fs.FileSystem.listStatus()

      assertTrue(dir + " should be zero size ", status.getLen() == 0);
      assertEquals(fs.makeQualified(dir).toString(), 
          status.getPath().toString());


      // test listStatus on an empty directory
      stats = fs.listStatus(dir);
      assertEquals(dir + " should be empty", 0, stats.length);
      assertEquals(dir + " should be zero size ",
          0, fs.getContentSummary(dir).getLength());
      assertEquals(dir + " should be zero size using hftp",
          0, hftpfs.getContentSummary(dir).getLength());

View Full Code Here

Examples of org.apache.hadoop.fs.HarFileSystem.listStatus()

    FileSystem fsHar = new HarFileSystem(destFs);
    String harURIPath = harPath.toUri().getPath();
    Path qualifiedPath = new Path("har://", harURIPath +
      Path.SEPARATOR + harPath.getParent().toUri().getPath());
    fsHar.initialize(qualifiedPath.toUri(), conf);
    FileStatus[] filesInHar = fsHar.listStatus(qualifiedPath);
    if (filesInHar.length == 0) {
      return 0;
    }
    int numUseless = 0;
    for (FileStatus one: filesInHar) {

View Full Code Here

Examples of org.apache.hadoop.fs.InMemoryFileSystem.listStatus()

    inMemFs.reserveSpaceWithCheckSum(testPath, 1024);
    fout = inMemFs.create(testPath);
    fout.write("testing".getBytes());
    fout.close();
    inMemFs.delete(testPath, true);
    assertTrue("nothing in the namespace", inMemFs.listStatus(new Path("/")).length == 0);
  }
  
  public void testVerifyChecksum() throws Exception {
    String TEST_ROOT_DIR
    = System.getProperty("test.build.data","build/test/data/work-dir/localfs");

View Full Code Here

Examples of org.apache.hadoop.fs.LocalFileSystem.listStatus()

    LocalFileSystem localFs = FileSystem.getLocal(conf);
    int count = 0;


    final FileStatus itemStatus = localFs.getFileStatus(itemToZip);
    if(itemStatus.isDir()) {
      final FileStatus[] statai = localFs.listStatus(itemToZip);


      // Add a directory entry to the zip file
      final String zipDirName = relativePathForZipEntry(itemToZip.toUri().getPath(), baseName, root);
      final ZipEntry dirZipEntry = new ZipEntry(zipDirName + Path.SEPARATOR_CHAR);
      LOG.info(String.format("Adding directory %s to zip", zipDirName));

View Full Code Here

Examples of org.apache.hadoop.hdfs.DistributedFileSystem.listStatus()

      System.out.println("Address of local minidfscluster: " + cluster.getUnderFilesystemAddress());
      Thread.sleep(10);
      DistributedFileSystem dfs = cluster.getDFSClient();
      dfs.mkdirs(new Path("/1"));
      mkdirs(cluster.getUnderFilesystemAddress() + "/1/2");
      FileStatus[] fs = dfs.listStatus(new Path(TachyonURI.SEPARATOR));
      assert fs.length != 0;
      System.out.println(fs[0].getPath().toUri());
      dfs.close();


      cluster.shutdown();

View Full Code Here

0 1 2 3 4 5 6

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.