List of listStatus() Examples

Examples of listStatus()

eu.stratosphere.core.fs.FileSystem.listStatus()
List the statuses of the files/directories in the given path if the path is a directory. @param f given path @return the statuses of the files/directories in the given patch @throws IOException
org.apache.accumulo.server.fs.VolumeManager.listStatus()
org.apache.flink.core.fs.FileSystem.listStatus()
List the statuses of the files/directories in the given path if the path is a directory. @param f given path @return the statuses of the files/directories in the given patch @throws IOException
org.apache.flink.core.fs.local.LocalFileSystem.listStatus()
org.apache.hadoop.fs.FileContext.listStatus()
List the statuses of the files/directories in the given path if the path is a directory. @param f is the path @return an iterator that traverses statuses of the files/directories in the given path @throws AccessControlException If access is denied @throws FileNotFoundException If f does not exist @throws UnsupportedFileSystemException If file system for f isnot supported @throws IOException If an I/O error occurredExceptions applicable to file systems accessed over RPC: @throws RpcClientException If an exception occurred in the RPC client @throws RpcServerException If an exception occurred in the RPC server @throws UnexpectedServerException If server implementation throws undeclared exception to RPC server
org.apache.hadoop.fs.FileSystem.listStatus()
List the statuses of the files/directories in the given path if the path is a directory. @param f given path @return the statuses of the files/directories in the given patch @throws IOException
org.apache.hadoop.fs.HarFileSystem.listStatus()
liststatus returns the children of a directory after looking up the index files.
org.apache.hadoop.fs.InMemoryFileSystem.listStatus()
Directory operations are not supported
org.apache.hadoop.fs.LocalFileSystem.listStatus()
org.apache.hadoop.hdfs.DistributedFileSystem.listStatus()
List all the entries of a directory Note that this operation is not atomic for a large directory. The entries of a directory may be fetched from NameNode multiple times. It only guarantees that each name occurs once if a directory undergoes changes between the calls.
org.apache.hadoop.hdfs.web.WebHdfsFileSystem.listStatus()
org.apache.hadoop.mapreduce.test.system.JTClient.listStatus()
org.apache.hadoop.mapreduce.test.system.TTClient.listStatus()
org.apache.pig.piggybank.storage.partition.PathPartitionHelper.listStatus()
This method is called by the FileInputFormat to find the input paths for which splits should be calculated.
If applyDateRanges == true: Then the HiveRCDateSplitter is used to apply filtering on the input files.
Else the default FileInputFormat listStatus method is used. @param ctx JobContext @param loaderClass this is chosen to be a subclass of LoadFunc to maintain some consistency.
tachyon.client.TachyonFS.listStatus()
If the path is a directory, return all the direct entries in it. If the path is a file, return its ClientFileInfo. @param path the target directory/file path @return A list of ClientFileInfo, null if the file or folder does not exist. @throws IOException

Examples of org.apache.hadoop.fs.FileSystem.listStatus()

   * @throws IOException
   */
  private Set<String> getColumnFamilyList(Set<String> columns, HbckInfo hbi) throws IOException {
    Path regionDir = hbi.getHdfsRegionDir();
    FileSystem fs = regionDir.getFileSystem(getConf());
    FileStatus[] subDirs = fs.listStatus(regionDir, new FSUtils.FamilyDirFilter(fs));
    for (FileStatus subdir : subDirs) {
      String columnfamily = subdir.getPath().getName();
      columns.add(columnfamily);
    }
    return columns;

View Full Code Here

Examples of org.apache.hadoop.fs.FileSystem.listStatus()


    // list all tables from HDFS
    List<FileStatus> tableDirs = Lists.newArrayList();


    boolean foundVersionFile = false;
    FileStatus[] files = fs.listStatus(rootDir);
    for (FileStatus file : files) {
      String dirName = file.getPath().getName();
      if (dirName.equals(HConstants.VERSION_FILE_NAME)) {
        foundVersionFile = true;
      } else {

View Full Code Here

Examples of org.apache.hadoop.fs.FileSystem.listStatus()

    }


    Path hbaseDir = new Path(getConf().get(HConstants.HBASE_DIR));
    FileSystem fs = hbaseDir.getFileSystem(getConf());
    User user = User.getCurrent();
    FileStatus[] files = fs.listStatus(hbaseDir);
    for (FileStatus file : files) {
      try {
        FSUtils.checkAccess(user, file, FsAction.WRITE);
      } catch (AccessControlException ace) {
        LOG.warn("Got AccessControlException when preCheckPermission ", ace);

View Full Code Here

Examples of org.apache.hadoop.fs.FileSystem.listStatus()

    LOG.debug("Contained region dir after close and pause");
    debugLsr(contained.getHdfsRegionDir());


    // rename the contained into the container.
    FileSystem fs = targetRegionDir.getFileSystem(getConf());
    FileStatus[] dirs = fs.listStatus(contained.getHdfsRegionDir());


    if (dirs == null) {
      if (!fs.exists(contained.getHdfsRegionDir())) {
        LOG.warn("HDFS region dir " + contained.getHdfsRegionDir() + " already sidelined.");
      } else {

View Full Code Here

Examples of org.apache.hadoop.fs.FileSystem.listStatus()

    if (!fs.exists(snapshotDir)) {
      return snapshotDescs;
    }


    // ignore all the snapshots in progress
    FileStatus[] snapshots = fs.listStatus(snapshotDir,
      new SnapshotDescriptionUtils.CompletedSnaphotDirectoriesFilter(fs));
    // loop through all the completed snapshots
    for (FileStatus snapshot : snapshots) {
      Path info = new Path(snapshot.getPath(), SnapshotDescriptionUtils.SNAPSHOTINFO_FILE);
      // if the snapshot is bad

View Full Code Here

Examples of org.apache.hadoop.fs.FileSystem.listStatus()

    // check for the existence of the archive directory and some files in it
    Path archiveDir = HFileArchiveTestingUtil.getRegionArchiveDir(UTIL.getConfiguration(), region);
    assertTrue(fs.exists(archiveDir));


    // check to make sure the store directory was copied
    FileStatus[] stores = fs.listStatus(archiveDir);
    assertTrue(stores.length == 1);


    // make sure we archived the store files
    FileStatus[] storeFiles = fs.listStatus(stores[0].getPath());
    assertTrue(storeFiles.length > 0);

View Full Code Here

Examples of org.apache.hadoop.fs.FileSystem.listStatus()

    // check to make sure the store directory was copied
    FileStatus[] stores = fs.listStatus(archiveDir);
    assertTrue(stores.length == 1);


    // make sure we archived the store files
    FileStatus[] storeFiles = fs.listStatus(stores[0].getPath());
    assertTrue(storeFiles.length > 0);


    // then ensure the region's directory isn't present
    assertFalse(fs.exists(regionDir));
  }

View Full Code Here

Examples of org.apache.hadoop.fs.FileSystem.listStatus()

      Path storeHomeDir = Store.getStoreHomedir(tablePath, regionEncodedName,
      family.getName());
      if (!fs.exists(storeHomeDir))continue;


      FileStatus[] hfilesStatus = null;
      hfilesStatus = fs.listStatus(storeHomeDir);


      for (FileStatus hfileStatus : hfilesStatus) {
        HDFSBlocksDistribution storeFileBlocksDistribution =
          FSUtils.computeHDFSBlocksDistribution(fs, hfileStatus, 0,
          hfileStatus.getLen());

View Full Code Here

Examples of org.apache.hadoop.fs.FileSystem.listStatus()

      Path storeHomeDir = Store.getStoreHomedir(tablePath, regionEncodedName,
      family.getName());
      if (!fs.exists(storeHomeDir))continue;


      FileStatus[] hfilesStatus = null;
      hfilesStatus = fs.listStatus(storeHomeDir);


      for (FileStatus hfileStatus : hfilesStatus) {
        HDFSBlocksDistribution storeFileBlocksDistribution =
          FSUtils.computeHDFSBlocksDistribution(fs, hfileStatus, 0,
          hfileStatus.getLen());

View Full Code Here

Examples of org.apache.hadoop.fs.FileSystem.listStatus()

    String jobId = t.getJobId();
    String jobFile = t.getJobFile();
    // Get sizes of JobFile and JarFile
    // sizes are -1 if they are not present.
    FileSystem fileSystem = FileSystem.get(fConf);
    FileStatus status[] = fileSystem.listStatus(new Path(jobFile).getParent());
    long jarFileSize = -1;
    long jobFileSize = -1;
    for(FileStatus stat : status) {
      if (stat.getPath().toString().contains("job.xml")) {
        jobFileSize = stat.getLen();

View Full Code Here

0 1 2 3 4 5 6

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.