List of initOutPathDistFS() Examples

Examples of initOutPathDistFS()

eu.stratosphere.core.fs.FileSystem.initOutPathDistFS()
Initializes output directories on distributed file systems according to the given write mode. WriteMode.CREATE & parallel output: - A directory is created if the output path does not exist. - An existing file or directory raises an exception. WriteMode.CREATE & NONE parallel output: - An existing file or directory raises an exception. WriteMode.OVERWRITE & parallel output: - A directory is created if the output path does not exist. - An existing directory and its content is deleted and a new directory is created. - An existing file is deleted and replaced by a new directory. WriteMode.OVERWRITE & NONE parallel output: - An existing file or directory is deleted and replaced by a new directory. @param outPath Output path that should be prepared. @param writeMode Write mode to consider. @param createDirectory True, to initialize a directory at the given path, false otherwise. @return True, if the path was successfully prepared, false otherwise. @throws IOException
org.apache.flink.core.fs.FileSystem.initOutPathDistFS()
Initializes output directories on distributed file systems according to the given write mode. WriteMode.CREATE & parallel output: - A directory is created if the output path does not exist. - An existing file or directory raises an exception. WriteMode.CREATE & NONE parallel output: - An existing file or directory raises an exception. WriteMode.OVERWRITE & parallel output: - A directory is created if the output path does not exist. - An existing directory and its content is deleted and a new directory is created. - An existing file is deleted and replaced by a new directory. WriteMode.OVERWRITE & NONE parallel output: - An existing file or directory is deleted and replaced by a new directory. @param outPath Output path that should be prepared. @param writeMode Write mode to consider. @param createDirectory True, to initialize a directory at the given path, false otherwise. @return True, if the path was successfully prepared, false otherwise. @throws IOException

Examples of eu.stratosphere.core.fs.FileSystem.initOutPathDistFS()

      if(dop == 1 && outDirMode == OutputDirectoryMode.PARONLY) {
        // output is not written in parallel and should be written to a single file.
        
        if(fs.isDistributedFS()) {
          // prepare distributed output path
          if(!fs.initOutPathDistFS(path, writeMode, false)) {
            // output preparation failed! Cancel task.
            throw new IOException("Output path could not be initialized.");
          }
        }

View Full Code Here

Examples of eu.stratosphere.core.fs.FileSystem.initOutPathDistFS()

      } else {
        // output should be written to a directory
        
        if(fs.isDistributedFS()) {
          // only distributed file systems can be initialized at start-up time.
          if(!fs.initOutPathDistFS(path, writeMode, true)) {
            throw new IOException("Output directory could not be created.");
          }
        }
        
        return -1;

View Full Code Here

Examples of org.apache.flink.core.fs.FileSystem.initOutPathDistFS()

      final OutputDirectoryMode outDirMode = getOutputDirectoryMode();


      if (parallelism == 1 && outDirMode == OutputDirectoryMode.PARONLY) {
        // output is not written in parallel and should be written to a single file.
        // prepare distributed output path
        if(!fs.initOutPathDistFS(path, writeMode, false)) {
          // output preparation failed! Cancel task.
          throw new IOException("Output path could not be initialized.");
        }


      } else {

View Full Code Here

Examples of org.apache.flink.core.fs.FileSystem.initOutPathDistFS()


      } else {
        // output should be written to a directory


        // only distributed file systems can be initialized at start-up time.
        if(!fs.initOutPathDistFS(path, writeMode, true)) {
          throw new IOException("Output directory could not be created.");
        }
      }
    }
  }

View Full Code Here

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.