Examples of eu.stratosphere.core.fs.FileSystem.initOutPathDistFS()

eu.stratosphere.core.fs.FileSystem.initOutPathDistFS()

Initializes output directories on distributed file systems according to the given write mode. WriteMode.CREATE & parallel output: - A directory is created if the output path does not exist. - An existing file or directory raises an exception. WriteMode.CREATE & NONE parallel output: - An existing file or directory raises an exception. WriteMode.OVERWRITE & parallel output: - A directory is created if the output path does not exist. - An existing directory and its content is deleted and a new directory is created. - An existing file is deleted and replaced by a new directory. WriteMode.OVERWRITE & NONE parallel output: - An existing file or directory is deleted and replaced by a new directory. @param outPath Output path that should be prepared. @param writeMode Write mode to consider. @param createDirectory True, to initialize a directory at the given path, false otherwise. @return True, if the path was successfully prepared, false otherwise. @throws IOException

      if(dop == 1 && outDirMode == OutputDirectoryMode.PARONLY) {
        // output is not written in parallel and should be written to a single file.
        
        if(fs.isDistributedFS()) {
          // prepare distributed output path
          if(!fs.initOutPathDistFS(path, writeMode, false)) {
            // output preparation failed! Cancel task.
            throw new IOException("Output path could not be initialized.");
          }
        }

      } else {
        // output should be written to a directory
        
        if(fs.isDistributedFS()) {
          // only distributed file systems can be initialized at start-up time.
          if(!fs.initOutPathDistFS(path, writeMode, true)) {
            throw new IOException("Output directory could not be created.");
          }
        }
        
        return -1;

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.