List of createFileSystem() Examples

Examples of createFileSystem()

com.cloudera.lib.service.Hadoop.createFileSystem()
org.apache.commons.vfs.FileSystemManager.createFileSystem()
Creates a layered file system. A layered file system is a file system that is created from the contents of a file, such as a zip or tar file. @param provider The name of the file system provider to use. This nameis the same as the scheme used in URI to identify the provider. @param file The file to use to create the file system. @return The root file of the new file system. @throws FileSystemException On error creating the file system.
org.apache.commons.vfs.provider.FileProvider.createFileSystem()
Creates a layered file system. @param scheme The URI scheme for the layered file system. @param file The file to build the file system on. @param fileSystemOptions
org.apache.commons.vfs2.FileSystemManager.createFileSystem()
Creates a layered file system. A layered file system is a file system that is created from the contents of a file, such as a zip or tar file. @param provider The name of the file system provider to use. This nameis the same as the scheme used in URI to identify the provider. @param file The file to use to create the file system. @return The root file of the new file system. @throws FileSystemException On error creating the file system.
org.apache.commons.vfs2.provider.FileProvider.createFileSystem()
Creates a layered file system. @param scheme The URI scheme for the layered file system. @param file The file to build the file system on. @param fileSystemOptions The FileSystemOptions. @return A FileObject in the file system. @throws FileSystemException if an error occurs.
org.apache.hadoop.lib.service.FileSystemAccess.createFileSystem()
org.apache.jackrabbit.core.config.FileSystemConfig.createFileSystem()
Instantiates and initializes the configured file system implementation class. @return new initialized file system instance. @throws ConfigurationException on file system initialization errors
org.apache.oozie.service.HadoopAccessorService.createFileSystem()
Return a FileSystem created with the provided user for the specified URI. @param uri file system URI. @param conf Configuration with all necessary information to create the FileSystem. @return FileSystem created with the provided user/group. @throws HadoopAccessorException if the filesystem could not be created.

Examples of org.apache.oozie.service.HadoopAccessorService.createFileSystem()

            throws IOException, HadoopAccessorException {
        // sPath += "/" + END_OF_OPERATION_INDICATOR_FILE;
        Path path = new Path(sPath);
        HadoopAccessorService has = Services.get().get(HadoopAccessorService.class);
        Configuration fsConf = has.createJobConf(path.toUri().getAuthority());
        return has.createFileSystem(user, path.toUri(), fsConf).exists(path);
    }


    /**
     * @param tm
     * @return a new Evaluator to be used for URI-template evaluation

View Full Code Here

Examples of org.apache.oozie.service.HadoopAccessorService.createFileSystem()

            String user = conf.get(OozieClient.USER_NAME);
            String group = ConfigUtils.getWithDeprecatedCheck(conf, OozieClient.JOB_ACL, OozieClient.GROUP_NAME, null);
            URI uri = new URI(conf.get(OozieClient.APP_PATH));
            HadoopAccessorService has = Services.get().get(HadoopAccessorService.class);
            Configuration fsConf = has.createJobConf(uri.getAuthority());
            FileSystem fs = has.createFileSystem(user, uri, fsConf);


            Path configDefault = null;
            // app path could be a directory
            Path path = new Path(uri.getPath());
            if (!fs.isFile(path)) {

View Full Code Here

Examples of org.apache.oozie.service.HadoopAccessorService.createFileSystem()


            appPath = conf.get(OozieClient.APP_PATH);
            URI uri = new URI(appPath);
            HadoopAccessorService has = Services.get().get(HadoopAccessorService.class);
            Configuration fsConf = has.createJobConf(uri.getAuthority());
            FileSystem fs = has.createFileSystem(wfBean.getUser(), uri, fsConf);


            Path configDefault = null;
            // app path could be a directory
            Path path = new Path(uri.getPath());
            if (!fs.isFile(path)) {

View Full Code Here

Examples of org.apache.oozie.service.HadoopAccessorService.createFileSystem()

            Path dstPath = lwas.getSystemLibPath();
            System.out.println("the destination path for sharelib is: " + dstPath);


            URI uri = new Path(hdfsUri).toUri();
            Configuration fsConf = has.createJobConf(uri.getAuthority());
            FileSystem fs = has.createFileSystem(System.getProperty("user.name"), uri, fsConf);




            if (!srcFile.exists()){
                throw new IOException(srcPath + " cannot be found");
            }

View Full Code Here

Examples of org.apache.oozie.service.HadoopAccessorService.createFileSystem()

    protected FileSystem getAppFileSystem(WorkflowJob workflow) throws HadoopAccessorException, IOException,
            URISyntaxException {
        URI uri = new URI(workflow.getAppPath());
        HadoopAccessorService has = Services.get().get(HadoopAccessorService.class);
        Configuration fsConf = has.createJobConf(uri.getAuthority());
        return has.createFileSystem(workflow.getUser(), uri, fsConf);
    }


    @Override
    public String getEntityKey() {
        return job.getId();

View Full Code Here

Examples of org.apache.oozie.service.HadoopAccessorService.createFileSystem()

            String coordAppPathStr = conf.get(OozieClient.COORDINATOR_APP_PATH);
            Path coordAppPath = new Path(coordAppPathStr);
            String user = ParamChecker.notEmpty(conf.get(OozieClient.USER_NAME), OozieClient.USER_NAME);
            HadoopAccessorService has = Services.get().get(HadoopAccessorService.class);
            Configuration fsConf = has.createJobConf(coordAppPath.toUri().getAuthority());
            FileSystem fs = has.createFileSystem(user, coordAppPath.toUri(), fsConf);


            // app path could be a directory
            if (!fs.isFile(coordAppPath)) {
                configDefault = new Path(coordAppPath, CONFIG_DEFAULT);
            } else {

View Full Code Here

Examples of org.apache.oozie.service.HadoopAccessorService.createFileSystem()

        try {
            URI uri = new URI(appPath);
            LOG.debug("user =" + user);
            HadoopAccessorService has = Services.get().get(HadoopAccessorService.class);
            Configuration fsConf = has.createJobConf(uri.getAuthority());
            FileSystem fs = has.createFileSystem(user, uri, fsConf);
            Path appDefPath = null;


            // app path could be a directory
            Path path = new Path(uri.getPath());
            // check file exists for dataset include file, app xml already checked

View Full Code Here

Examples of org.apache.oozie.service.HadoopAccessorService.createFileSystem()

    private FileSystem getTargetFileSysyem() throws Exception {
        if (fs == null) {
            HadoopAccessorService has = getServices().get(HadoopAccessorService.class);
            URI uri = new Path(outPath).toUri();
            Configuration fsConf = has.createJobConf(uri.getAuthority());
            fs = has.createFileSystem(System.getProperty("user.name"), uri, fsConf);
        }
        return fs;


    }

View Full Code Here

Examples of org.apache.oozie.service.HadoopAccessorService.createFileSystem()

        WorkflowJob workflow = DagELFunctions.getWorkflow();
        String user = workflow.getUser();
        String group = workflow.getGroup();
        HadoopAccessorService has = Services.get().get(HadoopAccessorService.class);
        JobConf conf = has.createJobConf(uri.getAuthority());
        return has.createFileSystem(user, uri, conf);
    }


    /**
     * Get file status.
     *

View Full Code Here

Examples of org.apache.oozie.service.HadoopAccessorService.createFileSystem()

            if (filesystemsMap.containsKey(path.toUri().getAuthority())) {
              fs = filesystemsMap.get(path.toUri().getAuthority());
            }
            else {
              if (path.toUri().getAuthority() != null) {
                fs = has.createFileSystem(context.getWorkflow().getUser(), path.toUri(),
                        has.createJobConf(path.toUri().getAuthority()));
              }
              else {
                fs = context.getAppFileSystem();
              }

View Full Code Here

0 1 2 3 4 5

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.