Examples of gri.tasks.managers.workflows.WorkflowManager

gri.tasks.managers.workflows.WorkflowManager
Interface for an object that allows one to run workflows. This is similar to a JobManager in that a list of available tasks are provided and jobs can be submitted and their status checked. However, a workflow submission allows one to specify multiple jobs that are to be run in sequence instead of just one job. We also have the ability to check on progress of individual jobs within the workflow and provide the user with more ability to control and query a job. NOTE: For a while we had thought of just using the JobManager for everything. A workflow could indeed be encapsualted as a single job in the JobManager (a task named 'workflow' that takes an array of JobSubmissions as inputs, for example), but this is lacking in many ways. Specifically, we cannot query individual jobs within the workflow since these are hidden behind the facade. Also, some mechanism must exist to run the jobs in sequence. Using a JobManager, we only have access to asynchronous tasks - even when the JobManager internally executes them sequentially. The WorkflowManager allows us to provide multiple implementations: a generic one that utilizes a JobManager asynchronously as well as custom implementations that take advantage of otherwise hidden features. @author dan.rogers

    public static void testWorkflow() throws Exception {
  
  //Create Manager:
  TaskProvider taskProvider = loadTaskProvider();
  //WorkflowManager wkflManager = createLocalWorkflowManager(taskProvider);
  WorkflowManager wkflManager = createRemoteWorkflowManager(taskProvider);
  
  //Define workflow:
  //WorkflowSubmission wkfl = createSimpleWorkflow();
  WorkflowSubmission wkfl = createFileWorkflow();
  
  //Execute:
  String id = wkflManager.submitWorkflow(wkfl);
  while (wkflManager.getWorkflowInfo(id).getStatus() != JobManager.COMPLETE) {
      System.out.println("Running...");
      
      try {
    Thread.sleep(200);
      }
      catch(Exception e) {};
  }
  
  System.out.println("Complete");
  
  //Print outputs:
  Map outputs1 = wkflManager.getWorkflowOutputs(id, 0);
  Map outputs2 = wkflManager.getWorkflowOutputs(id, 1);
  
  System.out.println("OUTPUT 1: " + String.valueOf(outputs1));
  System.out.println("OUTPUT 2: " + String.valueOf(outputs2));
  
  //Free workflow:
  wkflManager.freeWorkflow(id);
  
  System.out.println();
  System.out.println(wkflManager.listWorkflows().length + " workflows remain");
  
    }

View Full Code Here

     * WorkflowManagerService to another WorkflowManager.  This imitates the
     * way in which a remote system would act as all messages pass through 
     * the service tunnel as XML.
     */
    protected static WorkflowManager createRemoteWorkflowManager(TaskProvider taskProvider) throws Exception {
        WorkflowManager localManager = createLocalWorkflowManager(taskProvider);
  
        File baseDir = new File("C:\\GRIDP_EXEC");
  SimpleJobFolderFactory jobFolderFactory = new SimpleJobFolderFactory(baseDir);
  
        WorkflowManagerServiceImpl webService = new WorkflowManagerServiceImpl(localManager, new BasicSerializerSet(), jobFolderFactory);

View Full Code Here

        try {
            
            //parse input:
            Element rootElem = xmlUtil.parseXML(xml).getRootElement();
            
            WorkflowManager wkflManager = getWorkflowManager();
            
            Map config = new HashMap();
            config.put("TASK_INFO_MANAGER", wkflManager);
            config.put("WORKFLOW_MANAGER", wkflManager);
            config.put("WORKFLOW_MANAGER_SERVICE", this);
            config.put("WORKING_DIRECTORY", workDir);
                   
            WorkflowSubmissionSerializer wkflSerializer = serializers
                .getWorkflowSerializerSet(wkflManager)
                .getWorkflowSubmissionSerializer(config);
            
            WorkflowSubmission wkfl = wkflSerializer.readWorkflow(rootElem);
            wkfl.setContextParam("WORKING_DIRECTORY", workDir);


            List jobs = wkfl.getJobs();
            for (int i=0; i<jobs.size(); i++) {
          JobSubmission job = (JobSubmission)jobs.get(i);
          
          String jobId = "job_" + (i+1);
          File subWorkDir = new File(workDir, jobId);
          
          job.setContextParam("WORKING_DIRECTORY", subWorkDir);
            }
            
            //submit:
            String wkflId = wkflManager.submitWorkflow(wkfl);
            logger.debug("Workflow submitted: " + wkflId);
            
            RunningJobInfo jobInfo = new RunningJobInfo(wkflId, null, workDir);
            jobInfoManager.storeJobInfo(jobInfo);

View Full Code Here

  int jobIndex = Integer.parseInt(req.getParameter("JOB_INDEX"));
  
  //process:
  try {
      
      WorkflowManager wkflManager = getWorkflowManager();
      WorkflowInfo wkflInfo = wkflManager.getWorkflowInfo(wkflId);
      String taskId = wkflInfo.getJobInfo(jobIndex).getTaskId();
      
      RunningJobInfo jobInfo = jobInfoManager.getJobInfo(wkflId);
                 
            //create serializer config:
            Map config = new HashMap();
            
            config.putAll(req.getParameters());  //do first (so user can't overwrite following params)
            
            config.put("WORKFLOW_MANAGER", wkflManager);
            config.put("WORKFLOW_MANAGER_SERVICE", this);
            config.put("WORKFLOW_ID", req.getJobId());
            config.put("WORKFLOW_ID", wkflId);
            config.put("WORKING_DIRECTORY", jobInfo.getWorkingDirectory());  //TODO: this is wrong
            
            
            JDOMSerializer paramSerializer = serializers
              .getWorkflowSerializerSet(wkflManager)
              .getOutputParameterSerializer(jobIndex, taskId, config);
            
            //serialize:
            Map outputs = wkflManager.getWorkflowOutputs(wkflId, jobIndex);
            
            Element elem = new Element("outputs");
            paramSerializer.write(outputs, elem);
            return xmlUtil.writeXML(elem);
        }

View Full Code Here

TOP

Related Classes of gri.tasks.managers.workflows.WorkflowManager

gri.tasks.remote.client.test

gri.tasks.remote.server.AbstractWorkflowManagerService

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.