Examples of org.apache.mahout.classifier.sgd.ModelDissector$Category

Package org.apache.mahout.classifier.sgd

Examples of org.apache.mahout.classifier.sgd.ModelDissector$Category

org.wso2.maven.p2.Category
Uses sample data to reverse engineer a feature-hashed model. The result gives approximate weights for features and interactions in the original space. The idea is that the hashed encoders have the option of having a trace dictionary. This tells us where each feature is hashed to, or each feature/value combination in the case of word-like values. Using this dictionary, we can put values into a synthetic feature vector in just the locations specified by a single feature or interaction. Then we can push this through a linear part of a model to see the contribution of that input. For any generalized linear model like logistic regression, there is a linear part of the model that allows this. What the ModelDissector does is to accept a trace dictionary and a model in an update method. It figures out the weights for the elements in the trace dictionary and stashes them. Then in a summary method, the biggest weights are returned. This update/flush style is used so that the trace dictionary doesn't have to grow to enormous levels, but instead can be cleared between updates.


    public void test_0() throws Exception {
        ByteArrayOutputStream out = new ByteArrayOutputStream();
        ObjectOutputStream objectOut = new ObjectOutputStream(out);


        Category p = new Category();
        p.setId(1);
        p.setName("root");
        {
            Category child = new Category();
            child.setId(2);
            child.setName("child");
            p.getChildren().add(child);
            child.setParent(p);
        }
        objectOut.writeObject(p);
    }

View Full Code Here

    private Object object;


    public CategoryEncode(){
        super("CategoryEncode");


        Category category = new Category();
        category.setId(1);
        category.setName("root");
        {
            Category child = new Category();
            child.setId(2);
            child.setName("child");
            category.getChildren().add(child);
            child.setParent(category);
        }


        object = category;
    }

View Full Code Here

                              Iterable<File> files) throws IOException {
    CrossFoldLearner model = learningAlgorithm.getBest().getPayload().getLearner();
    model.close();


    Map<String, Set<Integer>> traceDictionary = Maps.newTreeMap();
    ModelDissector md = new ModelDissector();


    encoder.setTraceDictionary(traceDictionary);
    bias.setTraceDictionary(traceDictionary);


    for (File file : permute(files, rand).subList(0, 500)) {
      traceDictionary.clear();
      Vector v = encodeFeatureVector(file);
      md.update(v, traceDictionary, model);
    }


    List<String> ngNames = Lists.newArrayList(newsGroups.values());
    List<ModelDissector.Weight> weights = md.summary(100);
    for (ModelDissector.Weight w : weights) {
      System.out.printf("%s\t%.1f\t%s\t%.1f\t%s\t%.1f\t%s\n",
                        w.getFeature(), w.getWeight(), ngNames.get(w.getMaxImpact() + 1),
                        w.getCategory(1), w.getWeight(1), w.getCategory(2), w.getWeight(2));
    }

View Full Code Here

            if (result == null)
                result = defaultCase(theEObject);
            return result;
        }
        case Bpmn2Package.CATEGORY: {
            Category category = (Category) theEObject;
            T result = caseCategory(category);
            if (result == null)
                result = caseRootElement(category);
            if (result == null)
                result = caseBaseElement(category);

View Full Code Here

            doc.appendChild(rootElement);
        }


      for (Object object : categories) {
      if (object instanceof Category){
        Category cat=(Category)object;
        Element categoryDef = doc.createElement("category-def");
        categoryDef.setAttribute("name", cat.getId());
        categoryDef.setAttribute("label", cat.getLabel());
        rootElement.appendChild(categoryDef);
        Element descriptionElement = doc.createElement("description");
        descriptionElement.setTextContent(cat.getDescription());
        categoryDef.appendChild(descriptionElement);
        ArrayList processedFeatures = cat.getProcessedFeatures(project, artifactFactory, remoteRepositories, localRepository, resolver);
        for (Object obj : processedFeatures) {
          FeatureArtifact feature=(FeatureArtifact)obj;
          if (!featureCategories.containsKey(feature.getArtifactId())){
            ArrayList list = new ArrayList();
            featureCategories.put(feature.getArtifactId(), list);
            list.add(feature);
          }
          ArrayList list = (ArrayList)featureCategories.get(feature.getArtifactId());
          list.add(cat.getId());
        }
      }
    }
      
      for (Object key : featureCategories.keySet()) {

View Full Code Here

TOP

Related Classes of org.apache.mahout.classifier.sgd.ModelDissector$Category

com.alibaba.json.bvt.CircularReferenceTest

com.alibaba.json.test.benchmark.encode.CategoryEncode

com.salas.bb.utils.IdNameHolder

mia.classifier.ch16.train.TrainNewsGroups

org.apache.commons.lang.mutable.MutableInt

org.apache.mahout.math.Vector

org.eclipse.bpmn2.util.Bpmn2Switch

org.wso2.maven.p2.generate.utils.P2Utils

java.util.ArrayList

java.util.Iterator

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.