List of computeStorageMetric() Examples

Examples of computeStorageMetric()

org.apache.falcon.latedata.LateDataHandler.computeStorageMetric()
This method computes the storage metrics for a given feed's instance or partition. It uses size on disk as the metric for File System Storage. It uses create time as the metric for Catalog Table Storage. The assumption is that if a partition has changed or reinstated, the underlying metric would change, either size or create time. @param feedUriTemplate URI for the feed storage, filesystem path or table uri @param feedStorageType feed storage type @param conf configuration @return computed metric @throws IOException @throws FalconException @throws URISyntaxException

Examples of org.apache.falcon.latedata.LateDataHandler.computeStorageMetric()

                lateFeed.add(li.getInput());
            }


            for (int index = 0; index < pathGroups.length; index++) {
                if (lateFeed.contains(inputFeeds[index])) {
                    long computedMetric = late.computeStorageMetric(
                            pathGroups[index], inputFeedStorageTypes[index], conf);
                    computedMetrics.put(inputFeeds[index], computedMetric);
                }
            }
        } else {

View Full Code Here

Examples of org.apache.falcon.latedata.LateDataHandler.computeStorageMetric()

            long size = Long.parseLong(line.substring(index + 1));
            recordedMetrics.put(key, size);
        }


        LateDataHandler lateDataHandler = new LateDataHandler();
        final long metric = lateDataHandler.computeStorageMetric(args[3], args[7], new Configuration());
        Assert.assertEquals(recordedMetrics.get("foo").longValue(), metric);


        final String changes = lateDataHandler.detectChanges(lateDataPath, recordedMetrics, new Configuration());
        Assert.assertEquals("", changes);
    }

View Full Code Here

Examples of org.apache.falcon.latedata.LateDataHandler.computeStorageMetric()

        }


        reinstatePartition();


        LateDataHandler lateDataHandler = new LateDataHandler();
        long metric = lateDataHandler.computeStorageMetric(args[3], args[7], new Configuration());
        Assert.assertFalse(recordedMetrics.get("foo") == metric);


        Map<String, Long> computedMetrics = new LinkedHashMap<String, Long>();
        computedMetrics.put("foo", metric);

View Full Code Here

Examples of org.apache.falcon.latedata.LateDataHandler.computeStorageMetric()

            long size = Long.parseLong(line.substring(index + 1));
            recordedMetrics.put(key, size);
        }


        LateDataHandler lateDataHandler = new LateDataHandler();
        final long metric = lateDataHandler.computeStorageMetric(args[3], args[7], new Configuration());
        Assert.assertEquals(recordedMetrics.get("foo").longValue(), metric);


        final String changes = lateDataHandler.detectChanges(lateDataPath, recordedMetrics, new Configuration());
        Assert.assertEquals("", changes);
    }

View Full Code Here

Examples of org.apache.falcon.latedata.LateDataHandler.computeStorageMetric()

        }


        reinstatePartition();


        LateDataHandler lateDataHandler = new LateDataHandler();
        long metric = lateDataHandler.computeStorageMetric(args[3], args[7], new Configuration());
        Assert.assertFalse(recordedMetrics.get("foo") == metric);


        Map<String, Long> computedMetrics = new LinkedHashMap<String, Long>();
        computedMetrics.put("foo", metric);

View Full Code Here

Examples of org.apache.falcon.latedata.LateDataHandler.computeStorageMetric()

                lateFeed.add(li.getInput());
            }


            for (int index = 0; index < pathGroups.length; index++) {
                if (lateFeed.contains(inputFeeds[index])) {
                    long computedMetric = late.computeStorageMetric(
                            pathGroups[index], inputFeedStorageTypes[index], conf);
                    computedMetrics.put(inputFeeds[index], computedMetric);
                }
            }
        } else {

View Full Code Here

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.