List of compactStores() Examples

Examples of compactStores()

org.apache.hadoop.hbase.HRegion.compactStores()
Compact all the stores. This should be called periodically to make sure the stores are kept manageable. This operation could block for a long time, so don't call it from a time-sensitive thread. If it returns TRUE, the compaction has completed. If it returns FALSE, the compaction was not carried out, because the HRegion is busy doing something else storage-intensive (like flushing the cache). The caller should check back later.
org.apache.hadoop.hbase.regionserver.HRegion.compactStores()
This is a helper function that compact all the stores synchronously It is used by utilities and testing @param majorCompaction True to force a major compaction regardless of thresholds @throws IOException e

Examples of org.apache.hadoop.hbase.regionserver.HRegion.compactStores()

    for (int i = 0; i < 3; i++) {
      addContent(region, fam3);
      region.flushcache();
    }


    region.compactStores();


    byte [] splitRow = region.checkSplit();


    assertNotNull(splitRow);
    HRegion [] regions = split(region, splitRow);

View Full Code Here

Examples of org.apache.hadoop.hbase.regionserver.HRegion.compactStores()

    assertEquals(expectedBlockMiss, cache.getStats().getMissCount());
    // compact, net minus two blocks, two hits, no misses
    System.out.println("Compacting");
    assertEquals(2, store.getStorefilesCount());
    store.triggerMajorCompaction();
    region.compactStores();
    waitForStoreFileCount(store, 1, 10000); // wait 10 seconds max
    assertEquals(1, store.getStorefilesCount());
    expectedBlockCount -= 2; // evicted two blocks, cached none
    assertEquals(expectedBlockCount, cache.getBlockCount());
    expectedBlockHits += 2;

View Full Code Here

Examples of org.apache.hadoop.hbase.regionserver.HRegion.compactStores()


    // Roll the log and compact table2, to have compaction record in the 2nd WAL.
    fshLog.rollWriter();
    assertEquals("Should have WAL; one table is not flushed", 1, fshLog.getNumLogFiles());
    admin.flush(table2.getTableName());
    region.compactStores();
    // Wait for compaction in case if flush triggered it before us.
    Assert.assertNotNull(s);
    for (int waitTime = 3000; s.getStorefilesCount() > 1 && waitTime > 0; waitTime -= 200) {
      Threads.sleepWithoutInterrupt(200);
    }

View Full Code Here

Examples of org.apache.hadoop.hbase.regionserver.HRegion.compactStores()

    assertEquals(expectedBlockMiss, cache.getStats().getMissCount());
    // compact, net minus two blocks, two hits, no misses
    System.out.println("Compacting");
    assertEquals(2, store.getNumberOfStoreFiles());
    store.triggerMajorCompaction();
    region.compactStores();
    waitForStoreFileCount(store, 1, 10000); // wait 10 seconds max
    assertEquals(1, store.getNumberOfStoreFiles());
    expectedBlockCount -= 2; // evicted two blocks, cached none
    assertEquals(expectedBlockCount, cache.getBlockCount());
    expectedBlockHits += 2;

View Full Code Here

Examples of org.apache.hadoop.hbase.regionserver.HRegion.compactStores()

    return this.rootRegion;
  }


  private HRegion openMetaRegion(HRegionInfo metaInfo) throws IOException {
    HRegion meta = HRegion.openHRegion(metaInfo, getLog(), this.conf);
    meta.compactStores();
    return meta;
  }


  /**
   * Set a single region on/offline.

View Full Code Here

Examples of org.apache.hadoop.hbase.regionserver.HRegion.compactStores()


    //verify correctness when memstore contains data
    doGets(region);


    //verify correctness again after compacting
    region.compactStores();
    doGets(region);




    Map<DataBlockEncoding, Integer> encodingCounts = cache.getEncodingCountsForTest();

View Full Code Here

Examples of org.apache.hadoop.hbase.regionserver.HRegion.compactStores()

    assertEquals(expectedBlockMiss, cache.getStats().getMissCount());
    // compact, net minus two blocks, two hits, no misses
    System.out.println("Compacting");
    assertEquals(2, store.getStorefilesCount());
    store.triggerMajorCompaction();
    region.compactStores();
    waitForStoreFileCount(store, 1, 10000); // wait 10 seconds max
    assertEquals(1, store.getStorefilesCount());
    expectedBlockCount -= 2; // evicted two blocks, cached none
    assertEquals(expectedBlockCount, cache.getBlockCount());
    expectedBlockHits += 2;

View Full Code Here

Examples of org.apache.hadoop.hbase.regionserver.HRegion.compactStores()

    for (int i = 0; i < 3; i++) {
      HBaseTestCase.addContent(region, fam3);
      region.flushcache();
    }


    region.compactStores();


    byte [] splitRow = region.checkSplit();


    assertNotNull(splitRow);
    HRegion [] regions = split(region, splitRow);

View Full Code Here

Examples of org.apache.hadoop.hbase.regionserver.HRegion.compactStores()

    for (int i = 0; i < 3; i++) {
      HBaseTestCase.addContent(region, fam3);
      region.flushcache();
    }


    region.compactStores();


    byte [] splitRow = region.checkSplit();


    assertNotNull(splitRow);
    HRegion [] regions = split(region, splitRow);

View Full Code Here

Examples of org.apache.hadoop.hbase.regionserver.HRegion.compactStores()

    }
    LruBlockCache blockCache =
        (LruBlockCache) new CacheConfig(conf).getBlockCache();
    blockCache.clearCache();
    assertEquals(0, blockCache.getBlockTypeCountsForTest().size());
    region.compactStores();
    LOG.debug("compactStores() returned");


    Map<BlockType, Integer> blockTypesInCache =
        blockCache.getBlockTypeCountsForTest();
    LOG.debug("Block types in cache: " + blockTypesInCache);

View Full Code Here

0 1 2 3 4 5

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.