List of rollWriter() Examples

Examples of rollWriter()

org.apache.hadoop.hbase.regionserver.wal.HLog.rollWriter()
Roll the log writer. That is, start writing log messages to a new file. Because a log cannot be rolled during a cache flush, and a cache flush spans two method calls, a special lock needs to be obtained so that a cache flush cannot start when the log is being rolled and the log cannot be rolled during a cache flush.
Note that this method cannot be synchronized because it is possible that startCacheFlush runs, obtaining the cacheFlushLock, then this method could start which would obtain the lock on this but block on obtaining the cacheFlushLock and then completeCacheFlush could be called which would wait for the lock on this and consequently never release the cacheFlushLock @return If lots of logs, flush the returned regions so next time throughwe can clean logs. Returns null if nothing to flush. Names are actual region names as returned by {@link HRegionInfo#getEncodedName()} @throws org.apache.hadoop.hbase.regionserver.wal.FailedLogCloseException @throws IOException

Examples of org.apache.hadoop.hbase.regionserver.wal.HLog.rollWriter()

  }


  @Override
  public byte[][] rollHLogWriter() throws IOException, FailedLogCloseException {
    HLog wal = this.getWAL();
    return wal.rollWriter(true);
  }


  /**
   * Gets the online regions of the specified table.
   * This method looks at the in-memory onlineRegions.  It does not go to <code>.META.</code>.

View Full Code Here

Examples of org.apache.hadoop.hbase.regionserver.wal.HLog.rollWriter()

  }


  @Override
  public byte[][] rollHLogWriter() throws IOException, FailedLogCloseException {
    HLog wal = this.getWAL();
    return wal.rollWriter(true);
  }


  /**
   * Gets the online regions of the specified table.
   * This method looks at the in-memory onlineRegions.  It does not go to <code>.META.</code>.

View Full Code Here

Examples of org.apache.hadoop.hbase.regionserver.wal.HLog.rollWriter()

  }


  @Override
  public byte[][] rollHLogWriter() throws IOException, FailedLogCloseException {
    HLog wal = this.getWAL();
    return wal.rollWriter(true);
  }


  /**
   * Gets the online regions of the specified table.
   * This method looks at the in-memory onlineRegions.  It does not go to <code>.META.</code>.

View Full Code Here

Examples of org.apache.hadoop.hbase.regionserver.wal.HLog.rollWriter()

    try {
      checkOpen();
      requestCount.increment();
      regionServer.getRegionServerCoprocessorHost().preRollWALWriterRequest();
      HLog wal = regionServer.getWAL();
      byte[][] regionsToFlush = wal.rollWriter(true);
      RollWALWriterResponse.Builder builder = RollWALWriterResponse.newBuilder();
      if (regionsToFlush != null) {
        for (byte[] region: regionsToFlush) {
          builder.addRegionToFlush(ByteStringer.wrap(region));
        }

View Full Code Here

Examples of org.apache.hadoop.hbase.regionserver.wal.HLog.rollWriter()

    HTableDescriptor htd = new HTableDescriptor();
    htd.addFamily(new HColumnDescriptor(f1));
    // Testing normal log rolling every 20
    for(long i = 1; i < 101; i++) {
      if(i > 1 && i % 20 == 0) {
        hlog.rollWriter();
      }
      LOG.info(i);
      HLogKey key = new HLogKey(hri.getRegionName(), test, seq++,
          System.currentTimeMillis(), HConstants.DEFAULT_CLUSTER_ID);
      hlog.append(hri, test, edit, System.currentTimeMillis(), htd, sequenceId);

View Full Code Here

Examples of org.apache.hadoop.hbase.regionserver.wal.HLog.rollWriter()

      hlog.append(hri, test, edit, System.currentTimeMillis(), htd, sequenceId);
    }


    assertEquals(6, manager.getHLogs().get(slaveId).size());


    hlog.rollWriter();


    manager.logPositionAndCleanOldLogs(manager.getSources().get(0).getCurrentPath(),
        "1", 0, false, false);


    hlog.append(hri, test, edit, System.currentTimeMillis(), htd, sequenceId);

View Full Code Here

Examples of org.apache.hadoop.hbase.regionserver.wal.HLog.rollWriter()

    d.deleteColumns(FAMILY, COLUMN1);
    t1.delete(d);


    // replay the WAL, map table 1 to table 2
    HLog log = cluster.getRegionServer(0).getWAL();
    log.rollWriter();
    String walInputDir = new Path(cluster.getMaster().getMasterFileSystem()
        .getRootDir(), HConstants.HREGION_LOGDIR_NAME).toString();


    Configuration configuration= TEST_UTIL.getConfiguration();
    WALPlayer player = new WALPlayer(configuration);

View Full Code Here

Examples of org.apache.hadoop.hbase.regionserver.wal.HLog.rollWriter()

    log.append(info, tableName, edit, ts, htd, sequenceId);
    edit = new WALEdit();
    edit.add(new KeyValue(rowName, family, Bytes.toBytes("2"), ts+1, value));
    log.append(info, tableName, edit, ts+1, htd, sequenceId);
    LOG.info("Before 1st WAL roll " + log.getFilenum());
    log.rollWriter();
    LOG.info("Past 1st WAL roll " + log.getFilenum());


    Thread.sleep(1);
    long ts1 = System.currentTimeMillis();

View Full Code Here

Examples of org.apache.hadoop.hbase.regionserver.wal.HLog.rollWriter()

    log.append(info, tableName, edit,
      System.currentTimeMillis(), htd, sequenceId);


    Thread.sleep(1); // make sure 2nd log gets a later timestamp
    long secondTs = System.currentTimeMillis();
    log.rollWriter();


    edit = new WALEdit();
    edit.add(new KeyValue(rowName, family, Bytes.toBytes("2"),
        System.currentTimeMillis(), value));
    log.append(info, tableName, edit,

View Full Code Here

Examples of org.apache.hadoop.hbase.regionserver.wal.HLog.rollWriter()

      final RollWALWriterRequest request) throws ServiceException {
    try {
      checkOpen();
      requestCount.increment();
      HLog wal = this.getWAL();
      byte[][] regionsToFlush = wal.rollWriter(true);
      RollWALWriterResponse.Builder builder = RollWALWriterResponse.newBuilder();
      if (regionsToFlush != null) {
        for (byte[] region: regionsToFlush) {
          builder.addRegionToFlush(ByteStringer.wrap(region));
        }

View Full Code Here

0 1 2 3 4 5

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.