Examples of org.apache.hadoop.hbase.snapshot.CopyRecoveredEditsTask

Package org.apache.hadoop.hbase.snapshot

Examples of org.apache.hadoop.hbase.snapshot.CopyRecoveredEditsTask

org.apache.hadoop.hbase.snapshot.CopyRecoveredEditsTask
Copy over each of the files in a region's recovered.edits directory to the region's snapshot directory.
This is a serial operation over each of the files in the recovered.edits directory and also streams all the bytes to the client and then back to the filesystem, so the files being copied should be small or it will (a) suck up a lot of bandwidth, and (b) take a long time.

        // check for error for each region
        monitor.rethrowException();


        // 2.2 for each region, copy over its recovered.edits directory
        Path regionDir = HRegion.getRegionDir(rootDir, regionInfo);
        new CopyRecoveredEditsTask(snapshot, monitor, fs, regionDir, snapshotRegionDir).call();
        monitor.rethrowException();


        // 2.3 reference all the files in the region
        new ReferenceRegionHFilesTask(snapshot, monitor, regionDir, fs, snapshotRegionDir).call();
        monitor.rethrowException();

View Full Code Here

    // check for error for each region
    monitor.rethrowException();


    // 2 for each region, copy over its recovered.edits directory
    Path regionDir = HRegion.getRegionDir(rootDir, regionInfo);
    new CopyRecoveredEditsTask(snapshot, monitor, fs, regionDir, snapshotRegionDir).call();
    monitor.rethrowException();
    status.setStatus("Completed copying recovered edits for offline snapshot of table: "
        + snapshot.getTable());


    // 3 reference all the files in the region

View Full Code Here

    monitor.rethrowException();


    // 2 for each region, copy over its recovered.edits directory
    Path regionDir = HRegion.getRegionDir(rootDir, regionInfo);
    Path snapshotRegionDir = regionFs.getRegionDir();
    new CopyRecoveredEditsTask(snapshot, monitor, fs, regionDir, snapshotRegionDir).call();
    monitor.rethrowException();
    status.setStatus("Completed copying recovered edits for offline snapshot of table: "
        + snapshotTable);


    // 2 reference all the files in the region

View Full Code Here

        monitor.rethrowException();


        // 2.2 for each region, copy over its recovered.edits directory
        Path regionDir = HRegion.getRegionDir(rootDir, regionInfo);
        Path snapshotRegionDir = regionFs.getRegionDir();
        new CopyRecoveredEditsTask(snapshot, monitor, fs, regionDir, snapshotRegionDir).call();
        monitor.rethrowException();
        status.setStatus("Completed copying recovered edits for offline snapshot of table: "
            + snapshotTable);


        // 2.3 reference all the files in the region

View Full Code Here

        monitor.rethrowException();


        // 2.2 for each region, copy over its recovered.edits directory
        Path regionDir = HRegion.getRegionDir(rootDir, regionInfo);
        Path snapshotRegionDir = regionFs.getRegionDir();
        new CopyRecoveredEditsTask(snapshot, monitor, fs, regionDir, snapshotRegionDir).call();
        monitor.rethrowException();


        // 2.3 reference all the files in the region
        new ReferenceRegionHFilesTask(snapshot, monitor, regionDir, fs, snapshotRegionDir).call();
        monitor.rethrowException();

View Full Code Here

        // check for error for each region
        monitor.rethrowException();


        // 2.2 for each region, copy over its recovered.edits directory
        Path regionDir = HRegion.getRegionDir(rootDir, regionInfo);
        new CopyRecoveredEditsTask(snapshot, monitor, fs, regionDir, snapshotRegionDir).call();
        monitor.rethrowException();
        status.setStatus("Completed copying recovered edits for offline snapshot of table: "
            + snapshot.getTable());


        // 2.3 reference all the files in the region

View Full Code Here

      out.close();
      // make an empty file
      Path empty = new Path(edits, "empty");
      fs.createNewFile(empty);


      CopyRecoveredEditsTask task = new CopyRecoveredEditsTask(snapshot, monitor, fs, regionDir,
          snapshotRegionDir);
      CopyRecoveredEditsTask taskSpy = Mockito.spy(task);
      taskSpy.call();


      Path snapshotEdits = HLogUtil.getRegionDirRecoveredEditsDir(snapshotRegionDir);
      FileStatus[] snapshotEditFiles = FSUtils.listStatus(fs, snapshotEdits);
      assertEquals("Got wrong number of files in the snapshot edits", 1, snapshotEditFiles.length);
      FileStatus file = snapshotEditFiles[0];

View Full Code Here

      Path snapshotRegionDir = new Path(workingDir, regionName);
      fs.mkdirs(snapshotRegionDir);
      Path regionEdits = HLogUtil.getRegionDirRecoveredEditsDir(regionDir);
      assertFalse("Edits dir exists already - it shouldn't", fs.exists(regionEdits));


      CopyRecoveredEditsTask task = new CopyRecoveredEditsTask(snapshot, monitor, fs, regionDir,
          snapshotRegionDir);
      task.call();
    } finally {
      // cleanup the working directory
      FSUtils.delete(fs, regionDir, true);
      FSUtils.delete(fs, workingDir, true);
    }

View Full Code Here

    monitor.rethrowException();


    // 2 for each region, copy over its recovered.edits directory
    Path regionDir = HRegion.getRegionDir(rootDir, regionInfo);
    Path snapshotRegionDir = regionFs.getRegionDir();
    new CopyRecoveredEditsTask(snapshot, monitor, fs, regionDir, snapshotRegionDir).call();
    monitor.rethrowException();
    status.setStatus("Completed copying recovered edits for offline snapshot of table: "
        + snapshotTable);


    // 2 reference all the files in the region

View Full Code Here

        // check for error for each region
        monitor.rethrowException();


        // 2.2 for each region, copy over its recovered.edits directory
        Path regionDir = HRegion.getRegionDir(rootDir, regionInfo);
        new CopyRecoveredEditsTask(snapshot, monitor, fs, regionDir, snapshotRegionDir).call();
        monitor.rethrowException();
        status.setStatus("Completed copying recovered edits for offline snapshot of table: "
            + snapshot.getTable());


        // 2.3 reference all the files in the region

View Full Code Here

TOP

Related Classes of org.apache.hadoop.hbase.snapshot.CopyRecoveredEditsTask

org.apache.hadoop.fs.FileStatus

org.apache.hadoop.fs.Path

org.apache.hadoop.hbase.master.snapshot.DisabledTableSnapshotHandler

org.apache.hadoop.hbase.master.snapshot.TakeSnapshotHandler

org.apache.hadoop.hbase.snapshot.TestCopyRecoveredEditsTask

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.