Examples of com.sleepycat.je.util.DbBackup

com.sleepycat.je.util.DbBackup
onal: Do a checkpoint to reduce recovery time after a restore. env.checkpoint(new CheckpointConfig().setForce(true)); // Start backup, find out what needs to be copied. backupHelper.startBackup(); try { // Copy the necessary files to archival storage. String[] filesForBackup = backupHelper.getLogFilesInBackupSet(); myCopyFiles(env, filesForBackup, destDir); } finally { // Remember to exit backup mode, or the JE cleaner cannot delete // log files and disk usage will grow without bounds. backupHelper.endBackup(); } } void myCopyFiles(Environment env, String[] filesForBackup, File destDir) { // See {@link LogVerificationInputStream}} When copying files to the backup directory, it is critical that each file is verified before or during the copy. If a file is copied that is corrupt (due to an earlier disk failure that went unnoticed, for example), the backup will be invalid and provide a false sense of security.
The {@link LogVerificationInputStream example here} shows how to implementthe {@code myCopyFiles} method using {@link LogVerificationInputStream}. A filter input stream is used to verify the file efficiently as it is being read. If you choose to use a script for copying files, the {@link DbVerifyLog} command line tool can be usedinstead.
Assuming that the full backup copied files into an empty directory, to restore you can simply copy these files back into another empty directory.
Always start with an empty directory as the destination for a full backup or a restore, to ensure that no unused files are present. Unused files -- perhaps the residual of an earlier environment or an earlier backup -- will take up space, and they will never be deleted by the JE log cleaner. Also note that such files will not be used by JE for calculating utilization and will not appear in the {@link DbSpace} output.
Performing incremental backups
Incremental backups are used to reduce the number of files copied during each backup. Compared to a full backup, there are two additional pieces of information needed for an incremental backup: the number of the last file in the previous backup, and a list of the files in the environment directory at the time of the current backup. Their purpose is explained below.
The number of the last file in the previous backup is used to avoid copying files that are already present in the backup set. This file number must be obtained before beginning the backup, either by checking the backup archive, or getting this value from a stored location. For example, the last file number could be written to a special file in the backup set at the time of a backup, and then read from the special file before starting the next backup.
The list of current files in the environment, which should be obtained after calling {@link #startBackup}, is used to avoid unused files after a restore, and may also be used to reduce the size of the backup set. How to use this list is described below.
Some applications need the ability to restore to the point in time of any of the incremental backups that were made in the past, and other applications only need to restore to the point in time of the most recent backup. Accordingly, the list of current files (that is made at the time of the backup), should be used in one of two ways.
1. If you need to keep all log files from each backup so you can restore to more than one point in time, then the list for each backup should be saved with the backup file set so it can be used during a restore. During the restore, only the files in the list should be copied, starting with an empty destination directory. This ensures that unused files will not be restored.
2. If you only need to restore to the point in time of the most recent backup, then the list should be used to delete unused files from the backup set. After copying all files during the backup, any file that is not present in the list may then be deleted from the backup set. This both reduces the size of the backup set, and ensures that unused files will not be present in the backup set and therefore will not be restored.
The following two examples shows how to perform an incremental backup. In the first example, the list of current files is used to delete files from the backup set that are no longer needed.
```
 void myBackup(Environment env, File destDir) { DbBackup backupHelper = new DbBackup(env); // Get the file number of the last file in the previous backup. long lastFileInPrevBackup =  ... // Optional: Do a checkpoint to reduce recovery time after a restore. env.checkpoint(new CheckpointConfig().setForce(true)); // Start backup, find out what needs to be copied. backupHelper.startBackup(); try { // Copy the necessary files to archival storage. String[] filesForBackup = backupHelper.getLogFilesInBackupSet(lastFileInPrevBackup); myCopyFiles(env, filesForBackup, destDir); // Delete files that are no longer needed. // WARNING: This should only be done after copying all new files. String[] filesAtBackupTime = myGetCurrentFiles(env); myDeleteUnusedFiles(destDir, filesAtBackupTime); // Optional: Update knowledge of last file saved in the backup set. lastFileInPrevBackup = backupHelper.getLastFileInBackupSet(); // Save lastFileInPrevBackup persistently here ... } finally { // Remember to exit backup mode, or the JE cleaner cannot delete // log files and disk usage will grow without bounds. backupHelper.endBackup(); } } String[] myGetCurrentFiles(Environment env) { // If multiple data directories are used, this will need to be changed // to return all files for all data directories. return env.getHome().list(); } void myDeleteUnusedFiles(File destDir, String[] filesAtBackupTime) { // For each file in destDir that is NOT in filesAtBackupTime, it should // be deleted from destDir to save disk space in the backup set, and to // ensure that unused files will not be restored. } void myCopyFiles(Environment env, String[] filesForBackup, File destDir) { // See  {@link LogVerificationInputStream}} 
```
When performing backups as shown in the first example above, to restore you can simply copy all files from the backup set into an empty directory.
In the second example below, the list of current files is saved with the backup set so it can be used during a restore. The backup set will effectively hold multiple backups that can be used to restore to different points in time.
```
 void myBackup(Environment env, File destDir) { DbBackup backupHelper = new DbBackup(env); // Get the file number of the last file in the previous backup. long lastFileInPrevBackup =  ... // Optional: Do a checkpoint to reduce recovery time after a restore. env.checkpoint(new CheckpointConfig().setForce(true)); // Start backup, find out what needs to be copied. backupHelper.startBackup(); try { // Copy the necessary files to archival storage. String[] filesForBackup = backupHelper.getLogFilesInBackupSet(lastFileInPrevBackup); myCopyFiles(env, filesForBackup, destDir); // Save current list of files with backup data set. String[] filesAtBackupTime = myGetCurrentFiles(env); // Save filesAtBackupTime persistently here ... // Optional: Update knowledge of last file saved in the backup set. lastFileInPrevBackup = backupHelper.getLastFileInBackupSet(); // Save lastFileInPrevBackup persistently here ... } finally { // Remember to exit backup mode, or the JE cleaner cannot delete // log files and disk usage will grow without bounds. backupHelper.endBackup(); } } String[] myGetCurrentFiles(Environment env) { // If multiple data directories are used, this will need to be changed // to return all files for all data directories. return env.getHome().list(); } void myCopyFiles(Environment env, String[] filesForBackup, File destDir) { // See  {@link LogVerificationInputStream}} 
```
When performing backups as shown in the example above, to restore you must choose one of the file lists that was saved. You may choose the list written by the most recent backup, or a list written by an earlier backup. To restore, the files in the list should be copied into an empty destination directory.

        Long lastFileInPrevBackup = determineLastFile(backupDir, status);


        try {


            if(lastFileInPrevBackup == null) {
                backupHelper = new DbBackup(env);
            } else {
                backupHelper = new DbBackup(env, lastFileInPrevBackup);
            }


            // Start backup, find out what needs to be copied.
            System.out.println("Native backup started at " + new Date().toString());
            backupHelper.startBackup();

View Full Code Here


        /* Wait for the request message. */
        protocol.read(namedChannel.getChannel(), Protocol.FileListReq.class);


        if (dbBackup == null) {
            dbBackup = new DbBackup(feederManager.getEnvImpl());
            dbBackup.startBackup();
        } else {
            feederManager.leaseRenewalCount++;
        }

View Full Code Here

                return null;
            }
            cancel();
            Lease l = leases.remove(id);
            assert(l == this);
            DbBackup saveDbBackup = dbBackup;
            dbBackup = null;
            return saveDbBackup;
        }

View Full Code Here

     *
     * @throws DatabaseException Any underlying execeptions from BDB are allowed to fall through.
     */
    public void takeBackup(String fromdir, String todir, Environment environment) throws DatabaseException
    {
        DbBackup backupHelper = null;


        try
        {
            backupHelper = new DbBackup(environment);


            // Prevent BDB from writing to its log files while the backup it taken.
            backupHelper.startBackup();


            // Back up the BDB log files to the destination directory.
            String[] filesForBackup = backupHelper.getLogFilesInBackupSet();


            for (int i = 0; i < filesForBackup.length; i++)
            {
                File sourceFile = new File(fromdir + File.separator + filesForBackup[i]);
                File destFile = new File(todir + File.separator + filesForBackup[i]);
                FileUtils.copy(sourceFile, destFile);
            }
        }
        finally
        {
            // Remember to exit backup mode, or all log files won't be cleaned and disk usage will bloat.
            if (backupHelper != null)
            {
                backupHelper.endBackup();
            }
        }
    }

View Full Code Here

     *
     * @throws DatabaseException Any underlying execeptions from BDB are allowed to fall through.
     */
    public void takeBackup(String fromdir, String todir, Environment environment) throws DatabaseException
    {
        DbBackup backupHelper = null;


        try
        {
            backupHelper = new DbBackup(environment);


            // Prevent BDB from writing to its log files while the backup it taken.
            backupHelper.startBackup();


            // Back up the BDB log files to the destination directory.
            String[] filesForBackup = backupHelper.getLogFilesInBackupSet();


            for (int i = 0; i < filesForBackup.length; i++)
            {
                File sourceFile = new File(fromdir + File.separator + filesForBackup[i]);
                File destFile = new File(todir + File.separator + filesForBackup[i]);
                FileUtils.copy(sourceFile, destFile);
            }
        }
        finally
        {
            // Remember to exit backup mode, or all log files won't be cleaned and disk usage will bloat.
            if (backupHelper != null)
            {
                backupHelper.endBackup();
            }
        }
    }

View Full Code Here

     *
     * @throws DatabaseException Any underlying execeptions from BDB are allowed to fall through.
     */
    public void takeBackup(String fromdir, String todir, Environment environment) throws DatabaseException
    {
        DbBackup backupHelper = null;


        try
        {
            backupHelper = new DbBackup(environment);


            // Prevent BDB from writing to its log files while the backup it taken.
            backupHelper.startBackup();


            // Back up the BDB log files to the destination directory.
            String[] filesForBackup = backupHelper.getLogFilesInBackupSet();


            for (int i = 0; i < filesForBackup.length; i++)
            {
                File sourceFile = new File(fromdir + File.separator + filesForBackup[i]);
                File destFile = new File(todir + File.separator + filesForBackup[i]);
                FileUtils.copy(sourceFile, destFile);
            }
        }
        finally
        {
            // Remember to exit backup mode, or all log files won't be cleaned and disk usage will bloat.
            if (backupHelper != null)
            {
                backupHelper.endBackup();
            }
        }
    }

View Full Code Here

     *
     * @throws DatabaseException Any underlying execeptions from BDB are allowed to fall through.
     */
    public void takeBackup(String fromdir, String todir, Environment environment) throws DatabaseException
    {
        DbBackup backupHelper = null;


        try
        {
            backupHelper = new DbBackup(environment);


            // Prevent BDB from writing to its log files while the backup it taken.
            backupHelper.startBackup();


            // Back up the BDB log files to the destination directory.
            String[] filesForBackup = backupHelper.getLogFilesInBackupSet();


            for (int i = 0; i < filesForBackup.length; i++)
            {
                File sourceFile = new File(fromdir + File.separator + filesForBackup[i]);
                File destFile = new File(todir + File.separator + filesForBackup[i]);
                FileUtils.copy(sourceFile, destFile);
            }
        }
        finally
        {
            // Remember to exit backup mode, or all log files won't be cleaned and disk usage will bloat.
            if (backupHelper != null)
            {
                backupHelper.endBackup();
            }
        }
    }

View Full Code Here


        /* Wait for the request message. */
        protocol.read(namedChannel.getChannel(), Protocol.FileListReq.class);


        if (dbBackup == null) {
            dbBackup = new DbBackup(feederManager.getEnvImpl());
            dbBackup.startBackup();
        } else {
            feederManager.leaseRenewalCount++;
        }
        String[] files = dbBackup.getLogFilesInBackupSet();

View Full Code Here

                return null;
            }
            cancel();
            Lease l = leases.remove(id);
            assert(l == this);
            DbBackup saveDbBackup = dbBackup;
            dbBackup = null;
            return saveDbBackup;
        }

View Full Code Here

        org.archive.util.FileUtils.ensureWriteableDirectory(f);
        this.bdbEnvironment = new EnhancedEnvironment(f, config);
        this.classCatalog = this.bdbEnvironment.getClassCatalog();
        if(!create) {
            // freeze last log file -- so that originating checkpoint isn't fouled
            DbBackup dbBackup = new DbBackup(bdbEnvironment);
            dbBackup.startBackup();
            dbBackup.endBackup();
        }
    }

View Full Code Here

0 1

TOP

Related Classes of com.sleepycat.je.util.DbBackup

com.sleepycat.je.log.FileManager

com.sleepycat.je.rep.impl.networkRestore.FeederManager$Lease

com.sleepycat.je.rep.impl.networkRestore.LogFileFeeder

org.apache.qpid.server.store.berkeleydb.BDBBackup

org.archive.bdb.BdbModule

voldemort.store.bdb.BdbNativeBackup

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.