Examples of JournalImpl

org.activeio.journal.active.JournalImpl
objectweb.org/">Howl project but tailored to the needs of ActiveMQ.
This Journal provides the following features:
- Conncurrent writes are batched into a single write/force done by a background thread.
- Uses preallocated logs to avoid disk fragmentation and performance degregation.
- The number and size of the preallocated logs are configurable.
- Uses direct ByteBuffers to write data to log files.
- Allows logs to grow in case of an overflow condition so that overflow exceptions are not not thrown. Grown logs that are inactivated (due to a new mark) are resized to thier original size.
- No limit on the size of the record written to the journal
- Should be possible to extend so that multiple physical disk are used concurrently to increase throughput and decrease latency.
@version $Revision: 1.1 $
org.apache.activeio.journal.active.JournalImpl
objectweb.org/">Howl project but tailored to the needs of ActiveMQ.
This Journal provides the following features:
- Concurrent writes are batched into a single write/force done by a background thread.
- Uses preallocated logs to avoid disk fragmentation and performance degregation.
- The number and size of the preallocated logs are configurable.
- Uses direct ByteBuffers to write data to log files.
- Allows logs to grow in case of an overflow condition so that overflow exceptions are not not thrown. Grown logs that are inactivate (due to a new mark) are resized to their original size.
- No limit on the size of the record written to the journal
- Should be possible to extend so that multiple physical disk are used concurrently to increase throughput and decrease latency.
@version $Revision: 1.1 $
org.codehaus.activemq.journal.impl.JournalImpl
objectweb.org/">Howl project but tailored to the needs of ActiveMQ.
This Journal provides the following features:
- Conncurrent writes are batched into a single write/force done by a background thread.
- Uses preallocated logs to avoid disk fragmentation and performance degregation.
- The number and size of the preallocated logs are configurable.
- Uses direct ByteBuffers to write data to log files.
- Allows logs to grow in case of an overflow condition so that overflow exceptions are not not thrown. Grown logs that are inactivated (due to a new mark) are resized to thier original size.
- No limit on the size of the record written to the journal
- Should be possible to extend so that multiple physical disk are used concurrently to increase throughput and decrease latency.
This class is a thing wrapper around a LogFileManager. It may be possible to extends this class so that it manages multiple LogFileManager objects to allow logging to multiple physical disks. @version $Revision: 1.3 $
org.hornetq.core.journal.impl.JournalImpl

A circular log implementation.
Look at {@link JournalImpl#load(LoaderCallback)} for the file layout @author Tim Fox @author Clebert Suconic

Examples of org.hornetq.core.journal.impl.JournalImpl

      SequentialFileFactory messagesFF = new NIOSequentialFileFactory(journalLocation, null);


      // Will use only default values. The load function should adapt to anything different
      ConfigurationImpl defaultValues = new ConfigurationImpl();


      JournalImpl messagesJournal = new JournalImpl(defaultValues.getJournalFileSize(),
                                                    defaultValues.getJournalMinFiles(),
                                                    0,
                                                    0,
                                                    messagesFF,
                                                    "hornetq-data",
                                                    "hq",
                                                    1);


      messagesJournal.start();


      ArrayList<RecordInfo> records = new ArrayList<RecordInfo>();
      ArrayList<PreparedTransactionInfo> txs = new ArrayList<PreparedTransactionInfo>();


      messagesJournal.load(records, txs, null, false);


      Map<Long, Set<PagePosition>> cursorRecords = new HashMap<Long, Set<PagePosition>>();
      
      Set<Long> pgTXs = new HashSet<Long>();

View Full Code Here

Examples of org.hornetq.core.journal.impl.JournalImpl


      journalDir = config.getJournalDirectory();


      SequentialFileFactory bindingsFF = new NIOSequentialFileFactory(bindingsDir, criticalErrorListener);


      Journal localBindings = new JournalImpl(1024 * 1024,
         2,
         config.getJournalCompactMinFiles(),
         config.getJournalCompactPercentage(),
         bindingsFF,
         "hornetq-bindings",
         "bindings",
         1);


      bindingsJournal = localBindings;
      originalBindingsJournal = localBindings;


      if (journalDir == null)
      {
         throw new NullPointerException("journal-dir is null");
      }


      createJournalDir = config.isCreateJournalDir();


      syncNonTransactional = config.isJournalSyncNonTransactional();


      syncTransactional = config.isJournalSyncTransactional();


      if (config.getJournalType() == JournalType.ASYNCIO)
      {
         HornetQServerLogger.LOGGER.journalUseAIO();


         journalFF = new AIOSequentialFileFactory(journalDir,
            config.getJournalBufferSize_AIO(),
            config.getJournalBufferTimeout_AIO(),
            config.isLogJournalWriteRate(),
            criticalErrorListener);
      }
      else if (config.getJournalType() == JournalType.NIO)
      {
         HornetQServerLogger.LOGGER.journalUseNIO();
         journalFF = new NIOSequentialFileFactory(journalDir,
            true,
            config.getJournalBufferSize_NIO(),
            config.getJournalBufferTimeout_NIO(),
            config.isLogJournalWriteRate(),
            criticalErrorListener);
      }
      else
      {
         throw HornetQMessageBundle.BUNDLE.invalidJournalType2(config.getJournalType());
      }


      idGenerator = new BatchingIDGenerator(0, JournalStorageManager.CHECKPOINT_BATCH_SIZE, this);


      Journal localMessage = new JournalImpl(config.getJournalFileSize(),
         config.getJournalMinFiles(),
         config.getJournalCompactMinFiles(),
         config.getJournalCompactPercentage(),
         journalFF,
         "hornetq-data",

View Full Code Here

Examples of org.hornetq.core.journal.impl.JournalImpl

   public static final void describeBindingsJournal(final String bindingsDir) throws Exception
   {


      SequentialFileFactory bindingsFF = new NIOSequentialFileFactory(bindingsDir, null);


      JournalImpl bindings = new JournalImpl(1024 * 1024, 2, -1, 0, bindingsFF, "hornetq-bindings", "bindings", 1);
      describeJournal(bindingsFF, bindings, bindingsDir);
   }

View Full Code Here

Examples of org.hornetq.core.journal.impl.JournalImpl

      SequentialFileFactory messagesFF = new NIOSequentialFileFactory(messagesDir, null);


      // Will use only default values. The load function should adapt to anything different
      ConfigurationImpl defaultValues = new ConfigurationImpl();


      JournalImpl messagesJournal = new JournalImpl(defaultValues.getJournalFileSize(),
         defaultValues.getJournalMinFiles(),
         0,
         0,
         messagesFF,
         "hornetq-data",

View Full Code Here

Examples of org.hornetq.core.journal.impl.JournalImpl

   public static final void describeBindingsJournal(final String bindingsDir) throws Exception
   {


      SequentialFileFactory bindingsFF = new NIOSequentialFileFactory(bindingsDir, null);


      JournalImpl bindings = new JournalImpl(1024 * 1024, 2, -1, 0, bindingsFF, "hornetq-bindings", "bindings", 1);
      describeJournal(bindingsFF, bindings, bindingsDir);
   }

View Full Code Here

Examples of org.hornetq.core.journal.impl.JournalImpl

      SequentialFileFactory messagesFF = new NIOSequentialFileFactory(messagesDir, null);


      // Will use only default values. The load function should adapt to anything different
      ConfigurationImpl defaultValues = new ConfigurationImpl();


      JournalImpl messagesJournal = new JournalImpl(defaultValues.getJournalFileSize(),
         defaultValues.getJournalMinFiles(),
         0,
         0,
         messagesFF,
         "hornetq-data",

View Full Code Here

Examples of org.hornetq.core.journal.impl.JournalImpl

      SequentialFileFactory messagesFF = new NIOSequentialFileFactory(journalLocation, null);


      // Will use only default values. The load function should adapt to anything different
      ConfigurationImpl defaultValues = new ConfigurationImpl();


      JournalImpl messagesJournal = new JournalImpl(defaultValues.getJournalFileSize(),
         defaultValues.getJournalMinFiles(),
         0,
         0,
         messagesFF,
         "hornetq-data",
         "hq",
         1);


      messagesJournal.start();


      ArrayList<RecordInfo> records = new ArrayList<RecordInfo>();
      ArrayList<PreparedTransactionInfo> txs = new ArrayList<PreparedTransactionInfo>();


      messagesJournal.load(records, txs, null, false);


      PageCursorsInfo cursorInfo = new PageCursorsInfo();




      for (RecordInfo record : records)

View Full Code Here

Examples of org.hornetq.core.journal.impl.JournalImpl

         session.close();
      }


      server.stop();


      JournalImpl journal = new JournalImpl(server.getConfiguration().getJournalFileSize(),
                                            2,
                                            0,
                                            0,
                                            new NIOSequentialFileFactory(server.getConfiguration()
                                                                               .getJournalDirectory()),
                                            "hornetq-data",
                                            "hq",
                                            1);


      final AtomicInteger updates = new AtomicInteger();


      journal.start();
      journal.load(new LoaderCallback()
      {


         public void failedTransaction(long transactionID, List<RecordInfo> records, List<RecordInfo> recordsToDelete)
         {
         }


         public void updateRecord(RecordInfo info)
         {
            if (info.userRecordType == JournalStorageManager.UPDATE_DELIVERY_COUNT)
            {
               updates.incrementAndGet();
            }
         }


         public void deleteRecord(long id)
         {
         }


         public void addRecord(RecordInfo info)
         {
         }


         public void addPreparedTransaction(PreparedTransactionInfo preparedTransaction)
         {
         }
      });


      journal.stop();


      assertEquals(7, updates.get());


   }

View Full Code Here

Examples of org.hornetq.core.journal.impl.JournalImpl


      ArrayList<RecordInfo> records = new ArrayList<RecordInfo>();


      List<PreparedTransactionInfo> list = new ArrayList<PreparedTransactionInfo>();


      JournalImpl jrn = new JournalImpl(config.getJournalFileSize(),
                                        2,
                                        0,
                                        0,
                                        new NIOSequentialFileFactory(getJournalDir()),
                                        "hornetq-data",
                                        "hq",
                                        1);
      jrn.start();
      jrn.load(records, list, null);


      // Delete everything from the journal
      for (RecordInfo info : records)
      {
         if (!info.isUpdate)
         {
            jrn.appendDeleteRecord(info.id, false);
         }
      }


      jrn.stop();


      server = createServer(true,
                            config,
                            PagingTest.PAGE_SIZE,
                            PagingTest.PAGE_MAX,

View Full Code Here

Examples of org.hornetq.core.journal.impl.JournalImpl


      createDir = config.isCreateBindingsDir();


      SequentialFileFactory bindingsJMS = new NIOSequentialFileFactory(journalDir);


      Journal localJMS = new JournalImpl(1024 * 1024,
                                         2,
                                         config.getJournalCompactMinFiles(),
                                         config.getJournalCompactPercentage(),
                                         bindingsJMS,
                                         "hornetq-jms",

View Full Code Here

0 1 2 3 4 5

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.