Examples of GetRecordsRequest

com.amazonaws.services.kinesis.model.GetRecordsRequest
Container for the parameters to the {@link com.amazonaws.services.kinesis.AmazonKinesis#getRecords(GetRecordsRequest) GetRecords operation}.
This operation returns one or more data records from a shard. A GetRecords operation request can retrieve up to 10 MB of data.

You specify a shard iterator for the shard that you want to read data from in the ShardIterator parameter. The shard iterator specifies the position in the shard from which you want to start reading data records sequentially. A shard iterator specifies this position using the sequence number of a data record in the shard. For more information about the shard iterator, see GetShardIterator.

GetRecords may return a partial result if the response size limit is exceeded. You will get an error, but not a partial result if the shard's provisioned throughput is exceeded, the shard iterator has expired, or an internal processing failure has occurred. Clients can request a smaller amount of data by specifying a maximum number of returned records using the Limit parameter. The Limit parameter can be set to an integer value of up to 10,000. If you set the value to an integer greater than 10,000, you will receive InvalidArgumentException .

A new shard iterator is returned by every GetRecords request in NextShardIterator , which you use in the ShardIterator parameter of the next GetRecords request. When you repeatedly read from an Amazon Kinesis stream use a GetShardIterator request to get the first shard iterator to use in your first GetRecords request and then use the shard iterator returned in NextShardIterator for subsequent reads.

GetRecords can return null for the NextShardIterator to reflect that the shard has been closed and that the requested shard iterator would never have returned more data.

If no items can be processed because of insufficient provisioned throughput on the shard involved in the request, GetRecords throws ProvisionedThroughputExceededException .
@see com.amazonaws.services.kinesis.AmazonKinesis#getRecords(GetRecordsRequest)
org.fao.geonet.csw.common.requests.GetRecordsRequest
Params: - resultType (0..1) Can be 'hits', 'results', 'validate'. Default is 'hits' - outputFormat (0..1) Can be only 'application/xml' - namespace (0..1) Used for the GET request - outputSchema (0..1) Can be 'ogccore', 'profile'. Default is 'ogccore' - startPosition (0..1) Default is 1 - maxRecords (0..1) Default is 10 - TypeNames (1..1) A set of 'dataset', 'datasetcollection', 'service', 'application' - elementSetName (0..1) Can be 'brief', 'summary', 'full'. Default is 'summary' - constraintLanguage (1..1) Can be 'CQL_TEXT', 'FILTER'. Must be included when 'constraint' is specified - constraintLanguageVersion (1..1) Example '1.0.0' - constraint (0..1) Query to execute - distributedSearch (0..1) TRUE|FALSE - hopCount (0..1) default is 2

Examples of com.amazonaws.services.kinesis.model.GetRecordsRequest

     */
    @Override
    public GetRecordsResult get(String shardIterator, int maxRecords)
        throws ResourceNotFoundException, InvalidArgumentException, ExpiredIteratorException {


        final GetRecordsRequest getRecordsRequest = new GetRecordsRequest();
        getRecordsRequest.setRequestCredentials(credentialsProvider.getCredentials());
        getRecordsRequest.setShardIterator(shardIterator);
        getRecordsRequest.setLimit(maxRecords);
        final GetRecordsResult response = client.getRecords(getRecordsRequest);
        return response;


    }

View Full Code Here

Examples of com.amazonaws.services.kinesis.model.GetRecordsRequest

     */
    @Override
    public GetRecordsResult get(String shardIterator, int maxRecords)
        throws ResourceNotFoundException, InvalidArgumentException, ExpiredIteratorException {


        final GetRecordsRequest getRecordsRequest = new GetRecordsRequest();
        getRecordsRequest.setRequestCredentials(credentialsProvider.getCredentials());
        getRecordsRequest.setShardIterator(shardIterator);
        getRecordsRequest.setLimit(maxRecords);
        final GetRecordsResult response = client.getRecords(getRecordsRequest);
        return response;


    }

View Full Code Here

Examples of org.fao.geonet.csw.common.requests.GetRecordsRequest

   */
  private Set<RecordInfo> search(CswServer server, Search s) throws Exception
  {
    int start =  1;


    GetRecordsRequest request = new GetRecordsRequest(context);


    request.setResultType(ResultType.RESULTS);
    //request.setOutputSchema(OutputSchema.OGC_CORE);  // Use default value
    request.setElementSetName(ElementSetName.SUMMARY);
    request.setMaxRecords(GETRECORDS_NUMBER_OF_RESULTS_PER_PAGE + "");
        request.setDistribSearch(params.queryScope.equalsIgnoreCase("true"));
        request.setHopCount(params.hopCount + "");


    CswOperation oper = server.getOperation(CswServer.GET_RECORDS);


        // Use the preferred HTTP method and check one exist.


        configRequest(request, oper, server, s, PREFERRED_HTTP_METHOD);


        if (params.useAccount) {
            log.debug("Logging into server (" + params.username + ")");
            request.setCredentials(params.username, params.password);
        }
        // Simple fallback mechanism. Try search with PREFERRED_HTTP_METHOD method, if fails change it
        try {
            log.info("Re-trying the search with another HTTP method.");
            request.setStartPosition(start +"");
        doSearch(request, start, 1);
        } catch(Exception ex) {
            if(log.isDebugEnabled()) {
                log.debug(ex.getMessage());
                log.debug("Changing to CSW harvester to use " + (PREFERRED_HTTP_METHOD.equals("GET")?"POST":"GET"));
            }
            errors.add(new HarvestError(ex, log));


            configRequest(request, oper, server, s, PREFERRED_HTTP_METHOD.equals("GET")?"POST":"GET");
        }


    Set<RecordInfo> records = new HashSet<RecordInfo>();


    while (true)
    {
      request.setStartPosition(start +"");
      Element response = doSearch(request, start, GETRECORDS_NUMBER_OF_RESULTS_PER_PAGE);
            if(log.isDebugEnabled())
                log.debug("Number of child elements in response: " + response.getChildren().size());


      Element results  = response.getChild("SearchResults", Csw.NAMESPACE_CSW);

View Full Code Here

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.