List of inputWrap() Examples

Examples of inputWrap()

org.archive.util.Recorder.inputWrap()

Examples of org.archive.util.Recorder.inputWrap()

        // without Recorder, CrawlURI#getContentLength() returns zero, which makes
        // loader().shoudProcess() return false.
        Recorder rec = new Recorder(getTmpDir(), "rec");
        curi1.setRecorder(rec);
        // give Recorder some content so that getContentLength() returns non-zero.
        InputStream is = rec.inputWrap(new ByteArrayInputStream("HTTP/1.0 200 OK\r\n\r\ntext.".getBytes()));
        is.read(new byte[1024]);
        is.close();
        
        assertFalse(loader().shouldProcess(curi1));
        assertFalse(storer().shouldProcess(curi1));

View Full Code Here

Examples of org.archive.util.Recorder.inputWrap()


        @Override
        protected InputStream getSocketInputStream(final Socket socket) throws IOException {
            Recorder recorder = Recorder.getHttpRecorder();
            if (recorder != null) {   // XXX || (isSecure() && isProxied())) {
                return recorder.inputWrap(super.getSocketInputStream(socket));
            } else {
                return super.getSocketInputStream(socket);
            }
        }

View Full Code Here

Examples of org.archive.util.Recorder.inputWrap()

            throws IOException {
        File temp = File.createTempFile("test", ".tmp");
        Recorder recorder = new Recorder(temp, 1024, 1024);
        byte[] b = content.getBytes(charset);
        ByteArrayInputStream bais = new ByteArrayInputStream(b);
        InputStream is = recorder.inputWrap(bais);
        recorder.markContentBegin();
        for (int x = is.read(); x >= 0; x = is.read());
        is.close();
        return recorder;
    }

View Full Code Here

Examples of org.archive.util.Recorder.inputWrap()

        CrawlURI testUri = new CrawlURI(testUuri, null, null, LinkContext.NAVLINK_MISC);
        


        File temp = File.createTempFile("test", ".tmp");
        Recorder recorder = new Recorder(temp, 1024, 1024);
        InputStream is = recorder.inputWrap(ExtractorPDFContentTest.class.getClassLoader().getResourceAsStream(resourceFileName));
        recorder.markContentBegin();
        for(int x = is.read(); x>=0; x=is.read());
        is.close();

View Full Code Here

Examples of org.archive.util.Recorder.inputWrap()

            client.setSoTimeout(getSoTimeoutMs()); // must be after connect()
            
            curi.getData().put(CoreAttributeConstants.A_WHOIS_SERVER_IP, 
                    client.getRemoteAddress().getHostAddress());
            
            recorder.inputWrap(client.getInputStream(whoisQuery));


            // look for info about whois server in the response
            // XXX run regex on the whole thing, rather than line by line?
            BufferedReader reader = new BufferedReader(new InputStreamReader(recorder.getRecordedInput(), "ASCII"));
            for (String line = reader.readLine(); line != null; line = reader.readLine()) {

View Full Code Here

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.