Package us.codecraft.webmagic.samples

Examples of us.codecraft.webmagic.samples.SinaBlogProcessor


public class SinablogProcessorTest {

    @Ignore
    @Test
    public void test() throws IOException {
        SinaBlogProcessor sinaBlogProcessor = new SinaBlogProcessor();
        //pipeline是抓取结束后的处理
        //默认放到/data/webmagic/ftl/[domain]目录下
        JsonFilePipeline pipeline = new JsonFilePipeline("/data/webmagic/");
        //Spider.me()是简化写法,其实就是new一个啦
        //Spider.pipeline()设定一个pipeline,支持链式调用
View Full Code Here

TOP

Related Classes of us.codecraft.webmagic.samples.SinaBlogProcessor

Copyright © 2018 www.massapicom. All rights reserved.
All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.