ó ç'ÊUc@sBdZddlZddlmZddlmZddlmZddlm Z ddl m Z defd „ƒYZ d e fd „ƒYZ d e fd „ƒYZde fd„ƒYZde fd„ƒYZdefd„ƒYZde fd„ƒYZde fd„ƒYZde fd„ƒYZdefd„ƒYZdS(s0 Some spiders used for testing and benchmarking iÿÿÿÿN(t urlencode(tSpider(tRequest(tItem(t LinkExtractort MetaSpidercBs eZdZd„Zd„ZRS(tmetacOs&tt|ƒj||Ži|_dS(N(tsuperRt__init__R(tselftargstkwargs((s1/home/travis/build/scrapy/scrapy/tests/spiders.pyRscCs||jdRt seedsseen(R tatkw((s1/home/travis/build/scrapy/scrapy/tests/spiders.pyRrsccsš|jrddnxjtdƒD]\}idd6|d6}dt|ddƒ}t|d i|d6ƒV|jr!d dq!q!W|js–td ƒ‚dS( Niiidi Rtseedshttp://localhost:8998/follow?%sRRis8All start requests consumed before any download happened(tfail_before_yieldtxrangeRRt fail_yieldingR?tAssertionError(R tsRR((s1/home/travis/build/scrapy/scrapy/tests/spiders.pyR/vs    ccsH|jj|jjdƒƒx%tt|ƒj|ƒD] }|Vq5WdS(NRB(R?R RtgetRR>R$(R R%treq((s1/home/travis/build/scrapy/scrapy/tests/spiders.pyR$„s(RRtFalseRCRERR/R$(((s1/home/travis/build/scrapy/scrapy/tests/spiders.pyR>ms   tSingleRequestSpidercBs5eZdZdZdZd„Zd„Zd„ZRS(ccsYt|jtƒr5|jjd|jd|jƒVn t|jd|jd|jƒVdS(NRR.(t isinstanceRBRtreplaceR$ton_error(R ((s1/home/travis/build/scrapy/scrapy/tests/spiders.pyR/s#cCsV|jjdgƒj|ƒt|jƒr8|j|ƒSd|jkrR|jdSdS(Nt responsestnext(Rt setdefaultR tcallablet callback_func(R R%((s1/home/travis/build/scrapy/scrapy/tests/spiders.pyR$–s  cCs-||jdRKRV(((s1/home/travis/build/scrapy/scrapy/tests/spiders.pyts