2015-05-23T13:50:52 [DEBUG] CookieJar - Created but will not store cookies (use option '--cookies-file=' to enable persisten cookie storage) 2015-05-23T13:50:52 [DEBUG] Phantom - execute: Configuration 2015-05-23T13:50:52 [DEBUG] 0 objectName : "" 2015-05-23T13:50:52 [DEBUG] 1 cookiesFile : "" 2015-05-23T13:50:52 [DEBUG] 2 diskCacheEnabled : "false" 2015-05-23T13:50:52 [DEBUG] 3 maxDiskCacheSize : "-1" 2015-05-23T13:50:52 [DEBUG] 4 ignoreSslErrors : "false" 2015-05-23T13:50:52 [DEBUG] 5 localToRemoteUrlAccessEnabled : "false" 2015-05-23T13:50:52 [DEBUG] 6 outputEncoding : "UTF-8" 2015-05-23T13:50:52 [DEBUG] 7 proxyType : "http" 2015-05-23T13:50:52 [DEBUG] 8 proxy : ":1080" 2015-05-23T13:50:52 [DEBUG] 9 proxyAuth : ":" 2015-05-23T13:50:52 [DEBUG] 10 scriptEncoding : "UTF-8" 2015-05-23T13:50:52 [DEBUG] 11 webSecurityEnabled : "true" 2015-05-23T13:50:52 [DEBUG] 12 offlineStoragePath : "" 2015-05-23T13:50:52 [DEBUG] 13 offlineStorageDefaultQuota : "-1" 2015-05-23T13:50:52 [DEBUG] 14 printDebugMessages : "true" 2015-05-23T13:50:52 [DEBUG] 15 javascriptCanOpenWindows : "true" 2015-05-23T13:50:52 [DEBUG] 16 javascriptCanCloseWindows : "true" 2015-05-23T13:50:52 [DEBUG] 17 sslProtocol : "tlsv1" 2015-05-23T13:50:52 [DEBUG] 18 sslCertificatesPath : "" 2015-05-23T13:50:52 [DEBUG] 19 webdriver : ":32999" 2015-05-23T13:50:52 [DEBUG] 20 webdriverLogFile : "" 2015-05-23T13:50:52 [DEBUG] 21 webdriverLogLevel : "debug" 2015-05-23T13:50:52 [DEBUG] 22 webdriverSeleniumGridHub : "" 2015-05-23T13:50:52 [DEBUG] Phantom - execute: Script & Arguments 2015-05-23T13:50:52 [DEBUG] script: "main.js" 2015-05-23T13:50:52 [DEBUG] 0 arg: "--ip=" 2015-05-23T13:50:52 [DEBUG] 1 arg: "--port=32999" 2015-05-23T13:50:52 [DEBUG] 2 arg: "--logLevel=debug" 2015-05-23T13:50:52 [DEBUG] Phantom - execute: Starting Remote WebDriver mode PhantomJS is launching GhostDriver... 2015-05-23T13:50:52 [DEBUG] WebPage - setupFrame "" 2015-05-23T13:50:52 [DEBUG] FileSystem - _open: ":/modules/fs.js" QMap(("mode", QVariant(QString, "r") ) ) 2015-05-23T13:50:52 [DEBUG] FileSystem - _open: ":/modules/system.js" QMap(("mode", QVariant(QString, "r") ) ) 2015-05-23T13:50:52 [DEBUG] FileSystem - _open: ":/modules/webpage.js" QMap(("mode", QVariant(QString, "r") ) ) 2015-05-23T13:50:52 [DEBUG] FileSystem - _open: ":/modules/webserver.js" QMap(("mode", QVariant(QString, "r") ) ) 2015-05-23T13:50:52 [DEBUG] FileSystem - _open: ":/ghostdriver/./hub_register.js" QMap(("mode", QVariant(QString, "r") ) ) 2015-05-23T13:50:52 [DEBUG] FileSystem - _open: ":/ghostdriver/./logger.js" QMap(("mode", QVariant(QString, "r") ) ) 2015-05-23T13:50:52 [DEBUG] FileSystem - _open: ":/ghostdriver/./third_party/console++.js" QMap(("mode", QVariant(QString, "r") ) ) 2015-05-23T13:50:52 [DEBUG] FileSystem - _open: ":/ghostdriver/./config.js" QMap(("mode", QVariant(QString, "r") ) ) [DEBUG - 2015-05-23T05:50:52.198Z] Config - config.init - {"ip":"127.0.0.1","port":"32999","hub":null,"logFile":null,"logLevel":"DEBUG","logColor":false} 2015-05-23T13:50:52 [DEBUG] FileSystem - _open: ":/ghostdriver/./third_party/parseuri.js" QMap(("mode", QVariant(QString, "r") ) ) 2015-05-23T13:50:52 [DEBUG] Phantom - injectJs: "session.js" 2015-05-23T13:50:52 [DEBUG] Phantom - injectJs: prepending ":/ghostdriver/" 2015-05-23T13:50:52 [DEBUG] Phantom - injectJs: "inputs.js" 2015-05-23T13:50:52 [DEBUG] Phantom - injectJs: prepending ":/ghostdriver/" 2015-05-23T13:50:52 [DEBUG] Phantom - injectJs: "request_handlers/request_handler.js" 2015-05-23T13:50:52 [DEBUG] Phantom - injectJs: prepending ":/ghostdriver/" 2015-05-23T13:50:52 [DEBUG] Phantom - injectJs: "request_handlers/status_request_handler.js" 2015-05-23T13:50:52 [DEBUG] Phantom - injectJs: prepending ":/ghostdriver/" 2015-05-23T13:50:52 [DEBUG] FileSystem - _open: ":/ghostdriver/./errors.js" QMap(("mode", QVariant(QString, "r") ) ) 2015-05-23T13:50:52 [DEBUG] Phantom - injectJs: "request_handlers/shutdown_request_handler.js" 2015-05-23T13:50:52 [DEBUG] Phantom - injectJs: prepending ":/ghostdriver/" 2015-05-23T13:50:52 [DEBUG] Phantom - injectJs: "request_handlers/session_manager_request_handler.js" 2015-05-23T13:50:52 [DEBUG] Phantom - injectJs: prepending ":/ghostdriver/" 2015-05-23T13:50:52 [DEBUG] Phantom - injectJs: "request_handlers/session_request_handler.js" 2015-05-23T13:50:52 [DEBUG] Phantom - injectJs: prepending ":/ghostdriver/" 2015-05-23T13:50:52 [DEBUG] Phantom - injectJs: "request_handlers/webelement_request_handler.js" 2015-05-23T13:50:52 [DEBUG] Phantom - injectJs: prepending ":/ghostdriver/" 2015-05-23T13:50:52 [DEBUG] Phantom - injectJs: "request_handlers/router_request_handler.js" 2015-05-23T13:50:52 [DEBUG] Phantom - injectJs: prepending ":/ghostdriver/" 2015-05-23T13:50:52 [DEBUG] Phantom - injectJs: "webelementlocator.js" 2015-05-23T13:50:52 [DEBUG] Phantom - injectJs: prepending ":/ghostdriver/" [INFO - 2015-05-23T05:50:52.204Z] GhostDriver - Main - running on port 32999 2015-05-23T13:50:53 [DEBUG] HTTP Request - URI /wd/hub/session 2015-05-23T13:50:53 [DEBUG] HTTP Request - Method POST 2015-05-23T13:50:53 [DEBUG] HTTP Request - HTTP Version 1.1 2015-05-23T13:50:53 [DEBUG] HTTP Request - Query String 2015-05-23T13:50:53 [DEBUG] HTTP Request - Receiving Header "Accept-Encoding" = "identity" 2015-05-23T13:50:53 [DEBUG] HTTP Request - Receiving Header "Content-Length" = "100" 2015-05-23T13:50:53 [DEBUG] HTTP Request - Receiving Header "Host" = "127.0.0.1:32999" 2015-05-23T13:50:53 [DEBUG] HTTP Request - Receiving Header "Accept" = "application/json" 2015-05-23T13:50:53 [DEBUG] HTTP Request - Receiving Header "User-Agent" = "Python-urllib/2.7" 2015-05-23T13:50:53 [DEBUG] HTTP Request - Receiving Header "Connection" = "close" 2015-05-23T13:50:53 [DEBUG] HTTP Request - Receiving Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:50:53 [DEBUG] HTTP Request - Method POST/PUT 2015-05-23T13:50:53 [DEBUG] HTTP Request - Content Body: {"desiredCapabilities": {"phantomjs.page.settings.userAgent": "Scrapy/0.24.5 (+http://scrapy.org)"}} [DEBUG - 2015-05-23T05:50:53.136Z] RouterReqHand - _handle - {"headers":{"Accept":"application/json","Accept-Encoding":"identity","Connection":"close","Content-Length":"100","Content-Type":"application/json;charset=UTF-8","Host":"127.0.0.1:32999","User-Agent":"Python-urllib/2.7"},"httpVersion":"1.1","method":"POST","post":"{\"desiredCapabilities\": {\"phantomjs.page.settings.userAgent\": \"Scrapy/0.24.5 (+http://scrapy.org)\"}}","url":"/session","urlParsed":{"anchor":"","query":"","file":"session","directory":"/","path":"/session","relative":"/session","port":"","host":"","password":"","user":"","userInfo":"","authority":"","protocol":"","source":"/session","queryKey":{},"chunks":["session"]}} 2015-05-23T13:50:53 [DEBUG] FileSystem - _open: ":/ghostdriver/./third_party/uuid.js" QMap(("mode", QVariant(QString, "r") ) ) 2015-05-23T13:50:53 [DEBUG] WebpageCallbacks - getFilePickerCallback 2015-05-23T13:50:53 [DEBUG] WebpageCallbacks - getGenericCallback [INFO - 2015-05-23T05:50:53.141Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.settings - {"XSSAuditingEnabled":false,"javascriptCanCloseWindows":true,"javascriptCanOpenWindows":true,"javascriptEnabled":true,"loadImages":false,"localToRemoteUrlAccessEnabled":false,"userAgent":"Scrapy/0.24.5 (+http://scrapy.org)","webSecurityEnabled":true} [INFO - 2015-05-23T05:50:53.141Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.customHeaders: - {} [DEBUG - 2015-05-23T05:50:53.141Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - Session.desiredCapabilities - {"phantomjs.page.settings.userAgent":"Scrapy/0.24.5 (+http://scrapy.org)"} [INFO - 2015-05-23T05:50:53.141Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - Session.negotiatedCapabilities - {"browserName":"phantomjs","version":"1.9.8","driverName":"ghostdriver","driverVersion":"1.1.0","platform":"linux-unknown-64bit","javascriptEnabled":true,"takesScreenshot":true,"handlesAlerts":false,"databaseEnabled":false,"locationContextEnabled":false,"applicationCacheEnabled":false,"browserConnectionEnabled":false,"cssSelectorsEnabled":true,"webStorageEnabled":false,"rotatable":false,"acceptSslCerts":false,"nativeEvents":true,"proxy":{"proxyType":"direct"},"phantomjs.page.settings.userAgent":"Scrapy/0.24.5 (+http://scrapy.org)"} [INFO - 2015-05-23T05:50:53.141Z] SessionManagerReqHand - _postNewSessionCommand - New Session Created: ac4aab20-010f-11e5-a1b5-e503e60d48a0 2015-05-23T13:50:53 [DEBUG] HTTP Response - Status Code 200 OK 2015-05-23T13:50:53 [DEBUG] HTTP Response - Sending Header "Cache" = "no-cache" 2015-05-23T13:50:53 [DEBUG] HTTP Response - Sending Header "Content-Length" = "609" 2015-05-23T13:50:53 [DEBUG] HTTP Response - Sending Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:50:53 [DEBUG] HTTP Request - URI /wd/hub/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url 2015-05-23T13:50:53 [DEBUG] HTTP Request - Method POST 2015-05-23T13:50:53 [DEBUG] HTTP Request - HTTP Version 1.1 2015-05-23T13:50:53 [DEBUG] HTTP Request - Query String 2015-05-23T13:50:53 [DEBUG] HTTP Request - Receiving Header "Accept-Encoding" = "identity" 2015-05-23T13:50:53 [DEBUG] HTTP Request - Receiving Header "Content-Length" = "87" 2015-05-23T13:50:53 [DEBUG] HTTP Request - Receiving Header "Host" = "127.0.0.1:32999" 2015-05-23T13:50:53 [DEBUG] HTTP Request - Receiving Header "Accept" = "application/json" 2015-05-23T13:50:53 [DEBUG] HTTP Request - Receiving Header "User-Agent" = "Python-urllib/2.7" 2015-05-23T13:50:53 [DEBUG] HTTP Request - Receiving Header "Connection" = "close" 2015-05-23T13:50:53 [DEBUG] HTTP Request - Receiving Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:50:53 [DEBUG] HTTP Request - Method POST/PUT 2015-05-23T13:50:53 [DEBUG] HTTP Request - Content Body: {"url": "http://image.baidu.com/", "sessionId": "ac4aab20-010f-11e5-a1b5-e503e60d48a0"} [DEBUG - 2015-05-23T05:50:53.147Z] RouterReqHand - _handle - {"headers":{"Accept":"application/json","Accept-Encoding":"identity","Connection":"close","Content-Length":"87","Content-Type":"application/json;charset=UTF-8","Host":"127.0.0.1:32999","User-Agent":"Python-urllib/2.7"},"httpVersion":"1.1","method":"POST","post":"{\"url\": \"http://image.baidu.com/\", \"sessionId\": \"ac4aab20-010f-11e5-a1b5-e503e60d48a0\"}","url":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","urlParsed":{"anchor":"","query":"","file":"url","directory":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/","path":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","relative":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","port":"","host":"","password":"","user":"","userInfo":"","authority":"","protocol":"","source":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","queryKey":{},"chunks":["session","ac4aab20-010f-11e5-a1b5-e503e60d48a0","url"]}} [DEBUG - 2015-05-23T05:50:53.148Z] SessionReqHand - _postUrlCommand - Session 'ac4aab20-010f-11e5-a1b5-e503e60d48a0' is about to load URL: http://image.baidu.com/ 2015-05-23T13:50:53 [DEBUG] WebPage - updateLoadingProgress: 10 [DEBUG - 2015-05-23T05:50:53.149Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8"}],"id":1,"method":"GET","time":"2015-05-23T05:50:53.149Z","url":"http://image.baidu.com/"} [DEBUG - 2015-05-23T05:50:53.149Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _oneShotCallback - onLoadStarted [DEBUG - 2015-05-23T05:50:53.159Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true 2015-05-23T13:50:53 [DEBUG] CookieJar - Saved "BAIDUID=969BCAF88B7295A1E3202FA8DE5206C1:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" [DEBUG - 2015-05-23T05:50:53.195Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":76397,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:50:53 GMT"},{"name":"P3p","value":"CP=\" OTI DSP COR IVA OUR IND COM \""},{"name":"Server","value":"Apache"},{"name":"Set-Cookie","value":"userid=deleted; expires=Fri, 23-May-2014 05:50:52 GMT; path=/\nBAIDUID=969BCAF88B7295A1E3202FA8DE5206C1:FG=1; expires=Sun, 22-May-16 05:50:53 GMT; max-age=31536000; path=/; domain=.baidu.com; version=1"},{"name":"Tracecode","value":"30531650340814046218052313"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Transfer-Encoding","value":"chunked"}],"id":1,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:53.195Z","url":"http://image.baidu.com/"} 2015-05-23T13:50:53 [DEBUG] WebPage - setupFrame "" [DEBUG - 2015-05-23T05:50:53.197Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/"}],"id":2,"method":"GET","time":"2015-05-23T05:50:53.197Z","url":"http://img0.bdstatic.com/static/common/fw_ff73dfc.js"} [DEBUG - 2015-05-23T05:50:53.198Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/css,*/*;q=0.1"},{"name":"Referer","value":"http://image.baidu.com/"}],"id":3,"method":"GET","time":"2015-05-23T05:50:53.198Z","url":"http://img1.bdstatic.com/static/common/pkg/base_b1e571e.css"} [DEBUG - 2015-05-23T05:50:53.198Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/css,*/*;q=0.1"},{"name":"Referer","value":"http://image.baidu.com/"}],"id":4,"method":"GET","time":"2015-05-23T05:50:53.198Z","url":"http://img2.bdstatic.com/static/common/pkg/page_a8fc491.css"} [DEBUG - 2015-05-23T05:50:53.198Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/css,*/*;q=0.1"},{"name":"Referer","value":"http://image.baidu.com/"}],"id":5,"method":"GET","time":"2015-05-23T05:50:53.198Z","url":"http://img0.bdstatic.com/static/home/pkg/default_44cee3f.css"} 2015-05-23T13:50:53 [DEBUG] WebPage - updateLoadingProgress: 24 [DEBUG - 2015-05-23T05:50:53.199Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:50:53 GMT"},{"name":"P3p","value":"CP=\" OTI DSP COR IVA OUR IND COM \""},{"name":"Server","value":"Apache"},{"name":"Set-Cookie","value":"userid=deleted; expires=Fri, 23-May-2014 05:50:52 GMT; path=/\nBAIDUID=969BCAF88B7295A1E3202FA8DE5206C1:FG=1; expires=Sun, 22-May-16 05:50:53 GMT; max-age=31536000; path=/; domain=.baidu.com; version=1"},{"name":"Tracecode","value":"30531650340814046218052313"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Transfer-Encoding","value":"chunked"}],"id":1,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:53.199Z","url":"http://image.baidu.com/"} [DEBUG - 2015-05-23T05:50:53.259Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true [DEBUG - 2015-05-23T05:50:53.329Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":2335,"contentType":"text/javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:53 GMT"},{"name":"Content-Type","value":"text/javascript"},{"name":"Connection","value":"keep-alive"},{"name":"ETag","value":"\"54086285\""},{"name":"Last-Modified","value":"Wed, 29 Apr 2015 06:35:44 GMT"},{"name":"Expires","value":"Thu, 28 May 2015 03:10:36 GMT"},{"name":"Age","value":"182417"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Accept-Ranges","value":"bytes"},{"name":"Content-Encoding","value":"gzip"},{"name":"Vary","value":"Accept-Encoding"}],"id":2,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:53.328Z","url":"http://img0.bdstatic.com/static/common/fw_ff73dfc.js"} 2015-05-23T13:50:53 [DEBUG] WebPage - updateLoadingProgress: 26 [DEBUG - 2015-05-23T05:50:53.329Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:53 GMT"},{"name":"Content-Type","value":"text/javascript"},{"name":"Connection","value":"keep-alive"},{"name":"ETag","value":"\"54086285\""},{"name":"Last-Modified","value":"Wed, 29 Apr 2015 06:35:44 GMT"},{"name":"Expires","value":"Thu, 28 May 2015 03:10:36 GMT"},{"name":"Age","value":"182417"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Accept-Ranges","value":"bytes"},{"name":"Content-Encoding","value":"gzip"},{"name":"Vary","value":"Accept-Encoding"}],"id":2,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:53.329Z","url":"http://img0.bdstatic.com/static/common/fw_ff73dfc.js"} [DEBUG - 2015-05-23T05:50:53.330Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":1053,"contentType":"text/css","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:53 GMT"},{"name":"Content-Type","value":"text/css"},{"name":"Connection","value":"keep-alive"},{"name":"Last-Modified","value":"Wed, 29 Apr 2015 06:35:44 GMT"},{"name":"Expires","value":"Wed, 27 May 2015 03:56:47 GMT"},{"name":"Age","value":"266046"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Content-Encoding","value":"gzip"},{"name":"Tracecode","value":"30436477080814046218050611"},{"name":"Vary","value":"Accept-Encoding"}],"id":3,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:53.330Z","url":"http://img1.bdstatic.com/static/common/pkg/base_b1e571e.css"} [DEBUG - 2015-05-23T05:50:53.331Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/css","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:53 GMT"},{"name":"Content-Type","value":"text/css"},{"name":"Connection","value":"keep-alive"},{"name":"Last-Modified","value":"Wed, 29 Apr 2015 06:35:44 GMT"},{"name":"Expires","value":"Wed, 27 May 2015 03:56:47 GMT"},{"name":"Age","value":"266046"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Content-Encoding","value":"gzip"},{"name":"Tracecode","value":"30436477080814046218050611"},{"name":"Vary","value":"Accept-Encoding"}],"id":3,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:53.330Z","url":"http://img1.bdstatic.com/static/common/pkg/base_b1e571e.css"} [DEBUG - 2015-05-23T05:50:53.331Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":38471,"contentType":"text/css","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:53 GMT"},{"name":"Content-Type","value":"text/css"},{"name":"Connection","value":"keep-alive"},{"name":"ETag","value":"\"1704647181\""},{"name":"Last-Modified","value":"Wed, 08 Apr 2015 06:44:11 GMT"},{"name":"Expires","value":"Fri, 29 May 2015 06:55:03 GMT"},{"name":"Age","value":"82550"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Accept-Ranges","value":"bytes"},{"name":"Content-Encoding","value":"gzip"},{"name":"Vary","value":"Accept-Encoding"}],"id":5,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:53.331Z","url":"http://img0.bdstatic.com/static/home/pkg/default_44cee3f.css"} 2015-05-23T13:50:53 [DEBUG] WebPage - updateLoadingProgress: 35 [DEBUG - 2015-05-23T05:50:53.331Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/css","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:53 GMT"},{"name":"Content-Type","value":"text/css"},{"name":"Connection","value":"keep-alive"},{"name":"ETag","value":"\"1704647181\""},{"name":"Last-Modified","value":"Wed, 08 Apr 2015 06:44:11 GMT"},{"name":"Expires","value":"Fri, 29 May 2015 06:55:03 GMT"},{"name":"Age","value":"82550"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Accept-Ranges","value":"bytes"},{"name":"Content-Encoding","value":"gzip"},{"name":"Vary","value":"Accept-Encoding"}],"id":5,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:53.331Z","url":"http://img0.bdstatic.com/static/home/pkg/default_44cee3f.css"} [DEBUG - 2015-05-23T05:50:53.333Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":99052,"contentType":"text/css","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:53 GMT"},{"name":"Content-Type","value":"text/css"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"keep-alive"},{"name":"Last-Modified","value":"Wed, 29 Apr 2015 06:35:44 GMT"},{"name":"Expires","value":"Tue, 26 May 2015 04:10:59 GMT"},{"name":"Age","value":"351594"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Content-Encoding","value":"gzip"},{"name":"Tracecode","value":"30409311490864443402050511"},{"name":"Vary","value":"Accept-Encoding"}],"id":4,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:53.333Z","url":"http://img2.bdstatic.com/static/common/pkg/page_a8fc491.css"} 2015-05-23T13:50:53 [DEBUG] WebPage - updateLoadingProgress: 42 [DEBUG - 2015-05-23T05:50:53.333Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/css","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:53 GMT"},{"name":"Content-Type","value":"text/css"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"keep-alive"},{"name":"Last-Modified","value":"Wed, 29 Apr 2015 06:35:44 GMT"},{"name":"Expires","value":"Tue, 26 May 2015 04:10:59 GMT"},{"name":"Age","value":"351594"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Content-Encoding","value":"gzip"},{"name":"Tracecode","value":"30409311490864443402050511"},{"name":"Vary","value":"Accept-Encoding"}],"id":4,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:53.333Z","url":"http://img2.bdstatic.com/static/common/pkg/page_a8fc491.css"} [DEBUG - 2015-05-23T05:50:53.366Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/"}],"id":6,"method":"GET","time":"2015-05-23T05:50:53.366Z","url":"http://img.baidu.com/hunter/image.js?st=-16579"} [DEBUG - 2015-05-23T05:50:53.366Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/"}],"id":7,"method":"GET","time":"2015-05-23T05:50:53.366Z","url":"http://hm.baidu.com/h.js?737dbb498415dd39d8abf5bc2404b290"} [DEBUG - 2015-05-23T05:50:53.369Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/"}],"id":8,"method":"GET","time":"2015-05-23T05:50:53.369Z","url":"http://img0.bdstatic.com/static/common/pkg/base_9584ab6.js"} [DEBUG - 2015-05-23T05:50:53.369Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/"}],"id":9,"method":"GET","time":"2015-05-23T05:50:53.369Z","url":"http://img2.bdstatic.com/static/common/pkg/com_adad11b.js"} [DEBUG - 2015-05-23T05:50:53.369Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/"}],"id":10,"method":"GET","time":"2015-05-23T05:50:53.369Z","url":"http://img2.bdstatic.com/static/common/pkg/other_022983d.js"} [DEBUG - 2015-05-23T05:50:53.370Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/"}],"id":11,"method":"GET","time":"2015-05-23T05:50:53.369Z","url":"http://img2.bdstatic.com/static/home/pkg/default_ad84cc1.js"} [DEBUG - 2015-05-23T05:50:53.370Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true [DEBUG - 2015-05-23T05:50:53.373Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":11312,"contentType":"text/javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:53 GMT"},{"name":"Content-Type","value":"text/javascript"},{"name":"Connection","value":"keep-alive"},{"name":"ETag","value":"\"1627996781\""},{"name":"Last-Modified","value":"Wed, 08 Apr 2015 06:44:11 GMT"},{"name":"Expires","value":"Fri, 29 May 2015 16:28:22 GMT"},{"name":"Age","value":"48151"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Accept-Ranges","value":"bytes"},{"name":"Content-Encoding","value":"gzip"},{"name":"Vary","value":"Accept-Encoding"}],"id":11,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:53.373Z","url":"http://img2.bdstatic.com/static/home/pkg/default_ad84cc1.js"} 2015-05-23T13:50:53 [DEBUG] WebPage - updateLoadingProgress: 46 [DEBUG - 2015-05-23T05:50:53.374Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:53 GMT"},{"name":"Content-Type","value":"text/javascript"},{"name":"Connection","value":"keep-alive"},{"name":"ETag","value":"\"1627996781\""},{"name":"Last-Modified","value":"Wed, 08 Apr 2015 06:44:11 GMT"},{"name":"Expires","value":"Fri, 29 May 2015 16:28:22 GMT"},{"name":"Age","value":"48151"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Accept-Ranges","value":"bytes"},{"name":"Content-Encoding","value":"gzip"},{"name":"Vary","value":"Accept-Encoding"}],"id":11,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:53.374Z","url":"http://img2.bdstatic.com/static/home/pkg/default_ad84cc1.js"} [DEBUG - 2015-05-23T05:50:53.381Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":56410,"contentType":"application/x-javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:53 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"keep-alive"},{"name":"Last-Modified","value":"Wed, 29 Apr 2015 06:35:44 GMT"},{"name":"Expires","value":"Thu, 28 May 2015 10:40:38 GMT"},{"name":"Age","value":"155415"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Tracecode","value":"12199584370763714570043018"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Content-Encoding","value":"gzip"}],"id":9,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:53.381Z","url":"http://img2.bdstatic.com/static/common/pkg/com_adad11b.js"} 2015-05-23T13:50:53 [DEBUG] WebPage - updateLoadingProgress: 59 2015-05-23T13:50:53 [DEBUG] WebPage - updateLoadingProgress: 66 [DEBUG - 2015-05-23T05:50:53.386Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/x-javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:53 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"keep-alive"},{"name":"Last-Modified","value":"Wed, 29 Apr 2015 06:35:44 GMT"},{"name":"Expires","value":"Thu, 28 May 2015 10:40:38 GMT"},{"name":"Age","value":"155415"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Tracecode","value":"12199584370763714570043018"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Content-Encoding","value":"gzip"}],"id":9,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:53.386Z","url":"http://img2.bdstatic.com/static/common/pkg/com_adad11b.js"} [DEBUG - 2015-05-23T05:50:53.389Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":52990,"contentType":"application/x-javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:53 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"keep-alive"},{"name":"Last-Modified","value":"Wed, 29 Apr 2015 06:35:44 GMT"},{"name":"Expires","value":"Thu, 28 May 2015 15:40:38 GMT"},{"name":"Age","value":"137415"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Tracecode","value":"30172589740746937354043021"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Content-Encoding","value":"gzip"}],"id":10,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:53.389Z","url":"http://img2.bdstatic.com/static/common/pkg/other_022983d.js"} 2015-05-23T13:50:53 [DEBUG] WebPage - updateLoadingProgress: 73 [DEBUG - 2015-05-23T05:50:53.389Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/x-javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:53 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"keep-alive"},{"name":"Last-Modified","value":"Wed, 29 Apr 2015 06:35:44 GMT"},{"name":"Expires","value":"Thu, 28 May 2015 15:40:38 GMT"},{"name":"Age","value":"137415"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Tracecode","value":"30172589740746937354043021"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Content-Encoding","value":"gzip"}],"id":10,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:53.389Z","url":"http://img2.bdstatic.com/static/common/pkg/other_022983d.js"} [DEBUG - 2015-05-23T05:50:53.389Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":94101,"contentType":"application/x-javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:53 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"keep-alive"},{"name":"Last-Modified","value":"Wed, 29 Apr 2015 06:35:44 GMT"},{"name":"Expires","value":"Thu, 28 May 2015 15:40:38 GMT"},{"name":"Age","value":"137415"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Tracecode","value":"30172231200210131978043021"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Content-Encoding","value":"gzip"}],"id":8,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:53.389Z","url":"http://img0.bdstatic.com/static/common/pkg/base_9584ab6.js"} 2015-05-23T13:50:53 [DEBUG] WebPage - updateLoadingProgress: 80 [DEBUG - 2015-05-23T05:50:53.389Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/x-javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:53 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"keep-alive"},{"name":"Last-Modified","value":"Wed, 29 Apr 2015 06:35:44 GMT"},{"name":"Expires","value":"Thu, 28 May 2015 15:40:38 GMT"},{"name":"Age","value":"137415"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Tracecode","value":"30172231200210131978043021"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Content-Encoding","value":"gzip"}],"id":8,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:53.389Z","url":"http://img0.bdstatic.com/static/common/pkg/base_9584ab6.js"} [DEBUG - 2015-05-23T05:50:53.470Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true 2015-05-23T13:50:53 [DEBUG] CookieJar - Saved "BAIDUID=969BCAF88B7295A1E3202FA8DE5206C1:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:50:53 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360253|; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:53 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" [DEBUG - 2015-05-23T05:50:53.544Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":21273,"contentType":"application/javascript","headers":[{"name":"Cache-Control","value":"max-age=0, must-revalidate"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"application/javascript"},{"name":"Date","value":"Sat, 23 May 2015 05:50:53 GMT"},{"name":"Etag","value":"911fe008064b30d39e97ec8cef7ea6aa"},{"name":"P3p","value":"CP=\"CURa ADMa DEVa PSAo PSDo OUR BUS UNI PUR INT DEM STA PRE COM NAV OTC NOI DSP COR\""},{"name":"Server","value":"apache"},{"name":"Set-Cookie","value":"HMVT=737dbb498415dd39d8abf5bc2404b290|1432360253|; Path=/; Domain=hm.baidu.com\nHMACCOUNT=8A6AC9A3FED60621; Path=/; Domain=hm.baidu.com; Expires=Sun, 18 Jan 2038 00:00:00 GMT"}],"id":7,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:53.544Z","url":"http://hm.baidu.com/h.js?737dbb498415dd39d8abf5bc2404b290"} 2015-05-23T13:50:53 [DEBUG] WebPage - updateLoadingProgress: 83 [DEBUG - 2015-05-23T05:50:53.544Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/javascript","headers":[{"name":"Cache-Control","value":"max-age=0, must-revalidate"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"application/javascript"},{"name":"Date","value":"Sat, 23 May 2015 05:50:53 GMT"},{"name":"Etag","value":"911fe008064b30d39e97ec8cef7ea6aa"},{"name":"P3p","value":"CP=\"CURa ADMa DEVa PSAo PSDo OUR BUS UNI PUR INT DEM STA PRE COM NAV OTC NOI DSP COR\""},{"name":"Server","value":"apache"},{"name":"Set-Cookie","value":"HMVT=737dbb498415dd39d8abf5bc2404b290|1432360253|; Path=/; Domain=hm.baidu.com\nHMACCOUNT=8A6AC9A3FED60621; Path=/; Domain=hm.baidu.com; Expires=Sun, 18 Jan 2038 00:00:00 GMT"}],"id":7,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:53.544Z","url":"http://hm.baidu.com/h.js?737dbb498415dd39d8abf5bc2404b290"} 2015-05-23T13:50:53 [DEBUG] CookieJar - Saved "BAIDUID=969BCAF88B7295A1E3202FA8DE5206C1:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:50:53 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360253|; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:53 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:53 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:50:53 [DEBUG] CookieJar - Saved "BAIDUID=969BCAF88B7295A1E3202FA8DE5206C1:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:50:53 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360253|; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:53 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:53 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:50:53 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360254; domain=.image.baidu.com; path=/" [DEBUG - 2015-05-23T05:50:53.550Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/javascript","headers":[{"name":"Accept-Ranges","value":"bytes"},{"name":"Cache-Control","value":"max-age=311040000"},{"name":"Content-Length","value":"0"},{"name":"Content-Type","value":"text/javascript"},{"name":"Date","value":"Sat, 23 May 2015 05:50:53 GMT"},{"name":"Etag","value":"\"1778109334\""},{"name":"Expires","value":"Mon, 31 Mar 2025 05:50:53 GMT"},{"name":"Last-Modified","value":"Fri, 19 Dec 2014 01:30:10 GMT"},{"name":"Server","value":"BWS/1.0"}],"id":6,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:53.550Z","url":"http://img.baidu.com/hunter/image.js?st=-16579"} 2015-05-23T13:50:53 [DEBUG] WebPage - updateLoadingProgress: 100 [DEBUG - 2015-05-23T05:50:53.551Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _oneShotCallback - onLoadFinished [DEBUG - 2015-05-23T05:50:53.551Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - onLoadFinished: success 2015-05-23T13:50:53 [DEBUG] WebPage - setupFrame "" [DEBUG - 2015-05-23T05:50:53.557Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/"}],"id":12,"method":"GET","time":"2015-05-23T05:50:53.557Z","url":"http://img1.bdstatic.com/static/common/pkg/onload_e5e13f7.js"} [DEBUG - 2015-05-23T05:50:53.563Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":58591,"contentType":"application/x-javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:53 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"keep-alive"},{"name":"Last-Modified","value":"Wed, 29 Apr 2015 06:35:44 GMT"},{"name":"Expires","value":"Wed, 27 May 2015 07:40:34 GMT"},{"name":"Age","value":"252619"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Content-Encoding","value":"gzip"},{"name":"Tracecode","value":"30262999690746937354042914"},{"name":"Vary","value":"Accept-Encoding"}],"id":12,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:53.563Z","url":"http://img1.bdstatic.com/static/common/pkg/onload_e5e13f7.js"} [DEBUG - 2015-05-23T05:50:53.565Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/x-javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:53 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"keep-alive"},{"name":"Last-Modified","value":"Wed, 29 Apr 2015 06:35:44 GMT"},{"name":"Expires","value":"Wed, 27 May 2015 07:40:34 GMT"},{"name":"Age","value":"252619"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Content-Encoding","value":"gzip"},{"name":"Tracecode","value":"30262999690746937354042914"},{"name":"Vary","value":"Accept-Encoding"}],"id":12,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:53.565Z","url":"http://img1.bdstatic.com/static/common/pkg/onload_e5e13f7.js"} [DEBUG - 2015-05-23T05:50:53.571Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"application/json, text/javascript, */*; q=0.01"},{"name":"Referer","value":"http://image.baidu.com/"}],"id":13,"method":"GET","time":"2015-05-23T05:50:53.571Z","url":"http://image.baidu.com/user/msg?t=1432360253570"} [DEBUG - 2015-05-23T05:50:53.572Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"application/json, text/javascript, */*; q=0.01"},{"name":"Referer","value":"http://image.baidu.com/"}],"id":14,"method":"GET","time":"2015-05-23T05:50:53.571Z","url":"http://image.baidu.com/user/medal?uid=0&t=1432360253571"} [DEBUG - 2015-05-23T05:50:53.572Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: false [DEBUG - 2015-05-23T05:50:53.572Z] SessionReqHand - _SuccessHandler - status: success 2015-05-23T13:50:53 [DEBUG] HTTP Response - Status Code 200 OK 2015-05-23T13:50:53 [DEBUG] HTTP Response - Sending Header "Cache" = "no-cache" 2015-05-23T13:50:53 [DEBUG] HTTP Response - Sending Header "Content-Length" = "74" 2015-05-23T13:50:53 [DEBUG] HTTP Response - Sending Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:50:53 [DEBUG] HTTP Request - URI /wd/hub/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source 2015-05-23T13:50:53 [DEBUG] HTTP Request - Method GET 2015-05-23T13:50:53 [DEBUG] HTTP Request - HTTP Version 1.1 2015-05-23T13:50:53 [DEBUG] HTTP Request - Query String 2015-05-23T13:50:53 [DEBUG] HTTP Request - Receiving Header "Accept-Encoding" = "identity" 2015-05-23T13:50:53 [DEBUG] HTTP Request - Receiving Header "Host" = "127.0.0.1:32999" 2015-05-23T13:50:53 [DEBUG] HTTP Request - Receiving Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:50:53 [DEBUG] HTTP Request - Receiving Header "Connection" = "close" 2015-05-23T13:50:53 [DEBUG] HTTP Request - Receiving Header "Accept" = "application/json" 2015-05-23T13:50:53 [DEBUG] HTTP Request - Receiving Header "User-Agent" = "Python-urllib/2.7" [DEBUG - 2015-05-23T05:50:53.573Z] RouterReqHand - _handle - {"headers":{"Accept":"application/json","Accept-Encoding":"identity","Connection":"close","Content-Type":"application/json;charset=UTF-8","Host":"127.0.0.1:32999","User-Agent":"Python-urllib/2.7"},"httpVersion":"1.1","method":"GET","url":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","urlParsed":{"anchor":"","query":"","file":"source","directory":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/","path":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","relative":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","port":"","host":"","password":"","user":"","userInfo":"","authority":"","protocol":"","source":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","queryKey":{},"chunks":["session","ac4aab20-010f-11e5-a1b5-e503e60d48a0","source"]}} 2015-05-23T13:50:53 [DEBUG] HTTP Response - Status Code 200 OK 2015-05-23T13:50:53 [DEBUG] HTTP Response - Sending Header "Cache" = "no-cache" 2015-05-23T13:50:53 [DEBUG] HTTP Response - Sending Header "Content-Length" = "93439" 2015-05-23T13:50:53 [DEBUG] HTTP Response - Sending Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:50:53 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360253|; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:53 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:53 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:50:53 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360254; domain=.image.baidu.com; path=/" 2015-05-23T13:50:53 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710ACB89A8A750B0FDF8:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" [DEBUG - 2015-05-23T05:50:53.588Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":72,"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:50:53 GMT"},{"name":"P3p","value":"CP=\" OTI DSP COR IVA OUR IND COM \""},{"name":"Server","value":"Apache"},{"name":"Set-Cookie","value":"BAIDUID=1429799A83F7710ACB89A8A750B0FDF8:FG=1; expires=Sun, 22-May-16 05:50:53 GMT; max-age=31536000; path=/; domain=.baidu.com; version=1"},{"name":"Tracecode","value":"30535835360746937354052313"},{"name":"Content-Length","value":"72"}],"id":13,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:53.588Z","url":"http://image.baidu.com/user/msg?t=1432360253570"} [DEBUG - 2015-05-23T05:50:53.589Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:50:53 GMT"},{"name":"P3p","value":"CP=\" OTI DSP COR IVA OUR IND COM \""},{"name":"Server","value":"Apache"},{"name":"Set-Cookie","value":"BAIDUID=1429799A83F7710ACB89A8A750B0FDF8:FG=1; expires=Sun, 22-May-16 05:50:53 GMT; max-age=31536000; path=/; domain=.baidu.com; version=1"},{"name":"Tracecode","value":"30535835360746937354052313"},{"name":"Content-Length","value":"72"}],"id":13,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:53.589Z","url":"http://image.baidu.com/user/msg?t=1432360253570"} 2015-05-23T13:50:53 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360253|; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:53 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:53 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:50:53 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360254; domain=.image.baidu.com; path=/" 2015-05-23T13:50:53 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" [DEBUG - 2015-05-23T05:50:53.604Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":98,"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:50:53 GMT"},{"name":"P3p","value":"CP=\" OTI DSP COR IVA OUR IND COM \""},{"name":"Server","value":"Apache"},{"name":"Set-Cookie","value":"BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-16 05:50:53 GMT; max-age=31536000; path=/; domain=.baidu.com; version=1"},{"name":"Tracecode","value":"30535859170277240842052313"},{"name":"Content-Length","value":"98"}],"id":14,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:53.604Z","url":"http://image.baidu.com/user/medal?uid=0&t=1432360253571"} [DEBUG - 2015-05-23T05:50:53.604Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:50:53 GMT"},{"name":"P3p","value":"CP=\" OTI DSP COR IVA OUR IND COM \""},{"name":"Server","value":"Apache"},{"name":"Set-Cookie","value":"BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-16 05:50:53 GMT; max-age=31536000; path=/; domain=.baidu.com; version=1"},{"name":"Tracecode","value":"30535859170277240842052313"},{"name":"Content-Length","value":"98"}],"id":14,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:53.604Z","url":"http://image.baidu.com/user/medal?uid=0&t=1432360253571"} 2015-05-23T13:50:53 [DEBUG] HTTP Request - URI /wd/hub/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url 2015-05-23T13:50:53 [DEBUG] HTTP Request - Method POST 2015-05-23T13:50:53 [DEBUG] HTTP Request - HTTP Version 1.1 2015-05-23T13:50:53 [DEBUG] HTTP Request - Query String 2015-05-23T13:50:53 [DEBUG] HTTP Request - Receiving Header "Accept-Encoding" = "identity" 2015-05-23T13:50:53 [DEBUG] HTTP Request - Receiving Header "Content-Length" = "83" 2015-05-23T13:50:53 [DEBUG] HTTP Request - Receiving Header "Host" = "127.0.0.1:32999" 2015-05-23T13:50:53 [DEBUG] HTTP Request - Receiving Header "Accept" = "application/json" 2015-05-23T13:50:53 [DEBUG] HTTP Request - Receiving Header "User-Agent" = "Python-urllib/2.7" 2015-05-23T13:50:53 [DEBUG] HTTP Request - Receiving Header "Connection" = "close" 2015-05-23T13:50:53 [DEBUG] HTTP Request - Receiving Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:50:53 [DEBUG] HTTP Request - Method POST/PUT 2015-05-23T13:50:53 [DEBUG] HTTP Request - Content Body: {"url": "http://v.baidu.com/", "sessionId": "ac4aab20-010f-11e5-a1b5-e503e60d48a0"} [DEBUG - 2015-05-23T05:50:53.704Z] RouterReqHand - _handle - {"headers":{"Accept":"application/json","Accept-Encoding":"identity","Connection":"close","Content-Length":"83","Content-Type":"application/json;charset=UTF-8","Host":"127.0.0.1:32999","User-Agent":"Python-urllib/2.7"},"httpVersion":"1.1","method":"POST","post":"{\"url\": \"http://v.baidu.com/\", \"sessionId\": \"ac4aab20-010f-11e5-a1b5-e503e60d48a0\"}","url":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","urlParsed":{"anchor":"","query":"","file":"url","directory":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/","path":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","relative":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","port":"","host":"","password":"","user":"","userInfo":"","authority":"","protocol":"","source":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","queryKey":{},"chunks":["session","ac4aab20-010f-11e5-a1b5-e503e60d48a0","url"]}} [DEBUG - 2015-05-23T05:50:53.704Z] SessionReqHand - _postUrlCommand - Session 'ac4aab20-010f-11e5-a1b5-e503e60d48a0' is about to load URL: http://v.baidu.com/ 2015-05-23T13:50:53 [DEBUG] WebPage - updateLoadingProgress: 10 [DEBUG - 2015-05-23T05:50:53.704Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8"}],"id":15,"method":"GET","time":"2015-05-23T05:50:53.704Z","url":"http://v.baidu.com/"} [DEBUG - 2015-05-23T05:50:53.714Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true [DEBUG - 2015-05-23T05:50:53.815Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true [DEBUG - 2015-05-23T05:50:53.915Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true [DEBUG - 2015-05-23T05:50:54.015Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true [DEBUG - 2015-05-23T05:50:54.110Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":85307,"contentType":"text/html; charset=UTF-8","headers":[{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html; charset=UTF-8"},{"name":"Date","value":"Sat, 23 May 2015 05:50:53 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30538508880984758794052313"},{"name":"X-Powered-By","value":"HPHP"},{"name":"Transfer-Encoding","value":"chunked"}],"id":15,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.110Z","url":"http://v.baidu.com/"} [DEBUG - 2015-05-23T05:50:54.111Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Cache-Control","value":"max-age=0"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Referer","value":"http://image.baidu.com/"},{"name":"Accept","value":"*/*"}],"id":16,"method":"GET","time":"2015-05-23T05:50:54.111Z","url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=564%2C564&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=617328057&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3&tt=%E7%99%BE%E5%BA%A6%E5%9B%BE%E7%89%87%E2%80%94%E5%85%A8%E7%90%83%E6%9C%80%E5%A4%A7%E4%B8%AD%E6%96%87%E5%9B%BE%E7%89%87%E5%BA%93"} 2015-05-23T13:50:54 [DEBUG] WebPage - setupFrame "" [DEBUG - 2015-05-23T05:50:54.112Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://v.baidu.com/"}],"id":17,"method":"GET","time":"2015-05-23T05:50:54.112Z","url":"http://img.baidu.com/hunter/alog/alog.min.js"} [DEBUG - 2015-05-23T05:50:54.113Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/css,*/*;q=0.1"},{"name":"Referer","value":"http://v.baidu.com/"}],"id":18,"method":"GET","time":"2015-05-23T05:50:54.112Z","url":"http://vs5.bdstatic.com/browse_static/v3/common/pkg/common_sync_css_0_f2a7259b.css"} [DEBUG - 2015-05-23T05:50:54.113Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/css,*/*;q=0.1"},{"name":"Referer","value":"http://v.baidu.com/"}],"id":19,"method":"GET","time":"2015-05-23T05:50:54.113Z","url":"http://vs6.bdstatic.com/browse_static/v3/index/pkg/index_sync_css_1_e546a06.css"} [DEBUG - 2015-05-23T05:50:54.113Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/css,*/*;q=0.1"},{"name":"Referer","value":"http://v.baidu.com/"}],"id":20,"method":"GET","time":"2015-05-23T05:50:54.113Z","url":"http://vs5.bdstatic.com/browse_static/v3/common/pkg/common_ui_video_086ce904.css"} [DEBUG - 2015-05-23T05:50:54.113Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/css,*/*;q=0.1"},{"name":"Referer","value":"http://v.baidu.com/"}],"id":21,"method":"GET","time":"2015-05-23T05:50:54.113Z","url":"http://vs5.bdstatic.com/browse_static/v3/index/pkg/index_sync_css_2_3f1be7f.css"} [DEBUG - 2015-05-23T05:50:54.113Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/css,*/*;q=0.1"},{"name":"Referer","value":"http://v.baidu.com/"}],"id":22,"method":"GET","time":"2015-05-23T05:50:54.113Z","url":"http://vs6.bdstatic.com/browse_static/v3/index/pkg/home_a57cff4.css"} [DEBUG - 2015-05-23T05:50:54.114Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/css,*/*;q=0.1"},{"name":"Referer","value":"http://v.baidu.com/"}],"id":23,"method":"GET","time":"2015-05-23T05:50:54.114Z","url":"http://vs6.bdstatic.com/browse_static/v3/index/pkg/index_sync_css_0_df9b187.css"} 2015-05-23T13:50:54 [DEBUG] WebPage - updateLoadingProgress: 34 2015-05-23T13:50:54 [DEBUG] WebPage - updateLoadingProgress: 50 [DEBUG - 2015-05-23T05:50:54.118Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true [DEBUG - 2015-05-23T05:50:54.121Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":20178,"contentType":"text/css","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Content-Type","value":"text/css"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"ETag","value":"W/\"5559f483-4ed2\""},{"name":"Last-Modified","value":"Mon, 18 May 2015 14:17:39 GMT"},{"name":"Expires","value":"Wed, 17 Jun 2015 14:30:32 GMT"},{"name":"Age","value":"400335"},{"name":"Cache-Control","value":"max-age=2592000"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Access-Control-Allow-Origin","value":"http://*.baidu.com"},{"name":"Content-Encoding","value":"gzip"}],"id":21,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.121Z","url":"http://vs5.bdstatic.com/browse_static/v3/index/pkg/index_sync_css_2_3f1be7f.css"} 2015-05-23T13:50:54 [DEBUG] WebPage - updateLoadingProgress: 52 [DEBUG - 2015-05-23T05:50:54.121Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/css","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Content-Type","value":"text/css"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"ETag","value":"W/\"5559f483-4ed2\""},{"name":"Last-Modified","value":"Mon, 18 May 2015 14:17:39 GMT"},{"name":"Expires","value":"Wed, 17 Jun 2015 14:30:32 GMT"},{"name":"Age","value":"400335"},{"name":"Cache-Control","value":"max-age=2592000"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Access-Control-Allow-Origin","value":"http://*.baidu.com"},{"name":"Content-Encoding","value":"gzip"}],"id":21,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.121Z","url":"http://vs5.bdstatic.com/browse_static/v3/index/pkg/index_sync_css_2_3f1be7f.css"} [DEBUG - 2015-05-23T05:50:54.123Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":48612,"contentType":"text/css","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Content-Type","value":"text/css"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"ETag","value":"W/\"555db643-bde4\""},{"name":"Last-Modified","value":"Thu, 21 May 2015 10:41:07 GMT"},{"name":"Expires","value":"Sat, 20 Jun 2015 10:43:28 GMT"},{"name":"Age","value":"153963"},{"name":"Cache-Control","value":"max-age=2592000"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Access-Control-Allow-Origin","value":"http://*.baidu.com"},{"name":"Content-Encoding","value":"gzip"}],"id":20,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.123Z","url":"http://vs5.bdstatic.com/browse_static/v3/common/pkg/common_ui_video_086ce904.css"} 2015-05-23T13:50:54 [DEBUG] WebPage - updateLoadingProgress: 57 [DEBUG - 2015-05-23T05:50:54.123Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/css","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Content-Type","value":"text/css"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"ETag","value":"W/\"555db643-bde4\""},{"name":"Last-Modified","value":"Thu, 21 May 2015 10:41:07 GMT"},{"name":"Expires","value":"Sat, 20 Jun 2015 10:43:28 GMT"},{"name":"Age","value":"153963"},{"name":"Cache-Control","value":"max-age=2592000"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Access-Control-Allow-Origin","value":"http://*.baidu.com"},{"name":"Content-Encoding","value":"gzip"}],"id":20,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.123Z","url":"http://vs5.bdstatic.com/browse_static/v3/common/pkg/common_ui_video_086ce904.css"} [DEBUG - 2015-05-23T05:50:54.126Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":31203,"contentType":"text/css","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Content-Type","value":"text/css"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"ETag","value":"W/\"5541bdb8-79e3\""},{"name":"Last-Modified","value":"Thu, 30 Apr 2015 05:29:28 GMT"},{"name":"Expires","value":"Mon, 01 Jun 2015 07:34:25 GMT"},{"name":"Age","value":"1807965"},{"name":"Cache-Control","value":"max-age=2592000"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Access-Control-Allow-Origin","value":"http://*.baidu.com"},{"name":"Content-Encoding","value":"gzip"}],"id":18,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.126Z","url":"http://vs5.bdstatic.com/browse_static/v3/common/pkg/common_sync_css_0_f2a7259b.css"} 2015-05-23T13:50:54 [DEBUG] WebPage - updateLoadingProgress: 59 [DEBUG - 2015-05-23T05:50:54.127Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/css","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Content-Type","value":"text/css"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"ETag","value":"W/\"5541bdb8-79e3\""},{"name":"Last-Modified","value":"Thu, 30 Apr 2015 05:29:28 GMT"},{"name":"Expires","value":"Mon, 01 Jun 2015 07:34:25 GMT"},{"name":"Age","value":"1807965"},{"name":"Cache-Control","value":"max-age=2592000"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Access-Control-Allow-Origin","value":"http://*.baidu.com"},{"name":"Content-Encoding","value":"gzip"}],"id":18,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.127Z","url":"http://vs5.bdstatic.com/browse_static/v3/common/pkg/common_sync_css_0_f2a7259b.css"} [DEBUG - 2015-05-23T05:50:54.129Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":5283,"contentType":"text/css","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Content-Type","value":"text/css"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"ETag","value":"W/\"5540cd6a-14a3\""},{"name":"Last-Modified","value":"Wed, 29 Apr 2015 12:24:10 GMT"},{"name":"Expires","value":"Mon, 01 Jun 2015 07:34:23 GMT"},{"name":"Age","value":"1807965"},{"name":"Cache-Control","value":"max-age=2592000"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Access-Control-Allow-Origin","value":"http://*.baidu.com"},{"name":"Content-Encoding","value":"gzip"}],"id":19,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.129Z","url":"http://vs6.bdstatic.com/browse_static/v3/index/pkg/index_sync_css_1_e546a06.css"} [DEBUG - 2015-05-23T05:50:54.129Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/css","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Content-Type","value":"text/css"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"ETag","value":"W/\"5540cd6a-14a3\""},{"name":"Last-Modified","value":"Wed, 29 Apr 2015 12:24:10 GMT"},{"name":"Expires","value":"Mon, 01 Jun 2015 07:34:23 GMT"},{"name":"Age","value":"1807965"},{"name":"Cache-Control","value":"max-age=2592000"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Access-Control-Allow-Origin","value":"http://*.baidu.com"},{"name":"Content-Encoding","value":"gzip"}],"id":19,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.129Z","url":"http://vs6.bdstatic.com/browse_static/v3/index/pkg/index_sync_css_1_e546a06.css"} [DEBUG - 2015-05-23T05:50:54.129Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":20964,"contentType":"text/css","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Content-Type","value":"text/css"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"ETag","value":"W/\"555dacdb-51e4\""},{"name":"Last-Modified","value":"Thu, 21 May 2015 10:00:59 GMT"},{"name":"Expires","value":"Sun, 21 Jun 2015 03:29:28 GMT"},{"name":"Age","value":"94817"},{"name":"Cache-Control","value":"max-age=2592000"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Access-Control-Allow-Origin","value":"http://*.baidu.com"},{"name":"Content-Encoding","value":"gzip"}],"id":23,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.129Z","url":"http://vs6.bdstatic.com/browse_static/v3/index/pkg/index_sync_css_0_df9b187.css"} 2015-05-23T13:50:54 [DEBUG] WebPage - updateLoadingProgress: 62 [DEBUG - 2015-05-23T05:50:54.129Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/css","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Content-Type","value":"text/css"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"ETag","value":"W/\"555dacdb-51e4\""},{"name":"Last-Modified","value":"Thu, 21 May 2015 10:00:59 GMT"},{"name":"Expires","value":"Sun, 21 Jun 2015 03:29:28 GMT"},{"name":"Age","value":"94817"},{"name":"Cache-Control","value":"max-age=2592000"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Access-Control-Allow-Origin","value":"http://*.baidu.com"},{"name":"Content-Encoding","value":"gzip"}],"id":23,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.129Z","url":"http://vs6.bdstatic.com/browse_static/v3/index/pkg/index_sync_css_0_df9b187.css"} [DEBUG - 2015-05-23T05:50:54.131Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":92150,"contentType":"text/css","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Content-Type","value":"text/css"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"ETag","value":"W/\"555c6853-167f6\""},{"name":"Last-Modified","value":"Wed, 20 May 2015 10:56:19 GMT"},{"name":"Expires","value":"Fri, 19 Jun 2015 11:00:02 GMT"},{"name":"Age","value":"240133"},{"name":"Cache-Control","value":"max-age=2592000"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Access-Control-Allow-Origin","value":"http://*.baidu.com"},{"name":"Content-Encoding","value":"gzip"}],"id":22,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.130Z","url":"http://vs6.bdstatic.com/browse_static/v3/index/pkg/home_a57cff4.css"} 2015-05-23T13:50:54 [DEBUG] WebPage - updateLoadingProgress: 68 [DEBUG - 2015-05-23T05:50:54.131Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/css","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Content-Type","value":"text/css"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"ETag","value":"W/\"555c6853-167f6\""},{"name":"Last-Modified","value":"Wed, 20 May 2015 10:56:19 GMT"},{"name":"Expires","value":"Fri, 19 Jun 2015 11:00:02 GMT"},{"name":"Age","value":"240133"},{"name":"Cache-Control","value":"max-age=2592000"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Access-Control-Allow-Origin","value":"http://*.baidu.com"},{"name":"Content-Encoding","value":"gzip"}],"id":22,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.131Z","url":"http://vs6.bdstatic.com/browse_static/v3/index/pkg/home_a57cff4.css"} [DEBUG - 2015-05-23T05:50:54.195Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":4620,"contentType":"text/javascript","headers":[{"name":"Accept-Ranges","value":"bytes"},{"name":"Cache-Control","value":"max-age=311040000"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/javascript"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Etag","value":"\"1267227191\""},{"name":"Expires","value":"Mon, 31 Mar 2025 05:50:54 GMT"},{"name":"Last-Modified","value":"Fri, 23 May 2014 06:06:14 GMT"},{"name":"Server","value":"BWS/1.0"},{"name":"Vary","value":"Accept-Encoding"}],"id":17,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.195Z","url":"http://img.baidu.com/hunter/alog/alog.min.js"} [DEBUG - 2015-05-23T05:50:54.195Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/javascript","headers":[{"name":"Accept-Ranges","value":"bytes"},{"name":"Cache-Control","value":"max-age=311040000"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/javascript"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Etag","value":"\"1267227191\""},{"name":"Expires","value":"Mon, 31 Mar 2025 05:50:54 GMT"},{"name":"Last-Modified","value":"Fri, 23 May 2014 06:06:14 GMT"},{"name":"Server","value":"BWS/1.0"},{"name":"Vary","value":"Accept-Encoding"}],"id":17,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.195Z","url":"http://img.baidu.com/hunter/alog/alog.min.js"} [DEBUG - 2015-05-23T05:50:54.219Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true [DEBUG - 2015-05-23T05:50:54.223Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://v.baidu.com/"}],"id":24,"method":"GET","time":"2015-05-23T05:50:54.223Z","url":"http://img.baidu.com/hunter/alog/monkey.min.js"} [DEBUG - 2015-05-23T05:50:54.224Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://v.baidu.com/"}],"id":25,"method":"GET","time":"2015-05-23T05:50:54.223Z","url":"http://img.baidu.com/hunter/alog/element.min.js"} [DEBUG - 2015-05-23T05:50:54.224Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://v.baidu.com/"}],"id":26,"method":"GET","time":"2015-05-23T05:50:54.224Z","url":"http://img.baidu.com/hunter/video.js?st=-16579"} [DEBUG - 2015-05-23T05:50:54.225Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://v.baidu.com/"}],"id":27,"method":"GET","time":"2015-05-23T05:50:54.225Z","url":"http://vs5.bdstatic.com/browse_static/v3/common/pkg/common_sync_js_0_52611b6d.js"} [DEBUG - 2015-05-23T05:50:54.225Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://v.baidu.com/"}],"id":28,"method":"GET","time":"2015-05-23T05:50:54.225Z","url":"http://vs5.bdstatic.com/browse_static/v3/common/pkg/common_sync_js_3_b08eb3ab.js"} [DEBUG - 2015-05-23T05:50:54.225Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://v.baidu.com/"}],"id":29,"method":"GET","time":"2015-05-23T05:50:54.225Z","url":"http://vs6.bdstatic.com/browse_static/v3/common/pkg/common_sync_js_1_042164bb.js"} [DEBUG - 2015-05-23T05:50:54.225Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://v.baidu.com/"}],"id":30,"method":"GET","time":"2015-05-23T05:50:54.225Z","url":"http://vs6.bdstatic.com/browse_static/v3/common/pkg/common_video_e0d2e385.js"} [DEBUG - 2015-05-23T05:50:54.225Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://v.baidu.com/"}],"id":31,"method":"GET","time":"2015-05-23T05:50:54.225Z","url":"http://vs6.bdstatic.com/browse_static/v3/common/ui/carousel/jCarouselLite_2ef10bec.js"} [DEBUG - 2015-05-23T05:50:54.226Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://v.baidu.com/"}],"id":32,"method":"GET","time":"2015-05-23T05:50:54.226Z","url":"http://vs5.bdstatic.com/browse_static/v3/index/pkg/home_video_ce0a283.js"} [DEBUG - 2015-05-23T05:50:54.226Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://v.baidu.com/"}],"id":33,"method":"GET","time":"2015-05-23T05:50:54.226Z","url":"http://vs5.bdstatic.com/browse_static/v3/index/pkg/index_sync_js_0_a6301a9.js"} 2015-05-23T13:50:54 [DEBUG] WebPage - updateLoadingProgress: 71 [DEBUG - 2015-05-23T05:50:54.226Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html; charset=UTF-8","headers":[{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html; charset=UTF-8"},{"name":"Date","value":"Sat, 23 May 2015 05:50:53 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30538508880984758794052313"},{"name":"X-Powered-By","value":"HPHP"},{"name":"Transfer-Encoding","value":"chunked"}],"id":15,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.226Z","url":"http://v.baidu.com/"} [DEBUG - 2015-05-23T05:50:54.228Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":15266,"contentType":"application/x-javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"Last-Modified","value":"Thu, 30 Apr 2015 05:29:28 GMT"},{"name":"Expires","value":"Tue, 02 Jun 2015 10:34:17 GMT"},{"name":"Age","value":"1710902"},{"name":"Cache-Control","value":"max-age=2592000"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Access-Control-Allow-Origin","value":"http://*.baidu.com"},{"name":"Content-Encoding","value":"gzip"}],"id":28,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.228Z","url":"http://vs5.bdstatic.com/browse_static/v3/common/pkg/common_sync_js_3_b08eb3ab.js"} [DEBUG - 2015-05-23T05:50:54.228Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/x-javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"Last-Modified","value":"Thu, 30 Apr 2015 05:29:28 GMT"},{"name":"Expires","value":"Tue, 02 Jun 2015 10:34:17 GMT"},{"name":"Age","value":"1710902"},{"name":"Cache-Control","value":"max-age=2592000"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Access-Control-Allow-Origin","value":"http://*.baidu.com"},{"name":"Content-Encoding","value":"gzip"}],"id":28,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.228Z","url":"http://vs5.bdstatic.com/browse_static/v3/common/pkg/common_sync_js_3_b08eb3ab.js"} [DEBUG - 2015-05-23T05:50:54.231Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":5380,"contentType":"application/x-javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"ETag","value":"W/\"554710b8-1504\""},{"name":"Last-Modified","value":"Mon, 04 May 2015 06:24:56 GMT"},{"name":"Expires","value":"Wed, 03 Jun 2015 06:33:36 GMT"},{"name":"Age","value":"1638903"},{"name":"Cache-Control","value":"max-age=2592000"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Access-Control-Allow-Origin","value":"http://*.baidu.com"},{"name":"Content-Encoding","value":"gzip"}],"id":31,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.231Z","url":"http://vs6.bdstatic.com/browse_static/v3/common/ui/carousel/jCarouselLite_2ef10bec.js"} 2015-05-23T13:50:54 [DEBUG] WebPage - updateLoadingProgress: 73 [DEBUG - 2015-05-23T05:50:54.231Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/x-javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"ETag","value":"W/\"554710b8-1504\""},{"name":"Last-Modified","value":"Mon, 04 May 2015 06:24:56 GMT"},{"name":"Expires","value":"Wed, 03 Jun 2015 06:33:36 GMT"},{"name":"Age","value":"1638903"},{"name":"Cache-Control","value":"max-age=2592000"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Access-Control-Allow-Origin","value":"http://*.baidu.com"},{"name":"Content-Encoding","value":"gzip"}],"id":31,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.231Z","url":"http://vs6.bdstatic.com/browse_static/v3/common/ui/carousel/jCarouselLite_2ef10bec.js"} [DEBUG - 2015-05-23T05:50:54.232Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":24070,"contentType":"application/x-javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"ETag","value":"W/\"555db643-5e06\""},{"name":"Last-Modified","value":"Thu, 21 May 2015 10:41:07 GMT"},{"name":"Expires","value":"Sat, 20 Jun 2015 10:44:20 GMT"},{"name":"Age","value":"154009"},{"name":"Cache-Control","value":"max-age=2592000"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Access-Control-Allow-Origin","value":"http://*.baidu.com"},{"name":"Content-Encoding","value":"gzip"}],"id":30,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.232Z","url":"http://vs6.bdstatic.com/browse_static/v3/common/pkg/common_video_e0d2e385.js"} 2015-05-23T13:50:54 [DEBUG] WebPage - updateLoadingProgress: 75 [DEBUG - 2015-05-23T05:50:54.232Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/x-javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"ETag","value":"W/\"555db643-5e06\""},{"name":"Last-Modified","value":"Thu, 21 May 2015 10:41:07 GMT"},{"name":"Expires","value":"Sat, 20 Jun 2015 10:44:20 GMT"},{"name":"Age","value":"154009"},{"name":"Cache-Control","value":"max-age=2592000"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Access-Control-Allow-Origin","value":"http://*.baidu.com"},{"name":"Content-Encoding","value":"gzip"}],"id":30,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.232Z","url":"http://vs6.bdstatic.com/browse_static/v3/common/pkg/common_video_e0d2e385.js"} [DEBUG - 2015-05-23T05:50:54.232Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":21650,"contentType":"application/x-javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"ETag","value":"W/\"555c6853-5492\""},{"name":"Last-Modified","value":"Wed, 20 May 2015 10:56:19 GMT"},{"name":"Expires","value":"Fri, 19 Jun 2015 11:01:43 GMT"},{"name":"Age","value":"240133"},{"name":"Cache-Control","value":"max-age=2592000"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Access-Control-Allow-Origin","value":"http://*.baidu.com"},{"name":"Content-Encoding","value":"gzip"}],"id":32,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.232Z","url":"http://vs5.bdstatic.com/browse_static/v3/index/pkg/home_video_ce0a283.js"} 2015-05-23T13:50:54 [DEBUG] WebPage - updateLoadingProgress: 77 [DEBUG - 2015-05-23T05:50:54.232Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/x-javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"ETag","value":"W/\"555c6853-5492\""},{"name":"Last-Modified","value":"Wed, 20 May 2015 10:56:19 GMT"},{"name":"Expires","value":"Fri, 19 Jun 2015 11:01:43 GMT"},{"name":"Age","value":"240133"},{"name":"Cache-Control","value":"max-age=2592000"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Access-Control-Allow-Origin","value":"http://*.baidu.com"},{"name":"Content-Encoding","value":"gzip"}],"id":32,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.232Z","url":"http://vs5.bdstatic.com/browse_static/v3/index/pkg/home_video_ce0a283.js"} [DEBUG - 2015-05-23T05:50:54.233Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":2510,"contentType":"application/x-javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"ETag","value":"W/\"5540cd6a-9ce\""},{"name":"Last-Modified","value":"Wed, 29 Apr 2015 12:24:10 GMT"},{"name":"Expires","value":"Mon, 01 Jun 2015 07:34:27 GMT"},{"name":"Age","value":"1807963"},{"name":"Cache-Control","value":"max-age=2592000"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Access-Control-Allow-Origin","value":"http://*.baidu.com"},{"name":"Content-Encoding","value":"gzip"}],"id":33,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.232Z","url":"http://vs5.bdstatic.com/browse_static/v3/index/pkg/index_sync_js_0_a6301a9.js"} [DEBUG - 2015-05-23T05:50:54.233Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/x-javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"ETag","value":"W/\"5540cd6a-9ce\""},{"name":"Last-Modified","value":"Wed, 29 Apr 2015 12:24:10 GMT"},{"name":"Expires","value":"Mon, 01 Jun 2015 07:34:27 GMT"},{"name":"Age","value":"1807963"},{"name":"Cache-Control","value":"max-age=2592000"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Access-Control-Allow-Origin","value":"http://*.baidu.com"},{"name":"Content-Encoding","value":"gzip"}],"id":33,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.233Z","url":"http://vs5.bdstatic.com/browse_static/v3/index/pkg/index_sync_js_0_a6301a9.js"} [DEBUG - 2015-05-23T05:50:54.235Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":43820,"contentType":"application/x-javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"ETag","value":"W/\"555c42d7-25689\""},{"name":"Last-Modified","value":"Wed, 20 May 2015 08:16:23 GMT"},{"name":"Expires","value":"Fri, 19 Jun 2015 08:31:23 GMT"},{"name":"Age","value":"249464"},{"name":"Cache-Control","value":"max-age=2592000"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Access-Control-Allow-Origin","value":"http://*.baidu.com"},{"name":"Content-Encoding","value":"gzip"}],"id":27,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.235Z","url":"http://vs5.bdstatic.com/browse_static/v3/common/pkg/common_sync_js_0_52611b6d.js"} 2015-05-23T13:50:54 [DEBUG] WebPage - updateLoadingProgress: 81 [DEBUG - 2015-05-23T05:50:54.236Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":47225,"contentType":"application/x-javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"ETag","value":"W/\"55556579-1042f\""},{"name":"Last-Modified","value":"Fri, 15 May 2015 03:18:17 GMT"},{"name":"Expires","value":"Sun, 14 Jun 2015 03:25:07 GMT"},{"name":"Age","value":"699135"},{"name":"Cache-Control","value":"max-age=2592000"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Access-Control-Allow-Origin","value":"http://*.baidu.com"},{"name":"Content-Encoding","value":"gzip"}],"id":29,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.235Z","url":"http://vs6.bdstatic.com/browse_static/v3/common/pkg/common_sync_js_1_042164bb.js"} 2015-05-23T13:50:54 [DEBUG] WebPage - updateLoadingProgress: 84 [DEBUG - 2015-05-23T05:50:54.236Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/x-javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"ETag","value":"W/\"55556579-1042f\""},{"name":"Last-Modified","value":"Fri, 15 May 2015 03:18:17 GMT"},{"name":"Expires","value":"Sun, 14 Jun 2015 03:25:07 GMT"},{"name":"Age","value":"699135"},{"name":"Cache-Control","value":"max-age=2592000"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Access-Control-Allow-Origin","value":"http://*.baidu.com"},{"name":"Content-Encoding","value":"gzip"}],"id":29,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.236Z","url":"http://vs6.bdstatic.com/browse_static/v3/common/pkg/common_sync_js_1_042164bb.js"} 2015-05-23T13:50:54 [DEBUG] WebPage - updateLoadingProgress: 86 [DEBUG - 2015-05-23T05:50:54.241Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/x-javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"ETag","value":"W/\"555c42d7-25689\""},{"name":"Last-Modified","value":"Wed, 20 May 2015 08:16:23 GMT"},{"name":"Expires","value":"Fri, 19 Jun 2015 08:31:23 GMT"},{"name":"Age","value":"249464"},{"name":"Cache-Control","value":"max-age=2592000"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Access-Control-Allow-Origin","value":"http://*.baidu.com"},{"name":"Content-Encoding","value":"gzip"}],"id":27,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.240Z","url":"http://vs5.bdstatic.com/browse_static/v3/common/pkg/common_sync_js_0_52611b6d.js"} [DEBUG - 2015-05-23T05:50:54.275Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/javascript, application/javascript, application/ecmascript, application/x-ecmascript, */*; q=0.01"},{"name":"Referer","value":"http://v.baidu.com/"}],"id":34,"method":"GET","time":"2015-05-23T05:50:54.275Z","url":"http://v.baidu.com/d?m=uss&word=1432360254274&callback=video_login_callback&_=1432360254252"} [DEBUG - 2015-05-23T05:50:54.285Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://v.baidu.com/"}],"id":35,"method":"GET","time":"2015-05-23T05:50:54.285Z","url":"http://vs3.bdstatic.com/pc_static/open/record/bdv-record-min.js?bdv=0924"} [DEBUG - 2015-05-23T05:50:54.286Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/javascript, application/javascript, application/ecmascript, application/x-ecmascript, */*; q=0.01"},{"name":"Referer","value":"http://v.baidu.com/"}],"id":36,"method":"GET","time":"2015-05-23T05:50:54.286Z","url":"http://v.baidu.com/staticapi/videoAd.json?callback=videoNewAd&_=1432360254253"} [DEBUG - 2015-05-23T05:50:54.287Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/javascript, application/javascript, application/ecmascript, application/x-ecmascript, */*; q=0.01"},{"name":"Referer","value":"http://v.baidu.com/"}],"id":37,"method":"GET","time":"2015-05-23T05:50:54.287Z","url":"http://v.baidu.com/videoapi/?page_name=navcommon&block_sign=list_common_ad_promote&format=json&callback=jQuery1111009549724566750228_1432360254254&_=1432360254255"} 2015-05-23T13:50:54 [DEBUG] Cache hit level 1 2015-05-23T13:50:54 [DEBUG] Cache hit level 1 2015-05-23T13:50:54 [DEBUG] Cache hit level 1 2015-05-23T13:50:54 [DEBUG] Cache hit level 1 2015-05-23T13:50:54 [DEBUG] Cache hit level 1 [DEBUG - 2015-05-23T05:50:54.371Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/javascript, application/javascript, application/ecmascript, application/x-ecmascript, */*; q=0.01"},{"name":"Referer","value":"http://v.baidu.com/"}],"id":38,"method":"GET","time":"2015-05-23T05:50:54.371Z","url":"http://v.baidu.com/channel/freeapi?callback=jQuery1111009549724566750228_1432360254256&type=cur&_=1432360254257"} [DEBUG - 2015-05-23T05:50:54.374Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://v.baidu.com/"}],"id":39,"method":"GET","time":"2015-05-23T05:50:54.374Z","url":"http://static.pay.baidu.com/resource/tuisong/v1/tuiSong.js?_=1432360254258"} [DEBUG - 2015-05-23T05:50:54.377Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Referer","value":"http://v.baidu.com/"},{"name":"Accept","value":"*/*"}],"id":40,"method":"GET","time":"2015-05-23T05:50:54.377Z","url":"http://v.baidu.com/?pagelets%5B%5D=pager1&force_mode=1&t=108758"} [DEBUG - 2015-05-23T05:50:54.378Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/javascript, application/javascript, application/ecmascript, application/x-ecmascript, */*; q=0.01"},{"name":"Referer","value":"http://v.baidu.com/"}],"id":41,"method":"GET","time":"2015-05-23T05:50:54.378Z","url":"http://v.baidu.com/commonapi/xiu8/?callback=jQuery1111009549724566750228_1432360254259&_=1432360254260"} [DEBUG - 2015-05-23T05:50:54.379Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://v.baidu.com/"}],"id":42,"method":"GET","time":"2015-05-23T05:50:54.379Z","url":"http://cbjs.baidu.com/js/m.js?_=1432360254261"} [DEBUG - 2015-05-23T05:50:54.380Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/javascript, application/javascript, application/ecmascript, application/x-ecmascript, */*; q=0.01"},{"name":"Referer","value":"http://v.baidu.com/"}],"id":43,"method":"GET","time":"2015-05-23T05:50:54.380Z","url":"http://v.baidu.com/staticapi/videoAdOld.json?v=49735&_=1432360254262"} [DEBUG - 2015-05-23T05:50:54.381Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true [DEBUG - 2015-05-23T05:50:54.382Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":43,"contentType":"image/gif","headers":[{"name":"Cache-Control","value":"private, max-age=0, no-cache"},{"name":"Content-Length","value":"43"},{"name":"Content-Type","value":"image/gif"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Pragma","value":"no-cache"},{"name":"Server","value":"apache"},{"name":"X-Content-Type-Options","value":"nosniff"}],"id":16,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.382Z","url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=564%2C564&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=617328057&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3&tt=%E7%99%BE%E5%BA%A6%E5%9B%BE%E7%89%87%E2%80%94%E5%85%A8%E7%90%83%E6%9C%80%E5%A4%A7%E4%B8%AD%E6%96%87%E5%9B%BE%E7%89%87%E5%BA%93"} 2015-05-23T13:50:54 [DEBUG] Network - Resource request error: 5 ( "Operation canceled" ) URL: "http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=564,564&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=617328057&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3&tt=百度图片—全球最大中文图片库" [DEBUG - 2015-05-23T05:50:54.382Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceError - {"errorCode":5,"errorString":"Operation canceled","id":16,"url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=564,564&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=617328057&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3&tt=百度图片—全球最大中文图片库"} [DEBUG - 2015-05-23T05:50:54.382Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"image/gif","headers":[{"name":"Cache-Control","value":"private, max-age=0, no-cache"},{"name":"Content-Length","value":"43"},{"name":"Content-Type","value":"image/gif"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Pragma","value":"no-cache"},{"name":"Server","value":"apache"},{"name":"X-Content-Type-Options","value":"nosniff"}],"id":16,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.382Z","url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=564%2C564&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=617328057&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3&tt=%E7%99%BE%E5%BA%A6%E5%9B%BE%E7%89%87%E2%80%94%E5%85%A8%E7%90%83%E6%9C%80%E5%A4%A7%E4%B8%AD%E6%96%87%E5%9B%BE%E7%89%87%E5%BA%93"} [DEBUG - 2015-05-23T05:50:54.382Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":66266,"contentType":"text/javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Content-Type","value":"text/javascript"},{"name":"Connection","value":"close"},{"name":"ETag","value":"\"2330492282\""},{"name":"Last-Modified","value":"Tue, 08 Apr 2014 08:42:18 GMT"},{"name":"Expires","value":"Mon, 21 Sep 2015 06:37:28 GMT"},{"name":"Age","value":"20646806"},{"name":"Cache-Control","value":"max-age=31104000"},{"name":"Accept-Ranges","value":"bytes"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Content-Encoding","value":"gzip"}],"id":35,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.382Z","url":"http://vs3.bdstatic.com/pc_static/open/record/bdv-record-min.js?bdv=0924"} 2015-05-23T13:50:54 [DEBUG] WebPage - updateLoadingProgress: 88 [DEBUG - 2015-05-23T05:50:54.383Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Content-Type","value":"text/javascript"},{"name":"Connection","value":"close"},{"name":"ETag","value":"\"2330492282\""},{"name":"Last-Modified","value":"Tue, 08 Apr 2014 08:42:18 GMT"},{"name":"Expires","value":"Mon, 21 Sep 2015 06:37:28 GMT"},{"name":"Age","value":"20646806"},{"name":"Cache-Control","value":"max-age=31104000"},{"name":"Accept-Ranges","value":"bytes"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Content-Encoding","value":"gzip"}],"id":35,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.382Z","url":"http://vs3.bdstatic.com/pc_static/open/record/bdv-record-min.js?bdv=0924"} [DEBUG - 2015-05-23T05:50:54.383Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":2901,"contentType":"text/javascript","headers":[{"name":"Accept-Ranges","value":"bytes"},{"name":"Cache-Control","value":"max-age=311040000"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/javascript"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Etag","value":"\"923391318\""},{"name":"Expires","value":"Mon, 31 Mar 2025 05:50:54 GMT"},{"name":"Last-Modified","value":"Wed, 19 Jun 2013 07:19:53 GMT"},{"name":"Server","value":"BWS/1.0"},{"name":"Vary","value":"Accept-Encoding"}],"id":24,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.383Z","url":"http://img.baidu.com/hunter/alog/monkey.min.js"} [DEBUG - 2015-05-23T05:50:54.383Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/javascript","headers":[{"name":"Accept-Ranges","value":"bytes"},{"name":"Cache-Control","value":"max-age=311040000"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/javascript"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Etag","value":"\"923391318\""},{"name":"Expires","value":"Mon, 31 Mar 2025 05:50:54 GMT"},{"name":"Last-Modified","value":"Wed, 19 Jun 2013 07:19:53 GMT"},{"name":"Server","value":"BWS/1.0"},{"name":"Vary","value":"Accept-Encoding"}],"id":24,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.383Z","url":"http://img.baidu.com/hunter/alog/monkey.min.js"} [DEBUG - 2015-05-23T05:50:54.390Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":31199,"contentType":"application/x-javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"Last-Modified","value":"Mon, 11 May 2015 03:49:01 GMT"},{"name":"Expires","value":"Sat, 23 May 2015 05:51:39 GMT"},{"name":"Age","value":"255"},{"name":"Cache-Control","value":"max-age=300"},{"name":"Content-Encoding","value":"gzip"}],"id":42,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.390Z","url":"http://cbjs.baidu.com/js/m.js?_=1432360254261"} [DEBUG - 2015-05-23T05:50:54.390Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/x-javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"Last-Modified","value":"Mon, 11 May 2015 03:49:01 GMT"},{"name":"Expires","value":"Sat, 23 May 2015 05:51:39 GMT"},{"name":"Age","value":"255"},{"name":"Cache-Control","value":"max-age=300"},{"name":"Content-Encoding","value":"gzip"}],"id":42,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.390Z","url":"http://cbjs.baidu.com/js/m.js?_=1432360254261"} [DEBUG - 2015-05-23T05:50:54.399Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":49,"contentType":"text/javascript","headers":[{"name":"Accept-Ranges","value":"bytes"},{"name":"Cache-Control","value":"max-age=311040000"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/javascript"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Etag","value":"\"1969802158\""},{"name":"Expires","value":"Mon, 31 Mar 2025 05:50:54 GMT"},{"name":"Last-Modified","value":"Sun, 18 Jan 2015 01:30:01 GMT"},{"name":"Server","value":"BWS/1.0"},{"name":"Vary","value":"Accept-Encoding"}],"id":26,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.399Z","url":"http://img.baidu.com/hunter/video.js?st=-16579"} [DEBUG - 2015-05-23T05:50:54.399Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/javascript","headers":[{"name":"Accept-Ranges","value":"bytes"},{"name":"Cache-Control","value":"max-age=311040000"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/javascript"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Etag","value":"\"1969802158\""},{"name":"Expires","value":"Mon, 31 Mar 2025 05:50:54 GMT"},{"name":"Last-Modified","value":"Sun, 18 Jan 2015 01:30:01 GMT"},{"name":"Server","value":"BWS/1.0"},{"name":"Vary","value":"Accept-Encoding"}],"id":26,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.399Z","url":"http://img.baidu.com/hunter/video.js?st=-16579"} [DEBUG - 2015-05-23T05:50:54.399Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":2521,"contentType":"text/javascript","headers":[{"name":"Accept-Ranges","value":"bytes"},{"name":"Cache-Control","value":"max-age=311040000"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/javascript"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Etag","value":"\"2511065917\""},{"name":"Expires","value":"Mon, 31 Mar 2025 05:50:54 GMT"},{"name":"Last-Modified","value":"Thu, 26 Jun 2014 11:32:18 GMT"},{"name":"Server","value":"BWS/1.0"},{"name":"Vary","value":"Accept-Encoding"}],"id":25,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.399Z","url":"http://img.baidu.com/hunter/alog/element.min.js"} [DEBUG - 2015-05-23T05:50:54.399Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/javascript","headers":[{"name":"Accept-Ranges","value":"bytes"},{"name":"Cache-Control","value":"max-age=311040000"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/javascript"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Etag","value":"\"2511065917\""},{"name":"Expires","value":"Mon, 31 Mar 2025 05:50:54 GMT"},{"name":"Last-Modified","value":"Thu, 26 Jun 2014 11:32:18 GMT"},{"name":"Server","value":"BWS/1.0"},{"name":"Vary","value":"Accept-Encoding"}],"id":25,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.399Z","url":"http://img.baidu.com/hunter/alog/element.min.js"} [DEBUG - 2015-05-23T05:50:54.403Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":140,"contentType":"text/javascript;charset=gb2312","headers":[{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/javascript;charset=gb2312"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Server","value":"apache"},{"name":"Vary","value":"Accept-Encoding"},{"name":"X-Powered-By","value":"PHP/5.2.10"}],"id":34,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.403Z","url":"http://v.baidu.com/d?m=uss&word=1432360254274&callback=video_login_callback&_=1432360254252"} [DEBUG - 2015-05-23T05:50:54.404Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/javascript;charset=gb2312","headers":[{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/javascript;charset=gb2312"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Server","value":"apache"},{"name":"Vary","value":"Accept-Encoding"},{"name":"X-Powered-By","value":"PHP/5.2.10"}],"id":34,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.404Z","url":"http://v.baidu.com/d?m=uss&word=1432360254274&callback=video_login_callback&_=1432360254252"} [DEBUG - 2015-05-23T05:50:54.482Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true [DEBUG - 2015-05-23T05:50:54.519Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":1941,"contentType":"text/json","headers":[{"name":"Accept-Ranges","value":"bytes"},{"name":"Content-Length","value":"1941"},{"name":"Content-Type","value":"text/json"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Etag","value":"\"3175798706\""},{"name":"Last-Modified","value":"Sat, 23 May 2015 05:50:17 GMT"},{"name":"Server","value":"apache"}],"id":36,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.519Z","url":"http://v.baidu.com/staticapi/videoAd.json?callback=videoNewAd&_=1432360254253"} 2015-05-23T13:50:54 [DEBUG] WebPage - updateLoadingProgress: 89 [DEBUG - 2015-05-23T05:50:54.520Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/json","headers":[{"name":"Accept-Ranges","value":"bytes"},{"name":"Content-Length","value":"1941"},{"name":"Content-Type","value":"text/json"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Etag","value":"\"3175798706\""},{"name":"Last-Modified","value":"Sat, 23 May 2015 05:50:17 GMT"},{"name":"Server","value":"apache"}],"id":36,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.520Z","url":"http://v.baidu.com/staticapi/videoAd.json?callback=videoNewAd&_=1432360254253"} [DEBUG - 2015-05-23T05:50:54.538Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":1973,"contentType":"application/x-javascript","headers":[{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30544440530867318282052313"},{"name":"X-Powered-By","value":"HPHP"}],"id":37,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.538Z","url":"http://v.baidu.com/videoapi/?page_name=navcommon&block_sign=list_common_ad_promote&format=json&callback=jQuery1111009549724566750228_1432360254254&_=1432360254255"} [DEBUG - 2015-05-23T05:50:54.538Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/x-javascript","headers":[{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30544440530867318282052313"},{"name":"X-Powered-By","value":"HPHP"}],"id":37,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.538Z","url":"http://v.baidu.com/videoapi/?page_name=navcommon&block_sign=list_common_ad_promote&format=json&callback=jQuery1111009549724566750228_1432360254254&_=1432360254255"} [DEBUG - 2015-05-23T05:50:54.539Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":1298,"contentType":"application/x-javascript","headers":[{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30544475380280504842052313"},{"name":"X-Powered-By","value":"HPHP"}],"id":38,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.539Z","url":"http://v.baidu.com/channel/freeapi?callback=jQuery1111009549724566750228_1432360254256&type=cur&_=1432360254257"} [DEBUG - 2015-05-23T05:50:54.539Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/x-javascript","headers":[{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30544475380280504842052313"},{"name":"X-Powered-By","value":"HPHP"}],"id":38,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.539Z","url":"http://v.baidu.com/channel/freeapi?callback=jQuery1111009549724566750228_1432360254256&type=cur&_=1432360254257"} [DEBUG - 2015-05-23T05:50:54.541Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/javascript, application/javascript, application/ecmascript, application/x-ecmascript, */*; q=0.01"},{"name":"Referer","value":"http://v.baidu.com/"}],"id":44,"method":"GET","time":"2015-05-23T05:50:54.541Z","url":"http://v.baidu.com/movie_intro/?callback=jQuery1111009549724566750228_1432360254256&id=23019&dtype=basic&service=json&_=1432360254263"} [DEBUG - 2015-05-23T05:50:54.582Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true [DEBUG - 2015-05-23T05:50:54.615Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":5328,"contentType":"text/json","headers":[{"name":"Accept-Ranges","value":"bytes"},{"name":"Content-Length","value":"16748"},{"name":"Content-Type","value":"text/json"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Etag","value":"\"3117112929\""},{"name":"Last-Modified","value":"Sat, 23 May 2015 05:50:18 GMT"},{"name":"Server","value":"apache"}],"id":43,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.615Z","url":"http://v.baidu.com/staticapi/videoAdOld.json?v=49735&_=1432360254262"} [DEBUG - 2015-05-23T05:50:54.625Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":89,"contentType":"application/x-javascript","headers":[{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Server","value":"apache"},{"name":"Vary","value":"Accept-Encoding"},{"name":"X-Powered-By","value":"PHP/5.2.17"}],"id":41,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.625Z","url":"http://v.baidu.com/commonapi/xiu8/?callback=jQuery1111009549724566750228_1432360254259&_=1432360254260"} 2015-05-23T13:50:54 [DEBUG] WebPage - updateLoadingProgress: 89 [DEBUG - 2015-05-23T05:50:54.626Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/x-javascript","headers":[{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Server","value":"apache"},{"name":"Vary","value":"Accept-Encoding"},{"name":"X-Powered-By","value":"PHP/5.2.17"}],"id":41,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.625Z","url":"http://v.baidu.com/commonapi/xiu8/?callback=jQuery1111009549724566750228_1432360254259&_=1432360254260"} [DEBUG - 2015-05-23T05:50:54.682Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true 2015-05-23T13:50:54 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360253|; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:54 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:54 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:50:54 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360254; domain=.image.baidu.com; path=/" 2015-05-23T13:50:54 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:50:54 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" [DEBUG - 2015-05-23T05:50:54.688Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":89053,"contentType":"text/json;charset: utf-8;charset=utf-8","headers":[{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/json;charset: utf-8;charset=utf-8"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30545265390928131594052313"},{"name":"X-Powered-By","value":"HPHP"},{"name":"Transfer-Encoding","value":"chunked"}],"id":40,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.688Z","url":"http://v.baidu.com/?pagelets%5B%5D=pager1&force_mode=1&t=108758"} [DEBUG - 2015-05-23T05:50:54.689Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/json;charset: utf-8;charset=utf-8","headers":[{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/json;charset: utf-8;charset=utf-8"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30545265390928131594052313"},{"name":"X-Powered-By","value":"HPHP"},{"name":"Transfer-Encoding","value":"chunked"}],"id":40,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.689Z","url":"http://v.baidu.com/?pagelets%5B%5D=pager1&force_mode=1&t=108758"} [DEBUG - 2015-05-23T05:50:54.716Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":1535,"contentType":"application/x-javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"Last-Modified","value":"Wed, 12 Nov 2014 03:54:35 GMT"},{"name":"Expires","value":"Sat, 23 May 2015 06:50:54 GMT"},{"name":"Cache-Control","value":"max-age=3600"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Content-Encoding","value":"gzip"}],"id":39,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.716Z","url":"http://static.pay.baidu.com/resource/tuisong/v1/tuiSong.js?_=1432360254258"} [DEBUG - 2015-05-23T05:50:54.716Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/x-javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"Last-Modified","value":"Wed, 12 Nov 2014 03:54:35 GMT"},{"name":"Expires","value":"Sat, 23 May 2015 06:50:54 GMT"},{"name":"Cache-Control","value":"max-age=3600"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Content-Encoding","value":"gzip"}],"id":39,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.716Z","url":"http://static.pay.baidu.com/resource/tuisong/v1/tuiSong.js?_=1432360254258"} [DEBUG - 2015-05-23T05:50:54.717Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://v.baidu.com/"}],"id":45,"method":"GET","time":"2015-05-23T05:50:54.717Z","url":"http://static.pay.baidu.com/resource/tuisong/v1/lib/esl.js"} [DEBUG - 2015-05-23T05:50:54.722Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":48896,"contentType":"application/x-javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"Last-Modified","value":"Wed, 15 Oct 2014 10:56:27 GMT"},{"name":"Expires","value":"Sat, 23 May 2015 06:08:42 GMT"},{"name":"Age","value":"2532"},{"name":"Cache-Control","value":"max-age=86400"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Content-Encoding","value":"gzip"}],"id":45,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.722Z","url":"http://static.pay.baidu.com/resource/tuisong/v1/lib/esl.js"} [DEBUG - 2015-05-23T05:50:54.722Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/x-javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"Last-Modified","value":"Wed, 15 Oct 2014 10:56:27 GMT"},{"name":"Expires","value":"Sat, 23 May 2015 06:08:42 GMT"},{"name":"Age","value":"2532"},{"name":"Cache-Control","value":"max-age=86400"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Content-Encoding","value":"gzip"}],"id":45,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.722Z","url":"http://static.pay.baidu.com/resource/tuisong/v1/lib/esl.js"} [DEBUG - 2015-05-23T05:50:54.724Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://v.baidu.com/"}],"id":46,"method":"GET","time":"2015-05-23T05:50:54.724Z","url":"http://static.pay.baidu.com/resource/tuisong/v1/site/init.js"} 2015-05-23T13:50:54 [DEBUG] WebPage - updateLoadingProgress: 90 [DEBUG - 2015-05-23T05:50:54.727Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/json","headers":[{"name":"Accept-Ranges","value":"bytes"},{"name":"Content-Length","value":"16748"},{"name":"Content-Type","value":"text/json"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Etag","value":"\"3117112929\""},{"name":"Last-Modified","value":"Sat, 23 May 2015 05:50:18 GMT"},{"name":"Server","value":"apache"}],"id":43,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.727Z","url":"http://v.baidu.com/staticapi/videoAdOld.json?v=49735&_=1432360254262"} [DEBUG - 2015-05-23T05:50:54.729Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/javascript, application/javascript, application/ecmascript, application/x-ecmascript, */*; q=0.01"},{"name":"Referer","value":"http://v.baidu.com/"}],"id":47,"method":"GET","time":"2015-05-23T05:50:54.729Z","url":"http://v.baidu.com/channel/freeapi?callback=jQuery1111009549724566750228_1432360254259&type=cur&_=1432360254264"} [DEBUG - 2015-05-23T05:50:54.732Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":139118,"contentType":"application/x-javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"Last-Modified","value":"Thu, 14 May 2015 11:25:14 GMT"},{"name":"Expires","value":"Sat, 23 May 2015 06:39:53 GMT"},{"name":"Age","value":"661"},{"name":"Cache-Control","value":"max-age=3600"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Content-Encoding","value":"gzip"}],"id":46,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.732Z","url":"http://static.pay.baidu.com/resource/tuisong/v1/site/init.js"} [DEBUG - 2015-05-23T05:50:54.733Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/x-javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"Last-Modified","value":"Thu, 14 May 2015 11:25:14 GMT"},{"name":"Expires","value":"Sat, 23 May 2015 06:39:53 GMT"},{"name":"Age","value":"661"},{"name":"Cache-Control","value":"max-age=3600"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Content-Encoding","value":"gzip"}],"id":46,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.733Z","url":"http://static.pay.baidu.com/resource/tuisong/v1/site/init.js"} [DEBUG - 2015-05-23T05:50:54.757Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://v.baidu.com/"}],"id":48,"method":"GET","time":"2015-05-23T05:50:54.757Z","url":"http://bubble.baidu.com/rs/message/push?callback=jQuery1111009549724566750228_1432360254254&getSettingType=true&_=1432360254265"} [DEBUG - 2015-05-23T05:50:54.777Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Referer","value":"http://v.baidu.com/"},{"name":"Accept","value":"*/*"}],"id":49,"method":"GET","time":"2015-05-23T05:50:54.777Z","url":"http://v.baidu.com/?pagelets%5B%5D=pager2&force_mode=1&t=313175"} [DEBUG - 2015-05-23T05:50:54.782Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true [DEBUG - 2015-05-23T05:50:54.803Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":4198,"contentType":"application/x-javascript","headers":[{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30545794803204927754052313"},{"name":"X-Powered-By","value":"HPHP"}],"id":44,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.803Z","url":"http://v.baidu.com/movie_intro/?callback=jQuery1111009549724566750228_1432360254256&id=23019&dtype=basic&service=json&_=1432360254263"} [DEBUG - 2015-05-23T05:50:54.803Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/x-javascript","headers":[{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30545794803204927754052313"},{"name":"X-Powered-By","value":"HPHP"}],"id":44,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.803Z","url":"http://v.baidu.com/movie_intro/?callback=jQuery1111009549724566750228_1432360254256&id=23019&dtype=basic&service=json&_=1432360254263"} [DEBUG - 2015-05-23T05:50:54.864Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":1298,"contentType":"application/x-javascript","headers":[{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30547732890263596554052313"},{"name":"X-Powered-By","value":"HPHP"}],"id":47,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.864Z","url":"http://v.baidu.com/channel/freeapi?callback=jQuery1111009549724566750228_1432360254259&type=cur&_=1432360254264"} 2015-05-23T13:50:54 [DEBUG] WebPage - updateLoadingProgress: 90 [DEBUG - 2015-05-23T05:50:54.864Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/x-javascript","headers":[{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30547732890263596554052313"},{"name":"X-Powered-By","value":"HPHP"}],"id":47,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.864Z","url":"http://v.baidu.com/channel/freeapi?callback=jQuery1111009549724566750228_1432360254259&type=cur&_=1432360254264"} [DEBUG - 2015-05-23T05:50:54.882Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true 2015-05-23T13:50:54 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360253|; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:54 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:54 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:50:54 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360254; domain=.image.baidu.com; path=/" 2015-05-23T13:50:54 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:50:54 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:50:54 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:50:54 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" [DEBUG - 2015-05-23T05:50:54.921Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":736,"contentType":"text/plain;charset=UTF-8","headers":[{"name":"Server","value":"nginx"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Content-Type","value":"text/plain;charset=UTF-8"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Set-Cookie","value":"mc_2015-05-23=\"1140@1\"; Version=1; Max-Age=3600; Expires=Sat, 23-May-2015 06:50:54 GMT\nPUSH_TIMESTAMP=1432360254875; Expires=Sat, 23-May-2015 06:50:54 GMT"},{"name":"Content-Encoding","value":"gzip"}],"id":48,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.921Z","url":"http://bubble.baidu.com/rs/message/push?callback=jQuery1111009549724566750228_1432360254254&getSettingType=true&_=1432360254265"} [DEBUG - 2015-05-23T05:50:54.921Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/plain;charset=UTF-8","headers":[{"name":"Server","value":"nginx"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Content-Type","value":"text/plain;charset=UTF-8"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Set-Cookie","value":"mc_2015-05-23=\"1140@1\"; Version=1; Max-Age=3600; Expires=Sat, 23-May-2015 06:50:54 GMT\nPUSH_TIMESTAMP=1432360254875; Expires=Sat, 23-May-2015 06:50:54 GMT"},{"name":"Content-Encoding","value":"gzip"}],"id":48,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.921Z","url":"http://bubble.baidu.com/rs/message/push?callback=jQuery1111009549724566750228_1432360254254&getSettingType=true&_=1432360254265"} 2015-05-23T13:50:54 [DEBUG] WebPage - setupFrame "-->" 2015-05-23T13:50:54 [DEBUG] WebPage - updateLoadingProgress: 90 [DEBUG - 2015-05-23T05:50:54.930Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://v.baidu.com/"}],"id":50,"method":"GET","time":"2015-05-23T05:50:54.930Z","url":"http://img.baidu.com/hunter/alog/dp.min.js?v=-16579"} 2015-05-23T13:50:54 [DEBUG] WebPage - setupFrame "BAIDU_DUP_fp_iframe" 2015-05-23T13:50:54 [DEBUG] WebPage - updateLoadingProgress: 90 [DEBUG - 2015-05-23T05:50:54.935Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8"},{"name":"Referer","value":"http://v.baidu.com/"}],"id":51,"method":"GET","time":"2015-05-23T05:50:54.935Z","url":"http://pos.baidu.com/wh/o.htm?ltr="} [DEBUG - 2015-05-23T05:50:54.943Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":1394,"contentType":"text/html","headers":[{"name":"Accept-Ranges","value":"bytes"},{"name":"Connection","value":"keep-alive"},{"name":"Content-Length","value":"1394"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Etag","value":"\"5518d81f-572\""},{"name":"Last-Modified","value":"Mon, 30 Mar 2015 04:59:11 GMT"},{"name":"P3p","value":"CP=\" OTI DSP COR IVA OUR IND COM \""},{"name":"Server","value":"nginx"}],"id":51,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.943Z","url":"http://pos.baidu.com/wh/o.htm?ltr="} [DEBUG - 2015-05-23T05:50:54.943Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://pos.baidu.com/wh/o.htm?ltr="}],"id":52,"method":"GET","time":"2015-05-23T05:50:54.943Z","url":"http://dup.baidustatic.com/tpl/wh.js"} [DEBUG - 2015-05-23T05:50:54.943Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://pos.baidu.com/wh/o.htm?ltr="}],"id":53,"method":"GET","time":"2015-05-23T05:50:54.943Z","url":"http://dup.baidustatic.com/tpl/ac.js"} [DEBUG - 2015-05-23T05:50:54.944Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Accept-Ranges","value":"bytes"},{"name":"Connection","value":"keep-alive"},{"name":"Content-Length","value":"1394"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Etag","value":"\"5518d81f-572\""},{"name":"Last-Modified","value":"Mon, 30 Mar 2015 04:59:11 GMT"},{"name":"P3p","value":"CP=\" OTI DSP COR IVA OUR IND COM \""},{"name":"Server","value":"nginx"}],"id":51,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.944Z","url":"http://pos.baidu.com/wh/o.htm?ltr="} [DEBUG - 2015-05-23T05:50:54.949Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":2722,"contentType":"application/x-javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"Last-Modified","value":"Thu, 02 Apr 2015 06:29:51 GMT"},{"name":"Expires","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Age","value":"279"},{"name":"Cache-Control","value":"max-age=300"},{"name":"Content-Encoding","value":"gzip"}],"id":53,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.949Z","url":"http://dup.baidustatic.com/tpl/ac.js"} [DEBUG - 2015-05-23T05:50:54.949Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/x-javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"Last-Modified","value":"Thu, 02 Apr 2015 06:29:51 GMT"},{"name":"Expires","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Age","value":"279"},{"name":"Cache-Control","value":"max-age=300"},{"name":"Content-Encoding","value":"gzip"}],"id":53,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:54.949Z","url":"http://dup.baidustatic.com/tpl/ac.js"} [DEBUG - 2015-05-23T05:50:54.982Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true [DEBUG - 2015-05-23T05:50:55.021Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":3119,"contentType":"text/javascript","headers":[{"name":"Accept-Ranges","value":"bytes"},{"name":"Cache-Control","value":"max-age=311040000"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/javascript"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Etag","value":"\"1633222573\""},{"name":"Expires","value":"Mon, 31 Mar 2025 05:50:54 GMT"},{"name":"Last-Modified","value":"Fri, 09 Jan 2015 03:40:50 GMT"},{"name":"Server","value":"BWS/1.0"},{"name":"Vary","value":"Accept-Encoding"}],"id":50,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:55.021Z","url":"http://img.baidu.com/hunter/alog/dp.min.js?v=-16579"} 2015-05-23T13:50:55 [DEBUG] WebPage - updateLoadingProgress: 90 [DEBUG - 2015-05-23T05:50:55.021Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/javascript","headers":[{"name":"Accept-Ranges","value":"bytes"},{"name":"Cache-Control","value":"max-age=311040000"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/javascript"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Etag","value":"\"1633222573\""},{"name":"Expires","value":"Mon, 31 Mar 2025 05:50:54 GMT"},{"name":"Last-Modified","value":"Fri, 09 Jan 2015 03:40:50 GMT"},{"name":"Server","value":"BWS/1.0"},{"name":"Vary","value":"Accept-Encoding"}],"id":50,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:55.021Z","url":"http://img.baidu.com/hunter/alog/dp.min.js?v=-16579"} [DEBUG - 2015-05-23T05:50:55.082Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true [DEBUG - 2015-05-23T05:50:55.100Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":133898,"contentType":"text/json;charset: utf-8;charset=utf-8","headers":[{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/json;charset: utf-8;charset=utf-8"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30548173390858735370052313"},{"name":"X-Powered-By","value":"HPHP"},{"name":"Transfer-Encoding","value":"chunked"}],"id":49,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:55.100Z","url":"http://v.baidu.com/?pagelets%5B%5D=pager2&force_mode=1&t=313175"} [DEBUG - 2015-05-23T05:50:55.101Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/json;charset: utf-8;charset=utf-8","headers":[{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/json;charset: utf-8;charset=utf-8"},{"name":"Date","value":"Sat, 23 May 2015 05:50:54 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30548173390858735370052313"},{"name":"X-Powered-By","value":"HPHP"},{"name":"Transfer-Encoding","value":"chunked"}],"id":49,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:55.101Z","url":"http://v.baidu.com/?pagelets%5B%5D=pager2&force_mode=1&t=313175"} 2015-05-23T13:50:55 [DEBUG] WebPage - setupFrame "cbgAdsRuntime" 2015-05-23T13:50:55 [DEBUG] WebPage - updateLoadingProgress: 90 [DEBUG - 2015-05-23T05:50:55.103Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"}],"id":54,"method":"GET","time":"2015-05-23T05:50:55.103Z","url":"http://static.pay.baidu.com/resource/ads/all.js"} [DEBUG - 2015-05-23T05:50:55.110Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":52348,"contentType":"application/x-javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:55 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"Last-Modified","value":"Fri, 22 May 2015 12:14:56 GMT"},{"name":"Expires","value":"Sat, 23 May 2015 06:10:46 GMT"},{"name":"Age","value":"2409"},{"name":"Cache-Control","value":"max-age=3600"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Content-Encoding","value":"gzip"}],"id":54,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:55.110Z","url":"http://static.pay.baidu.com/resource/ads/all.js"} [DEBUG - 2015-05-23T05:50:55.114Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/x-javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:55 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"Last-Modified","value":"Fri, 22 May 2015 12:14:56 GMT"},{"name":"Expires","value":"Sat, 23 May 2015 06:10:46 GMT"},{"name":"Age","value":"2409"},{"name":"Cache-Control","value":"max-age=3600"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Content-Encoding","value":"gzip"}],"id":54,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:55.114Z","url":"http://static.pay.baidu.com/resource/ads/all.js"} [DEBUG - 2015-05-23T05:50:55.133Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"}],"id":55,"method":"GET","time":"2015-05-23T05:50:55.132Z","url":"http://baichuan.baidu.com/rs/adp/launch?callback=jQuery11120767825793242082_1432360255124&placeId=1427086921389&referUrl=&location=http%3A%2F%2Fv.baidu.com%2F&_=1432360255125"} [DEBUG - 2015-05-23T05:50:55.133Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"}],"id":56,"method":"GET","time":"2015-05-23T05:50:55.133Z","url":"http://baichuan.baidu.com/rs/adp/launch?callback=jQuery11120767825793242082_1432360255126&placeId=1427086959682&referUrl=&location=http%3A%2F%2Fv.baidu.com%2F&_=1432360255127"} [DEBUG - 2015-05-23T05:50:55.183Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true [DEBUG - 2015-05-23T05:50:55.184Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":36465,"contentType":"application/x-javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:55 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"Last-Modified","value":"Thu, 21 May 2015 03:22:17 GMT"},{"name":"Expires","value":"Sat, 23 May 2015 05:50:38 GMT"},{"name":"Cache-Control","value":"max-age=300"},{"name":"Content-Encoding","value":"gzip"}],"id":52,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:55.184Z","url":"http://dup.baidustatic.com/tpl/wh.js"} 2015-05-23T13:50:55 [DEBUG] WebPage - updateLoadingProgress: 90 [DEBUG - 2015-05-23T05:50:55.186Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/x-javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:55 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"Last-Modified","value":"Thu, 21 May 2015 03:22:17 GMT"},{"name":"Expires","value":"Sat, 23 May 2015 05:50:38 GMT"},{"name":"Cache-Control","value":"max-age=300"},{"name":"Content-Encoding","value":"gzip"}],"id":52,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:55.186Z","url":"http://dup.baidustatic.com/tpl/wh.js"} 2015-05-23T13:50:55 [DEBUG] WebPage - setupFrame "-->" 2015-05-23T13:50:55 [DEBUG] WebPage - updateLoadingProgress: 90 [DEBUG - 2015-05-23T05:50:55.189Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8"},{"name":"Referer","value":"http://pos.baidu.com/wh/o.htm?ltr="}],"id":57,"method":"GET","time":"2015-05-23T05:50:55.189Z","url":"http://eclick.baidu.com/fp.htm?br=5&_=1432360255188"} 2015-05-23T13:50:55 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360253|; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:55 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:55 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:50:55 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360254; domain=.image.baidu.com; path=/" 2015-05-23T13:50:55 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:50:55 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:50:55 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:50:55 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:50:55 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" [DEBUG - 2015-05-23T05:50:55.190Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://pos.baidu.com/wh/o.htm?ltr="}],"id":58,"method":"GET","time":"2015-05-23T05:50:55.190Z","url":"http://ec.pos.baidu.com/b.php"} [DEBUG - 2015-05-23T05:50:55.283Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true [DEBUG - 2015-05-23T05:50:55.359Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":114,"contentType":"text/html","headers":[{"name":"Server","value":"nginx"},{"name":"Date","value":"Sat, 23 May 2015 05:50:55 GMT"},{"name":"Content-Type","value":"text/html"},{"name":"Content-Length","value":"114"},{"name":"Last-Modified","value":"Thu, 21 May 2015 04:02:02 GMT"},{"name":"Connection","value":"keep-alive"},{"name":"ETag","value":"\"555d58ba-72\""},{"name":"Expires","value":"Sat, 23 May 2015 05:50:55 GMT"},{"name":"Cache-Control","value":"max-age=0"},{"name":"Accept-Ranges","value":"bytes"}],"id":57,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:55.359Z","url":"http://eclick.baidu.com/fp.htm?br=5&_=1432360255188"} [DEBUG - 2015-05-23T05:50:55.359Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Server","value":"nginx"},{"name":"Date","value":"Sat, 23 May 2015 05:50:55 GMT"},{"name":"Content-Type","value":"text/html"},{"name":"Content-Length","value":"114"},{"name":"Last-Modified","value":"Thu, 21 May 2015 04:02:02 GMT"},{"name":"Connection","value":"keep-alive"},{"name":"ETag","value":"\"555d58ba-72\""},{"name":"Expires","value":"Sat, 23 May 2015 05:50:55 GMT"},{"name":"Cache-Control","value":"max-age=0"},{"name":"Accept-Ranges","value":"bytes"}],"id":57,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:55.359Z","url":"http://eclick.baidu.com/fp.htm?br=5&_=1432360255188"} 2015-05-23T13:50:55 [DEBUG] WebPage - updateLoadingProgress: 90 [DEBUG - 2015-05-23T05:50:55.383Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true [DEBUG - 2015-05-23T05:50:55.430Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html; charset=UTF-8","headers":[{"name":"Server","value":"nginx"},{"name":"Date","value":"Sat, 23 May 2015 05:50:55 GMT"},{"name":"Content-Type","value":"text/html; charset=UTF-8"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"keep-alive"},{"name":"X-Powered-By","value":"PHP/5.6.0"}],"id":58,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:55.430Z","url":"http://ec.pos.baidu.com/b.php"} 2015-05-23T13:50:55 [DEBUG] WebPage - updateLoadingProgress: 100 [DEBUG - 2015-05-23T05:50:55.430Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _oneShotCallback - onLoadFinished [DEBUG - 2015-05-23T05:50:55.430Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - onLoadFinished: success 2015-05-23T13:50:55 [DEBUG] WebPage - setupFrame "" [DEBUG - 2015-05-23T05:50:55.440Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":569,"contentType":"application/json;charset=UTF-8","headers":[{"name":"Server","value":"nginx"},{"name":"Date","value":"Sat, 23 May 2015 05:50:55 GMT"},{"name":"Content-Type","value":"application/json;charset=UTF-8"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"}],"id":55,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:55.440Z","url":"http://baichuan.baidu.com/rs/adp/launch?callback=jQuery11120767825793242082_1432360255124&placeId=1427086921389&referUrl=&location=http%3A%2F%2Fv.baidu.com%2F&_=1432360255125"} [DEBUG - 2015-05-23T05:50:55.440Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/json;charset=UTF-8","headers":[{"name":"Server","value":"nginx"},{"name":"Date","value":"Sat, 23 May 2015 05:50:55 GMT"},{"name":"Content-Type","value":"application/json;charset=UTF-8"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"}],"id":55,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:55.440Z","url":"http://baichuan.baidu.com/rs/adp/launch?callback=jQuery11120767825793242082_1432360255124&placeId=1427086921389&referUrl=&location=http%3A%2F%2Fv.baidu.com%2F&_=1432360255125"} [DEBUG - 2015-05-23T05:50:55.443Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"}],"id":59,"method":"GET","time":"2015-05-23T05:50:55.443Z","url":"http://baichuan.baidu.com/rs/logger/stat?key=xBeqA2UCVL0eOLJ3DLb2GYJeDvb5CdntUdIflZH9OcD5OcA3CoKfAESdk3CyUQnzVY0vCoSup2UhWZCdDdH0VBDzNZOqOZHyOLJ4Oa1qD2UqNYPvVYM4AdH4GLP0AFVwx0Swxv0a&callback=jQuery11120767825793242082_1432360255124&referUrl=&_=1432360255128"} [DEBUG - 2015-05-23T05:50:55.443Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://v.baidu.com/"}],"id":60,"method":"GET","time":"2015-05-23T05:50:55.443Z","url":"http://cbjs.baidu.com/js/m.js"} [DEBUG - 2015-05-23T05:50:55.449Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":31199,"contentType":"application/x-javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:55 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"Last-Modified","value":"Mon, 11 May 2015 04:25:18 GMT"},{"name":"Expires","value":"Sat, 23 May 2015 05:55:30 GMT"},{"name":"Age","value":"25"},{"name":"Cache-Control","value":"max-age=300"},{"name":"Content-Encoding","value":"gzip"}],"id":60,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:55.449Z","url":"http://cbjs.baidu.com/js/m.js"} [DEBUG - 2015-05-23T05:50:55.449Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/x-javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:55 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"Last-Modified","value":"Mon, 11 May 2015 04:25:18 GMT"},{"name":"Expires","value":"Sat, 23 May 2015 05:55:30 GMT"},{"name":"Age","value":"25"},{"name":"Cache-Control","value":"max-age=300"},{"name":"Content-Encoding","value":"gzip"}],"id":60,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:55.449Z","url":"http://cbjs.baidu.com/js/m.js"} [DEBUG - 2015-05-23T05:50:55.455Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://v.baidu.com/"}],"id":61,"method":"GET","time":"2015-05-23T05:50:55.455Z","url":"http://cb.baidu.com/ecom?di=639667&dcb=BAIDU_DUP_define&dtm=BAIDU_DUP2_SETJSONADSLOT&dbv=0&dci=2&dri=0&dis=0&dai=1&dds=&drs=4&dvi=1430984165<u=http%3A%2F%2Fv.baidu.com%2F&liu=<r=&lcr=&ps=1602x42&psr=1024x768&par=1024x768&pcs=400x300&pss=1020x2061&pis=-1x-1&cfv=0&ccd=32&chi=2&cja=false&cpl=0&cmi=0&cce=true&col=en-US&cec=UTF-8&cdo=-1&tsr=1060&tlm=1432331455&tcn=1432360255&tpr=1432360255455&dpt=none&coa=&ti=%E7%99%BE%E5%BA%A6%E8%A7%86%E9%A2%91%E6%90%9C%E7%B4%A2%E2%80%94%E2%80%94%E5%85%A8%E7%90%83%E6%9C%80%E5%A4%A7%E4%B8%AD%E6%96%87%E8%A7%86%E9%A2%91%E6%90%9C%E7%B4%A2%E5%BC%95%E6%93%8E&baidu_id="} [DEBUG - 2015-05-23T05:50:55.483Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: false [DEBUG - 2015-05-23T05:50:55.483Z] SessionReqHand - _SuccessHandler - status: success 2015-05-23T13:50:55 [DEBUG] HTTP Response - Status Code 200 OK 2015-05-23T13:50:55 [DEBUG] HTTP Response - Sending Header "Cache" = "no-cache" 2015-05-23T13:50:55 [DEBUG] HTTP Response - Sending Header "Content-Length" = "74" 2015-05-23T13:50:55 [DEBUG] HTTP Response - Sending Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:50:55 [DEBUG] HTTP Request - URI /wd/hub/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source 2015-05-23T13:50:55 [DEBUG] HTTP Request - Method GET 2015-05-23T13:50:55 [DEBUG] HTTP Request - HTTP Version 1.1 2015-05-23T13:50:55 [DEBUG] HTTP Request - Query String 2015-05-23T13:50:55 [DEBUG] HTTP Request - Receiving Header "Accept-Encoding" = "identity" 2015-05-23T13:50:55 [DEBUG] HTTP Request - Receiving Header "Host" = "127.0.0.1:32999" 2015-05-23T13:50:55 [DEBUG] HTTP Request - Receiving Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:50:55 [DEBUG] HTTP Request - Receiving Header "Connection" = "close" 2015-05-23T13:50:55 [DEBUG] HTTP Request - Receiving Header "Accept" = "application/json" 2015-05-23T13:50:55 [DEBUG] HTTP Request - Receiving Header "User-Agent" = "Python-urllib/2.7" [DEBUG - 2015-05-23T05:50:55.486Z] RouterReqHand - _handle - {"headers":{"Accept":"application/json","Accept-Encoding":"identity","Connection":"close","Content-Type":"application/json;charset=UTF-8","Host":"127.0.0.1:32999","User-Agent":"Python-urllib/2.7"},"httpVersion":"1.1","method":"GET","url":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","urlParsed":{"anchor":"","query":"","file":"source","directory":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/","path":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","relative":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","port":"","host":"","password":"","user":"","userInfo":"","authority":"","protocol":"","source":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","queryKey":{},"chunks":["session","ac4aab20-010f-11e5-a1b5-e503e60d48a0","source"]}} 2015-05-23T13:50:55 [DEBUG] HTTP Response - Status Code 200 OK 2015-05-23T13:50:55 [DEBUG] HTTP Response - Sending Header "Cache" = "no-cache" 2015-05-23T13:50:55 [DEBUG] HTTP Response - Sending Header "Content-Length" = "344615" 2015-05-23T13:50:55 [DEBUG] HTTP Response - Sending Header "Content-Type" = "application/json;charset=UTF-8" [DEBUG - 2015-05-23T05:50:55.515Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":1946,"contentType":"application/json;charset=UTF-8","headers":[{"name":"Server","value":"nginx"},{"name":"Date","value":"Sat, 23 May 2015 05:50:55 GMT"},{"name":"Content-Type","value":"application/json;charset=UTF-8"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"}],"id":56,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:55.515Z","url":"http://baichuan.baidu.com/rs/adp/launch?callback=jQuery11120767825793242082_1432360255126&placeId=1427086959682&referUrl=&location=http%3A%2F%2Fv.baidu.com%2F&_=1432360255127"} [DEBUG - 2015-05-23T05:50:55.515Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/json;charset=UTF-8","headers":[{"name":"Server","value":"nginx"},{"name":"Date","value":"Sat, 23 May 2015 05:50:55 GMT"},{"name":"Content-Type","value":"application/json;charset=UTF-8"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"}],"id":56,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:55.515Z","url":"http://baichuan.baidu.com/rs/adp/launch?callback=jQuery11120767825793242082_1432360255126&placeId=1427086959682&referUrl=&location=http%3A%2F%2Fv.baidu.com%2F&_=1432360255127"} [DEBUG - 2015-05-23T05:50:55.516Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"}],"id":62,"method":"GET","time":"2015-05-23T05:50:55.516Z","url":"http://baichuan.baidu.com/rs/logger/stat?key=xBeqA2UCVL0eOLJ3DLb2GYH5OcbaCoCnxEUnx3SCVL1tO2JeOcOqOYbvVYD0DZM3AYA3DBMaOvtzVLxzAcb0DXVtx3KCVL0eOcbeOLJ1OvJ1CdItUQnzVY0eCdCwVIS5xBH9OFV0k2ynkc1cAvx4O2JzDF04D2VjNYRvVcMyGBM3DX02VcSjOdUdVcD3OvPdxdIhVB9yWYDzDdHvDLDzDvPvGFVwx0Swxv00&callback=jQuery11120767825793242082_1432360255126&referUrl=&_=1432360255129"} [DEBUG - 2015-05-23T05:50:55.533Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":1314,"contentType":"text/javascript;charset=UTF-8","headers":[{"name":"Cache-Control","value":"post-check=0, pre-check=0"},{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/javascript;charset=UTF-8"},{"name":"Date","value":"Sat, 23 May 2015 05:50:55 GMT"},{"name":"Expires","value":"Mon, 26 Jul 1997 05:00:00 GMT"},{"name":"Last-Modified","value":"Sat May 23 13:50:55 2015"},{"name":"P3p","value":"CP=\" OTI DSP COR IVA OUR IND COM \""},{"name":"Pragma","value":"no-cache"},{"name":"Server","value":"nginx"}],"id":61,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:55.533Z","url":"http://cb.baidu.com/ecom?di=639667&dcb=BAIDU_DUP_define&dtm=BAIDU_DUP2_SETJSONADSLOT&dbv=0&dci=2&dri=0&dis=0&dai=1&dds=&drs=4&dvi=1430984165<u=http%3A%2F%2Fv.baidu.com%2F&liu=<r=&lcr=&ps=1602x42&psr=1024x768&par=1024x768&pcs=400x300&pss=1020x2061&pis=-1x-1&cfv=0&ccd=32&chi=2&cja=false&cpl=0&cmi=0&cce=true&col=en-US&cec=UTF-8&cdo=-1&tsr=1060&tlm=1432331455&tcn=1432360255&tpr=1432360255455&dpt=none&coa=&ti=%E7%99%BE%E5%BA%A6%E8%A7%86%E9%A2%91%E6%90%9C%E7%B4%A2%E2%80%94%E2%80%94%E5%85%A8%E7%90%83%E6%9C%80%E5%A4%A7%E4%B8%AD%E6%96%87%E8%A7%86%E9%A2%91%E6%90%9C%E7%B4%A2%E5%BC%95%E6%93%8E&baidu_id="} [DEBUG - 2015-05-23T05:50:55.533Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/javascript;charset=UTF-8","headers":[{"name":"Cache-Control","value":"post-check=0, pre-check=0"},{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/javascript;charset=UTF-8"},{"name":"Date","value":"Sat, 23 May 2015 05:50:55 GMT"},{"name":"Expires","value":"Mon, 26 Jul 1997 05:00:00 GMT"},{"name":"Last-Modified","value":"Sat May 23 13:50:55 2015"},{"name":"P3p","value":"CP=\" OTI DSP COR IVA OUR IND COM \""},{"name":"Pragma","value":"no-cache"},{"name":"Server","value":"nginx"}],"id":61,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:55.533Z","url":"http://cb.baidu.com/ecom?di=639667&dcb=BAIDU_DUP_define&dtm=BAIDU_DUP2_SETJSONADSLOT&dbv=0&dci=2&dri=0&dis=0&dai=1&dds=&drs=4&dvi=1430984165<u=http%3A%2F%2Fv.baidu.com%2F&liu=<r=&lcr=&ps=1602x42&psr=1024x768&par=1024x768&pcs=400x300&pss=1020x2061&pis=-1x-1&cfv=0&ccd=32&chi=2&cja=false&cpl=0&cmi=0&cce=true&col=en-US&cec=UTF-8&cdo=-1&tsr=1060&tlm=1432331455&tcn=1432360255&tpr=1432360255455&dpt=none&coa=&ti=%E7%99%BE%E5%BA%A6%E8%A7%86%E9%A2%91%E6%90%9C%E7%B4%A2%E2%80%94%E2%80%94%E5%85%A8%E7%90%83%E6%9C%80%E5%A4%A7%E4%B8%AD%E6%96%87%E8%A7%86%E9%A2%91%E6%90%9C%E7%B4%A2%E5%BC%95%E6%93%8E&baidu_id="} [DEBUG - 2015-05-23T05:50:55.534Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://v.baidu.com/"}],"id":63,"method":"GET","time":"2015-05-23T05:50:55.534Z","url":"http://dup.baidustatic.com/painter/union/inlayFixed.js"} [DEBUG - 2015-05-23T05:50:55.564Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":78,"contentType":"application/json;charset=UTF-8","headers":[{"name":"Server","value":"nginx"},{"name":"Date","value":"Sat, 23 May 2015 05:50:55 GMT"},{"name":"Content-Type","value":"application/json;charset=UTF-8"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"}],"id":59,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:55.564Z","url":"http://baichuan.baidu.com/rs/logger/stat?key=xBeqA2UCVL0eOLJ3DLb2GYJeDvb5CdntUdIflZH9OcD5OcA3CoKfAESdk3CyUQnzVY0vCoSup2UhWZCdDdH0VBDzNZOqOZHyOLJ4Oa1qD2UqNYPvVYM4AdH4GLP0AFVwx0Swxv0a&callback=jQuery11120767825793242082_1432360255124&referUrl=&_=1432360255128"} [DEBUG - 2015-05-23T05:50:55.564Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/json;charset=UTF-8","headers":[{"name":"Server","value":"nginx"},{"name":"Date","value":"Sat, 23 May 2015 05:50:55 GMT"},{"name":"Content-Type","value":"application/json;charset=UTF-8"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"}],"id":59,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:55.564Z","url":"http://baichuan.baidu.com/rs/logger/stat?key=xBeqA2UCVL0eOLJ3DLb2GYJeDvb5CdntUdIflZH9OcD5OcA3CoKfAESdk3CyUQnzVY0vCoSup2UhWZCdDdH0VBDzNZOqOZHyOLJ4Oa1qD2UqNYPvVYM4AdH4GLP0AFVwx0Swxv0a&callback=jQuery11120767825793242082_1432360255124&referUrl=&_=1432360255128"} [DEBUG - 2015-05-23T05:50:55.701Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":16075,"contentType":"application/x-javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:55 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"Last-Modified","value":"Mon, 11 May 2015 06:32:38 GMT"},{"name":"Expires","value":"Sat, 23 May 2015 05:37:33 GMT"},{"name":"Cache-Control","value":"max-age=300"},{"name":"Content-Encoding","value":"gzip"}],"id":63,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:55.700Z","url":"http://dup.baidustatic.com/painter/union/inlayFixed.js"} [DEBUG - 2015-05-23T05:50:55.701Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/x-javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:55 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"Last-Modified","value":"Mon, 11 May 2015 06:32:38 GMT"},{"name":"Expires","value":"Sat, 23 May 2015 05:37:33 GMT"},{"name":"Cache-Control","value":"max-age=300"},{"name":"Content-Encoding","value":"gzip"}],"id":63,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:55.701Z","url":"http://dup.baidustatic.com/painter/union/inlayFixed.js"} 2015-05-23T13:50:55 [DEBUG] WebPage - setupFrame "cproIframe_639667_1" 2015-05-23T13:50:55 [DEBUG] WebPage - updateLoadingProgress: 10 [DEBUG - 2015-05-23T05:50:55.704Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8"},{"name":"Referer","value":"http://v.baidu.com/"}],"id":64,"method":"GET","time":"2015-05-23T05:50:55.704Z","url":"http://cb.baidu.com/ecom?adn=4&at=6&aurl=&cad=1&ccd=32&cec=UTF-8&cfv=0&ch=0&col=en-US&conOP=0&cpa=1&dai=1&dis=0<r=<u=http%3A%2F%2Fv.baidu.com%2F&lunum=6&n=91010099_1_cpr&pcs=400x300&pis=10000x10000&ps=1602x42&psr=1024x768&pss=1020x2061&qn=f35d166bc808f10e&rad=&rs=301&rsi0=960&rsi1=90&rsi5=4&rss0=%23FFFFFF&rss1=%23FFFFFF&rss2=%230000FF&rss3=%23444444&rss4=%23008000&rss5=&rss6=%23e10900&rss7=&scale=&skin=&td_id=9223372032564449124&tn=text_default_960_90&tpr=1432360255455&ts=1&version=2.0&xuanting=0&dtm=BAIDU_DUP2_SETJSONADSLOT&dc=2&di=639667&ti=%E7%99%BE%E5%BA%A6%E8%A7%86%E9%A2%91%E6%90%9C%E7%B4%A2%E2%80%94%E2%80%94%E5%85%A8%E7%90%83%E6%9C%80%E5%A4%A7%E4%B8%AD%E6%96%87%E8%A7%86%E9%A2%91%E6%90%9C%E7%B4%A2%E5%BC%95%E6%93%8E&tt=1432360254392.1063.1142.1311"} [DEBUG - 2015-05-23T05:50:55.747Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":78,"contentType":"application/json;charset=UTF-8","headers":[{"name":"Server","value":"nginx"},{"name":"Date","value":"Sat, 23 May 2015 05:50:55 GMT"},{"name":"Content-Type","value":"application/json;charset=UTF-8"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"}],"id":62,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:55.747Z","url":"http://baichuan.baidu.com/rs/logger/stat?key=xBeqA2UCVL0eOLJ3DLb2GYH5OcbaCoCnxEUnx3SCVL1tO2JeOcOqOYbvVYD0DZM3AYA3DBMaOvtzVLxzAcb0DXVtx3KCVL0eOcbeOLJ1OvJ1CdItUQnzVY0eCdCwVIS5xBH9OFV0k2ynkc1cAvx4O2JzDF04D2VjNYRvVcMyGBM3DX02VcSjOdUdVcD3OvPdxdIhVB9yWYDzDdHvDLDzDvPvGFVwx0Swxv00&callback=jQuery11120767825793242082_1432360255126&referUrl=&_=1432360255129"} 2015-05-23T13:50:55 [DEBUG] WebPage - updateLoadingProgress: 30 [DEBUG - 2015-05-23T05:50:55.747Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/json;charset=UTF-8","headers":[{"name":"Server","value":"nginx"},{"name":"Date","value":"Sat, 23 May 2015 05:50:55 GMT"},{"name":"Content-Type","value":"application/json;charset=UTF-8"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"}],"id":62,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:55.747Z","url":"http://baichuan.baidu.com/rs/logger/stat?key=xBeqA2UCVL0eOLJ3DLb2GYH5OcbaCoCnxEUnx3SCVL1tO2JeOcOqOYbvVYD0DZM3AYA3DBMaOvtzVLxzAcb0DXVtx3KCVL0eOcbeOLJ1OvJ1CdItUQnzVY0eCdCwVIS5xBH9OFV0k2ynkc1cAvx4O2JzDF04D2VjNYRvVcMyGBM3DX02VcSjOdUdVcD3OvPdxdIhVB9yWYDzDdHvDLDzDvPvGFVwx0Swxv00&callback=jQuery11120767825793242082_1432360255126&referUrl=&_=1432360255129"} [DEBUG - 2015-05-23T05:50:55.861Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":23184,"contentType":"text/html","headers":[{"name":"Cache-Control","value":"post-check=0, pre-check=0"},{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:50:55 GMT"},{"name":"Expires","value":"Mon, 26 Jul 1997 05:00:00 GMT"},{"name":"Last-Modified","value":"Sat May 23 13:50:55 2015"},{"name":"P3p","value":"CP=\" OTI DSP COR IVA OUR IND COM \""},{"name":"Pragma","value":"no-cache"},{"name":"Server","value":"nginx"}],"id":64,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:55.861Z","url":"http://cb.baidu.com/ecom?adn=4&at=6&aurl=&cad=1&ccd=32&cec=UTF-8&cfv=0&ch=0&col=en-US&conOP=0&cpa=1&dai=1&dis=0<r=<u=http%3A%2F%2Fv.baidu.com%2F&lunum=6&n=91010099_1_cpr&pcs=400x300&pis=10000x10000&ps=1602x42&psr=1024x768&pss=1020x2061&qn=f35d166bc808f10e&rad=&rs=301&rsi0=960&rsi1=90&rsi5=4&rss0=%23FFFFFF&rss1=%23FFFFFF&rss2=%230000FF&rss3=%23444444&rss4=%23008000&rss5=&rss6=%23e10900&rss7=&scale=&skin=&td_id=9223372032564449124&tn=text_default_960_90&tpr=1432360255455&ts=1&version=2.0&xuanting=0&dtm=BAIDU_DUP2_SETJSONADSLOT&dc=2&di=639667&ti=%E7%99%BE%E5%BA%A6%E8%A7%86%E9%A2%91%E6%90%9C%E7%B4%A2%E2%80%94%E2%80%94%E5%85%A8%E7%90%83%E6%9C%80%E5%A4%A7%E4%B8%AD%E6%96%87%E8%A7%86%E9%A2%91%E6%90%9C%E7%B4%A2%E5%BC%95%E6%93%8E&tt=1432360254392.1063.1142.1311"} [DEBUG - 2015-05-23T05:50:55.863Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://cb.baidu.com/ecom?adn=4&at=6&aurl=&cad=1&ccd=32&cec=UTF-8&cfv=0&ch=0&col=en-US&conOP=0&cpa=1&dai=1&dis=0<r=<u=http%3A%2F%2Fv.baidu.com%2F&lunum=6&n=91010099_1_cpr&pcs=400x300&pis=10000x10000&ps=1602x42&psr=1024x768&pss=1020x2061&qn=f35d166bc808f10e&rad=&rs=301&rsi0=960&rsi1=90&rsi5=4&rss0=%23FFFFFF&rss1=%23FFFFFF&rss2=%230000FF&rss3=%23444444&rss4=%23008000&rss5=&rss6=%23e10900&rss7=&scale=&skin=&td_id=9223372032564449124&tn=text_default_960_90&tpr=1432360255455&ts=1&version=2.0&xuanting=0&dtm=BAIDU_DUP2_SETJSONADSLOT&dc=2&di=639667&ti=%E7%99%BE%E5%BA%A6%E8%A7%86%E9%A2%91%E6%90%9C%E7%B4%A2%E2%80%94%E2%80%94%E5%85%A8%E7%90%83%E6%9C%80%E5%A4%A7%E4%B8%AD%E6%96%87%E8%A7%86%E9%A2%91%E6%90%9C%E7%B4%A2%E5%BC%95%E6%93%8E&tt=1432360254392.1063.1142.1311"}],"id":65,"method":"GET","time":"2015-05-23T05:50:55.863Z","url":"http://cpro.baidustatic.com/cpro/ui/noexpire/js/3.1.6/cpro.js"} 2015-05-23T13:50:55 [DEBUG] WebPage - setupFrame "ifr78254" 2015-05-23T13:50:55 [DEBUG] WebPage - updateLoadingProgress: 30 [DEBUG - 2015-05-23T05:50:55.865Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8"},{"name":"Referer","value":"http://cb.baidu.com/ecom?adn=4&at=6&aurl=&cad=1&ccd=32&cec=UTF-8&cfv=0&ch=0&col=en-US&conOP=0&cpa=1&dai=1&dis=0<r=<u=http%3A%2F%2Fv.baidu.com%2F&lunum=6&n=91010099_1_cpr&pcs=400x300&pis=10000x10000&ps=1602x42&psr=1024x768&pss=1020x2061&qn=f35d166bc808f10e&rad=&rs=301&rsi0=960&rsi1=90&rsi5=4&rss0=%23FFFFFF&rss1=%23FFFFFF&rss2=%230000FF&rss3=%23444444&rss4=%23008000&rss5=&rss6=%23e10900&rss7=&scale=&skin=&td_id=9223372032564449124&tn=text_default_960_90&tpr=1432360255455&ts=1&version=2.0&xuanting=0&dtm=BAIDU_DUP2_SETJSONADSLOT&dc=2&di=639667&ti=%E7%99%BE%E5%BA%A6%E8%A7%86%E9%A2%91%E6%90%9C%E7%B4%A2%E2%80%94%E2%80%94%E5%85%A8%E7%90%83%E6%9C%80%E5%A4%A7%E4%B8%AD%E6%96%87%E8%A7%86%E9%A2%91%E6%90%9C%E7%B4%A2%E5%BC%95%E6%93%8E&tt=1432360254392.1063.1142.1311"}],"id":66,"method":"GET","time":"2015-05-23T05:50:55.865Z","url":"http://cpro.baidustatic.com/sync.htm?cproid=1429799A83F7710AA238AA6C05FFA47F%3AFG%3D1"} 2015-05-23T13:50:55 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360253|; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:55 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:55 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:50:55 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360254; domain=.image.baidu.com; path=/" 2015-05-23T13:50:55 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:50:55 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:50:55 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:50:55 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:50:55 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:50:55 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:50:55 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360253|; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:55 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:55 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:50:55 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360254; domain=.image.baidu.com; path=/" 2015-05-23T13:50:55 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:50:55 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:50:55 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:50:55 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:50:55 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:50:55 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:50:55 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:50:55 [DEBUG] WebPage - updateLoadingProgress: 37 [DEBUG - 2015-05-23T05:50:55.866Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Cache-Control","value":"post-check=0, pre-check=0"},{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:50:55 GMT"},{"name":"Expires","value":"Mon, 26 Jul 1997 05:00:00 GMT"},{"name":"Last-Modified","value":"Sat May 23 13:50:55 2015"},{"name":"P3p","value":"CP=\" OTI DSP COR IVA OUR IND COM \""},{"name":"Pragma","value":"no-cache"},{"name":"Server","value":"nginx"}],"id":64,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:55.866Z","url":"http://cb.baidu.com/ecom?adn=4&at=6&aurl=&cad=1&ccd=32&cec=UTF-8&cfv=0&ch=0&col=en-US&conOP=0&cpa=1&dai=1&dis=0<r=<u=http%3A%2F%2Fv.baidu.com%2F&lunum=6&n=91010099_1_cpr&pcs=400x300&pis=10000x10000&ps=1602x42&psr=1024x768&pss=1020x2061&qn=f35d166bc808f10e&rad=&rs=301&rsi0=960&rsi1=90&rsi5=4&rss0=%23FFFFFF&rss1=%23FFFFFF&rss2=%230000FF&rss3=%23444444&rss4=%23008000&rss5=&rss6=%23e10900&rss7=&scale=&skin=&td_id=9223372032564449124&tn=text_default_960_90&tpr=1432360255455&ts=1&version=2.0&xuanting=0&dtm=BAIDU_DUP2_SETJSONADSLOT&dc=2&di=639667&ti=%E7%99%BE%E5%BA%A6%E8%A7%86%E9%A2%91%E6%90%9C%E7%B4%A2%E2%80%94%E2%80%94%E5%85%A8%E7%90%83%E6%9C%80%E5%A4%A7%E4%B8%AD%E6%96%87%E8%A7%86%E9%A2%91%E6%90%9C%E7%B4%A2%E5%BC%95%E6%93%8E&tt=1432360254392.1063.1142.1311"} [DEBUG - 2015-05-23T05:50:55.871Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":2816,"contentType":"text/html","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:55 GMT"},{"name":"Content-Type","value":"text/html"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"Last-Modified","value":"Fri, 22 May 2015 04:04:21 GMT"},{"name":"Age","value":"56"},{"name":"Content-Encoding","value":"gzip"}],"id":66,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:55.871Z","url":"http://cpro.baidustatic.com/sync.htm?cproid=1429799A83F7710AA238AA6C05FFA47F%3AFG%3D1"} [DEBUG - 2015-05-23T05:50:55.872Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:55 GMT"},{"name":"Content-Type","value":"text/html"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"close"},{"name":"Last-Modified","value":"Fri, 22 May 2015 04:04:21 GMT"},{"name":"Age","value":"56"},{"name":"Content-Encoding","value":"gzip"}],"id":66,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:55.872Z","url":"http://cpro.baidustatic.com/sync.htm?cproid=1429799A83F7710AA238AA6C05FFA47F%3AFG%3D1"} [DEBUG - 2015-05-23T05:50:55.876Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":73771,"contentType":"application/x-javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:55 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Connection","value":"close"},{"name":"Last-Modified","value":"Tue, 25 Feb 2014 09:52:00 GMT"},{"name":"Expires","value":"Sun, 16 Jun 2024 09:27:07 GMT"},{"name":"Age","value":"29190228"},{"name":"Cache-Control","value":"max-age=315360000"},{"name":"Content-Encoding","value":"gzip"}],"id":65,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:55.875Z","url":"http://cpro.baidustatic.com/cpro/ui/noexpire/js/3.1.6/cpro.js"} 2015-05-23T13:50:55 [DEBUG] WebPage - updateLoadingProgress: 62 [DEBUG - 2015-05-23T05:50:55.876Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/x-javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:55 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Connection","value":"close"},{"name":"Last-Modified","value":"Tue, 25 Feb 2014 09:52:00 GMT"},{"name":"Expires","value":"Sun, 16 Jun 2024 09:27:07 GMT"},{"name":"Age","value":"29190228"},{"name":"Cache-Control","value":"max-age=315360000"},{"name":"Content-Encoding","value":"gzip"}],"id":65,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:55.876Z","url":"http://cpro.baidustatic.com/cpro/ui/noexpire/js/3.1.6/cpro.js"} 2015-05-23T13:50:55 [DEBUG] WebPage - updateLoadingProgress: 100 2015-05-23T13:50:55 [DEBUG] Cache hit level 1 2015-05-23T13:50:55 [DEBUG] Cache hit level 1 2015-05-23T13:50:55 [DEBUG] Cache hit level 1 2015-05-23T13:50:55 [DEBUG] Cache hit level 1 2015-05-23T13:50:55 [DEBUG] Cache hit level 1 2015-05-23T13:50:55 [DEBUG] Cache hit level 1 2015-05-23T13:50:55 [DEBUG] Cache hit level 1 2015-05-23T13:50:55 [DEBUG] Cache hit level 1 2015-05-23T13:50:55 [DEBUG] Cache hit level 1 2015-05-23T13:50:55 [DEBUG] Cache hit level 1 2015-05-23T13:50:55 [DEBUG] Cache hit level 1 2015-05-23T13:50:55 [DEBUG] Cache hit level 1 2015-05-23T13:50:55 [DEBUG] Cache hit level 1 2015-05-23T13:50:55 [DEBUG] Cache hit level 1 2015-05-23T13:50:55 [DEBUG] Cache hit level 1 2015-05-23T13:50:55 [DEBUG] Cache hit level 1 2015-05-23T13:50:55 [DEBUG] Cache hit level 1 2015-05-23T13:50:55 [DEBUG] Cache hit level 1 2015-05-23T13:50:55 [DEBUG] Cache hit level 1 2015-05-23T13:50:55 [DEBUG] WebPage - setupFrame "-->" 2015-05-23T13:50:55 [DEBUG] WebPage - updateLoadingProgress: 10 [DEBUG - 2015-05-23T05:50:55.992Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8"},{"name":"Referer","value":"http://pos.baidu.com/wh/o.htm?ltr="}],"id":67,"method":"GET","time":"2015-05-23T05:50:55.991Z","url":"http://eclick.baidu.com/fp.htm?ci=1429799A83F7710AA238AA6C05FFA47F%3AFG%3D1&cn=1429799A83F7710AA238AA6C05FFA47F%3AFG%3D1&cu=&cl=8853D1664B0E04464AB1DB64BBF57918%3AFG%3D1&cf=&ce=&ff=c&nip=&_=1432360255991"} 2015-05-23T13:50:56 [DEBUG] HTTP Request - URI /wd/hub/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url 2015-05-23T13:50:56 [DEBUG] HTTP Request - Method POST 2015-05-23T13:50:56 [DEBUG] HTTP Request - HTTP Version 1.1 2015-05-23T13:50:56 [DEBUG] HTTP Request - Query String 2015-05-23T13:50:56 [DEBUG] HTTP Request - Receiving Header "Accept-Encoding" = "identity" 2015-05-23T13:50:56 [DEBUG] HTTP Request - Receiving Header "Content-Length" = "140" 2015-05-23T13:50:56 [DEBUG] HTTP Request - Receiving Header "Host" = "127.0.0.1:32999" 2015-05-23T13:50:56 [DEBUG] HTTP Request - Receiving Header "Accept" = "application/json" 2015-05-23T13:50:56 [DEBUG] HTTP Request - Receiving Header "User-Agent" = "Python-urllib/2.7" 2015-05-23T13:50:56 [DEBUG] HTTP Request - Receiving Header "Connection" = "close" 2015-05-23T13:50:56 [DEBUG] HTTP Request - Receiving Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:50:56 [DEBUG] HTTP Request - Method POST/PUT 2015-05-23T13:50:56 [DEBUG] HTTP Request - Content Body: {"url": "http://image.baidu.com/channel?c=%E6%91%84%E5%BD%B1&t=%E5%85%A8%E9%83%A8&s=0", "sessionId": "ac4aab20-010f-11e5-a1b5-e503e60d48a0"} [DEBUG - 2015-05-23T05:50:56.004Z] RouterReqHand - _handle - {"headers":{"Accept":"application/json","Accept-Encoding":"identity","Connection":"close","Content-Length":"140","Content-Type":"application/json;charset=UTF-8","Host":"127.0.0.1:32999","User-Agent":"Python-urllib/2.7"},"httpVersion":"1.1","method":"POST","post":"{\"url\": \"http://image.baidu.com/channel?c=%E6%91%84%E5%BD%B1&t=%E5%85%A8%E9%83%A8&s=0\", \"sessionId\": \"ac4aab20-010f-11e5-a1b5-e503e60d48a0\"}","url":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","urlParsed":{"anchor":"","query":"","file":"url","directory":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/","path":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","relative":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","port":"","host":"","password":"","user":"","userInfo":"","authority":"","protocol":"","source":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","queryKey":{},"chunks":["session","ac4aab20-010f-11e5-a1b5-e503e60d48a0","url"]}} [DEBUG - 2015-05-23T05:50:56.004Z] SessionReqHand - _postUrlCommand - Session 'ac4aab20-010f-11e5-a1b5-e503e60d48a0' is about to load URL: http://image.baidu.com/channel?c=%E6%91%84%E5%BD%B1&t=%E5%85%A8%E9%83%A8&s=0 2015-05-23T13:50:56 [DEBUG] Network - Resource request error: 5 ( "Operation canceled" ) URL: "http://eclick.baidu.com/fp.htm?ci=1429799A83F7710AA238AA6C05FFA47F:FG=1&cn=1429799A83F7710AA238AA6C05FFA47F:FG=1&cu=&cl=8853D1664B0E04464AB1DB64BBF57918:FG=1&cf=&ce=&ff=c&nip=&_=1432360255991" [DEBUG - 2015-05-23T05:50:56.005Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceError - {"errorCode":5,"errorString":"Operation canceled","id":67,"url":"http://eclick.baidu.com/fp.htm?ci=1429799A83F7710AA238AA6C05FFA47F:FG=1&cn=1429799A83F7710AA238AA6C05FFA47F:FG=1&cu=&cl=8853D1664B0E04464AB1DB64BBF57918:FG=1&cf=&ce=&ff=c&nip=&_=1432360255991"} [DEBUG - 2015-05-23T05:50:56.005Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":null,"headers":[],"id":67,"redirectURL":null,"stage":"end","status":null,"statusText":null,"time":"2015-05-23T05:50:56.005Z","url":"http://eclick.baidu.com/fp.htm?ci=1429799A83F7710AA238AA6C05FFA47F%3AFG%3D1&cn=1429799A83F7710AA238AA6C05FFA47F%3AFG%3D1&cu=&cl=8853D1664B0E04464AB1DB64BBF57918%3AFG%3D1&cf=&ce=&ff=c&nip=&_=1432360255991"} 2015-05-23T13:50:56 [DEBUG] WebPage - updateLoadingProgress: 100 [DEBUG - 2015-05-23T05:50:56.006Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Cache-Control","value":"max-age=0"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Referer","value":"http://v.baidu.com/"},{"name":"Accept","value":"*/*"}],"id":68,"method":"GET","time":"2015-05-23T05:50:56.006Z","url":"http://nsclick.baidu.com/u.gif?ts=1gl&sid=ia0mb9is0ur&page=page-video-index-new&pid=241&p=104&hid=337&px=1024*768&ver=5&cmd=close&pd=300&ft=1gl&at=1gl"} 2015-05-23T13:50:56 [DEBUG] WebPage - updateLoadingProgress: 10 [DEBUG - 2015-05-23T05:50:56.106Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8"}],"id":69,"method":"GET","time":"2015-05-23T05:50:56.106Z","url":"http://image.baidu.com/channel?c=%E6%91%84%E5%BD%B1&t=%E5%85%A8%E9%83%A8&s=0"} [DEBUG - 2015-05-23T05:50:56.107Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _oneShotCallback - onLoadFinished [DEBUG - 2015-05-23T05:50:56.107Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - onLoadFinished: fail [DEBUG - 2015-05-23T05:50:56.117Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360253|; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360254; domain=.image.baidu.com; path=/" 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" [DEBUG - 2015-05-23T05:50:56.172Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"image/gif","headers":[{"name":"Accept-Ranges","value":"bytes"},{"name":"Cache-Control","value":"max-age=0"},{"name":"Content-Length","value":"0"},{"name":"Content-Type","value":"image/gif"},{"name":"Date","value":"Sat, 23 May 2015 05:50:56 GMT"},{"name":"Etag","value":"\"4047126933\""},{"name":"Expires","value":"Sat, 23 May 2015 05:50:56 GMT"},{"name":"Last-Modified","value":"Wed, 21 Sep 2011 07:53:10 GMT"},{"name":"Pragma","value":"no-cache"},{"name":"Server","value":"BWS/1.0"}],"id":68,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:56.172Z","url":"http://nsclick.baidu.com/u.gif?ts=1gl&sid=ia0mb9is0ur&page=page-video-index-new&pid=241&p=104&hid=337&px=1024*768&ver=5&cmd=close&pd=300&ft=1gl&at=1gl"} [DEBUG - 2015-05-23T05:50:56.217Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true [DEBUG - 2015-05-23T05:50:56.300Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":84822,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:50:56 GMT"},{"name":"Server","value":"Apache"},{"name":"Set-Cookie","value":"userid=deleted; expires=Fri, 23-May-2014 05:50:55 GMT; path=/"},{"name":"Tracecode","value":"30561200770210131978052313"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Transfer-Encoding","value":"chunked"}],"id":69,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:56.300Z","url":"http://image.baidu.com/channel?c=%E6%91%84%E5%BD%B1&t=%E5%85%A8%E9%83%A8&s=0"} 2015-05-23T13:50:56 [DEBUG] WebPage - setupFrame "" [DEBUG - 2015-05-23T05:50:56.311Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/css,*/*;q=0.1"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E6%91%84%E5%BD%B1&t=%E5%85%A8%E9%83%A8&s=0"}],"id":70,"method":"GET","time":"2015-05-23T05:50:56.311Z","url":"http://img0.bdstatic.com/static/channelnew/pkg/cnew_7f6d9fc.css"} [DEBUG - 2015-05-23T05:50:56.312Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E6%91%84%E5%BD%B1&t=%E5%85%A8%E9%83%A8&s=0"}],"id":71,"method":"GET","time":"2015-05-23T05:50:56.312Z","url":"http://img0.bdstatic.com/static/channelnew/pkg/cnew_56c5846.js"} 2015-05-23T13:50:56 [DEBUG] WebPage - updateLoadingProgress: 27 2015-05-23T13:50:56 [DEBUG] WebPage - updateLoadingProgress: 40 [DEBUG - 2015-05-23T05:50:56.323Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":60786,"contentType":"text/css","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:56 GMT"},{"name":"Content-Type","value":"text/css"},{"name":"Connection","value":"keep-alive"},{"name":"ETag","value":"\"1864066797\""},{"name":"Last-Modified","value":"Tue, 27 Jan 2015 09:47:49 GMT"},{"name":"Expires","value":"Sun, 24 May 2015 04:40:47 GMT"},{"name":"Age","value":"522609"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Accept-Ranges","value":"bytes"},{"name":"Content-Encoding","value":"gzip"},{"name":"Vary","value":"Accept-Encoding"}],"id":70,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:56.323Z","url":"http://img0.bdstatic.com/static/channelnew/pkg/cnew_7f6d9fc.css"} 2015-05-23T13:50:56 [DEBUG] WebPage - updateLoadingProgress: 43 [DEBUG - 2015-05-23T05:50:56.324Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/css","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:56 GMT"},{"name":"Content-Type","value":"text/css"},{"name":"Connection","value":"keep-alive"},{"name":"ETag","value":"\"1864066797\""},{"name":"Last-Modified","value":"Tue, 27 Jan 2015 09:47:49 GMT"},{"name":"Expires","value":"Sun, 24 May 2015 04:40:47 GMT"},{"name":"Age","value":"522609"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Accept-Ranges","value":"bytes"},{"name":"Content-Encoding","value":"gzip"},{"name":"Vary","value":"Accept-Encoding"}],"id":70,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:56.324Z","url":"http://img0.bdstatic.com/static/channelnew/pkg/cnew_7f6d9fc.css"} [DEBUG - 2015-05-23T05:50:56.334Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":135293,"contentType":"text/javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:56 GMT"},{"name":"Content-Type","value":"text/javascript"},{"name":"Connection","value":"keep-alive"},{"name":"ETag","value":"\"625599041\""},{"name":"Last-Modified","value":"Tue, 27 Jan 2015 09:47:49 GMT"},{"name":"Expires","value":"Thu, 28 May 2015 13:07:24 GMT"},{"name":"Age","value":"146612"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Accept-Ranges","value":"bytes"},{"name":"Content-Encoding","value":"gzip"},{"name":"Vary","value":"Accept-Encoding"}],"id":71,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:56.334Z","url":"http://img0.bdstatic.com/static/channelnew/pkg/cnew_56c5846.js"} 2015-05-23T13:50:56 [DEBUG] WebPage - updateLoadingProgress: 46 [DEBUG - 2015-05-23T05:50:56.334Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:56 GMT"},{"name":"Content-Type","value":"text/javascript"},{"name":"Connection","value":"keep-alive"},{"name":"ETag","value":"\"625599041\""},{"name":"Last-Modified","value":"Tue, 27 Jan 2015 09:47:49 GMT"},{"name":"Expires","value":"Thu, 28 May 2015 13:07:24 GMT"},{"name":"Age","value":"146612"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Accept-Ranges","value":"bytes"},{"name":"Content-Encoding","value":"gzip"},{"name":"Vary","value":"Accept-Encoding"}],"id":71,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:56.334Z","url":"http://img0.bdstatic.com/static/channelnew/pkg/cnew_56c5846.js"} [DEBUG - 2015-05-23T05:50:56.340Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true 2015-05-23T13:50:56 [DEBUG] Cache hit level 1 2015-05-23T13:50:56 [DEBUG] Cache hit level 1 2015-05-23T13:50:56 [DEBUG] Cache hit level 1 2015-05-23T13:50:56 [DEBUG] Cache hit level 1 2015-05-23T13:50:56 [DEBUG] Cache hit level 1 2015-05-23T13:50:56 [DEBUG] Cache hit level 1 2015-05-23T13:50:56 [DEBUG] Cache hit level 1 2015-05-23T13:50:56 [DEBUG] Cache hit level 1 2015-05-23T13:50:56 [DEBUG] Cache hit level 1 2015-05-23T13:50:56 [DEBUG] Cache hit level 1 2015-05-23T13:50:56 [DEBUG] Cache hit level 1 2015-05-23T13:50:56 [DEBUG] Cache hit level 1 2015-05-23T13:50:56 [DEBUG] Cache hit level 1 2015-05-23T13:50:56 [DEBUG] Cache hit level 1 2015-05-23T13:50:56 [DEBUG] Cache hit level 1 2015-05-23T13:50:56 [DEBUG] Cache hit level 1 2015-05-23T13:50:56 [DEBUG] Cache hit level 1 2015-05-23T13:50:56 [DEBUG] Cache hit level 1 2015-05-23T13:50:56 [DEBUG] Cache hit level 1 2015-05-23T13:50:56 [DEBUG] Cache hit level 1 [DEBUG - 2015-05-23T05:50:56.400Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E6%91%84%E5%BD%B1&t=%E5%85%A8%E9%83%A8&s=0"}],"id":72,"method":"GET","time":"2015-05-23T05:50:56.400Z","url":"http://image.baidu.com/detail/info?fr=channel&tag1=%E6%91%84%E5%BD%B1&tag2=%E5%85%A8%E9%83%A8&column=%E6%91%84%E5%BD%B1&tag=%E5%85%A8%E9%83%A8&ie=utf-8&oe=utf-8&word=1&t=1432360256399"} [DEBUG - 2015-05-23T05:50:56.407Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Origin","value":"http://image.baidu.com"},{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Content-Type","value":"application/x-www-form-urlencoded; charset=UTF-8"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E6%91%84%E5%BD%B1&t=%E5%85%A8%E9%83%A8&s=0"},{"name":"Content-Length","value":"101"}],"id":73,"method":"POST","time":"2015-05-23T05:50:56.406Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:50:56.407Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Origin","value":"http://image.baidu.com"},{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Content-Type","value":"application/x-www-form-urlencoded; charset=UTF-8"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E6%91%84%E5%BD%B1&t=%E5%85%A8%E9%83%A8&s=0"},{"name":"Content-Length","value":"17"}],"id":74,"method":"POST","time":"2015-05-23T05:50:56.407Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:50:56.407Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Origin","value":"http://image.baidu.com"},{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Content-Type","value":"application/x-www-form-urlencoded; charset=UTF-8"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E6%91%84%E5%BD%B1&t=%E5%85%A8%E9%83%A8&s=0"},{"name":"Content-Length","value":"17"}],"id":75,"method":"POST","time":"2015-05-23T05:50:56.407Z","url":"http://image.baidu.com/albumlist/getlike"} 2015-05-23T13:50:56 [DEBUG] WebPage - updateLoadingProgress: 57 [DEBUG - 2015-05-23T05:50:56.462Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E6%91%84%E5%BD%B1&t=%E5%85%A8%E9%83%A8&s=0"}],"id":76,"method":"GET","time":"2015-05-23T05:50:56.462Z","url":"http://image.baidu.com/channel/favdownload?c=%E6%91%84%E5%BD%B1&t=%E5%85%A8%E9%83%A8&s=0&t3=&idlist=9419854332%2C15601655755%2C15324221385%2C9819700457%2C14339875757%2C9846737110%2C9631098273%2C9556402836%2C11840781156%2C9366264727%2C9905199120%2C9326644792%2C9277789013%2C9631138373%2C7711392657%2C9425768573%2C9419816039%2C15601747299%2C15324219845%2C9819564996%2C9582992532%2C9583049076%2C9631099742%2C9526371902%2C11925780170%2C11097962792%2C9401359716%2C9227994439%2C9324628120%2C9583029522"} [DEBUG - 2015-05-23T05:50:56.473Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E6%91%84%E5%BD%B1&t=%E5%85%A8%E9%83%A8&s=0"},{"name":"If-None-Match","value":"911fe008064b30d39e97ec8cef7ea6aa"}],"id":77,"method":"GET","time":"2015-05-23T05:50:56.473Z","url":"http://hm.baidu.com/h.js?737dbb498415dd39d8abf5bc2404b290"} 2015-05-23T13:50:56 [DEBUG] WebPage - updateLoadingProgress: 86 [DEBUG - 2015-05-23T05:50:56.475Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:50:56 GMT"},{"name":"Server","value":"Apache"},{"name":"Set-Cookie","value":"userid=deleted; expires=Fri, 23-May-2014 05:50:55 GMT; path=/"},{"name":"Tracecode","value":"30561200770210131978052313"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Transfer-Encoding","value":"chunked"}],"id":69,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:56.474Z","url":"http://image.baidu.com/channel?c=%E6%91%84%E5%BD%B1&t=%E5%85%A8%E9%83%A8&s=0"} [DEBUG - 2015-05-23T05:50:56.496Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true [DEBUG - 2015-05-23T05:50:56.496Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":3622,"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:50:56 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30564138740747002890052313"},{"name":"Transfer-Encoding","value":"chunked"}],"id":72,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:56.496Z","url":"http://image.baidu.com/detail/info?fr=channel&tag1=%E6%91%84%E5%BD%B1&tag2=%E5%85%A8%E9%83%A8&column=%E6%91%84%E5%BD%B1&tag=%E5%85%A8%E9%83%A8&ie=utf-8&oe=utf-8&word=1&t=1432360256399"} [DEBUG - 2015-05-23T05:50:56.497Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:50:56 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30564138740747002890052313"},{"name":"Transfer-Encoding","value":"chunked"}],"id":72,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:56.496Z","url":"http://image.baidu.com/detail/info?fr=channel&tag1=%E6%91%84%E5%BD%B1&tag2=%E5%85%A8%E9%83%A8&column=%E6%91%84%E5%BD%B1&tag=%E5%85%A8%E9%83%A8&ie=utf-8&oe=utf-8&word=1&t=1432360256399"} [DEBUG - 2015-05-23T05:50:56.499Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":3048,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:50:56 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30564748900864443402052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":76,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:56.499Z","url":"http://image.baidu.com/channel/favdownload?c=%E6%91%84%E5%BD%B1&t=%E5%85%A8%E9%83%A8&s=0&t3=&idlist=9419854332%2C15601655755%2C15324221385%2C9819700457%2C14339875757%2C9846737110%2C9631098273%2C9556402836%2C11840781156%2C9366264727%2C9905199120%2C9326644792%2C9277789013%2C9631138373%2C7711392657%2C9425768573%2C9419816039%2C15601747299%2C15324219845%2C9819564996%2C9582992532%2C9583049076%2C9631099742%2C9526371902%2C11925780170%2C11097962792%2C9401359716%2C9227994439%2C9324628120%2C9583029522"} [DEBUG - 2015-05-23T05:50:56.499Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:50:56 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30564748900864443402052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":76,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:56.499Z","url":"http://image.baidu.com/channel/favdownload?c=%E6%91%84%E5%BD%B1&t=%E5%85%A8%E9%83%A8&s=0&t3=&idlist=9419854332%2C15601655755%2C15324221385%2C9819700457%2C14339875757%2C9846737110%2C9631098273%2C9556402836%2C11840781156%2C9366264727%2C9905199120%2C9326644792%2C9277789013%2C9631138373%2C7711392657%2C9425768573%2C9419816039%2C15601747299%2C15324219845%2C9819564996%2C9582992532%2C9583049076%2C9631099742%2C9526371902%2C11925780170%2C11097962792%2C9401359716%2C9227994439%2C9324628120%2C9583029522"} [DEBUG - 2015-05-23T05:50:56.520Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":104,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:50:56 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30565111790747002890052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":75,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:56.520Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:50:56.520Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:50:56 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30565111790747002890052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":75,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:56.520Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:50:56.526Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":105,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:50:56 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30565120830763714570052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":74,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:56.526Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:50:56.526Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:50:56 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30565120830763714570052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":74,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:56.526Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:50:56.531Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":489,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:50:56 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30565093500881220618052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":73,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:56.531Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:50:56.531Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:50:56 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30565093500881220618052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":73,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:56.531Z","url":"http://image.baidu.com/albumlist/getlike"} 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360254; domain=.image.baidu.com; path=/" 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360256|; domain=.hm.baidu.com; path=/" [DEBUG - 2015-05-23T05:50:56.568Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":20045,"contentType":"application/javascript","headers":[{"name":"Cache-Control","value":"max-age=0, must-revalidate"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"application/javascript"},{"name":"Date","value":"Sat, 23 May 2015 05:50:56 GMT"},{"name":"Etag","value":"20661c0706a23b25c1b8fe847b3fc48e"},{"name":"P3p","value":"CP=\"CURa ADMa DEVa PSAo PSDo OUR BUS UNI PUR INT DEM STA PRE COM NAV OTC NOI DSP COR\""},{"name":"Server","value":"apache"},{"name":"Set-Cookie","value":"HMVT=737dbb498415dd39d8abf5bc2404b290|1432360256|; Path=/; Domain=hm.baidu.com"}],"id":77,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:56.568Z","url":"http://hm.baidu.com/h.js?737dbb498415dd39d8abf5bc2404b290"} 2015-05-23T13:50:56 [DEBUG] WebPage - updateLoadingProgress: 88 [DEBUG - 2015-05-23T05:50:56.569Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/javascript","headers":[{"name":"Cache-Control","value":"max-age=0, must-revalidate"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"application/javascript"},{"name":"Date","value":"Sat, 23 May 2015 05:50:56 GMT"},{"name":"Etag","value":"20661c0706a23b25c1b8fe847b3fc48e"},{"name":"P3p","value":"CP=\"CURa ADMa DEVa PSAo PSDo OUR BUS UNI PUR INT DEM STA PRE COM NAV OTC NOI DSP COR\""},{"name":"Server","value":"apache"},{"name":"Set-Cookie","value":"HMVT=737dbb498415dd39d8abf5bc2404b290|1432360256|; Path=/; Domain=hm.baidu.com"}],"id":77,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:56.569Z","url":"http://hm.baidu.com/h.js?737dbb498415dd39d8abf5bc2404b290"} 2015-05-23T13:50:56 [DEBUG] WebPage - updateLoadingProgress: 100 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360254; domain=.image.baidu.com; path=/" 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360256|; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:50:56 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360256|; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:50:56 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:50:56 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360257; domain=.image.baidu.com; path=/" 2015-05-23T13:50:56 [DEBUG] WebPage - setupFrame "" [DEBUG - 2015-05-23T05:50:56.575Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E6%91%84%E5%BD%B1&t=%E5%85%A8%E9%83%A8&s=0"}],"id":78,"method":"GET","time":"2015-05-23T05:50:56.575Z","url":"http://static.tieba.baidu.com/tb/pms/wpo.pda.js?v=2.9"} [DEBUG - 2015-05-23T05:50:56.579Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"application/json, text/javascript, */*; q=0.01"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E6%91%84%E5%BD%B1&t=%E5%85%A8%E9%83%A8&s=0"}],"id":79,"method":"GET","time":"2015-05-23T05:50:56.579Z","url":"http://image.baidu.com/user/msg?t=1432360256578"} [DEBUG - 2015-05-23T05:50:56.579Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"application/json, text/javascript, */*; q=0.01"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E6%91%84%E5%BD%B1&t=%E5%85%A8%E9%83%A8&s=0"}],"id":80,"method":"GET","time":"2015-05-23T05:50:56.579Z","url":"http://image.baidu.com/user/medal?uid=0&t=1432360256579"} [DEBUG - 2015-05-23T05:50:56.583Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":4834,"contentType":"application/x-javascript","headers":[{"name":"Date","value":"Sat, 23 May 2015 05:50:56 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Last-Modified","value":"Wed, 17 Jul 2013 05:44:02 GMT"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"keep-alive"},{"name":"Vary","value":"Accept-Encoding"},{"name":"ETag","value":"W/\"51e62f22-12e2\""},{"name":"Server","value":"Apache"},{"name":"Expires","value":"Mon, 22 Jun 2015 05:50:56 GMT"},{"name":"Cache-Control","value":"max-age=2592000"},{"name":"Content-Encoding","value":"gzip"}],"id":78,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:56.583Z","url":"http://static.tieba.baidu.com/tb/pms/wpo.pda.js?v=2.9"} [DEBUG - 2015-05-23T05:50:56.583Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/x-javascript","headers":[{"name":"Date","value":"Sat, 23 May 2015 05:50:56 GMT"},{"name":"Content-Type","value":"application/x-javascript"},{"name":"Last-Modified","value":"Wed, 17 Jul 2013 05:44:02 GMT"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"keep-alive"},{"name":"Vary","value":"Accept-Encoding"},{"name":"ETag","value":"W/\"51e62f22-12e2\""},{"name":"Server","value":"Apache"},{"name":"Expires","value":"Mon, 22 Jun 2015 05:50:56 GMT"},{"name":"Cache-Control","value":"max-age=2592000"},{"name":"Content-Encoding","value":"gzip"}],"id":78,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:56.583Z","url":"http://static.tieba.baidu.com/tb/pms/wpo.pda.js?v=2.9"} [DEBUG - 2015-05-23T05:50:56.596Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: false [DEBUG - 2015-05-23T05:50:56.596Z] SessionReqHand - _SuccessHandler - status: fail 2015-05-23T13:50:56 [DEBUG] HTTP Response - Status Code 200 OK 2015-05-23T13:50:56 [DEBUG] HTTP Response - Sending Header "Cache" = "no-cache" 2015-05-23T13:50:56 [DEBUG] HTTP Response - Sending Header "Content-Length" = "74" 2015-05-23T13:50:56 [DEBUG] HTTP Response - Sending Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:50:56 [DEBUG] HTTP Request - URI /wd/hub/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source 2015-05-23T13:50:56 [DEBUG] HTTP Request - Method GET 2015-05-23T13:50:56 [DEBUG] HTTP Request - HTTP Version 1.1 2015-05-23T13:50:56 [DEBUG] HTTP Request - Query String 2015-05-23T13:50:56 [DEBUG] HTTP Request - Receiving Header "Accept-Encoding" = "identity" 2015-05-23T13:50:56 [DEBUG] HTTP Request - Receiving Header "Host" = "127.0.0.1:32999" 2015-05-23T13:50:56 [DEBUG] HTTP Request - Receiving Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:50:56 [DEBUG] HTTP Request - Receiving Header "Connection" = "close" 2015-05-23T13:50:56 [DEBUG] HTTP Request - Receiving Header "Accept" = "application/json" 2015-05-23T13:50:56 [DEBUG] HTTP Request - Receiving Header "User-Agent" = "Python-urllib/2.7" [DEBUG - 2015-05-23T05:50:56.598Z] RouterReqHand - _handle - {"headers":{"Accept":"application/json","Accept-Encoding":"identity","Connection":"close","Content-Type":"application/json;charset=UTF-8","Host":"127.0.0.1:32999","User-Agent":"Python-urllib/2.7"},"httpVersion":"1.1","method":"GET","url":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","urlParsed":{"anchor":"","query":"","file":"source","directory":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/","path":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","relative":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","port":"","host":"","password":"","user":"","userInfo":"","authority":"","protocol":"","source":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","queryKey":{},"chunks":["session","ac4aab20-010f-11e5-a1b5-e503e60d48a0","source"]}} 2015-05-23T13:50:56 [DEBUG] HTTP Response - Status Code 200 OK 2015-05-23T13:50:56 [DEBUG] HTTP Response - Sending Header "Cache" = "no-cache" 2015-05-23T13:50:56 [DEBUG] HTTP Response - Sending Header "Content-Length" = "544873" 2015-05-23T13:50:56 [DEBUG] HTTP Response - Sending Header "Content-Type" = "application/json;charset=UTF-8" [DEBUG - 2015-05-23T05:50:56.652Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":72,"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:50:56 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30565910240746937354052313"},{"name":"Content-Length","value":"72"}],"id":79,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:56.652Z","url":"http://image.baidu.com/user/msg?t=1432360256578"} [DEBUG - 2015-05-23T05:50:56.652Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:50:56 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30565910240746937354052313"},{"name":"Content-Length","value":"72"}],"id":79,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:56.652Z","url":"http://image.baidu.com/user/msg?t=1432360256578"} [DEBUG - 2015-05-23T05:50:56.653Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":98,"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:50:56 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30565924380797269002052313"},{"name":"Content-Length","value":"98"}],"id":80,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:56.653Z","url":"http://image.baidu.com/user/medal?uid=0&t=1432360256579"} [DEBUG - 2015-05-23T05:50:56.653Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:50:56 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30565924380797269002052313"},{"name":"Content-Length","value":"98"}],"id":80,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:56.653Z","url":"http://image.baidu.com/user/medal?uid=0&t=1432360256579"} 2015-05-23T13:50:57 [DEBUG] HTTP Request - URI /wd/hub/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url 2015-05-23T13:50:57 [DEBUG] HTTP Request - Method POST 2015-05-23T13:50:57 [DEBUG] HTTP Request - HTTP Version 1.1 2015-05-23T13:50:57 [DEBUG] HTTP Request - Query String 2015-05-23T13:50:57 [DEBUG] HTTP Request - Receiving Header "Accept-Encoding" = "identity" 2015-05-23T13:50:57 [DEBUG] HTTP Request - Receiving Header "Content-Length" = "104" 2015-05-23T13:50:57 [DEBUG] HTTP Request - Receiving Header "Host" = "127.0.0.1:32999" 2015-05-23T13:50:57 [DEBUG] HTTP Request - Receiving Header "Accept" = "application/json" 2015-05-23T13:50:57 [DEBUG] HTTP Request - Receiving Header "User-Agent" = "Python-urllib/2.7" 2015-05-23T13:50:57 [DEBUG] HTTP Request - Receiving Header "Connection" = "close" 2015-05-23T13:50:57 [DEBUG] HTTP Request - Receiving Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:50:57 [DEBUG] HTTP Request - Method POST/PUT 2015-05-23T13:50:57 [DEBUG] HTTP Request - Content Body: {"url": "http://image.baidu.com/channel/wallpaper", "sessionId": "ac4aab20-010f-11e5-a1b5-e503e60d48a0"} [DEBUG - 2015-05-23T05:50:57.253Z] RouterReqHand - _handle - {"headers":{"Accept":"application/json","Accept-Encoding":"identity","Connection":"close","Content-Length":"104","Content-Type":"application/json;charset=UTF-8","Host":"127.0.0.1:32999","User-Agent":"Python-urllib/2.7"},"httpVersion":"1.1","method":"POST","post":"{\"url\": \"http://image.baidu.com/channel/wallpaper\", \"sessionId\": \"ac4aab20-010f-11e5-a1b5-e503e60d48a0\"}","url":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","urlParsed":{"anchor":"","query":"","file":"url","directory":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/","path":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","relative":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","port":"","host":"","password":"","user":"","userInfo":"","authority":"","protocol":"","source":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","queryKey":{},"chunks":["session","ac4aab20-010f-11e5-a1b5-e503e60d48a0","url"]}} [DEBUG - 2015-05-23T05:50:57.254Z] SessionReqHand - _postUrlCommand - Session 'ac4aab20-010f-11e5-a1b5-e503e60d48a0' is about to load URL: http://image.baidu.com/channel/wallpaper 2015-05-23T13:50:57 [DEBUG] WebPage - updateLoadingProgress: 10 [DEBUG - 2015-05-23T05:50:57.255Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8"}],"id":81,"method":"GET","time":"2015-05-23T05:50:57.255Z","url":"http://image.baidu.com/channel/wallpaper"} [DEBUG - 2015-05-23T05:50:57.265Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360256|; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:50:56 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360257; domain=.image.baidu.com; path=/" [DEBUG - 2015-05-23T05:50:57.324Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":78436,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:50:57 GMT"},{"name":"Server","value":"Apache"},{"name":"Set-Cookie","value":"userid=deleted; expires=Fri, 23-May-2014 05:50:56 GMT; path=/"},{"name":"Tracecode","value":"30572673910747002890052313"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Transfer-Encoding","value":"chunked"}],"id":81,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:57.324Z","url":"http://image.baidu.com/channel/wallpaper"} [DEBUG - 2015-05-23T05:50:57.326Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Cache-Control","value":"max-age=0"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E6%91%84%E5%BD%B1&t=%E5%85%A8%E9%83%A8&s=0"},{"name":"Accept","value":"*/*"}],"id":82,"method":"GET","time":"2015-05-23T05:50:57.326Z","url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=755%2C755&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=942415631&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3"} 2015-05-23T13:50:57 [DEBUG] WebPage - setupFrame "" [DEBUG - 2015-05-23T05:50:57.337Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/css,*/*;q=0.1"},{"name":"Referer","value":"http://image.baidu.com/channel/wallpaper"}],"id":83,"method":"GET","time":"2015-05-23T05:50:57.337Z","url":"http://img1.bdstatic.com/static/wallpaper/pkg/wallnew_015c8fe.css"} [DEBUG - 2015-05-23T05:50:57.337Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/css,*/*;q=0.1"},{"name":"Referer","value":"http://image.baidu.com/channel/wallpaper"}],"id":84,"method":"GET","time":"2015-05-23T05:50:57.337Z","url":"http://img1.bdstatic.com/static/wallpaper/pkg/wallpaperindex_053b8f6.css"} 2015-05-23T13:50:57 [DEBUG] WebPage - updateLoadingProgress: 27 [DEBUG - 2015-05-23T05:50:57.339Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel/wallpaper"}],"id":85,"method":"GET","time":"2015-05-23T05:50:57.339Z","url":"http://img0.bdstatic.com/static/wallpaper/pkg/wallnew_89e1fa4.js"} 2015-05-23T13:50:57 [DEBUG] WebPage - updateLoadingProgress: 37 [DEBUG - 2015-05-23T05:50:57.339Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:50:57 GMT"},{"name":"Server","value":"Apache"},{"name":"Set-Cookie","value":"userid=deleted; expires=Fri, 23-May-2014 05:50:56 GMT; path=/"},{"name":"Tracecode","value":"30572673910747002890052313"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Transfer-Encoding","value":"chunked"}],"id":81,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:57.339Z","url":"http://image.baidu.com/channel/wallpaper"} [DEBUG - 2015-05-23T05:50:57.346Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":23220,"contentType":"text/css","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:57 GMT"},{"name":"Content-Type","value":"text/css"},{"name":"Connection","value":"keep-alive"},{"name":"ETag","value":"\"1730793005\""},{"name":"Last-Modified","value":"Tue, 10 Feb 2015 06:59:30 GMT"},{"name":"Expires","value":"Mon, 25 May 2015 11:13:00 GMT"},{"name":"Age","value":"412677"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Accept-Ranges","value":"bytes"},{"name":"Content-Encoding","value":"gzip"},{"name":"Vary","value":"Accept-Encoding"}],"id":83,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:57.346Z","url":"http://img1.bdstatic.com/static/wallpaper/pkg/wallnew_015c8fe.css"} 2015-05-23T13:50:57 [DEBUG] WebPage - updateLoadingProgress: 40 [DEBUG - 2015-05-23T05:50:57.347Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/css","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:57 GMT"},{"name":"Content-Type","value":"text/css"},{"name":"Connection","value":"keep-alive"},{"name":"ETag","value":"\"1730793005\""},{"name":"Last-Modified","value":"Tue, 10 Feb 2015 06:59:30 GMT"},{"name":"Expires","value":"Mon, 25 May 2015 11:13:00 GMT"},{"name":"Age","value":"412677"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Accept-Ranges","value":"bytes"},{"name":"Content-Encoding","value":"gzip"},{"name":"Vary","value":"Accept-Encoding"}],"id":83,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:57.347Z","url":"http://img1.bdstatic.com/static/wallpaper/pkg/wallnew_015c8fe.css"} [DEBUG - 2015-05-23T05:50:57.348Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":327,"contentType":"text/css","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:57 GMT"},{"name":"Content-Type","value":"text/css"},{"name":"Connection","value":"keep-alive"},{"name":"ETag","value":"\"1658573\""},{"name":"Last-Modified","value":"Tue, 10 Feb 2015 06:59:30 GMT"},{"name":"Expires","value":"Mon, 25 May 2015 11:13:00 GMT"},{"name":"Age","value":"412677"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Accept-Ranges","value":"bytes"},{"name":"Content-Encoding","value":"gzip"},{"name":"Vary","value":"Accept-Encoding"}],"id":84,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:57.348Z","url":"http://img1.bdstatic.com/static/wallpaper/pkg/wallpaperindex_053b8f6.css"} [DEBUG - 2015-05-23T05:50:57.349Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/css","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:57 GMT"},{"name":"Content-Type","value":"text/css"},{"name":"Connection","value":"keep-alive"},{"name":"ETag","value":"\"1658573\""},{"name":"Last-Modified","value":"Tue, 10 Feb 2015 06:59:30 GMT"},{"name":"Expires","value":"Mon, 25 May 2015 11:13:00 GMT"},{"name":"Age","value":"412677"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Accept-Ranges","value":"bytes"},{"name":"Content-Encoding","value":"gzip"},{"name":"Vary","value":"Accept-Encoding"}],"id":84,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:57.348Z","url":"http://img1.bdstatic.com/static/wallpaper/pkg/wallpaperindex_053b8f6.css"} [DEBUG - 2015-05-23T05:50:57.356Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel/wallpaper"},{"name":"If-None-Match","value":"20661c0706a23b25c1b8fe847b3fc48e"}],"id":86,"method":"GET","time":"2015-05-23T05:50:57.356Z","url":"http://hm.baidu.com/h.js?737dbb498415dd39d8abf5bc2404b290"} [DEBUG - 2015-05-23T05:50:57.358Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":62484,"contentType":"text/javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:57 GMT"},{"name":"Content-Type","value":"text/javascript"},{"name":"Connection","value":"keep-alive"},{"name":"ETag","value":"\"1866131117\""},{"name":"Last-Modified","value":"Tue, 10 Feb 2015 06:59:30 GMT"},{"name":"Expires","value":"Mon, 25 May 2015 11:13:00 GMT"},{"name":"Age","value":"412677"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Accept-Ranges","value":"bytes"},{"name":"Content-Encoding","value":"gzip"},{"name":"Vary","value":"Accept-Encoding"}],"id":85,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:57.358Z","url":"http://img0.bdstatic.com/static/wallpaper/pkg/wallnew_89e1fa4.js"} 2015-05-23T13:50:57 [DEBUG] WebPage - updateLoadingProgress: 44 [DEBUG - 2015-05-23T05:50:57.359Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:57 GMT"},{"name":"Content-Type","value":"text/javascript"},{"name":"Connection","value":"keep-alive"},{"name":"ETag","value":"\"1866131117\""},{"name":"Last-Modified","value":"Tue, 10 Feb 2015 06:59:30 GMT"},{"name":"Expires","value":"Mon, 25 May 2015 11:13:00 GMT"},{"name":"Age","value":"412677"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Accept-Ranges","value":"bytes"},{"name":"Content-Encoding","value":"gzip"},{"name":"Vary","value":"Accept-Encoding"}],"id":85,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:57.358Z","url":"http://img0.bdstatic.com/static/wallpaper/pkg/wallnew_89e1fa4.js"} [DEBUG - 2015-05-23T05:50:57.378Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel/wallpaper"}],"id":87,"method":"GET","time":"2015-05-23T05:50:57.378Z","url":"http://img0.bdstatic.com/static/wallpaper/pkg/wallpaperindex_dcf55f0.js"} [DEBUG - 2015-05-23T05:50:57.389Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":1698,"contentType":"text/javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:57 GMT"},{"name":"Content-Type","value":"text/javascript"},{"name":"Connection","value":"keep-alive"},{"name":"ETag","value":"\"51110701\""},{"name":"Last-Modified","value":"Tue, 10 Feb 2015 06:59:30 GMT"},{"name":"Expires","value":"Mon, 25 May 2015 11:13:00 GMT"},{"name":"Age","value":"412677"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Accept-Ranges","value":"bytes"},{"name":"Content-Encoding","value":"gzip"},{"name":"Vary","value":"Accept-Encoding"}],"id":87,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:57.389Z","url":"http://img0.bdstatic.com/static/wallpaper/pkg/wallpaperindex_dcf55f0.js"} 2015-05-23T13:50:57 [DEBUG] WebPage - updateLoadingProgress: 46 [DEBUG - 2015-05-23T05:50:57.390Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:57 GMT"},{"name":"Content-Type","value":"text/javascript"},{"name":"Connection","value":"keep-alive"},{"name":"ETag","value":"\"51110701\""},{"name":"Last-Modified","value":"Tue, 10 Feb 2015 06:59:30 GMT"},{"name":"Expires","value":"Mon, 25 May 2015 11:13:00 GMT"},{"name":"Age","value":"412677"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Accept-Ranges","value":"bytes"},{"name":"Content-Encoding","value":"gzip"},{"name":"Vary","value":"Accept-Encoding"}],"id":87,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:57.390Z","url":"http://img0.bdstatic.com/static/wallpaper/pkg/wallpaperindex_dcf55f0.js"} [DEBUG - 2015-05-23T05:50:57.390Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true [DEBUG - 2015-05-23T05:50:57.431Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"application/json, text/javascript, */*; q=0.01"},{"name":"Referer","value":"http://image.baidu.com/channel/wallpaper"}],"id":88,"method":"GET","time":"2015-05-23T05:50:57.431Z","url":"http://image.baidu.com/data/imgs?pn=0&rn=18&col=%E5%A3%81%E7%BA%B8&tag=%E5%85%A8%E9%83%A8&tag3=&width=1024&height=768&ic=0&ie=utf8&oe=utf-8&image_id=&fr=channel&p=channel&from=1&app=img.browse.channel.wallpaper&t=0.06541129387915134"} [DEBUG - 2015-05-23T05:50:57.432Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":43,"contentType":"image/gif","headers":[{"name":"Cache-Control","value":"private, max-age=0, no-cache"},{"name":"Content-Length","value":"43"},{"name":"Content-Type","value":"image/gif"},{"name":"Date","value":"Sat, 23 May 2015 05:50:57 GMT"},{"name":"Pragma","value":"no-cache"},{"name":"Server","value":"apache"},{"name":"X-Content-Type-Options","value":"nosniff"}],"id":82,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:57.432Z","url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=755%2C755&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=942415631&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3"} 2015-05-23T13:50:57 [DEBUG] Network - Resource request error: 5 ( "Operation canceled" ) URL: "http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=755,755&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=942415631&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3" [DEBUG - 2015-05-23T05:50:57.433Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceError - {"errorCode":5,"errorString":"Operation canceled","id":82,"url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=755,755&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=942415631&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3"} [DEBUG - 2015-05-23T05:50:57.433Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"image/gif","headers":[{"name":"Cache-Control","value":"private, max-age=0, no-cache"},{"name":"Content-Length","value":"43"},{"name":"Content-Type","value":"image/gif"},{"name":"Date","value":"Sat, 23 May 2015 05:50:57 GMT"},{"name":"Pragma","value":"no-cache"},{"name":"Server","value":"apache"},{"name":"X-Content-Type-Options","value":"nosniff"}],"id":82,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:57.433Z","url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=755%2C755&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=942415631&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3"} 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:50:56 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360257; domain=.image.baidu.com; path=/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360257|; domain=.hm.baidu.com; path=/" [DEBUG - 2015-05-23T05:50:57.448Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":null,"headers":[{"name":"Cache-Control","value":"max-age=0, must-revalidate"},{"name":"Date","value":"Sat, 23 May 2015 05:50:57 GMT"},{"name":"Etag","value":"20661c0706a23b25c1b8fe847b3fc48e"},{"name":"P3p","value":"CP=\"CURa ADMa DEVa PSAo PSDo OUR BUS UNI PUR INT DEM STA PRE COM NAV OTC NOI DSP COR\""},{"name":"Server","value":"apache"},{"name":"Set-Cookie","value":"HMVT=737dbb498415dd39d8abf5bc2404b290|1432360257|; Path=/; Domain=hm.baidu.com"}],"id":86,"redirectURL":null,"stage":"end","status":304,"statusText":"Not Modified","time":"2015-05-23T05:50:57.448Z","url":"http://hm.baidu.com/h.js?737dbb498415dd39d8abf5bc2404b290"} 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360257; domain=.image.baidu.com; path=/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360257|; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:50:57 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360257|; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:50:57 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360257; domain=.image.baidu.com; path=/" [DEBUG - 2015-05-23T05:50:57.457Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"application/json, text/javascript, */*; q=0.01"},{"name":"Referer","value":"http://image.baidu.com/channel/wallpaper"}],"id":89,"method":"GET","time":"2015-05-23T05:50:57.457Z","url":"http://image.baidu.com/user/msg?t=1432360257457"} [DEBUG - 2015-05-23T05:50:57.458Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"application/json, text/javascript, */*; q=0.01"},{"name":"Referer","value":"http://image.baidu.com/channel/wallpaper"}],"id":90,"method":"GET","time":"2015-05-23T05:50:57.458Z","url":"http://image.baidu.com/user/medal?uid=0&t=1432360257458"} [DEBUG - 2015-05-23T05:50:57.479Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":72,"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:50:57 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30574761360780491786052313"},{"name":"Content-Length","value":"72"}],"id":89,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:57.479Z","url":"http://image.baidu.com/user/msg?t=1432360257457"} 2015-05-23T13:50:57 [DEBUG] WebPage - updateLoadingProgress: 90 [DEBUG - 2015-05-23T05:50:57.479Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:50:57 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30574761360780491786052313"},{"name":"Content-Length","value":"72"}],"id":89,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:57.479Z","url":"http://image.baidu.com/user/msg?t=1432360257457"} [DEBUG - 2015-05-23T05:50:57.480Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":98,"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:50:57 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30574708860864443402052313"},{"name":"Content-Length","value":"98"}],"id":90,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:57.480Z","url":"http://image.baidu.com/user/medal?uid=0&t=1432360257458"} [DEBUG - 2015-05-23T05:50:57.481Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:50:57 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30574708860864443402052313"},{"name":"Content-Length","value":"98"}],"id":90,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:57.481Z","url":"http://image.baidu.com/user/medal?uid=0&t=1432360257458"} [DEBUG - 2015-05-23T05:50:57.490Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true [DEBUG - 2015-05-23T05:50:57.555Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":59438,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:50:57 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30574444820797269002052313"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Transfer-Encoding","value":"chunked"}],"id":88,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:57.554Z","url":"http://image.baidu.com/data/imgs?pn=0&rn=18&col=%E5%A3%81%E7%BA%B8&tag=%E5%85%A8%E9%83%A8&tag3=&width=1024&height=768&ic=0&ie=utf8&oe=utf-8&image_id=&fr=channel&p=channel&from=1&app=img.browse.channel.wallpaper&t=0.06541129387915134"} [DEBUG - 2015-05-23T05:50:57.555Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:50:57 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30574444820797269002052313"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Transfer-Encoding","value":"chunked"}],"id":88,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:57.555Z","url":"http://image.baidu.com/data/imgs?pn=0&rn=18&col=%E5%A3%81%E7%BA%B8&tag=%E5%85%A8%E9%83%A8&tag3=&width=1024&height=768&ic=0&ie=utf8&oe=utf-8&image_id=&fr=channel&p=channel&from=1&app=img.browse.channel.wallpaper&t=0.06541129387915134"} 2015-05-23T13:50:57 [DEBUG] WebPage - updateLoadingProgress: 100 [DEBUG - 2015-05-23T05:50:57.600Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _oneShotCallback - onLoadFinished [DEBUG - 2015-05-23T05:50:57.600Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - onLoadFinished: success 2015-05-23T13:50:57 [DEBUG] WebPage - setupFrame "" [DEBUG - 2015-05-23T05:50:57.600Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: false [DEBUG - 2015-05-23T05:50:57.600Z] SessionReqHand - _SuccessHandler - status: success 2015-05-23T13:50:57 [DEBUG] HTTP Response - Status Code 200 OK 2015-05-23T13:50:57 [DEBUG] HTTP Response - Sending Header "Cache" = "no-cache" 2015-05-23T13:50:57 [DEBUG] HTTP Response - Sending Header "Content-Length" = "74" 2015-05-23T13:50:57 [DEBUG] HTTP Response - Sending Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:50:57 [DEBUG] HTTP Request - URI /wd/hub/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source 2015-05-23T13:50:57 [DEBUG] HTTP Request - Method GET 2015-05-23T13:50:57 [DEBUG] HTTP Request - HTTP Version 1.1 2015-05-23T13:50:57 [DEBUG] HTTP Request - Query String 2015-05-23T13:50:57 [DEBUG] HTTP Request - Receiving Header "Accept-Encoding" = "identity" 2015-05-23T13:50:57 [DEBUG] HTTP Request - Receiving Header "Host" = "127.0.0.1:32999" 2015-05-23T13:50:57 [DEBUG] HTTP Request - Receiving Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:50:57 [DEBUG] HTTP Request - Receiving Header "Connection" = "close" 2015-05-23T13:50:57 [DEBUG] HTTP Request - Receiving Header "Accept" = "application/json" 2015-05-23T13:50:57 [DEBUG] HTTP Request - Receiving Header "User-Agent" = "Python-urllib/2.7" [DEBUG - 2015-05-23T05:50:57.604Z] RouterReqHand - _handle - {"headers":{"Accept":"application/json","Accept-Encoding":"identity","Connection":"close","Content-Type":"application/json;charset=UTF-8","Host":"127.0.0.1:32999","User-Agent":"Python-urllib/2.7"},"httpVersion":"1.1","method":"GET","url":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","urlParsed":{"anchor":"","query":"","file":"source","directory":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/","path":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","relative":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","port":"","host":"","password":"","user":"","userInfo":"","authority":"","protocol":"","source":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","queryKey":{},"chunks":["session","ac4aab20-010f-11e5-a1b5-e503e60d48a0","source"]}} 2015-05-23T13:50:57 [DEBUG] HTTP Response - Status Code 200 OK 2015-05-23T13:50:57 [DEBUG] HTTP Response - Sending Header "Cache" = "no-cache" 2015-05-23T13:50:57 [DEBUG] HTTP Response - Sending Header "Content-Length" = "188283" 2015-05-23T13:50:57 [DEBUG] HTTP Response - Sending Header "Content-Type" = "application/json;charset=UTF-8" [DEBUG - 2015-05-23T05:50:57.638Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"application/json, text/javascript, */*; q=0.01"},{"name":"Referer","value":"http://image.baidu.com/channel/wallpaper"}],"id":91,"method":"GET","time":"2015-05-23T05:50:57.638Z","url":"http://image.baidu.com/channel/getpicinfo?idlist=9399916350%2C9400491407%2C9426443511%2C9563605139%2C9426024511%2C9395785352%2C9423341647%2C16411196380%2C9626207388%2C11812143298%2C10501199471%2C9423432088%2C9399950870%2C9400494738%2C9426444488%2C9522000998%2C9563190094%2C13865604255"} [DEBUG - 2015-05-23T05:50:57.667Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":1386,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:50:57 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30576529770310795274052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":91,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:57.666Z","url":"http://image.baidu.com/channel/getpicinfo?idlist=9399916350%2C9400491407%2C9426443511%2C9563605139%2C9426024511%2C9395785352%2C9423341647%2C16411196380%2C9626207388%2C11812143298%2C10501199471%2C9423432088%2C9399950870%2C9400494738%2C9426444488%2C9522000998%2C9563190094%2C13865604255"} [DEBUG - 2015-05-23T05:50:57.667Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:50:57 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30576529770310795274052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":91,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:57.667Z","url":"http://image.baidu.com/channel/getpicinfo?idlist=9399916350%2C9400491407%2C9426443511%2C9563605139%2C9426024511%2C9395785352%2C9423341647%2C16411196380%2C9626207388%2C11812143298%2C10501199471%2C9423432088%2C9399950870%2C9400494738%2C9426444488%2C9522000998%2C9563190094%2C13865604255"} 2015-05-23T13:50:57 [DEBUG] HTTP Request - URI /wd/hub/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url 2015-05-23T13:50:57 [DEBUG] HTTP Request - Method POST 2015-05-23T13:50:57 [DEBUG] HTTP Request - HTTP Version 1.1 2015-05-23T13:50:57 [DEBUG] HTTP Request - Query String 2015-05-23T13:50:57 [DEBUG] HTTP Request - Receiving Header "Accept-Encoding" = "identity" 2015-05-23T13:50:57 [DEBUG] HTTP Request - Receiving Header "Content-Length" = "99" 2015-05-23T13:50:57 [DEBUG] HTTP Request - Receiving Header "Host" = "127.0.0.1:32999" 2015-05-23T13:50:57 [DEBUG] HTTP Request - Receiving Header "Accept" = "application/json" 2015-05-23T13:50:57 [DEBUG] HTTP Request - Receiving Header "User-Agent" = "Python-urllib/2.7" 2015-05-23T13:50:57 [DEBUG] HTTP Request - Receiving Header "Connection" = "close" 2015-05-23T13:50:57 [DEBUG] HTTP Request - Receiving Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:50:57 [DEBUG] HTTP Request - Method POST/PUT 2015-05-23T13:50:57 [DEBUG] HTTP Request - Content Body: {"url": "http://image.baidu.com/channel/star", "sessionId": "ac4aab20-010f-11e5-a1b5-e503e60d48a0"} [DEBUG - 2015-05-23T05:50:57.903Z] RouterReqHand - _handle - {"headers":{"Accept":"application/json","Accept-Encoding":"identity","Connection":"close","Content-Length":"99","Content-Type":"application/json;charset=UTF-8","Host":"127.0.0.1:32999","User-Agent":"Python-urllib/2.7"},"httpVersion":"1.1","method":"POST","post":"{\"url\": \"http://image.baidu.com/channel/star\", \"sessionId\": \"ac4aab20-010f-11e5-a1b5-e503e60d48a0\"}","url":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","urlParsed":{"anchor":"","query":"","file":"url","directory":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/","path":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","relative":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","port":"","host":"","password":"","user":"","userInfo":"","authority":"","protocol":"","source":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","queryKey":{},"chunks":["session","ac4aab20-010f-11e5-a1b5-e503e60d48a0","url"]}} [DEBUG - 2015-05-23T05:50:57.903Z] SessionReqHand - _postUrlCommand - Session 'ac4aab20-010f-11e5-a1b5-e503e60d48a0' is about to load URL: http://image.baidu.com/channel/star 2015-05-23T13:50:57 [DEBUG] WebPage - updateLoadingProgress: 10 [DEBUG - 2015-05-23T05:50:57.904Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8"}],"id":92,"method":"GET","time":"2015-05-23T05:50:57.904Z","url":"http://image.baidu.com/channel/star"} [DEBUG - 2015-05-23T05:50:57.914Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360257|; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:50:57 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:50:57 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360257; domain=.image.baidu.com; path=/" [DEBUG - 2015-05-23T05:50:57.983Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":82162,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:50:57 GMT"},{"name":"Server","value":"Apache"},{"name":"Set-Cookie","value":"userid=deleted; expires=Fri, 23-May-2014 05:50:56 GMT; path=/"},{"name":"Tracecode","value":"30579163150747002890052313"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Transfer-Encoding","value":"chunked"}],"id":92,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:57.983Z","url":"http://image.baidu.com/channel/star"} [DEBUG - 2015-05-23T05:50:57.984Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Cache-Control","value":"max-age=0"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Referer","value":"http://image.baidu.com/channel/wallpaper"},{"name":"Accept","value":"*/*"}],"id":93,"method":"GET","time":"2015-05-23T05:50:57.984Z","url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=533%2C533&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=1135029781&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3"} 2015-05-23T13:50:57 [DEBUG] WebPage - setupFrame "" [DEBUG - 2015-05-23T05:50:57.993Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/css,*/*;q=0.1"},{"name":"Referer","value":"http://image.baidu.com/channel/star"}],"id":94,"method":"GET","time":"2015-05-23T05:50:57.993Z","url":"http://img2.bdstatic.com/static/superstar/pkg/superstar_38d1c7b.css"} [DEBUG - 2015-05-23T05:50:57.994Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/css,*/*;q=0.1"},{"name":"Referer","value":"http://image.baidu.com/channel/star"}],"id":95,"method":"GET","time":"2015-05-23T05:50:57.994Z","url":"http://img1.bdstatic.com/static/superstar/pkg/base_2d0a80f.css"} [DEBUG - 2015-05-23T05:50:57.994Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/css,*/*;q=0.1"},{"name":"Referer","value":"http://image.baidu.com/channel/star"}],"id":96,"method":"GET","time":"2015-05-23T05:50:57.994Z","url":"http://img1.bdstatic.com/static/superstar/pkg/index_d41d8cd.css"} [DEBUG - 2015-05-23T05:50:57.995Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel/star"}],"id":97,"method":"GET","time":"2015-05-23T05:50:57.995Z","url":"http://img2.bdstatic.com/static/superstar/pkg/superstar_d79950e.js"} 2015-05-23T13:50:57 [DEBUG] WebPage - updateLoadingProgress: 24 2015-05-23T13:50:57 [DEBUG] WebPage - updateLoadingProgress: 31 [DEBUG - 2015-05-23T05:50:57.995Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:50:57 GMT"},{"name":"Server","value":"Apache"},{"name":"Set-Cookie","value":"userid=deleted; expires=Fri, 23-May-2014 05:50:56 GMT; path=/"},{"name":"Tracecode","value":"30579163150747002890052313"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Transfer-Encoding","value":"chunked"}],"id":92,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:57.995Z","url":"http://image.baidu.com/channel/star"} [DEBUG - 2015-05-23T05:50:58.004Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":270,"contentType":"text/css","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:57 GMT"},{"name":"Content-Type","value":"text/css"},{"name":"Connection","value":"keep-alive"},{"name":"ETag","value":"\"1694253\""},{"name":"Last-Modified","value":"Wed, 22 Oct 2014 09:33:43 GMT"},{"name":"Expires","value":"Tue, 26 May 2015 22:40:32 GMT"},{"name":"Age","value":"285025"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Accept-Ranges","value":"bytes"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Content-Encoding","value":"gzip"}],"id":95,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:58.003Z","url":"http://img1.bdstatic.com/static/superstar/pkg/base_2d0a80f.css"} [DEBUG - 2015-05-23T05:50:58.004Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/css","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:57 GMT"},{"name":"Content-Type","value":"text/css"},{"name":"Connection","value":"keep-alive"},{"name":"ETag","value":"\"1694253\""},{"name":"Last-Modified","value":"Wed, 22 Oct 2014 09:33:43 GMT"},{"name":"Expires","value":"Tue, 26 May 2015 22:40:32 GMT"},{"name":"Age","value":"285025"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Accept-Ranges","value":"bytes"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Content-Encoding","value":"gzip"}],"id":95,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:58.004Z","url":"http://img1.bdstatic.com/static/superstar/pkg/base_2d0a80f.css"} [DEBUG - 2015-05-23T05:50:58.004Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":22762,"contentType":"text/css","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:57 GMT"},{"name":"Content-Type","value":"text/css"},{"name":"Connection","value":"keep-alive"},{"name":"ETag","value":"\"1731944045\""},{"name":"Last-Modified","value":"Wed, 22 Oct 2014 09:33:43 GMT"},{"name":"Expires","value":"Sat, 23 May 2015 20:10:16 GMT"},{"name":"Age","value":"553242"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Accept-Ranges","value":"bytes"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Content-Encoding","value":"gzip"}],"id":94,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:58.004Z","url":"http://img2.bdstatic.com/static/superstar/pkg/superstar_38d1c7b.css"} 2015-05-23T13:50:58 [DEBUG] WebPage - updateLoadingProgress: 35 [DEBUG - 2015-05-23T05:50:58.005Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/css","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:57 GMT"},{"name":"Content-Type","value":"text/css"},{"name":"Connection","value":"keep-alive"},{"name":"ETag","value":"\"1731944045\""},{"name":"Last-Modified","value":"Wed, 22 Oct 2014 09:33:43 GMT"},{"name":"Expires","value":"Sat, 23 May 2015 20:10:16 GMT"},{"name":"Age","value":"553242"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Accept-Ranges","value":"bytes"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Content-Encoding","value":"gzip"}],"id":94,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:58.005Z","url":"http://img2.bdstatic.com/static/superstar/pkg/superstar_38d1c7b.css"} [DEBUG - 2015-05-23T05:50:58.006Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":59307,"contentType":"text/javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:57 GMT"},{"name":"Content-Type","value":"text/javascript"},{"name":"Connection","value":"keep-alive"},{"name":"ETag","value":"\"1770604237\""},{"name":"Last-Modified","value":"Wed, 22 Oct 2014 09:33:43 GMT"},{"name":"Expires","value":"Wed, 27 May 2015 17:10:35 GMT"},{"name":"Age","value":"218422"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Accept-Ranges","value":"bytes"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Content-Encoding","value":"gzip"}],"id":97,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:58.006Z","url":"http://img2.bdstatic.com/static/superstar/pkg/superstar_d79950e.js"} 2015-05-23T13:50:58 [DEBUG] WebPage - updateLoadingProgress: 41 [DEBUG - 2015-05-23T05:50:58.006Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:57 GMT"},{"name":"Content-Type","value":"text/javascript"},{"name":"Connection","value":"keep-alive"},{"name":"ETag","value":"\"1770604237\""},{"name":"Last-Modified","value":"Wed, 22 Oct 2014 09:33:43 GMT"},{"name":"Expires","value":"Wed, 27 May 2015 17:10:35 GMT"},{"name":"Age","value":"218422"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Accept-Ranges","value":"bytes"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Content-Encoding","value":"gzip"}],"id":97,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:58.006Z","url":"http://img2.bdstatic.com/static/superstar/pkg/superstar_d79950e.js"} 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360257|; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:50:57 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360257; domain=.image.baidu.com; path=/" [DEBUG - 2015-05-23T05:50:58.007Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/css","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:50:58 GMT"},{"name":"Content-Type","value":"text/css"},{"name":"Content-Length","value":"0"},{"name":"Connection","value":"keep-alive"},{"name":"ETag","value":"\"544779f7-0\""},{"name":"Set-Cookie","value":"BAIDUID=4B023DE9BDEB8F15C1962B68E1046FBA:FG=1; expires=Sun, 22-May-16 05:50:58 GMT; max-age=31536000; path=/; domain=.baidu.com; version=1"},{"name":"P3P","value":"CP=\" OTI DSP COR IVA OUR IND COM \""},{"name":"Last-Modified","value":"Wed, 22 Oct 2014 09:33:43 GMT"},{"name":"Expires","value":"Wed, 07 Jan 1970 23:59:59 GMT"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Accept-Ranges","value":"bytes"},{"name":"Tracecode","value":"30580173160780491786052313"}],"id":96,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:58.007Z","url":"http://img1.bdstatic.com/static/superstar/pkg/index_d41d8cd.css"} [DEBUG - 2015-05-23T05:50:58.013Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel/star"},{"name":"If-None-Match","value":"20661c0706a23b25c1b8fe847b3fc48e"}],"id":98,"method":"GET","time":"2015-05-23T05:50:58.013Z","url":"http://hm.baidu.com/h.js?737dbb498415dd39d8abf5bc2404b290"} [DEBUG - 2015-05-23T05:50:58.132Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true [DEBUG - 2015-05-23T05:50:58.133Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":43,"contentType":"image/gif","headers":[{"name":"Cache-Control","value":"private, max-age=0, no-cache"},{"name":"Content-Length","value":"43"},{"name":"Content-Type","value":"image/gif"},{"name":"Date","value":"Sat, 23 May 2015 05:50:58 GMT"},{"name":"Pragma","value":"no-cache"},{"name":"Server","value":"apache"},{"name":"X-Content-Type-Options","value":"nosniff"}],"id":93,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:58.133Z","url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=533%2C533&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=1135029781&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3"} 2015-05-23T13:50:58 [DEBUG] Network - Resource request error: 5 ( "Operation canceled" ) URL: "http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=533,533&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=1135029781&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3" [DEBUG - 2015-05-23T05:50:58.133Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceError - {"errorCode":5,"errorString":"Operation canceled","id":93,"url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=533,533&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=1135029781&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3"} [DEBUG - 2015-05-23T05:50:58.133Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"image/gif","headers":[{"name":"Cache-Control","value":"private, max-age=0, no-cache"},{"name":"Content-Length","value":"43"},{"name":"Content-Type","value":"image/gif"},{"name":"Date","value":"Sat, 23 May 2015 05:50:58 GMT"},{"name":"Pragma","value":"no-cache"},{"name":"Server","value":"apache"},{"name":"X-Content-Type-Options","value":"nosniff"}],"id":93,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:58.133Z","url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=533%2C533&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=1135029781&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3"} 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:50:57 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360257; domain=.image.baidu.com; path=/" 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360258|; domain=.hm.baidu.com; path=/" [DEBUG - 2015-05-23T05:50:58.133Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":null,"headers":[{"name":"Cache-Control","value":"max-age=0, must-revalidate"},{"name":"Date","value":"Sat, 23 May 2015 05:50:58 GMT"},{"name":"Etag","value":"20661c0706a23b25c1b8fe847b3fc48e"},{"name":"P3p","value":"CP=\"CURa ADMa DEVa PSAo PSDo OUR BUS UNI PUR INT DEM STA PRE COM NAV OTC NOI DSP COR\""},{"name":"Server","value":"apache"},{"name":"Set-Cookie","value":"HMVT=737dbb498415dd39d8abf5bc2404b290|1432360258|; Path=/; Domain=hm.baidu.com"}],"id":98,"redirectURL":null,"stage":"end","status":304,"statusText":"Not Modified","time":"2015-05-23T05:50:58.133Z","url":"http://hm.baidu.com/h.js?737dbb498415dd39d8abf5bc2404b290"} 2015-05-23T13:50:58 [DEBUG] WebPage - updateLoadingProgress: 100 [DEBUG - 2015-05-23T05:50:58.134Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _oneShotCallback - onLoadFinished [DEBUG - 2015-05-23T05:50:58.134Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - onLoadFinished: success 2015-05-23T13:50:58 [DEBUG] WebPage - setupFrame "" 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360257; domain=.image.baidu.com; path=/" 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360258|; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:50:58 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360258|; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:50:58 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:50:58 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360258; domain=.image.baidu.com; path=/" [DEBUG - 2015-05-23T05:50:58.144Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"application/json, text/javascript, */*; q=0.01"},{"name":"Referer","value":"http://image.baidu.com/channel/star"}],"id":99,"method":"GET","time":"2015-05-23T05:50:58.144Z","url":"http://image.baidu.com/user/msg?t=1432360258143"} [DEBUG - 2015-05-23T05:50:58.147Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"application/json, text/javascript, */*; q=0.01"},{"name":"Referer","value":"http://image.baidu.com/channel/star"}],"id":100,"method":"GET","time":"2015-05-23T05:50:58.147Z","url":"http://image.baidu.com/user/medal?uid=0&t=1432360258144"} [DEBUG - 2015-05-23T05:50:58.164Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":72,"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:50:58 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30581541410881220618052313"},{"name":"Content-Length","value":"72"}],"id":99,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:58.164Z","url":"http://image.baidu.com/user/msg?t=1432360258143"} [DEBUG - 2015-05-23T05:50:58.164Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:50:58 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30581541410881220618052313"},{"name":"Content-Length","value":"72"}],"id":99,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:58.164Z","url":"http://image.baidu.com/user/msg?t=1432360258143"} [DEBUG - 2015-05-23T05:50:58.167Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":98,"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:50:58 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30581599660864443402052313"},{"name":"Content-Length","value":"98"}],"id":100,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:58.167Z","url":"http://image.baidu.com/user/medal?uid=0&t=1432360258144"} [DEBUG - 2015-05-23T05:50:58.167Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:50:58 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30581599660864443402052313"},{"name":"Content-Length","value":"98"}],"id":100,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:50:58.167Z","url":"http://image.baidu.com/user/medal?uid=0&t=1432360258144"} [DEBUG - 2015-05-23T05:50:58.232Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: false [DEBUG - 2015-05-23T05:50:58.232Z] SessionReqHand - _SuccessHandler - status: success 2015-05-23T13:50:58 [DEBUG] HTTP Response - Status Code 200 OK 2015-05-23T13:50:58 [DEBUG] HTTP Response - Sending Header "Cache" = "no-cache" 2015-05-23T13:50:58 [DEBUG] HTTP Response - Sending Header "Content-Length" = "74" 2015-05-23T13:50:58 [DEBUG] HTTP Response - Sending Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:50:58 [DEBUG] HTTP Request - URI /wd/hub/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source 2015-05-23T13:50:58 [DEBUG] HTTP Request - Method GET 2015-05-23T13:50:58 [DEBUG] HTTP Request - HTTP Version 1.1 2015-05-23T13:50:58 [DEBUG] HTTP Request - Query String 2015-05-23T13:50:58 [DEBUG] HTTP Request - Receiving Header "Accept-Encoding" = "identity" 2015-05-23T13:50:58 [DEBUG] HTTP Request - Receiving Header "Host" = "127.0.0.1:32999" 2015-05-23T13:50:58 [DEBUG] HTTP Request - Receiving Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:50:58 [DEBUG] HTTP Request - Receiving Header "Connection" = "close" 2015-05-23T13:50:58 [DEBUG] HTTP Request - Receiving Header "Accept" = "application/json" 2015-05-23T13:50:58 [DEBUG] HTTP Request - Receiving Header "User-Agent" = "Python-urllib/2.7" [DEBUG - 2015-05-23T05:50:58.234Z] RouterReqHand - _handle - {"headers":{"Accept":"application/json","Accept-Encoding":"identity","Connection":"close","Content-Type":"application/json;charset=UTF-8","Host":"127.0.0.1:32999","User-Agent":"Python-urllib/2.7"},"httpVersion":"1.1","method":"GET","url":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","urlParsed":{"anchor":"","query":"","file":"source","directory":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/","path":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","relative":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","port":"","host":"","password":"","user":"","userInfo":"","authority":"","protocol":"","source":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","queryKey":{},"chunks":["session","ac4aab20-010f-11e5-a1b5-e503e60d48a0","source"]}} 2015-05-23T13:50:58 [DEBUG] HTTP Response - Status Code 200 OK 2015-05-23T13:50:58 [DEBUG] HTTP Response - Sending Header "Cache" = "no-cache" 2015-05-23T13:50:58 [DEBUG] HTTP Response - Sending Header "Content-Length" = "177660" 2015-05-23T13:50:58 [DEBUG] HTTP Response - Sending Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:50:59 [DEBUG] HTTP Request - URI /wd/hub/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url 2015-05-23T13:50:59 [DEBUG] HTTP Request - Method POST 2015-05-23T13:50:59 [DEBUG] HTTP Request - HTTP Version 1.1 2015-05-23T13:50:59 [DEBUG] HTTP Request - Query String 2015-05-23T13:50:59 [DEBUG] HTTP Request - Receiving Header "Accept-Encoding" = "identity" 2015-05-23T13:50:59 [DEBUG] HTTP Request - Receiving Header "Content-Length" = "134" 2015-05-23T13:50:59 [DEBUG] HTTP Request - Receiving Header "Host" = "127.0.0.1:32999" 2015-05-23T13:50:59 [DEBUG] HTTP Request - Receiving Header "Accept" = "application/json" 2015-05-23T13:50:59 [DEBUG] HTTP Request - Receiving Header "User-Agent" = "Python-urllib/2.7" 2015-05-23T13:50:59 [DEBUG] HTTP Request - Receiving Header "Connection" = "close" 2015-05-23T13:50:59 [DEBUG] HTTP Request - Receiving Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:50:59 [DEBUG] HTTP Request - Method POST/PUT 2015-05-23T13:50:59 [DEBUG] HTTP Request - Content Body: {"url": "http://image.baidu.com/channel?c=%E5%AE%A0%E7%89%A9#%E5%AE%A0%E7%89%A9", "sessionId": "ac4aab20-010f-11e5-a1b5-e503e60d48a0"} [DEBUG - 2015-05-23T05:50:59.673Z] RouterReqHand - _handle - {"headers":{"Accept":"application/json","Accept-Encoding":"identity","Connection":"close","Content-Length":"134","Content-Type":"application/json;charset=UTF-8","Host":"127.0.0.1:32999","User-Agent":"Python-urllib/2.7"},"httpVersion":"1.1","method":"POST","post":"{\"url\": \"http://image.baidu.com/channel?c=%E5%AE%A0%E7%89%A9#%E5%AE%A0%E7%89%A9\", \"sessionId\": \"ac4aab20-010f-11e5-a1b5-e503e60d48a0\"}","url":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","urlParsed":{"anchor":"","query":"","file":"url","directory":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/","path":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","relative":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","port":"","host":"","password":"","user":"","userInfo":"","authority":"","protocol":"","source":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","queryKey":{},"chunks":["session","ac4aab20-010f-11e5-a1b5-e503e60d48a0","url"]}} [DEBUG - 2015-05-23T05:50:59.674Z] SessionReqHand - _postUrlCommand - Session 'ac4aab20-010f-11e5-a1b5-e503e60d48a0' is about to load URL: http://image.baidu.com/channel?c=%E5%AE%A0%E7%89%A9#%E5%AE%A0%E7%89%A9 2015-05-23T13:50:59 [DEBUG] WebPage - updateLoadingProgress: 10 [DEBUG - 2015-05-23T05:50:59.675Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8"}],"id":101,"method":"GET","time":"2015-05-23T05:50:59.675Z","url":"http://image.baidu.com/channel?c=%E5%AE%A0%E7%89%A9#%E5%AE%A0%E7%89%A9"} [DEBUG - 2015-05-23T05:50:59.685Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true 2015-05-23T13:50:59 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:59 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:50:59 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:50:59 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:50:59 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:50:59 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:50:59 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:50:59 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:50:59 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360258|; domain=.hm.baidu.com; path=/" 2015-05-23T13:50:59 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:50:58 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:50:59 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360258; domain=.image.baidu.com; path=/" [DEBUG - 2015-05-23T05:50:59.785Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true [DEBUG - 2015-05-23T05:50:59.864Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":86368,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:50:59 GMT"},{"name":"Server","value":"Apache"},{"name":"Set-Cookie","value":"userid=deleted; expires=Fri, 23-May-2014 05:50:58 GMT; path=/"},{"name":"Tracecode","value":"30596881290310795274052313"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Transfer-Encoding","value":"chunked"}],"id":101,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:50:59.864Z","url":"http://image.baidu.com/channel?c=%E5%AE%A0%E7%89%A9#%E5%AE%A0%E7%89%A9"} [DEBUG - 2015-05-23T05:50:59.865Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Cache-Control","value":"max-age=0"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Referer","value":"http://image.baidu.com/channel/star"},{"name":"Accept","value":"*/*"}],"id":102,"method":"GET","time":"2015-05-23T05:50:59.865Z","url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=1730%2C1730&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=677931657&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3"} 2015-05-23T13:50:59 [DEBUG] WebPage - setupFrame "" 2015-05-23T13:50:59 [DEBUG] WebPage - updateLoadingProgress: 30 2015-05-23T13:50:59 [DEBUG] WebPage - updateLoadingProgress: 46 [DEBUG - 2015-05-23T05:50:59.892Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true [DEBUG - 2015-05-23T05:50:59.946Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%AE%A0%E7%89%A9"}],"id":103,"method":"GET","time":"2015-05-23T05:50:59.946Z","url":"http://image.baidu.com/detail/info?fr=channel&tag1=%E5%AE%A0%E7%89%A9&tag2=%E5%85%A8%E9%83%A8&column=%E5%AE%A0%E7%89%A9&tag=%E5%85%A8%E9%83%A8&ie=utf-8&oe=utf-8&word=1&t=1432360259944"} 2015-05-23T13:50:59 [DEBUG] WebPage - updateLoadingProgress: 57 [DEBUG - 2015-05-23T05:50:59.999Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%AE%A0%E7%89%A9"}],"id":104,"method":"GET","time":"2015-05-23T05:50:59.999Z","url":"http://image.baidu.com/channel/favdownload?c=%E5%AE%A0%E7%89%A9&t=%E5%85%A8%E9%83%A8&s=0&t3=&idlist=9373361518%2C9551993978%2C9623167045%2C9414414989%2C10886010912%2C9542515305%2C9551961255%2C9442381611%2C9419340241%2C9555093516%2C9419339543%2C9552095379%2C9265636402%2C10506310854%2C9414473010%2C9395853356%2C9529522420%2C9265652993%2C9918048938%2C9416200082%2C9555092955%2C9419339640%2C9552098162%2C10058296850%2C4819239046%2C9414572046%2C9442376848%2C9419215924%2C9265638365%2C9442381328"} [DEBUG - 2015-05-23T05:51:00.007Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%AE%A0%E7%89%A9"},{"name":"If-None-Match","value":"20661c0706a23b25c1b8fe847b3fc48e"}],"id":105,"method":"GET","time":"2015-05-23T05:51:00.007Z","url":"http://hm.baidu.com/h.js?737dbb498415dd39d8abf5bc2404b290"} 2015-05-23T13:51:00 [DEBUG] WebPage - updateLoadingProgress: 83 [DEBUG - 2015-05-23T05:51:00.008Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:50:59 GMT"},{"name":"Server","value":"Apache"},{"name":"Set-Cookie","value":"userid=deleted; expires=Fri, 23-May-2014 05:50:58 GMT; path=/"},{"name":"Tracecode","value":"30596881290310795274052313"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Transfer-Encoding","value":"chunked"}],"id":101,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:00.008Z","url":"http://image.baidu.com/channel?c=%E5%AE%A0%E7%89%A9#%E5%AE%A0%E7%89%A9"} [DEBUG - 2015-05-23T05:51:00.024Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":43,"contentType":"image/gif","headers":[{"name":"Cache-Control","value":"private, max-age=0, no-cache"},{"name":"Content-Length","value":"43"},{"name":"Content-Type","value":"image/gif"},{"name":"Date","value":"Sat, 23 May 2015 05:50:59 GMT"},{"name":"Pragma","value":"no-cache"},{"name":"Server","value":"apache"},{"name":"X-Content-Type-Options","value":"nosniff"}],"id":102,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:00.024Z","url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=1730%2C1730&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=677931657&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3"} 2015-05-23T13:51:00 [DEBUG] Network - Resource request error: 5 ( "Operation canceled" ) URL: "http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=1730,1730&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=677931657&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3" [DEBUG - 2015-05-23T05:51:00.024Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceError - {"errorCode":5,"errorString":"Operation canceled","id":102,"url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=1730,1730&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=677931657&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3"} [DEBUG - 2015-05-23T05:51:00.024Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"image/gif","headers":[{"name":"Cache-Control","value":"private, max-age=0, no-cache"},{"name":"Content-Length","value":"43"},{"name":"Content-Type","value":"image/gif"},{"name":"Date","value":"Sat, 23 May 2015 05:50:59 GMT"},{"name":"Pragma","value":"no-cache"},{"name":"Server","value":"apache"},{"name":"X-Content-Type-Options","value":"nosniff"}],"id":102,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:00.024Z","url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=1730%2C1730&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=677931657&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3"} [DEBUG - 2015-05-23T05:51:00.028Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true [DEBUG - 2015-05-23T05:51:00.028Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":3081,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:00 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30600108260713448458052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":104,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:00.028Z","url":"http://image.baidu.com/channel/favdownload?c=%E5%AE%A0%E7%89%A9&t=%E5%85%A8%E9%83%A8&s=0&t3=&idlist=9373361518%2C9551993978%2C9623167045%2C9414414989%2C10886010912%2C9542515305%2C9551961255%2C9442381611%2C9419340241%2C9555093516%2C9419339543%2C9552095379%2C9265636402%2C10506310854%2C9414473010%2C9395853356%2C9529522420%2C9265652993%2C9918048938%2C9416200082%2C9555092955%2C9419339640%2C9552098162%2C10058296850%2C4819239046%2C9414572046%2C9442376848%2C9419215924%2C9265638365%2C9442381328"} [DEBUG - 2015-05-23T05:51:00.029Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:00 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30600108260713448458052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":104,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:00.029Z","url":"http://image.baidu.com/channel/favdownload?c=%E5%AE%A0%E7%89%A9&t=%E5%85%A8%E9%83%A8&s=0&t3=&idlist=9373361518%2C9551993978%2C9623167045%2C9414414989%2C10886010912%2C9542515305%2C9551961255%2C9442381611%2C9419340241%2C9555093516%2C9419339543%2C9552095379%2C9265636402%2C10506310854%2C9414473010%2C9395853356%2C9529522420%2C9265652993%2C9918048938%2C9416200082%2C9555092955%2C9419339640%2C9552098162%2C10058296850%2C4819239046%2C9414572046%2C9442376848%2C9419215924%2C9265638365%2C9442381328"} 2015-05-23T13:51:00 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:00 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:51:00 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:51:00 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:00 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:00 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:51:00 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:00 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:00 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:50:58 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:51:00 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360258; domain=.image.baidu.com; path=/" 2015-05-23T13:51:00 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360260|; domain=.hm.baidu.com; path=/" [DEBUG - 2015-05-23T05:51:00.096Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":null,"headers":[{"name":"Cache-Control","value":"max-age=0, must-revalidate"},{"name":"Date","value":"Sat, 23 May 2015 05:51:00 GMT"},{"name":"Etag","value":"20661c0706a23b25c1b8fe847b3fc48e"},{"name":"P3p","value":"CP=\"CURa ADMa DEVa PSAo PSDo OUR BUS UNI PUR INT DEM STA PRE COM NAV OTC NOI DSP COR\""},{"name":"Server","value":"apache"},{"name":"Set-Cookie","value":"HMVT=737dbb498415dd39d8abf5bc2404b290|1432360260|; Path=/; Domain=hm.baidu.com"}],"id":105,"redirectURL":null,"stage":"end","status":304,"statusText":"Not Modified","time":"2015-05-23T05:51:00.096Z","url":"http://hm.baidu.com/h.js?737dbb498415dd39d8abf5bc2404b290"} 2015-05-23T13:51:00 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:00 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:51:00 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:51:00 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:00 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:00 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:51:00 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:00 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:00 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360258; domain=.image.baidu.com; path=/" 2015-05-23T13:51:00 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360260|; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:00 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:51:00 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:51:00 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:00 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:51:00 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:51:00 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:00 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:00 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:51:00 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:00 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:00 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360260|; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:00 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:51:00 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:51:00 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360260; domain=.image.baidu.com; path=/" [DEBUG - 2015-05-23T05:51:00.104Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"application/json, text/javascript, */*; q=0.01"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%AE%A0%E7%89%A9"}],"id":106,"method":"GET","time":"2015-05-23T05:51:00.104Z","url":"http://image.baidu.com/user/msg?t=1432360260104"} [DEBUG - 2015-05-23T05:51:00.105Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"application/json, text/javascript, */*; q=0.01"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%AE%A0%E7%89%A9"}],"id":107,"method":"GET","time":"2015-05-23T05:51:00.105Z","url":"http://image.baidu.com/user/medal?uid=0&t=1432360260105"} [DEBUG - 2015-05-23T05:51:00.114Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":3532,"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:51:00 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30599583350747002890052313"},{"name":"Transfer-Encoding","value":"chunked"}],"id":103,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:00.113Z","url":"http://image.baidu.com/detail/info?fr=channel&tag1=%E5%AE%A0%E7%89%A9&tag2=%E5%85%A8%E9%83%A8&column=%E5%AE%A0%E7%89%A9&tag=%E5%85%A8%E9%83%A8&ie=utf-8&oe=utf-8&word=1&t=1432360259944"} 2015-05-23T13:51:00 [DEBUG] WebPage - updateLoadingProgress: 87 [DEBUG - 2015-05-23T05:51:00.114Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:51:00 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30599583350747002890052313"},{"name":"Transfer-Encoding","value":"chunked"}],"id":103,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:00.114Z","url":"http://image.baidu.com/detail/info?fr=channel&tag1=%E5%AE%A0%E7%89%A9&tag2=%E5%85%A8%E9%83%A8&column=%E5%AE%A0%E7%89%A9&tag=%E5%85%A8%E9%83%A8&ie=utf-8&oe=utf-8&word=1&t=1432360259944"} [DEBUG - 2015-05-23T05:51:00.120Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":72,"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:51:00 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30601173640747002890052313"},{"name":"Content-Length","value":"72"}],"id":106,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:00.120Z","url":"http://image.baidu.com/user/msg?t=1432360260104"} 2015-05-23T13:51:00 [DEBUG] WebPage - updateLoadingProgress: 90 [DEBUG - 2015-05-23T05:51:00.120Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:51:00 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30601173640747002890052313"},{"name":"Content-Length","value":"72"}],"id":106,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:00.120Z","url":"http://image.baidu.com/user/msg?t=1432360260104"} [DEBUG - 2015-05-23T05:51:00.128Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true [DEBUG - 2015-05-23T05:51:00.130Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":98,"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:51:00 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30601153730713448458052313"},{"name":"Content-Length","value":"98"}],"id":107,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:00.129Z","url":"http://image.baidu.com/user/medal?uid=0&t=1432360260105"} [DEBUG - 2015-05-23T05:51:00.130Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:51:00 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30601153730713448458052313"},{"name":"Content-Length","value":"98"}],"id":107,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:00.130Z","url":"http://image.baidu.com/user/medal?uid=0&t=1432360260105"} 2015-05-23T13:51:00 [DEBUG] WebPage - updateLoadingProgress: 100 [DEBUG - 2015-05-23T05:51:00.130Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _oneShotCallback - onLoadFinished [DEBUG - 2015-05-23T05:51:00.130Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - onLoadFinished: success 2015-05-23T13:51:00 [DEBUG] WebPage - setupFrame "" [DEBUG - 2015-05-23T05:51:00.228Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: false [DEBUG - 2015-05-23T05:51:00.228Z] SessionReqHand - _SuccessHandler - status: success 2015-05-23T13:51:00 [DEBUG] HTTP Response - Status Code 200 OK 2015-05-23T13:51:00 [DEBUG] HTTP Response - Sending Header "Cache" = "no-cache" 2015-05-23T13:51:00 [DEBUG] HTTP Response - Sending Header "Content-Length" = "74" 2015-05-23T13:51:00 [DEBUG] HTTP Response - Sending Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:51:00 [DEBUG] HTTP Request - URI /wd/hub/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source 2015-05-23T13:51:00 [DEBUG] HTTP Request - Method GET 2015-05-23T13:51:00 [DEBUG] HTTP Request - HTTP Version 1.1 2015-05-23T13:51:00 [DEBUG] HTTP Request - Query String 2015-05-23T13:51:00 [DEBUG] HTTP Request - Receiving Header "Accept-Encoding" = "identity" 2015-05-23T13:51:00 [DEBUG] HTTP Request - Receiving Header "Host" = "127.0.0.1:32999" 2015-05-23T13:51:00 [DEBUG] HTTP Request - Receiving Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:51:00 [DEBUG] HTTP Request - Receiving Header "Connection" = "close" 2015-05-23T13:51:00 [DEBUG] HTTP Request - Receiving Header "Accept" = "application/json" 2015-05-23T13:51:00 [DEBUG] HTTP Request - Receiving Header "User-Agent" = "Python-urllib/2.7" [DEBUG - 2015-05-23T05:51:00.230Z] RouterReqHand - _handle - {"headers":{"Accept":"application/json","Accept-Encoding":"identity","Connection":"close","Content-Type":"application/json;charset=UTF-8","Host":"127.0.0.1:32999","User-Agent":"Python-urllib/2.7"},"httpVersion":"1.1","method":"GET","url":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","urlParsed":{"anchor":"","query":"","file":"source","directory":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/","path":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","relative":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","port":"","host":"","password":"","user":"","userInfo":"","authority":"","protocol":"","source":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","queryKey":{},"chunks":["session","ac4aab20-010f-11e5-a1b5-e503e60d48a0","source"]}} 2015-05-23T13:51:00 [DEBUG] HTTP Response - Status Code 200 OK 2015-05-23T13:51:00 [DEBUG] HTTP Response - Sending Header "Cache" = "no-cache" 2015-05-23T13:51:00 [DEBUG] HTTP Response - Sending Header "Content-Length" = "532567" 2015-05-23T13:51:00 [DEBUG] HTTP Response - Sending Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:51:01 [DEBUG] HTTP Request - URI /wd/hub/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url 2015-05-23T13:51:01 [DEBUG] HTTP Request - Method POST 2015-05-23T13:51:01 [DEBUG] HTTP Request - HTTP Version 1.1 2015-05-23T13:51:01 [DEBUG] HTTP Request - Query String 2015-05-23T13:51:01 [DEBUG] HTTP Request - Receiving Header "Accept-Encoding" = "identity" 2015-05-23T13:51:01 [DEBUG] HTTP Request - Receiving Header "Content-Length" = "140" 2015-05-23T13:51:01 [DEBUG] HTTP Request - Receiving Header "Host" = "127.0.0.1:32999" 2015-05-23T13:51:01 [DEBUG] HTTP Request - Receiving Header "Accept" = "application/json" 2015-05-23T13:51:01 [DEBUG] HTTP Request - Receiving Header "User-Agent" = "Python-urllib/2.7" 2015-05-23T13:51:01 [DEBUG] HTTP Request - Receiving Header "Connection" = "close" 2015-05-23T13:51:01 [DEBUG] HTTP Request - Receiving Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:51:01 [DEBUG] HTTP Request - Method POST/PUT 2015-05-23T13:51:01 [DEBUG] HTTP Request - Content Body: {"url": "http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1", "sessionId": "ac4aab20-010f-11e5-a1b5-e503e60d48a0"} [DEBUG - 2015-05-23T05:51:01.441Z] RouterReqHand - _handle - {"headers":{"Accept":"application/json","Accept-Encoding":"identity","Connection":"close","Content-Length":"140","Content-Type":"application/json;charset=UTF-8","Host":"127.0.0.1:32999","User-Agent":"Python-urllib/2.7"},"httpVersion":"1.1","method":"POST","post":"{\"url\": \"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1\", \"sessionId\": \"ac4aab20-010f-11e5-a1b5-e503e60d48a0\"}","url":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","urlParsed":{"anchor":"","query":"","file":"url","directory":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/","path":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","relative":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","port":"","host":"","password":"","user":"","userInfo":"","authority":"","protocol":"","source":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","queryKey":{},"chunks":["session","ac4aab20-010f-11e5-a1b5-e503e60d48a0","url"]}} [DEBUG - 2015-05-23T05:51:01.441Z] SessionReqHand - _postUrlCommand - Session 'ac4aab20-010f-11e5-a1b5-e503e60d48a0' is about to load URL: http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1 2015-05-23T13:51:01 [DEBUG] WebPage - updateLoadingProgress: 10 [DEBUG - 2015-05-23T05:51:01.442Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8"}],"id":108,"method":"GET","time":"2015-05-23T05:51:01.442Z","url":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"} [DEBUG - 2015-05-23T05:51:01.452Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360260|; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:51:00 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360260; domain=.image.baidu.com; path=/" [DEBUG - 2015-05-23T05:51:01.552Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true [DEBUG - 2015-05-23T05:51:01.640Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":82110,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Set-Cookie","value":"userid=deleted; expires=Fri, 23-May-2014 05:51:00 GMT; path=/"},{"name":"Tracecode","value":"30614627820780491786052313"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Transfer-Encoding","value":"chunked"}],"id":108,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.640Z","url":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"} [DEBUG - 2015-05-23T05:51:01.641Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Cache-Control","value":"max-age=0"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%AE%A0%E7%89%A9"},{"name":"Accept","value":"*/*"}],"id":109,"method":"GET","time":"2015-05-23T05:51:01.641Z","url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=1544%2C1544&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=966089935&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3"} 2015-05-23T13:51:01 [DEBUG] WebPage - setupFrame "" 2015-05-23T13:51:01 [DEBUG] WebPage - updateLoadingProgress: 30 2015-05-23T13:51:01 [DEBUG] WebPage - updateLoadingProgress: 44 [DEBUG - 2015-05-23T05:51:01.667Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true [DEBUG - 2015-05-23T05:51:01.729Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"}],"id":110,"method":"GET","time":"2015-05-23T05:51:01.729Z","url":"http://image.baidu.com/detail/info?fr=channel&tag1=%E5%8A%A8%E6%BC%AB&tag2=%E5%85%A8%E9%83%A8&column=%E5%8A%A8%E6%BC%AB&tag=%E5%85%A8%E9%83%A8&ie=utf-8&oe=utf-8&word=1&t=1432360261728"} [DEBUG - 2015-05-23T05:51:01.743Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Origin","value":"http://image.baidu.com"},{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Content-Type","value":"application/x-www-form-urlencoded; charset=UTF-8"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"},{"name":"Content-Length","value":"17"}],"id":111,"method":"POST","time":"2015-05-23T05:51:01.742Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.743Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Origin","value":"http://image.baidu.com"},{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Content-Type","value":"application/x-www-form-urlencoded; charset=UTF-8"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"},{"name":"Content-Length","value":"16"}],"id":112,"method":"POST","time":"2015-05-23T05:51:01.743Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.743Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Origin","value":"http://image.baidu.com"},{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Content-Type","value":"application/x-www-form-urlencoded; charset=UTF-8"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"},{"name":"Content-Length","value":"17"}],"id":113,"method":"POST","time":"2015-05-23T05:51:01.743Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.744Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Origin","value":"http://image.baidu.com"},{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Content-Type","value":"application/x-www-form-urlencoded; charset=UTF-8"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"},{"name":"Content-Length","value":"17"}],"id":114,"method":"POST","time":"2015-05-23T05:51:01.744Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.744Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Origin","value":"http://image.baidu.com"},{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Content-Type","value":"application/x-www-form-urlencoded; charset=UTF-8"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"},{"name":"Content-Length","value":"18"}],"id":115,"method":"POST","time":"2015-05-23T05:51:01.744Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.745Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Origin","value":"http://image.baidu.com"},{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Content-Type","value":"application/x-www-form-urlencoded; charset=UTF-8"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"},{"name":"Content-Length","value":"16"}],"id":116,"method":"POST","time":"2015-05-23T05:51:01.745Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.745Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Origin","value":"http://image.baidu.com"},{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Content-Type","value":"application/x-www-form-urlencoded; charset=UTF-8"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"},{"name":"Content-Length","value":"17"}],"id":117,"method":"POST","time":"2015-05-23T05:51:01.745Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.745Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Origin","value":"http://image.baidu.com"},{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Content-Type","value":"application/x-www-form-urlencoded; charset=UTF-8"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"},{"name":"Content-Length","value":"18"}],"id":118,"method":"POST","time":"2015-05-23T05:51:01.745Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.746Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Origin","value":"http://image.baidu.com"},{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Content-Type","value":"application/x-www-form-urlencoded; charset=UTF-8"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"},{"name":"Content-Length","value":"17"}],"id":119,"method":"POST","time":"2015-05-23T05:51:01.746Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.746Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Origin","value":"http://image.baidu.com"},{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Content-Type","value":"application/x-www-form-urlencoded; charset=UTF-8"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"},{"name":"Content-Length","value":"17"}],"id":120,"method":"POST","time":"2015-05-23T05:51:01.746Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.746Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Origin","value":"http://image.baidu.com"},{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Content-Type","value":"application/x-www-form-urlencoded; charset=UTF-8"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"},{"name":"Content-Length","value":"18"}],"id":121,"method":"POST","time":"2015-05-23T05:51:01.746Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.747Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Origin","value":"http://image.baidu.com"},{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Content-Type","value":"application/x-www-form-urlencoded; charset=UTF-8"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"},{"name":"Content-Length","value":"17"}],"id":122,"method":"POST","time":"2015-05-23T05:51:01.747Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.747Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Origin","value":"http://image.baidu.com"},{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Content-Type","value":"application/x-www-form-urlencoded; charset=UTF-8"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"},{"name":"Content-Length","value":"18"}],"id":123,"method":"POST","time":"2015-05-23T05:51:01.747Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.747Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Origin","value":"http://image.baidu.com"},{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Content-Type","value":"application/x-www-form-urlencoded; charset=UTF-8"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"},{"name":"Content-Length","value":"18"}],"id":124,"method":"POST","time":"2015-05-23T05:51:01.747Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.748Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Origin","value":"http://image.baidu.com"},{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Content-Type","value":"application/x-www-form-urlencoded; charset=UTF-8"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"},{"name":"Content-Length","value":"18"}],"id":125,"method":"POST","time":"2015-05-23T05:51:01.748Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.748Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Origin","value":"http://image.baidu.com"},{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Content-Type","value":"application/x-www-form-urlencoded; charset=UTF-8"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"},{"name":"Content-Length","value":"18"}],"id":126,"method":"POST","time":"2015-05-23T05:51:01.748Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.751Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Origin","value":"http://image.baidu.com"},{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Content-Type","value":"application/x-www-form-urlencoded; charset=UTF-8"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"},{"name":"Content-Length","value":"18"}],"id":127,"method":"POST","time":"2015-05-23T05:51:01.751Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.751Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Origin","value":"http://image.baidu.com"},{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Content-Type","value":"application/x-www-form-urlencoded; charset=UTF-8"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"},{"name":"Content-Length","value":"17"}],"id":128,"method":"POST","time":"2015-05-23T05:51:01.751Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.751Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Origin","value":"http://image.baidu.com"},{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Content-Type","value":"application/x-www-form-urlencoded; charset=UTF-8"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"},{"name":"Content-Length","value":"17"}],"id":129,"method":"POST","time":"2015-05-23T05:51:01.751Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.752Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Origin","value":"http://image.baidu.com"},{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Content-Type","value":"application/x-www-form-urlencoded; charset=UTF-8"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"},{"name":"Content-Length","value":"18"}],"id":130,"method":"POST","time":"2015-05-23T05:51:01.752Z","url":"http://image.baidu.com/albumlist/getlike"} 2015-05-23T13:51:01 [DEBUG] WebPage - updateLoadingProgress: 55 [DEBUG - 2015-05-23T05:51:01.804Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"}],"id":131,"method":"GET","time":"2015-05-23T05:51:01.804Z","url":"http://image.baidu.com/channel/favdownload?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1&t3=&idlist=9421289371%2C9420585969%2C9628641263%2C9387498651%2C9421097071%2C9621440012%2C9385548780%2C9420745179%2C9620508755%2C9433097486%2C9554047603%2C9399468471%2C9554752920%2C9557663128%2C9430700999%2C9531380380%2C11187392075%2C9628644841%2C9387498794%2C9521553516%2C9353679627%2C9539105403%2C9387403595%2C9386701871%2C9433097474%2C9534172115%2C9419343822%2C9632052808%2C4854176596%2C9430669625"} [DEBUG - 2015-05-23T05:51:01.818Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"},{"name":"If-None-Match","value":"20661c0706a23b25c1b8fe847b3fc48e"}],"id":132,"method":"GET","time":"2015-05-23T05:51:01.818Z","url":"http://hm.baidu.com/h.js?737dbb498415dd39d8abf5bc2404b290"} 2015-05-23T13:51:01 [DEBUG] WebPage - updateLoadingProgress: 67 [DEBUG - 2015-05-23T05:51:01.819Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Set-Cookie","value":"userid=deleted; expires=Fri, 23-May-2014 05:51:00 GMT; path=/"},{"name":"Tracecode","value":"30614627820780491786052313"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Transfer-Encoding","value":"chunked"}],"id":108,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.819Z","url":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"} [DEBUG - 2015-05-23T05:51:01.838Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":43,"contentType":"image/gif","headers":[{"name":"Cache-Control","value":"private, max-age=0, no-cache"},{"name":"Content-Length","value":"43"},{"name":"Content-Type","value":"image/gif"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Pragma","value":"no-cache"},{"name":"Server","value":"apache"},{"name":"X-Content-Type-Options","value":"nosniff"}],"id":109,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.838Z","url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=1544%2C1544&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=966089935&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3"} 2015-05-23T13:51:01 [DEBUG] Network - Resource request error: 5 ( "Operation canceled" ) URL: "http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=1544,1544&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=966089935&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3" [DEBUG - 2015-05-23T05:51:01.838Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceError - {"errorCode":5,"errorString":"Operation canceled","id":109,"url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=1544,1544&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=966089935&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3"} [DEBUG - 2015-05-23T05:51:01.838Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"image/gif","headers":[{"name":"Cache-Control","value":"private, max-age=0, no-cache"},{"name":"Content-Length","value":"43"},{"name":"Content-Type","value":"image/gif"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Pragma","value":"no-cache"},{"name":"Server","value":"apache"},{"name":"X-Content-Type-Options","value":"nosniff"}],"id":109,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.838Z","url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=1544%2C1544&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=966089935&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3"} [DEBUG - 2015-05-23T05:51:01.839Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":3645,"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30617412840814046218052313"},{"name":"Transfer-Encoding","value":"chunked"}],"id":110,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.839Z","url":"http://image.baidu.com/detail/info?fr=channel&tag1=%E5%8A%A8%E6%BC%AB&tag2=%E5%85%A8%E9%83%A8&column=%E5%8A%A8%E6%BC%AB&tag=%E5%85%A8%E9%83%A8&ie=utf-8&oe=utf-8&word=1&t=1432360261728"} 2015-05-23T13:51:01 [DEBUG] WebPage - updateLoadingProgress: 70 [DEBUG - 2015-05-23T05:51:01.839Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30617412840814046218052313"},{"name":"Transfer-Encoding","value":"chunked"}],"id":110,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.839Z","url":"http://image.baidu.com/detail/info?fr=channel&tag1=%E5%8A%A8%E6%BC%AB&tag2=%E5%85%A8%E9%83%A8&column=%E5%8A%A8%E6%BC%AB&tag=%E5%85%A8%E9%83%A8&ie=utf-8&oe=utf-8&word=1&t=1432360261728"} [DEBUG - 2015-05-23T05:51:01.845Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true [DEBUG - 2015-05-23T05:51:01.847Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":3120,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30618184510210131978052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":131,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.847Z","url":"http://image.baidu.com/channel/favdownload?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1&t3=&idlist=9421289371%2C9420585969%2C9628641263%2C9387498651%2C9421097071%2C9621440012%2C9385548780%2C9420745179%2C9620508755%2C9433097486%2C9554047603%2C9399468471%2C9554752920%2C9557663128%2C9430700999%2C9531380380%2C11187392075%2C9628644841%2C9387498794%2C9521553516%2C9353679627%2C9539105403%2C9387403595%2C9386701871%2C9433097474%2C9534172115%2C9419343822%2C9632052808%2C4854176596%2C9430669625"} 2015-05-23T13:51:01 [DEBUG] WebPage - updateLoadingProgress: 73 [DEBUG - 2015-05-23T05:51:01.847Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30618184510210131978052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":131,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.847Z","url":"http://image.baidu.com/channel/favdownload?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1&t3=&idlist=9421289371%2C9420585969%2C9628641263%2C9387498651%2C9421097071%2C9621440012%2C9385548780%2C9420745179%2C9620508755%2C9433097486%2C9554047603%2C9399468471%2C9554752920%2C9557663128%2C9430700999%2C9531380380%2C11187392075%2C9628644841%2C9387498794%2C9521553516%2C9353679627%2C9539105403%2C9387403595%2C9386701871%2C9433097474%2C9534172115%2C9419343822%2C9632052808%2C4854176596%2C9430669625"} [DEBUG - 2015-05-23T05:51:01.866Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":101,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30618577840881220618052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":114,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.866Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.866Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30618577840881220618052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":114,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.866Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.867Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":101,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30618578810277240842052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":111,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.867Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.867Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30618578810277240842052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":111,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.867Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.867Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":100,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30618605720210131978052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":112,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.867Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.867Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30618605720210131978052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":112,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.867Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.868Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":100,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30618604560797269002052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":116,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.868Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.868Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30618604560797269002052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":116,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.868Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.872Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":103,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30618574500277240842052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":115,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.872Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.872Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30618574500277240842052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":115,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.872Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.873Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":101,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30618604880797269002052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":113,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.873Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.873Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30618604880797269002052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":113,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.873Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.890Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":102,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30618813470814046218052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":120,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.890Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.890Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30618813470814046218052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":120,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.890Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.890Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":103,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30618803430746937354052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":117,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.890Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.891Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30618803430746937354052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":117,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.891Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.892Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":101,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30618796460277240842052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":119,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.892Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.892Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30618796460277240842052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":119,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.892Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.894Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":102,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30618770630294018058052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":118,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.894Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.894Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30618770630294018058052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":118,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.894Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.901Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":101,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30618877300814046218052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":122,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.901Z","url":"http://image.baidu.com/albumlist/getlike"} 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:51:00 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360260; domain=.image.baidu.com; path=/" 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360261|; domain=.hm.baidu.com; path=/" [DEBUG - 2015-05-23T05:51:01.901Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30618877300814046218052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":122,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.901Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.902Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":null,"headers":[{"name":"Cache-Control","value":"max-age=0, must-revalidate"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Etag","value":"20661c0706a23b25c1b8fe847b3fc48e"},{"name":"P3p","value":"CP=\"CURa ADMa DEVa PSAo PSDo OUR BUS UNI PUR INT DEM STA PRE COM NAV OTC NOI DSP COR\""},{"name":"Server","value":"apache"},{"name":"Set-Cookie","value":"HMVT=737dbb498415dd39d8abf5bc2404b290|1432360261|; Path=/; Domain=hm.baidu.com"}],"id":132,"redirectURL":null,"stage":"end","status":304,"statusText":"Not Modified","time":"2015-05-23T05:51:01.902Z","url":"http://hm.baidu.com/h.js?737dbb498415dd39d8abf5bc2404b290"} 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360260; domain=.image.baidu.com; path=/" 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360261|; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:51:01 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360261|; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:51:01 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:51:01 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360262; domain=.image.baidu.com; path=/" [DEBUG - 2015-05-23T05:51:01.905Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":103,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30618916680294018058052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":121,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.905Z","url":"http://image.baidu.com/albumlist/getlike"} 2015-05-23T13:51:01 [DEBUG] WebPage - updateLoadingProgress: 82 [DEBUG - 2015-05-23T05:51:01.906Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30618916680294018058052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":121,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.906Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.911Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"application/json, text/javascript, */*; q=0.01"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"}],"id":133,"method":"GET","time":"2015-05-23T05:51:01.911Z","url":"http://image.baidu.com/user/msg?t=1432360261910"} [DEBUG - 2015-05-23T05:51:01.911Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"application/json, text/javascript, */*; q=0.01"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"}],"id":134,"method":"GET","time":"2015-05-23T05:51:01.911Z","url":"http://image.baidu.com/user/medal?uid=0&t=1432360261911"} [DEBUG - 2015-05-23T05:51:01.912Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":102,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30619053450797269002052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":124,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.912Z","url":"http://image.baidu.com/albumlist/getlike"} 2015-05-23T13:51:01 [DEBUG] WebPage - updateLoadingProgress: 86 [DEBUG - 2015-05-23T05:51:01.913Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30619053450797269002052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":124,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.913Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.917Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":103,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30619055850210131978052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":123,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.916Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.917Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30619055850210131978052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":123,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.917Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.917Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":103,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30619096850310795274052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":126,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.917Z","url":"http://image.baidu.com/albumlist/getlike"} 2015-05-23T13:51:01 [DEBUG] WebPage - updateLoadingProgress: 89 [DEBUG - 2015-05-23T05:51:01.917Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30619096850310795274052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":126,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.917Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.918Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":102,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30619035360294018058052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":125,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.918Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.918Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30619035360294018058052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":125,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.918Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.926Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":101,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30619162290713448458052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":128,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.926Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.926Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30619162290713448458052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":128,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.926Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.927Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":102,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30619162570210131978052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":127,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.927Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.927Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30619162570210131978052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":127,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.927Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.933Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":72,"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30619257180713448458052313"},{"name":"Content-Length","value":"72"}],"id":133,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.933Z","url":"http://image.baidu.com/user/msg?t=1432360261910"} [DEBUG - 2015-05-23T05:51:01.933Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30619257180713448458052313"},{"name":"Content-Length","value":"72"}],"id":133,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.933Z","url":"http://image.baidu.com/user/msg?t=1432360261910"} [DEBUG - 2015-05-23T05:51:01.936Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":101,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30619260350814046218052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":129,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.936Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.936Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30619260350814046218052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":129,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.936Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.936Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":104,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30619262040277240842052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":130,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.936Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.937Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30619262040277240842052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":130,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.937Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:01.941Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":98,"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30619292440310795274052313"},{"name":"Content-Length","value":"98"}],"id":134,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.941Z","url":"http://image.baidu.com/user/medal?uid=0&t=1432360261911"} [DEBUG - 2015-05-23T05:51:01.941Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:51:01 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30619292440310795274052313"},{"name":"Content-Length","value":"98"}],"id":134,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:01.941Z","url":"http://image.baidu.com/user/medal?uid=0&t=1432360261911"} 2015-05-23T13:51:01 [DEBUG] WebPage - updateLoadingProgress: 100 [DEBUG - 2015-05-23T05:51:01.941Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _oneShotCallback - onLoadFinished [DEBUG - 2015-05-23T05:51:01.941Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - onLoadFinished: success 2015-05-23T13:51:01 [DEBUG] WebPage - setupFrame "" [DEBUG - 2015-05-23T05:51:01.945Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: false [DEBUG - 2015-05-23T05:51:01.945Z] SessionReqHand - _SuccessHandler - status: success 2015-05-23T13:51:01 [DEBUG] HTTP Response - Status Code 200 OK 2015-05-23T13:51:01 [DEBUG] HTTP Response - Sending Header "Cache" = "no-cache" 2015-05-23T13:51:01 [DEBUG] HTTP Response - Sending Header "Content-Length" = "74" 2015-05-23T13:51:01 [DEBUG] HTTP Response - Sending Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:51:01 [DEBUG] HTTP Request - URI /wd/hub/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source 2015-05-23T13:51:01 [DEBUG] HTTP Request - Method GET 2015-05-23T13:51:01 [DEBUG] HTTP Request - HTTP Version 1.1 2015-05-23T13:51:01 [DEBUG] HTTP Request - Query String 2015-05-23T13:51:01 [DEBUG] HTTP Request - Receiving Header "Accept-Encoding" = "identity" 2015-05-23T13:51:01 [DEBUG] HTTP Request - Receiving Header "Host" = "127.0.0.1:32999" 2015-05-23T13:51:01 [DEBUG] HTTP Request - Receiving Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:51:01 [DEBUG] HTTP Request - Receiving Header "Connection" = "close" 2015-05-23T13:51:01 [DEBUG] HTTP Request - Receiving Header "Accept" = "application/json" 2015-05-23T13:51:01 [DEBUG] HTTP Request - Receiving Header "User-Agent" = "Python-urllib/2.7" [DEBUG - 2015-05-23T05:51:01.948Z] RouterReqHand - _handle - {"headers":{"Accept":"application/json","Accept-Encoding":"identity","Connection":"close","Content-Type":"application/json;charset=UTF-8","Host":"127.0.0.1:32999","User-Agent":"Python-urllib/2.7"},"httpVersion":"1.1","method":"GET","url":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","urlParsed":{"anchor":"","query":"","file":"source","directory":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/","path":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","relative":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","port":"","host":"","password":"","user":"","userInfo":"","authority":"","protocol":"","source":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","queryKey":{},"chunks":["session","ac4aab20-010f-11e5-a1b5-e503e60d48a0","source"]}} 2015-05-23T13:51:01 [DEBUG] HTTP Response - Status Code 200 OK 2015-05-23T13:51:01 [DEBUG] HTTP Response - Sending Header "Cache" = "no-cache" 2015-05-23T13:51:01 [DEBUG] HTTP Response - Sending Header "Content-Length" = "551395" 2015-05-23T13:51:01 [DEBUG] HTTP Response - Sending Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:51:03 [DEBUG] HTTP Request - URI /wd/hub/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url 2015-05-23T13:51:03 [DEBUG] HTTP Request - Method POST 2015-05-23T13:51:03 [DEBUG] HTTP Request - HTTP Version 1.1 2015-05-23T13:51:03 [DEBUG] HTTP Request - Query String 2015-05-23T13:51:03 [DEBUG] HTTP Request - Receiving Header "Accept-Encoding" = "identity" 2015-05-23T13:51:03 [DEBUG] HTTP Request - Receiving Header "Content-Length" = "99" 2015-05-23T13:51:03 [DEBUG] HTTP Request - Receiving Header "Host" = "127.0.0.1:32999" 2015-05-23T13:51:03 [DEBUG] HTTP Request - Receiving Header "Accept" = "application/json" 2015-05-23T13:51:03 [DEBUG] HTTP Request - Receiving Header "User-Agent" = "Python-urllib/2.7" 2015-05-23T13:51:03 [DEBUG] HTTP Request - Receiving Header "Connection" = "close" 2015-05-23T13:51:03 [DEBUG] HTTP Request - Receiving Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:51:03 [DEBUG] HTTP Request - Method POST/PUT 2015-05-23T13:51:03 [DEBUG] HTTP Request - Content Body: {"url": "http://image.baidu.com/channel/star", "sessionId": "ac4aab20-010f-11e5-a1b5-e503e60d48a0"} [DEBUG - 2015-05-23T05:51:03.791Z] RouterReqHand - _handle - {"headers":{"Accept":"application/json","Accept-Encoding":"identity","Connection":"close","Content-Length":"99","Content-Type":"application/json;charset=UTF-8","Host":"127.0.0.1:32999","User-Agent":"Python-urllib/2.7"},"httpVersion":"1.1","method":"POST","post":"{\"url\": \"http://image.baidu.com/channel/star\", \"sessionId\": \"ac4aab20-010f-11e5-a1b5-e503e60d48a0\"}","url":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","urlParsed":{"anchor":"","query":"","file":"url","directory":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/","path":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","relative":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","port":"","host":"","password":"","user":"","userInfo":"","authority":"","protocol":"","source":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","queryKey":{},"chunks":["session","ac4aab20-010f-11e5-a1b5-e503e60d48a0","url"]}} [DEBUG - 2015-05-23T05:51:03.791Z] SessionReqHand - _postUrlCommand - Session 'ac4aab20-010f-11e5-a1b5-e503e60d48a0' is about to load URL: http://image.baidu.com/channel/star 2015-05-23T13:51:03 [DEBUG] WebPage - updateLoadingProgress: 10 [DEBUG - 2015-05-23T05:51:03.792Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8"}],"id":135,"method":"GET","time":"2015-05-23T05:51:03.792Z","url":"http://image.baidu.com/channel/star"} [DEBUG - 2015-05-23T05:51:03.802Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true 2015-05-23T13:51:03 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:03 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:51:03 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:51:03 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:03 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:03 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:51:03 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:03 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:03 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360261|; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:03 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:51:01 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:51:03 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360262; domain=.image.baidu.com; path=/" [DEBUG - 2015-05-23T05:51:03.885Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":78859,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:03 GMT"},{"name":"Server","value":"Apache"},{"name":"Set-Cookie","value":"userid=deleted; expires=Fri, 23-May-2014 05:51:02 GMT; path=/"},{"name":"Tracecode","value":"30638024400277240842052313"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Transfer-Encoding","value":"chunked"}],"id":135,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:03.885Z","url":"http://image.baidu.com/channel/star"} [DEBUG - 2015-05-23T05:51:03.886Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Cache-Control","value":"max-age=0"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"},{"name":"Accept","value":"*/*"}],"id":136,"method":"GET","time":"2015-05-23T05:51:03.886Z","url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=1984%2C1984&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=888922782&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3"} 2015-05-23T13:51:03 [DEBUG] WebPage - setupFrame "" [DEBUG - 2015-05-23T05:51:03.902Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel/star"},{"name":"If-None-Match","value":"20661c0706a23b25c1b8fe847b3fc48e"}],"id":137,"method":"GET","time":"2015-05-23T05:51:03.902Z","url":"http://hm.baidu.com/h.js?737dbb498415dd39d8abf5bc2404b290"} 2015-05-23T13:51:03 [DEBUG] WebPage - updateLoadingProgress: 46 2015-05-23T13:51:03 [DEBUG] WebPage - updateLoadingProgress: 65 [DEBUG - 2015-05-23T05:51:03.966Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:03 GMT"},{"name":"Server","value":"Apache"},{"name":"Set-Cookie","value":"userid=deleted; expires=Fri, 23-May-2014 05:51:02 GMT; path=/"},{"name":"Tracecode","value":"30638024400277240842052313"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Transfer-Encoding","value":"chunked"}],"id":135,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:03.965Z","url":"http://image.baidu.com/channel/star"} [DEBUG - 2015-05-23T05:51:03.999Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true 2015-05-23T13:51:04 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:04 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:51:04 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:51:04 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:04 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:04 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:51:04 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:04 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:04 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:51:01 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:51:04 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360262; domain=.image.baidu.com; path=/" 2015-05-23T13:51:04 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360263|; domain=.hm.baidu.com; path=/" [DEBUG - 2015-05-23T05:51:04.001Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":null,"headers":[{"name":"Cache-Control","value":"max-age=0, must-revalidate"},{"name":"Date","value":"Sat, 23 May 2015 05:51:03 GMT"},{"name":"Etag","value":"20661c0706a23b25c1b8fe847b3fc48e"},{"name":"P3p","value":"CP=\"CURa ADMa DEVa PSAo PSDo OUR BUS UNI PUR INT DEM STA PRE COM NAV OTC NOI DSP COR\""},{"name":"Server","value":"apache"},{"name":"Set-Cookie","value":"HMVT=737dbb498415dd39d8abf5bc2404b290|1432360263|; Path=/; Domain=hm.baidu.com"}],"id":137,"redirectURL":null,"stage":"end","status":304,"statusText":"Not Modified","time":"2015-05-23T05:51:04.000Z","url":"http://hm.baidu.com/h.js?737dbb498415dd39d8abf5bc2404b290"} 2015-05-23T13:51:04 [DEBUG] WebPage - updateLoadingProgress: 100 [DEBUG - 2015-05-23T05:51:04.001Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":43,"contentType":"image/gif","headers":[{"name":"Cache-Control","value":"private, max-age=0, no-cache"},{"name":"Content-Length","value":"43"},{"name":"Content-Type","value":"image/gif"},{"name":"Date","value":"Sat, 23 May 2015 05:51:03 GMT"},{"name":"Pragma","value":"no-cache"},{"name":"Server","value":"apache"},{"name":"X-Content-Type-Options","value":"nosniff"}],"id":136,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:04.001Z","url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=1984%2C1984&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=888922782&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3"} 2015-05-23T13:51:04 [DEBUG] Network - Resource request error: 5 ( "Operation canceled" ) URL: "http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=1984,1984&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=888922782&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3" [DEBUG - 2015-05-23T05:51:04.001Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceError - {"errorCode":5,"errorString":"Operation canceled","id":136,"url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=1984,1984&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=888922782&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3"} [DEBUG - 2015-05-23T05:51:04.001Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"image/gif","headers":[{"name":"Cache-Control","value":"private, max-age=0, no-cache"},{"name":"Content-Length","value":"43"},{"name":"Content-Type","value":"image/gif"},{"name":"Date","value":"Sat, 23 May 2015 05:51:03 GMT"},{"name":"Pragma","value":"no-cache"},{"name":"Server","value":"apache"},{"name":"X-Content-Type-Options","value":"nosniff"}],"id":136,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:04.001Z","url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=1984%2C1984&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=888922782&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3"} [DEBUG - 2015-05-23T05:51:04.001Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _oneShotCallback - onLoadFinished [DEBUG - 2015-05-23T05:51:04.001Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - onLoadFinished: success 2015-05-23T13:51:04 [DEBUG] WebPage - setupFrame "" 2015-05-23T13:51:04 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:04 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:51:04 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:51:04 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:04 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:04 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:51:04 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:04 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:04 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360262; domain=.image.baidu.com; path=/" 2015-05-23T13:51:04 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360263|; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:04 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:51:04 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:51:04 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:04 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:51:04 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:51:04 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:04 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:04 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:51:04 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:04 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:04 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360263|; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:04 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:51:04 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:51:04 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360264; domain=.image.baidu.com; path=/" [DEBUG - 2015-05-23T05:51:04.015Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"application/json, text/javascript, */*; q=0.01"},{"name":"Referer","value":"http://image.baidu.com/channel/star"}],"id":138,"method":"GET","time":"2015-05-23T05:51:04.015Z","url":"http://image.baidu.com/user/msg?t=1432360264013"} [DEBUG - 2015-05-23T05:51:04.016Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"application/json, text/javascript, */*; q=0.01"},{"name":"Referer","value":"http://image.baidu.com/channel/star"}],"id":139,"method":"GET","time":"2015-05-23T05:51:04.016Z","url":"http://image.baidu.com/user/medal?uid=0&t=1432360264015"} [DEBUG - 2015-05-23T05:51:04.030Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":72,"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:51:04 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30640252890294018058052313"},{"name":"Content-Length","value":"72"}],"id":138,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:04.030Z","url":"http://image.baidu.com/user/msg?t=1432360264013"} [DEBUG - 2015-05-23T05:51:04.030Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:51:04 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30640252890294018058052313"},{"name":"Content-Length","value":"72"}],"id":138,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:04.030Z","url":"http://image.baidu.com/user/msg?t=1432360264013"} [DEBUG - 2015-05-23T05:51:04.041Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":98,"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:51:04 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30640282390814046218052313"},{"name":"Content-Length","value":"98"}],"id":139,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:04.041Z","url":"http://image.baidu.com/user/medal?uid=0&t=1432360264015"} [DEBUG - 2015-05-23T05:51:04.041Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:51:04 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30640282390814046218052313"},{"name":"Content-Length","value":"98"}],"id":139,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:04.041Z","url":"http://image.baidu.com/user/medal?uid=0&t=1432360264015"} [DEBUG - 2015-05-23T05:51:04.100Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: false [DEBUG - 2015-05-23T05:51:04.100Z] SessionReqHand - _SuccessHandler - status: success 2015-05-23T13:51:04 [DEBUG] HTTP Response - Status Code 200 OK 2015-05-23T13:51:04 [DEBUG] HTTP Response - Sending Header "Cache" = "no-cache" 2015-05-23T13:51:04 [DEBUG] HTTP Response - Sending Header "Content-Length" = "74" 2015-05-23T13:51:04 [DEBUG] HTTP Response - Sending Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:51:04 [DEBUG] HTTP Request - URI /wd/hub/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source 2015-05-23T13:51:04 [DEBUG] HTTP Request - Method GET 2015-05-23T13:51:04 [DEBUG] HTTP Request - HTTP Version 1.1 2015-05-23T13:51:04 [DEBUG] HTTP Request - Query String 2015-05-23T13:51:04 [DEBUG] HTTP Request - Receiving Header "Accept-Encoding" = "identity" 2015-05-23T13:51:04 [DEBUG] HTTP Request - Receiving Header "Host" = "127.0.0.1:32999" 2015-05-23T13:51:04 [DEBUG] HTTP Request - Receiving Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:51:04 [DEBUG] HTTP Request - Receiving Header "Connection" = "close" 2015-05-23T13:51:04 [DEBUG] HTTP Request - Receiving Header "Accept" = "application/json" 2015-05-23T13:51:04 [DEBUG] HTTP Request - Receiving Header "User-Agent" = "Python-urllib/2.7" [DEBUG - 2015-05-23T05:51:04.102Z] RouterReqHand - _handle - {"headers":{"Accept":"application/json","Accept-Encoding":"identity","Connection":"close","Content-Type":"application/json;charset=UTF-8","Host":"127.0.0.1:32999","User-Agent":"Python-urllib/2.7"},"httpVersion":"1.1","method":"GET","url":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","urlParsed":{"anchor":"","query":"","file":"source","directory":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/","path":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","relative":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","port":"","host":"","password":"","user":"","userInfo":"","authority":"","protocol":"","source":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","queryKey":{},"chunks":["session","ac4aab20-010f-11e5-a1b5-e503e60d48a0","source"]}} 2015-05-23T13:51:04 [DEBUG] HTTP Response - Status Code 200 OK 2015-05-23T13:51:04 [DEBUG] HTTP Response - Sending Header "Cache" = "no-cache" 2015-05-23T13:51:04 [DEBUG] HTTP Response - Sending Header "Content-Length" = "177660" 2015-05-23T13:51:04 [DEBUG] HTTP Response - Sending Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:51:08 [DEBUG] HTTP Request - URI /wd/hub/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url 2015-05-23T13:51:08 [DEBUG] HTTP Request - Method POST 2015-05-23T13:51:08 [DEBUG] HTTP Request - HTTP Version 1.1 2015-05-23T13:51:08 [DEBUG] HTTP Request - Query String 2015-05-23T13:51:08 [DEBUG] HTTP Request - Receiving Header "Accept-Encoding" = "identity" 2015-05-23T13:51:08 [DEBUG] HTTP Request - Receiving Header "Content-Length" = "125" 2015-05-23T13:51:08 [DEBUG] HTTP Request - Receiving Header "Host" = "127.0.0.1:32999" 2015-05-23T13:51:08 [DEBUG] HTTP Request - Receiving Header "Accept" = "application/json" 2015-05-23T13:51:08 [DEBUG] HTTP Request - Receiving Header "User-Agent" = "Python-urllib/2.7" 2015-05-23T13:51:08 [DEBUG] HTTP Request - Receiving Header "Connection" = "close" 2015-05-23T13:51:08 [DEBUG] HTTP Request - Receiving Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:51:08 [DEBUG] HTTP Request - Method POST/PUT 2015-05-23T13:51:08 [DEBUG] HTTP Request - Content Body: {"url": "http://image.baidu.com/channel/infotag?tag=%E5%9B%BD%E5%86%85", "sessionId": "ac4aab20-010f-11e5-a1b5-e503e60d48a0"} [DEBUG - 2015-05-23T05:51:08.245Z] RouterReqHand - _handle - {"headers":{"Accept":"application/json","Accept-Encoding":"identity","Connection":"close","Content-Length":"125","Content-Type":"application/json;charset=UTF-8","Host":"127.0.0.1:32999","User-Agent":"Python-urllib/2.7"},"httpVersion":"1.1","method":"POST","post":"{\"url\": \"http://image.baidu.com/channel/infotag?tag=%E5%9B%BD%E5%86%85\", \"sessionId\": \"ac4aab20-010f-11e5-a1b5-e503e60d48a0\"}","url":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","urlParsed":{"anchor":"","query":"","file":"url","directory":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/","path":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","relative":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","port":"","host":"","password":"","user":"","userInfo":"","authority":"","protocol":"","source":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","queryKey":{},"chunks":["session","ac4aab20-010f-11e5-a1b5-e503e60d48a0","url"]}} [DEBUG - 2015-05-23T05:51:08.245Z] SessionReqHand - _postUrlCommand - Session 'ac4aab20-010f-11e5-a1b5-e503e60d48a0' is about to load URL: http://image.baidu.com/channel/infotag?tag=%E5%9B%BD%E5%86%85 2015-05-23T13:51:08 [DEBUG] WebPage - updateLoadingProgress: 10 [DEBUG - 2015-05-23T05:51:08.246Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8"}],"id":140,"method":"GET","time":"2015-05-23T05:51:08.246Z","url":"http://image.baidu.com/channel/infotag?tag=%E5%9B%BD%E5%86%85"} [DEBUG - 2015-05-23T05:51:08.256Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true [DEBUG - 2015-05-23T05:51:08.356Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360263|; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:51:04 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360264; domain=.image.baidu.com; path=/" [DEBUG - 2015-05-23T05:51:08.368Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":66936,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:08 GMT"},{"name":"Server","value":"Apache"},{"name":"Set-Cookie","value":"userid=deleted; expires=Fri, 23-May-2014 05:51:07 GMT; path=/"},{"name":"Tracecode","value":"30682591300747002890052313"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Transfer-Encoding","value":"chunked"}],"id":140,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:08.368Z","url":"http://image.baidu.com/channel/infotag?tag=%E5%9B%BD%E5%86%85"} [DEBUG - 2015-05-23T05:51:08.370Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Cache-Control","value":"max-age=0"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Referer","value":"http://image.baidu.com/channel/star"},{"name":"Accept","value":"*/*"}],"id":141,"method":"GET","time":"2015-05-23T05:51:08.370Z","url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=4367%2C4367&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=169303856&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3"} 2015-05-23T13:51:08 [DEBUG] WebPage - setupFrame "" [DEBUG - 2015-05-23T05:51:08.374Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/css,*/*;q=0.1"},{"name":"Referer","value":"http://image.baidu.com/channel/infotag?tag=%E5%9B%BD%E5%86%85"}],"id":142,"method":"GET","time":"2015-05-23T05:51:08.374Z","url":"http://img0.bdstatic.com/static/information/pkg/info-com_3af9600.css"} [DEBUG - 2015-05-23T05:51:08.374Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/css,*/*;q=0.1"},{"name":"Referer","value":"http://image.baidu.com/channel/infotag?tag=%E5%9B%BD%E5%86%85"}],"id":143,"method":"GET","time":"2015-05-23T05:51:08.374Z","url":"http://img0.bdstatic.com/static/information/pkg/infor-channel_0911eaa.css"} 2015-05-23T13:51:08 [DEBUG] WebPage - updateLoadingProgress: 26 2015-05-23T13:51:08 [DEBUG] WebPage - updateLoadingProgress: 42 [DEBUG - 2015-05-23T05:51:08.381Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:08 GMT"},{"name":"Server","value":"Apache"},{"name":"Set-Cookie","value":"userid=deleted; expires=Fri, 23-May-2014 05:51:07 GMT; path=/"},{"name":"Tracecode","value":"30682591300747002890052313"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Transfer-Encoding","value":"chunked"}],"id":140,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:08.381Z","url":"http://image.baidu.com/channel/infotag?tag=%E5%9B%BD%E5%86%85"} [DEBUG - 2015-05-23T05:51:08.381Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":3896,"contentType":"text/css","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:51:08 GMT"},{"name":"Content-Type","value":"text/css"},{"name":"Connection","value":"keep-alive"},{"name":"ETag","value":"\"53273325\""},{"name":"Last-Modified","value":"Fri, 13 Feb 2015 10:54:38 GMT"},{"name":"Expires","value":"Thu, 28 May 2015 06:24:53 GMT"},{"name":"Age","value":"170775"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Accept-Ranges","value":"bytes"},{"name":"Content-Encoding","value":"gzip"},{"name":"Vary","value":"Accept-Encoding"}],"id":142,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:08.381Z","url":"http://img0.bdstatic.com/static/information/pkg/info-com_3af9600.css"} [DEBUG - 2015-05-23T05:51:08.381Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/css","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:51:08 GMT"},{"name":"Content-Type","value":"text/css"},{"name":"Connection","value":"keep-alive"},{"name":"ETag","value":"\"53273325\""},{"name":"Last-Modified","value":"Fri, 13 Feb 2015 10:54:38 GMT"},{"name":"Expires","value":"Thu, 28 May 2015 06:24:53 GMT"},{"name":"Age","value":"170775"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Accept-Ranges","value":"bytes"},{"name":"Content-Encoding","value":"gzip"},{"name":"Vary","value":"Accept-Encoding"}],"id":142,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:08.381Z","url":"http://img0.bdstatic.com/static/information/pkg/info-com_3af9600.css"} [DEBUG - 2015-05-23T05:51:08.382Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":4017,"contentType":"text/css","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:51:08 GMT"},{"name":"Content-Type","value":"text/css"},{"name":"Connection","value":"keep-alive"},{"name":"ETag","value":"\"56148685\""},{"name":"Last-Modified","value":"Fri, 13 Feb 2015 10:54:38 GMT"},{"name":"Expires","value":"Thu, 28 May 2015 06:24:53 GMT"},{"name":"Age","value":"170775"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Accept-Ranges","value":"bytes"},{"name":"Content-Encoding","value":"gzip"},{"name":"Vary","value":"Accept-Encoding"}],"id":143,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:08.382Z","url":"http://img0.bdstatic.com/static/information/pkg/infor-channel_0911eaa.css"} [DEBUG - 2015-05-23T05:51:08.382Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/css","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:51:08 GMT"},{"name":"Content-Type","value":"text/css"},{"name":"Connection","value":"keep-alive"},{"name":"ETag","value":"\"56148685\""},{"name":"Last-Modified","value":"Fri, 13 Feb 2015 10:54:38 GMT"},{"name":"Expires","value":"Thu, 28 May 2015 06:24:53 GMT"},{"name":"Age","value":"170775"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Accept-Ranges","value":"bytes"},{"name":"Content-Encoding","value":"gzip"},{"name":"Vary","value":"Accept-Encoding"}],"id":143,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:08.382Z","url":"http://img0.bdstatic.com/static/information/pkg/infor-channel_0911eaa.css"} [DEBUG - 2015-05-23T05:51:08.388Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel/infotag?tag=%E5%9B%BD%E5%86%85"},{"name":"If-None-Match","value":"20661c0706a23b25c1b8fe847b3fc48e"}],"id":144,"method":"GET","time":"2015-05-23T05:51:08.388Z","url":"http://hm.baidu.com/h.js?737dbb498415dd39d8abf5bc2404b290"} [DEBUG - 2015-05-23T05:51:08.390Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel/infotag?tag=%E5%9B%BD%E5%86%85"}],"id":145,"method":"GET","time":"2015-05-23T05:51:08.390Z","url":"http://img0.bdstatic.com/static/information/pkg/info-com_1a0e1b8.js"} [DEBUG - 2015-05-23T05:51:08.391Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel/infotag?tag=%E5%9B%BD%E5%86%85"}],"id":146,"method":"GET","time":"2015-05-23T05:51:08.391Z","url":"http://img0.bdstatic.com/static/information/pkg/infor-channel_35f8863.js"} 2015-05-23T13:51:08 [WARNING] QFont::setPixelSize: Pixel size <= 0 (0) [DEBUG - 2015-05-23T05:51:08.415Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":7316,"contentType":"text/javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:51:08 GMT"},{"name":"Content-Type","value":"text/javascript"},{"name":"Connection","value":"keep-alive"},{"name":"ETag","value":"\"57230061\""},{"name":"Last-Modified","value":"Fri, 13 Feb 2015 10:54:38 GMT"},{"name":"Expires","value":"Thu, 28 May 2015 06:24:53 GMT"},{"name":"Age","value":"170775"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Accept-Ranges","value":"bytes"},{"name":"Content-Encoding","value":"gzip"},{"name":"Vary","value":"Accept-Encoding"}],"id":145,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:08.415Z","url":"http://img0.bdstatic.com/static/information/pkg/info-com_1a0e1b8.js"} 2015-05-23T13:51:08 [DEBUG] WebPage - updateLoadingProgress: 49 [DEBUG - 2015-05-23T05:51:08.415Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:51:08 GMT"},{"name":"Content-Type","value":"text/javascript"},{"name":"Connection","value":"keep-alive"},{"name":"ETag","value":"\"57230061\""},{"name":"Last-Modified","value":"Fri, 13 Feb 2015 10:54:38 GMT"},{"name":"Expires","value":"Thu, 28 May 2015 06:24:53 GMT"},{"name":"Age","value":"170775"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Accept-Ranges","value":"bytes"},{"name":"Content-Encoding","value":"gzip"},{"name":"Vary","value":"Accept-Encoding"}],"id":145,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:08.415Z","url":"http://img0.bdstatic.com/static/information/pkg/info-com_1a0e1b8.js"} [DEBUG - 2015-05-23T05:51:08.415Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":29668,"contentType":"text/javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:51:08 GMT"},{"name":"Content-Type","value":"text/javascript"},{"name":"Connection","value":"keep-alive"},{"name":"ETag","value":"\"1737219885\""},{"name":"Last-Modified","value":"Fri, 13 Feb 2015 10:54:38 GMT"},{"name":"Expires","value":"Thu, 28 May 2015 06:24:53 GMT"},{"name":"Age","value":"170775"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Accept-Ranges","value":"bytes"},{"name":"Content-Encoding","value":"gzip"},{"name":"Vary","value":"Accept-Encoding"}],"id":146,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:08.415Z","url":"http://img0.bdstatic.com/static/information/pkg/infor-channel_35f8863.js"} 2015-05-23T13:51:08 [DEBUG] WebPage - updateLoadingProgress: 62 [DEBUG - 2015-05-23T05:51:08.416Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:51:08 GMT"},{"name":"Content-Type","value":"text/javascript"},{"name":"Connection","value":"keep-alive"},{"name":"ETag","value":"\"1737219885\""},{"name":"Last-Modified","value":"Fri, 13 Feb 2015 10:54:38 GMT"},{"name":"Expires","value":"Thu, 28 May 2015 06:24:53 GMT"},{"name":"Age","value":"170775"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Accept-Ranges","value":"bytes"},{"name":"Content-Encoding","value":"gzip"},{"name":"Vary","value":"Accept-Encoding"}],"id":146,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:08.416Z","url":"http://img0.bdstatic.com/static/information/pkg/infor-channel_35f8863.js"} [DEBUG - 2015-05-23T05:51:08.434Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"application/json, text/javascript, */*; q=0.01"},{"name":"Referer","value":"http://image.baidu.com/channel/infotag?tag=%E5%9B%BD%E5%86%85"}],"id":147,"method":"GET","time":"2015-05-23T05:51:08.434Z","url":"http://image.baidu.com/channel/infolist?pn=0&rn=24&tag1=%E8%B5%84%E8%AE%AF&tag2=%E5%9B%BD%E5%86%85&is_re=0&ie=utf8&oe=utf-8&filterids=15795493200462327308%2C5186872426148269496%2C15270508812199007748%2C14856276456421853813%2C5257368915554018825%2C9035648175322175327%2C12522393500398489320%2C12448599283549251191%2C12346134034005042246%2C18296101185850460767%2C15558150000581834652%2C12977986919480652636%2C12947904796711141094&t=0.7947298581711948"} [DEBUG - 2015-05-23T05:51:08.457Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true [DEBUG - 2015-05-23T05:51:08.464Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":43,"contentType":"image/gif","headers":[{"name":"Cache-Control","value":"private, max-age=0, no-cache"},{"name":"Content-Length","value":"43"},{"name":"Content-Type","value":"image/gif"},{"name":"Date","value":"Sat, 23 May 2015 05:51:08 GMT"},{"name":"Pragma","value":"no-cache"},{"name":"Server","value":"apache"},{"name":"X-Content-Type-Options","value":"nosniff"}],"id":141,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:08.464Z","url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=4367%2C4367&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=169303856&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3"} 2015-05-23T13:51:08 [DEBUG] Network - Resource request error: 5 ( "Operation canceled" ) URL: "http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=4367,4367&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=169303856&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3" [DEBUG - 2015-05-23T05:51:08.464Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceError - {"errorCode":5,"errorString":"Operation canceled","id":141,"url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=4367,4367&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=169303856&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3"} [DEBUG - 2015-05-23T05:51:08.464Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"image/gif","headers":[{"name":"Cache-Control","value":"private, max-age=0, no-cache"},{"name":"Content-Length","value":"43"},{"name":"Content-Type","value":"image/gif"},{"name":"Date","value":"Sat, 23 May 2015 05:51:08 GMT"},{"name":"Pragma","value":"no-cache"},{"name":"Server","value":"apache"},{"name":"X-Content-Type-Options","value":"nosniff"}],"id":141,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:08.464Z","url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=4367%2C4367&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=169303856&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3"} [DEBUG - 2015-05-23T05:51:08.467Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":14542,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:08 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30684464690864443402052313"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Transfer-Encoding","value":"chunked"}],"id":147,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:08.467Z","url":"http://image.baidu.com/channel/infolist?pn=0&rn=24&tag1=%E8%B5%84%E8%AE%AF&tag2=%E5%9B%BD%E5%86%85&is_re=0&ie=utf8&oe=utf-8&filterids=15795493200462327308%2C5186872426148269496%2C15270508812199007748%2C14856276456421853813%2C5257368915554018825%2C9035648175322175327%2C12522393500398489320%2C12448599283549251191%2C12346134034005042246%2C18296101185850460767%2C15558150000581834652%2C12977986919480652636%2C12947904796711141094&t=0.7947298581711948"} 2015-05-23T13:51:08 [DEBUG] WebPage - updateLoadingProgress: 71 [DEBUG - 2015-05-23T05:51:08.468Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:08 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30684464690864443402052313"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Transfer-Encoding","value":"chunked"}],"id":147,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:08.468Z","url":"http://image.baidu.com/channel/infolist?pn=0&rn=24&tag1=%E8%B5%84%E8%AE%AF&tag2=%E5%9B%BD%E5%86%85&is_re=0&ie=utf8&oe=utf-8&filterids=15795493200462327308%2C5186872426148269496%2C15270508812199007748%2C14856276456421853813%2C5257368915554018825%2C9035648175322175327%2C12522393500398489320%2C12448599283549251191%2C12346134034005042246%2C18296101185850460767%2C15558150000581834652%2C12977986919480652636%2C12947904796711141094&t=0.7947298581711948"} 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:51:04 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360264; domain=.image.baidu.com; path=/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360268|; domain=.hm.baidu.com; path=/" [DEBUG - 2015-05-23T05:51:08.591Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":null,"headers":[{"name":"Cache-Control","value":"max-age=0, must-revalidate"},{"name":"Date","value":"Sat, 23 May 2015 05:51:08 GMT"},{"name":"Etag","value":"20661c0706a23b25c1b8fe847b3fc48e"},{"name":"P3p","value":"CP=\"CURa ADMa DEVa PSAo PSDo OUR BUS UNI PUR INT DEM STA PRE COM NAV OTC NOI DSP COR\""},{"name":"Server","value":"apache"},{"name":"Set-Cookie","value":"HMVT=737dbb498415dd39d8abf5bc2404b290|1432360268|; Path=/; Domain=hm.baidu.com"}],"id":144,"redirectURL":null,"stage":"end","status":304,"statusText":"Not Modified","time":"2015-05-23T05:51:08.591Z","url":"http://hm.baidu.com/h.js?737dbb498415dd39d8abf5bc2404b290"} 2015-05-23T13:51:08 [DEBUG] WebPage - updateLoadingProgress: 100 [DEBUG - 2015-05-23T05:51:08.591Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _oneShotCallback - onLoadFinished [DEBUG - 2015-05-23T05:51:08.591Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - onLoadFinished: success 2015-05-23T13:51:08 [DEBUG] WebPage - setupFrame "" [DEBUG - 2015-05-23T05:51:08.592Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: false [DEBUG - 2015-05-23T05:51:08.592Z] SessionReqHand - _SuccessHandler - status: success 2015-05-23T13:51:08 [DEBUG] HTTP Response - Status Code 200 OK 2015-05-23T13:51:08 [DEBUG] HTTP Response - Sending Header "Cache" = "no-cache" 2015-05-23T13:51:08 [DEBUG] HTTP Response - Sending Header "Content-Length" = "74" 2015-05-23T13:51:08 [DEBUG] HTTP Response - Sending Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:51:08 [DEBUG] HTTP Request - URI /wd/hub/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source 2015-05-23T13:51:08 [DEBUG] HTTP Request - Method GET 2015-05-23T13:51:08 [DEBUG] HTTP Request - HTTP Version 1.1 2015-05-23T13:51:08 [DEBUG] HTTP Request - Query String 2015-05-23T13:51:08 [DEBUG] HTTP Request - Receiving Header "Accept-Encoding" = "identity" 2015-05-23T13:51:08 [DEBUG] HTTP Request - Receiving Header "Host" = "127.0.0.1:32999" 2015-05-23T13:51:08 [DEBUG] HTTP Request - Receiving Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:51:08 [DEBUG] HTTP Request - Receiving Header "Connection" = "close" 2015-05-23T13:51:08 [DEBUG] HTTP Request - Receiving Header "Accept" = "application/json" 2015-05-23T13:51:08 [DEBUG] HTTP Request - Receiving Header "User-Agent" = "Python-urllib/2.7" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360264; domain=.image.baidu.com; path=/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360268|; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:51:08 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360268|; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:51:08 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360269; domain=.image.baidu.com; path=/" [DEBUG - 2015-05-23T05:51:08.597Z] RouterReqHand - _handle - {"headers":{"Accept":"application/json","Accept-Encoding":"identity","Connection":"close","Content-Type":"application/json;charset=UTF-8","Host":"127.0.0.1:32999","User-Agent":"Python-urllib/2.7"},"httpVersion":"1.1","method":"GET","url":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","urlParsed":{"anchor":"","query":"","file":"source","directory":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/","path":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","relative":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","port":"","host":"","password":"","user":"","userInfo":"","authority":"","protocol":"","source":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","queryKey":{},"chunks":["session","ac4aab20-010f-11e5-a1b5-e503e60d48a0","source"]}} 2015-05-23T13:51:08 [DEBUG] HTTP Response - Status Code 200 OK 2015-05-23T13:51:08 [DEBUG] HTTP Response - Sending Header "Cache" = "no-cache" 2015-05-23T13:51:08 [DEBUG] HTTP Response - Sending Header "Content-Length" = "158034" 2015-05-23T13:51:08 [DEBUG] HTTP Response - Sending Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:51:08 [DEBUG] HTTP Request - URI /wd/hub/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url 2015-05-23T13:51:08 [DEBUG] HTTP Request - Method POST 2015-05-23T13:51:08 [DEBUG] HTTP Request - HTTP Version 1.1 2015-05-23T13:51:08 [DEBUG] HTTP Request - Query String 2015-05-23T13:51:08 [DEBUG] HTTP Request - Receiving Header "Accept-Encoding" = "identity" 2015-05-23T13:51:08 [DEBUG] HTTP Request - Receiving Header "Content-Length" = "134" 2015-05-23T13:51:08 [DEBUG] HTTP Request - Receiving Header "Host" = "127.0.0.1:32999" 2015-05-23T13:51:08 [DEBUG] HTTP Request - Receiving Header "Accept" = "application/json" 2015-05-23T13:51:08 [DEBUG] HTTP Request - Receiving Header "User-Agent" = "Python-urllib/2.7" 2015-05-23T13:51:08 [DEBUG] HTTP Request - Receiving Header "Connection" = "close" 2015-05-23T13:51:08 [DEBUG] HTTP Request - Receiving Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:51:08 [DEBUG] HTTP Request - Method POST/PUT 2015-05-23T13:51:08 [DEBUG] HTTP Request - Content Body: {"url": "http://image.baidu.com/channel?c=%E7%BE%8E%E5%A5%B3#%E7%BE%8E%E5%A5%B3", "sessionId": "ac4aab20-010f-11e5-a1b5-e503e60d48a0"} [DEBUG - 2015-05-23T05:51:08.627Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"application/json, text/javascript, */*; q=0.01"},{"name":"Referer","value":"http://image.baidu.com/channel/infotag?tag=%E5%9B%BD%E5%86%85"}],"id":148,"method":"GET","time":"2015-05-23T05:51:08.627Z","url":"http://image.baidu.com/user/msg?t=1432360268626"} [DEBUG - 2015-05-23T05:51:08.627Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"application/json, text/javascript, */*; q=0.01"},{"name":"Referer","value":"http://image.baidu.com/channel/infotag?tag=%E5%9B%BD%E5%86%85"}],"id":149,"method":"GET","time":"2015-05-23T05:51:08.627Z","url":"http://image.baidu.com/user/medal?uid=0&t=1432360268627"} [DEBUG - 2015-05-23T05:51:08.635Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"application/json, text/javascript, */*; q=0.01"},{"name":"Referer","value":"http://image.baidu.com/channel/infotag?tag=%E5%9B%BD%E5%86%85"}],"id":150,"method":"GET","time":"2015-05-23T05:51:08.635Z","url":"http://image.baidu.com/channel/infolist?pn=0&rn=24&tag1=%E8%B5%84%E8%AE%AF&tag2=%E5%9B%BD%E5%86%85&is_re=0&ie=utf8&oe=utf-8&filterids=15795493200462327308%2C5186872426148269496%2C15270508812199007748%2C14856276456421853813%2C5257368915554018825%2C9035648175322175327%2C12522393500398489320%2C12448599283549251191%2C12346134034005042246%2C18296101185850460767%2C15558150000581834652%2C12977986919480652636%2C12947904796711141094&t=0.5143384761177003"} [DEBUG - 2015-05-23T05:51:08.636Z] RouterReqHand - _handle - {"headers":{"Accept":"application/json","Accept-Encoding":"identity","Connection":"close","Content-Length":"134","Content-Type":"application/json;charset=UTF-8","Host":"127.0.0.1:32999","User-Agent":"Python-urllib/2.7"},"httpVersion":"1.1","method":"POST","post":"{\"url\": \"http://image.baidu.com/channel?c=%E7%BE%8E%E5%A5%B3#%E7%BE%8E%E5%A5%B3\", \"sessionId\": \"ac4aab20-010f-11e5-a1b5-e503e60d48a0\"}","url":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","urlParsed":{"anchor":"","query":"","file":"url","directory":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/","path":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","relative":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","port":"","host":"","password":"","user":"","userInfo":"","authority":"","protocol":"","source":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","queryKey":{},"chunks":["session","ac4aab20-010f-11e5-a1b5-e503e60d48a0","url"]}} [DEBUG - 2015-05-23T05:51:08.636Z] SessionReqHand - _postUrlCommand - Session 'ac4aab20-010f-11e5-a1b5-e503e60d48a0' is about to load URL: http://image.baidu.com/channel?c=%E7%BE%8E%E5%A5%B3#%E7%BE%8E%E5%A5%B3 2015-05-23T13:51:08 [DEBUG] Network - Resource request error: 5 ( "Operation canceled" ) URL: "http://image.baidu.com/user/medal?uid=0&t=1432360268627" [DEBUG - 2015-05-23T05:51:08.637Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceError - {"errorCode":5,"errorString":"Operation canceled","id":149,"url":"http://image.baidu.com/user/medal?uid=0&t=1432360268627"} [DEBUG - 2015-05-23T05:51:08.637Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":null,"headers":[],"id":149,"redirectURL":null,"stage":"end","status":null,"statusText":null,"time":"2015-05-23T05:51:08.637Z","url":"http://image.baidu.com/user/medal?uid=0&t=1432360268627"} 2015-05-23T13:51:08 [DEBUG] Network - Resource request error: 5 ( "Operation canceled" ) URL: "http://image.baidu.com/channel/infolist?pn=0&rn=24&tag1=资讯&tag2=国内&is_re=0&ie=utf8&oe=utf-8&filterids=15795493200462327308,5186872426148269496,15270508812199007748,14856276456421853813,5257368915554018825,9035648175322175327,12522393500398489320,12448599283549251191,12346134034005042246,18296101185850460767,15558150000581834652,12977986919480652636,12947904796711141094&t=0.5143384761177003" [DEBUG - 2015-05-23T05:51:08.637Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceError - {"errorCode":5,"errorString":"Operation canceled","id":150,"url":"http://image.baidu.com/channel/infolist?pn=0&rn=24&tag1=资讯&tag2=国内&is_re=0&ie=utf8&oe=utf-8&filterids=15795493200462327308,5186872426148269496,15270508812199007748,14856276456421853813,5257368915554018825,9035648175322175327,12522393500398489320,12448599283549251191,12346134034005042246,18296101185850460767,15558150000581834652,12977986919480652636,12947904796711141094&t=0.5143384761177003"} [DEBUG - 2015-05-23T05:51:08.637Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":null,"headers":[],"id":150,"redirectURL":null,"stage":"end","status":null,"statusText":null,"time":"2015-05-23T05:51:08.637Z","url":"http://image.baidu.com/channel/infolist?pn=0&rn=24&tag1=%E8%B5%84%E8%AE%AF&tag2=%E5%9B%BD%E5%86%85&is_re=0&ie=utf8&oe=utf-8&filterids=15795493200462327308%2C5186872426148269496%2C15270508812199007748%2C14856276456421853813%2C5257368915554018825%2C9035648175322175327%2C12522393500398489320%2C12448599283549251191%2C12346134034005042246%2C18296101185850460767%2C15558150000581834652%2C12977986919480652636%2C12947904796711141094&t=0.5143384761177003"} 2015-05-23T13:51:08 [DEBUG] Network - Resource request error: 5 ( "Operation canceled" ) URL: "http://image.baidu.com/user/msg?t=1432360268626" [DEBUG - 2015-05-23T05:51:08.637Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceError - {"errorCode":5,"errorString":"Operation canceled","id":148,"url":"http://image.baidu.com/user/msg?t=1432360268626"} [DEBUG - 2015-05-23T05:51:08.637Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":null,"headers":[],"id":148,"redirectURL":null,"stage":"end","status":null,"statusText":null,"time":"2015-05-23T05:51:08.637Z","url":"http://image.baidu.com/user/msg?t=1432360268626"} 2015-05-23T13:51:08 [DEBUG] WebPage - updateLoadingProgress: 10 [DEBUG - 2015-05-23T05:51:08.638Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8"}],"id":151,"method":"GET","time":"2015-05-23T05:51:08.638Z","url":"http://image.baidu.com/channel?c=%E7%BE%8E%E5%A5%B3#%E7%BE%8E%E5%A5%B3"} [DEBUG - 2015-05-23T05:51:08.648Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360268|; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:51:08 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:51:08 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360269; domain=.image.baidu.com; path=/" [DEBUG - 2015-05-23T05:51:08.748Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true [DEBUG - 2015-05-23T05:51:08.820Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":87170,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:08 GMT"},{"name":"Server","value":"Apache"},{"name":"Set-Cookie","value":"userid=deleted; expires=Fri, 23-May-2014 05:51:07 GMT; path=/"},{"name":"Tracecode","value":"30686512380763714570052313"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Transfer-Encoding","value":"chunked"}],"id":151,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:08.820Z","url":"http://image.baidu.com/channel?c=%E7%BE%8E%E5%A5%B3#%E7%BE%8E%E5%A5%B3"} [DEBUG - 2015-05-23T05:51:08.820Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Cache-Control","value":"max-age=0"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Referer","value":"http://image.baidu.com/channel/infotag?tag=%E5%9B%BD%E5%86%85"},{"name":"Accept","value":"*/*"}],"id":152,"method":"GET","time":"2015-05-23T05:51:08.820Z","url":"http://imgstat.baidu.com/7.gif?pid=322&type=2013&sample=&ua=other&logid=552142f5aa562290c9ba4e310046b155&et=3&at=&url=&xpath=&ds=&x=&y=&path=&event_type=active.time&p=information&col=&sort=0&entime=20150523&pinfo=/channel/infotag&by=unload&t=329&sendtime=20150523&userid=&ownersign=&_dev=pc&ref=index&_t=0.19659531442448497"} [DEBUG - 2015-05-23T05:51:08.821Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Cache-Control","value":"max-age=0"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Referer","value":"http://image.baidu.com/channel/infotag?tag=%E5%9B%BD%E5%86%85"},{"name":"Accept","value":"*/*"}],"id":153,"method":"GET","time":"2015-05-23T05:51:08.821Z","url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=227%2C227&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=790558931&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3"} 2015-05-23T13:51:08 [DEBUG] WebPage - setupFrame "" 2015-05-23T13:51:08 [DEBUG] WebPage - updateLoadingProgress: 30 2015-05-23T13:51:08 [DEBUG] WebPage - updateLoadingProgress: 44 [DEBUG - 2015-05-23T05:51:08.841Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"image/gif","headers":[{"name":"Content-Type","value":"image/gif"},{"name":"ETag","value":"\"1541271013\""},{"name":"Accept-Ranges","value":"bytes"},{"name":"Last-Modified","value":"Fri, 19 Dec 2014 05:30:38 GMT"},{"name":"Content-Length","value":"0"},{"name":"Connection","value":"close"},{"name":"Date","value":"Sat, 23 May 2015 05:51:08 GMT"},{"name":"Server","value":"Apache"}],"id":152,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:08.841Z","url":"http://imgstat.baidu.com/7.gif?pid=322&type=2013&sample=&ua=other&logid=552142f5aa562290c9ba4e310046b155&et=3&at=&url=&xpath=&ds=&x=&y=&path=&event_type=active.time&p=information&col=&sort=0&entime=20150523&pinfo=/channel/infotag&by=unload&t=329&sendtime=20150523&userid=&ownersign=&_dev=pc&ref=index&_t=0.19659531442448497"} [DEBUG - 2015-05-23T05:51:08.848Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true [DEBUG - 2015-05-23T05:51:08.901Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E7%BE%8E%E5%A5%B3"}],"id":154,"method":"GET","time":"2015-05-23T05:51:08.901Z","url":"http://image.baidu.com/detail/info?fr=channel&tag1=%E7%BE%8E%E5%A5%B3&tag2=%E5%85%A8%E9%83%A8&column=%E7%BE%8E%E5%A5%B3&tag=%E5%85%A8%E9%83%A8&ie=utf-8&oe=utf-8&word=1&t=1432360268900"} 2015-05-23T13:51:08 [DEBUG] WebPage - updateLoadingProgress: 57 [DEBUG - 2015-05-23T05:51:08.952Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E7%BE%8E%E5%A5%B3"}],"id":155,"method":"GET","time":"2015-05-23T05:51:08.952Z","url":"http://image.baidu.com/channel/favdownload?c=%E7%BE%8E%E5%A5%B3&t=%E5%85%A8%E9%83%A8&s=0&t3=&idlist=21556851421%2C20951284590%2C21213461062%2C21196438671%2C20946908621%2C21217877261%2C21555733544%2C23702313639%2C23702320041%2C15069412339%2C17023681645%2C11681528889%2C9408268051%2C15206402639%2C20926018300%2C20942492962%2C20784794630%2C20938025512%2C21203202211%2C15372281661%2C23701368046%2C21824294717%2C17023750922%2C17023720719%2C9535105254%2C9549274275%2C15069392128%2C21010026442%2C21208186727%2C21308006839"} [DEBUG - 2015-05-23T05:51:08.958Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E7%BE%8E%E5%A5%B3"},{"name":"If-None-Match","value":"20661c0706a23b25c1b8fe847b3fc48e"}],"id":156,"method":"GET","time":"2015-05-23T05:51:08.958Z","url":"http://hm.baidu.com/h.js?737dbb498415dd39d8abf5bc2404b290"} 2015-05-23T13:51:08 [DEBUG] WebPage - updateLoadingProgress: 83 [DEBUG - 2015-05-23T05:51:08.959Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:08 GMT"},{"name":"Server","value":"Apache"},{"name":"Set-Cookie","value":"userid=deleted; expires=Fri, 23-May-2014 05:51:07 GMT; path=/"},{"name":"Tracecode","value":"30686512380763714570052313"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Transfer-Encoding","value":"chunked"}],"id":151,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:08.959Z","url":"http://image.baidu.com/channel?c=%E7%BE%8E%E5%A5%B3#%E7%BE%8E%E5%A5%B3"} [DEBUG - 2015-05-23T05:51:08.978Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true [DEBUG - 2015-05-23T05:51:08.978Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":43,"contentType":"image/gif","headers":[{"name":"Cache-Control","value":"private, max-age=0, no-cache"},{"name":"Content-Length","value":"43"},{"name":"Content-Type","value":"image/gif"},{"name":"Date","value":"Sat, 23 May 2015 05:51:08 GMT"},{"name":"Pragma","value":"no-cache"},{"name":"Server","value":"apache"},{"name":"X-Content-Type-Options","value":"nosniff"}],"id":153,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:08.978Z","url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=227%2C227&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=790558931&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3"} 2015-05-23T13:51:08 [DEBUG] Network - Resource request error: 5 ( "Operation canceled" ) URL: "http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=227,227&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=790558931&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3" [DEBUG - 2015-05-23T05:51:08.979Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceError - {"errorCode":5,"errorString":"Operation canceled","id":153,"url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=227,227&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=790558931&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3"} [DEBUG - 2015-05-23T05:51:08.979Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"image/gif","headers":[{"name":"Cache-Control","value":"private, max-age=0, no-cache"},{"name":"Content-Length","value":"43"},{"name":"Content-Type","value":"image/gif"},{"name":"Date","value":"Sat, 23 May 2015 05:51:08 GMT"},{"name":"Pragma","value":"no-cache"},{"name":"Server","value":"apache"},{"name":"X-Content-Type-Options","value":"nosniff"}],"id":153,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:08.979Z","url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=227%2C227&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=790558931&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3"} [DEBUG - 2015-05-23T05:51:08.979Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":3531,"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:51:08 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30689205090780491786052313"},{"name":"Transfer-Encoding","value":"chunked"}],"id":154,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:08.979Z","url":"http://image.baidu.com/detail/info?fr=channel&tag1=%E7%BE%8E%E5%A5%B3&tag2=%E5%85%A8%E9%83%A8&column=%E7%BE%8E%E5%A5%B3&tag=%E5%85%A8%E9%83%A8&ie=utf-8&oe=utf-8&word=1&t=1432360268900"} [DEBUG - 2015-05-23T05:51:08.979Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:51:08 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30689205090780491786052313"},{"name":"Transfer-Encoding","value":"chunked"}],"id":154,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:08.979Z","url":"http://image.baidu.com/detail/info?fr=channel&tag1=%E7%BE%8E%E5%A5%B3&tag2=%E5%85%A8%E9%83%A8&column=%E7%BE%8E%E5%A5%B3&tag=%E5%85%A8%E9%83%A8&ie=utf-8&oe=utf-8&word=1&t=1432360268900"} [DEBUG - 2015-05-23T05:51:08.986Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":3107,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:08 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30689664450797269002052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":155,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:08.986Z","url":"http://image.baidu.com/channel/favdownload?c=%E7%BE%8E%E5%A5%B3&t=%E5%85%A8%E9%83%A8&s=0&t3=&idlist=21556851421%2C20951284590%2C21213461062%2C21196438671%2C20946908621%2C21217877261%2C21555733544%2C23702313639%2C23702320041%2C15069412339%2C17023681645%2C11681528889%2C9408268051%2C15206402639%2C20926018300%2C20942492962%2C20784794630%2C20938025512%2C21203202211%2C15372281661%2C23701368046%2C21824294717%2C17023750922%2C17023720719%2C9535105254%2C9549274275%2C15069392128%2C21010026442%2C21208186727%2C21308006839"} [DEBUG - 2015-05-23T05:51:08.987Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:08 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30689664450797269002052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":155,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:08.986Z","url":"http://image.baidu.com/channel/favdownload?c=%E7%BE%8E%E5%A5%B3&t=%E5%85%A8%E9%83%A8&s=0&t3=&idlist=21556851421%2C20951284590%2C21213461062%2C21196438671%2C20946908621%2C21217877261%2C21555733544%2C23702313639%2C23702320041%2C15069412339%2C17023681645%2C11681528889%2C9408268051%2C15206402639%2C20926018300%2C20942492962%2C20784794630%2C20938025512%2C21203202211%2C15372281661%2C23701368046%2C21824294717%2C17023750922%2C17023720719%2C9535105254%2C9549274275%2C15069392128%2C21010026442%2C21208186727%2C21308006839"} 2015-05-23T13:51:09 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:09 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:51:09 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:51:09 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:09 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:09 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:51:09 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:09 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:09 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:51:08 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:51:09 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360269; domain=.image.baidu.com; path=/" 2015-05-23T13:51:09 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360268|; domain=.hm.baidu.com; path=/" [DEBUG - 2015-05-23T05:51:09.045Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":null,"headers":[{"name":"Cache-Control","value":"max-age=0, must-revalidate"},{"name":"Date","value":"Sat, 23 May 2015 05:51:08 GMT"},{"name":"Etag","value":"20661c0706a23b25c1b8fe847b3fc48e"},{"name":"P3p","value":"CP=\"CURa ADMa DEVa PSAo PSDo OUR BUS UNI PUR INT DEM STA PRE COM NAV OTC NOI DSP COR\""},{"name":"Server","value":"apache"},{"name":"Set-Cookie","value":"HMVT=737dbb498415dd39d8abf5bc2404b290|1432360268|; Path=/; Domain=hm.baidu.com"}],"id":156,"redirectURL":null,"stage":"end","status":304,"statusText":"Not Modified","time":"2015-05-23T05:51:09.045Z","url":"http://hm.baidu.com/h.js?737dbb498415dd39d8abf5bc2404b290"} 2015-05-23T13:51:09 [DEBUG] WebPage - updateLoadingProgress: 100 [DEBUG - 2015-05-23T05:51:09.046Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _oneShotCallback - onLoadFinished [DEBUG - 2015-05-23T05:51:09.046Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - onLoadFinished: success 2015-05-23T13:51:09 [DEBUG] WebPage - setupFrame "" 2015-05-23T13:51:09 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:09 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:51:09 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:51:09 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:09 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:09 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:51:09 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:09 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:09 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360269; domain=.image.baidu.com; path=/" 2015-05-23T13:51:09 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360268|; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:09 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:51:09 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:51:09 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:09 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:51:09 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:51:09 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:09 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:09 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:51:09 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:09 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:09 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360268|; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:09 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:51:09 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:51:09 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360269; domain=.image.baidu.com; path=/" [DEBUG - 2015-05-23T05:51:09.057Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"application/json, text/javascript, */*; q=0.01"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E7%BE%8E%E5%A5%B3"}],"id":157,"method":"GET","time":"2015-05-23T05:51:09.057Z","url":"http://image.baidu.com/user/msg?t=1432360269057"} [DEBUG - 2015-05-23T05:51:09.058Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"application/json, text/javascript, */*; q=0.01"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E7%BE%8E%E5%A5%B3"}],"id":158,"method":"GET","time":"2015-05-23T05:51:09.058Z","url":"http://image.baidu.com/user/medal?uid=0&t=1432360269057"} [DEBUG - 2015-05-23T05:51:09.078Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: false [DEBUG - 2015-05-23T05:51:09.078Z] SessionReqHand - _SuccessHandler - status: success 2015-05-23T13:51:09 [DEBUG] HTTP Response - Status Code 200 OK 2015-05-23T13:51:09 [DEBUG] HTTP Response - Sending Header "Cache" = "no-cache" 2015-05-23T13:51:09 [DEBUG] HTTP Response - Sending Header "Content-Length" = "74" 2015-05-23T13:51:09 [DEBUG] HTTP Response - Sending Header "Content-Type" = "application/json;charset=UTF-8" [DEBUG - 2015-05-23T05:51:09.079Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":72,"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:51:09 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30690716670210131978052313"},{"name":"Content-Length","value":"72"}],"id":157,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:09.079Z","url":"http://image.baidu.com/user/msg?t=1432360269057"} [DEBUG - 2015-05-23T05:51:09.079Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:51:09 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30690716670210131978052313"},{"name":"Content-Length","value":"72"}],"id":157,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:09.079Z","url":"http://image.baidu.com/user/msg?t=1432360269057"} 2015-05-23T13:51:09 [DEBUG] HTTP Request - URI /wd/hub/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source 2015-05-23T13:51:09 [DEBUG] HTTP Request - Method GET 2015-05-23T13:51:09 [DEBUG] HTTP Request - HTTP Version 1.1 2015-05-23T13:51:09 [DEBUG] HTTP Request - Query String 2015-05-23T13:51:09 [DEBUG] HTTP Request - Receiving Header "Accept-Encoding" = "identity" 2015-05-23T13:51:09 [DEBUG] HTTP Request - Receiving Header "Host" = "127.0.0.1:32999" 2015-05-23T13:51:09 [DEBUG] HTTP Request - Receiving Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:51:09 [DEBUG] HTTP Request - Receiving Header "Connection" = "close" 2015-05-23T13:51:09 [DEBUG] HTTP Request - Receiving Header "Accept" = "application/json" 2015-05-23T13:51:09 [DEBUG] HTTP Request - Receiving Header "User-Agent" = "Python-urllib/2.7" [DEBUG - 2015-05-23T05:51:09.080Z] RouterReqHand - _handle - {"headers":{"Accept":"application/json","Accept-Encoding":"identity","Connection":"close","Content-Type":"application/json;charset=UTF-8","Host":"127.0.0.1:32999","User-Agent":"Python-urllib/2.7"},"httpVersion":"1.1","method":"GET","url":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","urlParsed":{"anchor":"","query":"","file":"source","directory":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/","path":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","relative":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","port":"","host":"","password":"","user":"","userInfo":"","authority":"","protocol":"","source":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","queryKey":{},"chunks":["session","ac4aab20-010f-11e5-a1b5-e503e60d48a0","source"]}} 2015-05-23T13:51:09 [DEBUG] HTTP Response - Status Code 200 OK 2015-05-23T13:51:09 [DEBUG] HTTP Response - Sending Header "Cache" = "no-cache" 2015-05-23T13:51:09 [DEBUG] HTTP Response - Sending Header "Content-Length" = "526661" 2015-05-23T13:51:09 [DEBUG] HTTP Response - Sending Header "Content-Type" = "application/json;charset=UTF-8" [DEBUG - 2015-05-23T05:51:09.144Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":98,"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:51:09 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30690711680797269002052313"},{"name":"Content-Length","value":"98"}],"id":158,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:09.143Z","url":"http://image.baidu.com/user/medal?uid=0&t=1432360269057"} [DEBUG - 2015-05-23T05:51:09.144Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:51:09 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30690711680797269002052313"},{"name":"Content-Length","value":"98"}],"id":158,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:09.144Z","url":"http://image.baidu.com/user/medal?uid=0&t=1432360269057"} 2015-05-23T13:51:11 [DEBUG] HTTP Request - URI /wd/hub/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url 2015-05-23T13:51:11 [DEBUG] HTTP Request - Method POST 2015-05-23T13:51:11 [DEBUG] HTTP Request - HTTP Version 1.1 2015-05-23T13:51:11 [DEBUG] HTTP Request - Query String 2015-05-23T13:51:11 [DEBUG] HTTP Request - Receiving Header "Accept-Encoding" = "identity" 2015-05-23T13:51:11 [DEBUG] HTTP Request - Receiving Header "Content-Length" = "104" 2015-05-23T13:51:11 [DEBUG] HTTP Request - Receiving Header "Host" = "127.0.0.1:32999" 2015-05-23T13:51:11 [DEBUG] HTTP Request - Receiving Header "Accept" = "application/json" 2015-05-23T13:51:11 [DEBUG] HTTP Request - Receiving Header "User-Agent" = "Python-urllib/2.7" 2015-05-23T13:51:11 [DEBUG] HTTP Request - Receiving Header "Connection" = "close" 2015-05-23T13:51:11 [DEBUG] HTTP Request - Receiving Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:51:11 [DEBUG] HTTP Request - Method POST/PUT 2015-05-23T13:51:11 [DEBUG] HTTP Request - Content Body: {"url": "http://image.baidu.com/channel/wallpaper", "sessionId": "ac4aab20-010f-11e5-a1b5-e503e60d48a0"} [DEBUG - 2015-05-23T05:51:11.205Z] RouterReqHand - _handle - {"headers":{"Accept":"application/json","Accept-Encoding":"identity","Connection":"close","Content-Length":"104","Content-Type":"application/json;charset=UTF-8","Host":"127.0.0.1:32999","User-Agent":"Python-urllib/2.7"},"httpVersion":"1.1","method":"POST","post":"{\"url\": \"http://image.baidu.com/channel/wallpaper\", \"sessionId\": \"ac4aab20-010f-11e5-a1b5-e503e60d48a0\"}","url":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","urlParsed":{"anchor":"","query":"","file":"url","directory":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/","path":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","relative":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","port":"","host":"","password":"","user":"","userInfo":"","authority":"","protocol":"","source":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","queryKey":{},"chunks":["session","ac4aab20-010f-11e5-a1b5-e503e60d48a0","url"]}} [DEBUG - 2015-05-23T05:51:11.205Z] SessionReqHand - _postUrlCommand - Session 'ac4aab20-010f-11e5-a1b5-e503e60d48a0' is about to load URL: http://image.baidu.com/channel/wallpaper 2015-05-23T13:51:11 [DEBUG] WebPage - updateLoadingProgress: 10 [DEBUG - 2015-05-23T05:51:11.206Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8"}],"id":159,"method":"GET","time":"2015-05-23T05:51:11.206Z","url":"http://image.baidu.com/channel/wallpaper"} [DEBUG - 2015-05-23T05:51:11.216Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360268|; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:51:09 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360269; domain=.image.baidu.com; path=/" [DEBUG - 2015-05-23T05:51:11.268Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":75250,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:11 GMT"},{"name":"Server","value":"Apache"},{"name":"Set-Cookie","value":"userid=deleted; expires=Fri, 23-May-2014 05:51:10 GMT; path=/"},{"name":"Tracecode","value":"30712184030747002890052313"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Transfer-Encoding","value":"chunked"}],"id":159,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:11.268Z","url":"http://image.baidu.com/channel/wallpaper"} [DEBUG - 2015-05-23T05:51:11.269Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Cache-Control","value":"max-age=0"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E7%BE%8E%E5%A5%B3"},{"name":"Accept","value":"*/*"}],"id":160,"method":"GET","time":"2015-05-23T05:51:11.269Z","url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=2220%2C2220&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=1291537815&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3"} 2015-05-23T13:51:11 [DEBUG] WebPage - setupFrame "" 2015-05-23T13:51:11 [DEBUG] WebPage - updateLoadingProgress: 30 [DEBUG - 2015-05-23T05:51:11.287Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel/wallpaper"},{"name":"If-None-Match","value":"20661c0706a23b25c1b8fe847b3fc48e"}],"id":161,"method":"GET","time":"2015-05-23T05:51:11.287Z","url":"http://hm.baidu.com/h.js?737dbb498415dd39d8abf5bc2404b290"} 2015-05-23T13:51:11 [DEBUG] WebPage - updateLoadingProgress: 71 [DEBUG - 2015-05-23T05:51:11.306Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:11 GMT"},{"name":"Server","value":"Apache"},{"name":"Set-Cookie","value":"userid=deleted; expires=Fri, 23-May-2014 05:51:10 GMT; path=/"},{"name":"Tracecode","value":"30712184030747002890052313"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Transfer-Encoding","value":"chunked"}],"id":159,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:11.306Z","url":"http://image.baidu.com/channel/wallpaper"} [DEBUG - 2015-05-23T05:51:11.367Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"application/json, text/javascript, */*; q=0.01"},{"name":"Referer","value":"http://image.baidu.com/channel/wallpaper"}],"id":162,"method":"GET","time":"2015-05-23T05:51:11.367Z","url":"http://image.baidu.com/data/imgs?pn=0&rn=18&col=%E5%A3%81%E7%BA%B8&tag=%E5%85%A8%E9%83%A8&tag3=&width=1024&height=768&ic=0&ie=utf8&oe=utf-8&image_id=&fr=channel&p=channel&from=1&app=img.browse.channel.wallpaper&t=0.621210117591545"} [DEBUG - 2015-05-23T05:51:11.368Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true [DEBUG - 2015-05-23T05:51:11.375Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":43,"contentType":"image/gif","headers":[{"name":"Cache-Control","value":"private, max-age=0, no-cache"},{"name":"Content-Length","value":"43"},{"name":"Content-Type","value":"image/gif"},{"name":"Date","value":"Sat, 23 May 2015 05:51:11 GMT"},{"name":"Pragma","value":"no-cache"},{"name":"Server","value":"apache"},{"name":"X-Content-Type-Options","value":"nosniff"}],"id":160,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:11.374Z","url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=2220%2C2220&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=1291537815&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3"} 2015-05-23T13:51:11 [DEBUG] Network - Resource request error: 5 ( "Operation canceled" ) URL: "http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=2220,2220&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=1291537815&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3" [DEBUG - 2015-05-23T05:51:11.375Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceError - {"errorCode":5,"errorString":"Operation canceled","id":160,"url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=2220,2220&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=1291537815&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3"} [DEBUG - 2015-05-23T05:51:11.375Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"image/gif","headers":[{"name":"Cache-Control","value":"private, max-age=0, no-cache"},{"name":"Content-Length","value":"43"},{"name":"Content-Type","value":"image/gif"},{"name":"Date","value":"Sat, 23 May 2015 05:51:11 GMT"},{"name":"Pragma","value":"no-cache"},{"name":"Server","value":"apache"},{"name":"X-Content-Type-Options","value":"nosniff"}],"id":160,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:11.375Z","url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=2220%2C2220&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=1291537815&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3"} 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:51:09 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360269; domain=.image.baidu.com; path=/" 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360271|; domain=.hm.baidu.com; path=/" [DEBUG - 2015-05-23T05:51:11.387Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":null,"headers":[{"name":"Cache-Control","value":"max-age=0, must-revalidate"},{"name":"Date","value":"Sat, 23 May 2015 05:51:11 GMT"},{"name":"Etag","value":"20661c0706a23b25c1b8fe847b3fc48e"},{"name":"P3p","value":"CP=\"CURa ADMa DEVa PSAo PSDo OUR BUS UNI PUR INT DEM STA PRE COM NAV OTC NOI DSP COR\""},{"name":"Server","value":"apache"},{"name":"Set-Cookie","value":"HMVT=737dbb498415dd39d8abf5bc2404b290|1432360271|; Path=/; Domain=hm.baidu.com"}],"id":161,"redirectURL":null,"stage":"end","status":304,"statusText":"Not Modified","time":"2015-05-23T05:51:11.387Z","url":"http://hm.baidu.com/h.js?737dbb498415dd39d8abf5bc2404b290"} 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360269; domain=.image.baidu.com; path=/" 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360271|; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:51:11 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360271|; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:51:11 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:51:11 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360271; domain=.image.baidu.com; path=/" [DEBUG - 2015-05-23T05:51:11.394Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"application/json, text/javascript, */*; q=0.01"},{"name":"Referer","value":"http://image.baidu.com/channel/wallpaper"}],"id":163,"method":"GET","time":"2015-05-23T05:51:11.394Z","url":"http://image.baidu.com/user/msg?t=1432360271394"} [DEBUG - 2015-05-23T05:51:11.397Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"application/json, text/javascript, */*; q=0.01"},{"name":"Referer","value":"http://image.baidu.com/channel/wallpaper"}],"id":164,"method":"GET","time":"2015-05-23T05:51:11.395Z","url":"http://image.baidu.com/user/medal?uid=0&t=1432360271395"} [DEBUG - 2015-05-23T05:51:11.412Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":72,"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:51:11 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30714064410746937354052313"},{"name":"Content-Length","value":"72"}],"id":163,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:11.412Z","url":"http://image.baidu.com/user/msg?t=1432360271394"} 2015-05-23T13:51:11 [DEBUG] WebPage - updateLoadingProgress: 90 [DEBUG - 2015-05-23T05:51:11.412Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:51:11 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30714064410746937354052313"},{"name":"Content-Length","value":"72"}],"id":163,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:11.412Z","url":"http://image.baidu.com/user/msg?t=1432360271394"} [DEBUG - 2015-05-23T05:51:11.422Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":98,"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:51:11 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30714105200310795274052313"},{"name":"Content-Length","value":"98"}],"id":164,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:11.422Z","url":"http://image.baidu.com/user/medal?uid=0&t=1432360271395"} [DEBUG - 2015-05-23T05:51:11.422Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:51:11 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30714105200310795274052313"},{"name":"Content-Length","value":"98"}],"id":164,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:11.422Z","url":"http://image.baidu.com/user/medal?uid=0&t=1432360271395"} [DEBUG - 2015-05-23T05:51:11.469Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true [DEBUG - 2015-05-23T05:51:11.504Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":59438,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:11 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30713804000746937354052313"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Transfer-Encoding","value":"chunked"}],"id":162,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:11.504Z","url":"http://image.baidu.com/data/imgs?pn=0&rn=18&col=%E5%A3%81%E7%BA%B8&tag=%E5%85%A8%E9%83%A8&tag3=&width=1024&height=768&ic=0&ie=utf8&oe=utf-8&image_id=&fr=channel&p=channel&from=1&app=img.browse.channel.wallpaper&t=0.621210117591545"} [DEBUG - 2015-05-23T05:51:11.505Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:11 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30713804000746937354052313"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Transfer-Encoding","value":"chunked"}],"id":162,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:11.505Z","url":"http://image.baidu.com/data/imgs?pn=0&rn=18&col=%E5%A3%81%E7%BA%B8&tag=%E5%85%A8%E9%83%A8&tag3=&width=1024&height=768&ic=0&ie=utf8&oe=utf-8&image_id=&fr=channel&p=channel&from=1&app=img.browse.channel.wallpaper&t=0.621210117591545"} 2015-05-23T13:51:11 [DEBUG] WebPage - updateLoadingProgress: 100 [DEBUG - 2015-05-23T05:51:11.534Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _oneShotCallback - onLoadFinished [DEBUG - 2015-05-23T05:51:11.534Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - onLoadFinished: success 2015-05-23T13:51:11 [DEBUG] WebPage - setupFrame "" [DEBUG - 2015-05-23T05:51:11.569Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: false [DEBUG - 2015-05-23T05:51:11.569Z] SessionReqHand - _SuccessHandler - status: success 2015-05-23T13:51:11 [DEBUG] HTTP Response - Status Code 200 OK 2015-05-23T13:51:11 [DEBUG] HTTP Response - Sending Header "Cache" = "no-cache" 2015-05-23T13:51:11 [DEBUG] HTTP Response - Sending Header "Content-Length" = "74" 2015-05-23T13:51:11 [DEBUG] HTTP Response - Sending Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:51:11 [DEBUG] HTTP Request - URI /wd/hub/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source 2015-05-23T13:51:11 [DEBUG] HTTP Request - Method GET 2015-05-23T13:51:11 [DEBUG] HTTP Request - HTTP Version 1.1 2015-05-23T13:51:11 [DEBUG] HTTP Request - Query String 2015-05-23T13:51:11 [DEBUG] HTTP Request - Receiving Header "Accept-Encoding" = "identity" 2015-05-23T13:51:11 [DEBUG] HTTP Request - Receiving Header "Host" = "127.0.0.1:32999" 2015-05-23T13:51:11 [DEBUG] HTTP Request - Receiving Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:51:11 [DEBUG] HTTP Request - Receiving Header "Connection" = "close" 2015-05-23T13:51:11 [DEBUG] HTTP Request - Receiving Header "Accept" = "application/json" 2015-05-23T13:51:11 [DEBUG] HTTP Request - Receiving Header "User-Agent" = "Python-urllib/2.7" [DEBUG - 2015-05-23T05:51:11.571Z] RouterReqHand - _handle - {"headers":{"Accept":"application/json","Accept-Encoding":"identity","Connection":"close","Content-Type":"application/json;charset=UTF-8","Host":"127.0.0.1:32999","User-Agent":"Python-urllib/2.7"},"httpVersion":"1.1","method":"GET","url":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","urlParsed":{"anchor":"","query":"","file":"source","directory":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/","path":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","relative":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","port":"","host":"","password":"","user":"","userInfo":"","authority":"","protocol":"","source":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","queryKey":{},"chunks":["session","ac4aab20-010f-11e5-a1b5-e503e60d48a0","source"]}} 2015-05-23T13:51:11 [DEBUG] HTTP Response - Status Code 200 OK 2015-05-23T13:51:11 [DEBUG] HTTP Response - Sending Header "Cache" = "no-cache" 2015-05-23T13:51:11 [DEBUG] HTTP Response - Sending Header "Content-Length" = "188625" 2015-05-23T13:51:11 [DEBUG] HTTP Response - Sending Header "Content-Type" = "application/json;charset=UTF-8" [DEBUG - 2015-05-23T05:51:11.587Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"application/json, text/javascript, */*; q=0.01"},{"name":"Referer","value":"http://image.baidu.com/channel/wallpaper"}],"id":165,"method":"GET","time":"2015-05-23T05:51:11.587Z","url":"http://image.baidu.com/channel/getpicinfo?idlist=9399916350%2C9400491407%2C9426443511%2C9563605139%2C9426024511%2C9395785352%2C9423341647%2C16411196380%2C9626207388%2C11812143298%2C10501199471%2C9423432088%2C9399950870%2C9400494738%2C9426444488%2C9522000998%2C9563190094%2C13865604255"} [DEBUG - 2015-05-23T05:51:11.615Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":1386,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:11 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30716013220797269002052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":165,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:11.615Z","url":"http://image.baidu.com/channel/getpicinfo?idlist=9399916350%2C9400491407%2C9426443511%2C9563605139%2C9426024511%2C9395785352%2C9423341647%2C16411196380%2C9626207388%2C11812143298%2C10501199471%2C9423432088%2C9399950870%2C9400494738%2C9426444488%2C9522000998%2C9563190094%2C13865604255"} [DEBUG - 2015-05-23T05:51:11.616Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:11 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30716013220797269002052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":165,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:11.616Z","url":"http://image.baidu.com/channel/getpicinfo?idlist=9399916350%2C9400491407%2C9426443511%2C9563605139%2C9426024511%2C9395785352%2C9423341647%2C16411196380%2C9626207388%2C11812143298%2C10501199471%2C9423432088%2C9399950870%2C9400494738%2C9426444488%2C9522000998%2C9563190094%2C13865604255"} 2015-05-23T13:51:12 [DEBUG] HTTP Request - URI /wd/hub/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url 2015-05-23T13:51:12 [DEBUG] HTTP Request - Method POST 2015-05-23T13:51:12 [DEBUG] HTTP Request - HTTP Version 1.1 2015-05-23T13:51:12 [DEBUG] HTTP Request - Query String 2015-05-23T13:51:12 [DEBUG] HTTP Request - Receiving Header "Accept-Encoding" = "identity" 2015-05-23T13:51:12 [DEBUG] HTTP Request - Receiving Header "Content-Length" = "102" 2015-05-23T13:51:12 [DEBUG] HTTP Request - Receiving Header "Host" = "127.0.0.1:32999" 2015-05-23T13:51:12 [DEBUG] HTTP Request - Receiving Header "Accept" = "application/json" 2015-05-23T13:51:12 [DEBUG] HTTP Request - Receiving Header "User-Agent" = "Python-urllib/2.7" 2015-05-23T13:51:12 [DEBUG] HTTP Request - Receiving Header "Connection" = "close" 2015-05-23T13:51:12 [DEBUG] HTTP Request - Receiving Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:51:12 [DEBUG] HTTP Request - Method POST/PUT 2015-05-23T13:51:12 [DEBUG] HTTP Request - Content Body: {"url": "http://image.baidu.com/channel/fashion", "sessionId": "ac4aab20-010f-11e5-a1b5-e503e60d48a0"} [DEBUG - 2015-05-23T05:51:12.795Z] RouterReqHand - _handle - {"headers":{"Accept":"application/json","Accept-Encoding":"identity","Connection":"close","Content-Length":"102","Content-Type":"application/json;charset=UTF-8","Host":"127.0.0.1:32999","User-Agent":"Python-urllib/2.7"},"httpVersion":"1.1","method":"POST","post":"{\"url\": \"http://image.baidu.com/channel/fashion\", \"sessionId\": \"ac4aab20-010f-11e5-a1b5-e503e60d48a0\"}","url":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","urlParsed":{"anchor":"","query":"","file":"url","directory":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/","path":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","relative":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","port":"","host":"","password":"","user":"","userInfo":"","authority":"","protocol":"","source":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","queryKey":{},"chunks":["session","ac4aab20-010f-11e5-a1b5-e503e60d48a0","url"]}} [DEBUG - 2015-05-23T05:51:12.795Z] SessionReqHand - _postUrlCommand - Session 'ac4aab20-010f-11e5-a1b5-e503e60d48a0' is about to load URL: http://image.baidu.com/channel/fashion 2015-05-23T13:51:12 [DEBUG] WebPage - updateLoadingProgress: 10 [DEBUG - 2015-05-23T05:51:12.796Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8"}],"id":166,"method":"GET","time":"2015-05-23T05:51:12.796Z","url":"http://image.baidu.com/channel/fashion"} [DEBUG - 2015-05-23T05:51:12.806Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true 2015-05-23T13:51:12 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:12 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:51:12 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:51:12 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:12 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:12 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:51:12 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:12 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:12 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360271|; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:12 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:51:11 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:51:12 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360271; domain=.image.baidu.com; path=/" [DEBUG - 2015-05-23T05:51:12.854Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":84759,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:12 GMT"},{"name":"Server","value":"Apache"},{"name":"Set-Cookie","value":"userid=deleted; expires=Fri, 23-May-2014 05:51:11 GMT; path=/"},{"name":"Tracecode","value":"30728080060864443402052313"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Transfer-Encoding","value":"chunked"}],"id":166,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:12.854Z","url":"http://image.baidu.com/channel/fashion"} [DEBUG - 2015-05-23T05:51:12.855Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Cache-Control","value":"max-age=0"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Referer","value":"http://image.baidu.com/channel/wallpaper"},{"name":"Accept","value":"*/*"}],"id":167,"method":"GET","time":"2015-05-23T05:51:12.855Z","url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=1468%2C1468&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=1051636179&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3"} 2015-05-23T13:51:12 [DEBUG] WebPage - setupFrame "" [DEBUG - 2015-05-23T05:51:12.864Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/css,*/*;q=0.1"},{"name":"Referer","value":"http://image.baidu.com/channel/fashion"}],"id":168,"method":"GET","time":"2015-05-23T05:51:12.864Z","url":"http://img0.bdstatic.com/static/fashion/pkg/default_ef5ceb6.css"} 2015-05-23T13:51:12 [DEBUG] WebPage - updateLoadingProgress: 28 2015-05-23T13:51:12 [DEBUG] WebPage - updateLoadingProgress: 40 [DEBUG - 2015-05-23T05:51:12.866Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:12 GMT"},{"name":"Server","value":"Apache"},{"name":"Set-Cookie","value":"userid=deleted; expires=Fri, 23-May-2014 05:51:11 GMT; path=/"},{"name":"Tracecode","value":"30728080060864443402052313"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Transfer-Encoding","value":"chunked"}],"id":166,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:12.865Z","url":"http://image.baidu.com/channel/fashion"} [DEBUG - 2015-05-23T05:51:12.874Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":34902,"contentType":"text/css","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:51:12 GMT"},{"name":"Content-Type","value":"text/css"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"keep-alive"},{"name":"Last-Modified","value":"Mon, 19 Jan 2015 09:50:21 GMT"},{"name":"Expires","value":"Thu, 28 May 2015 06:24:55 GMT"},{"name":"Age","value":"170777"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Content-Encoding","value":"gzip"},{"name":"Tracecode","value":"14957613370780491786052114"},{"name":"Vary","value":"Accept-Encoding"}],"id":168,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:12.873Z","url":"http://img0.bdstatic.com/static/fashion/pkg/default_ef5ceb6.css"} 2015-05-23T13:51:12 [DEBUG] WebPage - updateLoadingProgress: 44 [DEBUG - 2015-05-23T05:51:12.874Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/css","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:51:12 GMT"},{"name":"Content-Type","value":"text/css"},{"name":"Transfer-Encoding","value":"chunked"},{"name":"Connection","value":"keep-alive"},{"name":"Last-Modified","value":"Mon, 19 Jan 2015 09:50:21 GMT"},{"name":"Expires","value":"Thu, 28 May 2015 06:24:55 GMT"},{"name":"Age","value":"170777"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Content-Encoding","value":"gzip"},{"name":"Tracecode","value":"14957613370780491786052114"},{"name":"Vary","value":"Accept-Encoding"}],"id":168,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:12.874Z","url":"http://img0.bdstatic.com/static/fashion/pkg/default_ef5ceb6.css"} [DEBUG - 2015-05-23T05:51:12.911Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel/fashion"},{"name":"If-None-Match","value":"20661c0706a23b25c1b8fe847b3fc48e"}],"id":169,"method":"GET","time":"2015-05-23T05:51:12.911Z","url":"http://hm.baidu.com/h.js?737dbb498415dd39d8abf5bc2404b290"} [DEBUG - 2015-05-23T05:51:12.913Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel/fashion"}],"id":170,"method":"GET","time":"2015-05-23T05:51:12.913Z","url":"http://img2.bdstatic.com/static/fashion/pkg/default_d059dbe.js"} [DEBUG - 2015-05-23T05:51:12.915Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true [DEBUG - 2015-05-23T05:51:12.932Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":7982,"contentType":"text/javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:51:12 GMT"},{"name":"Content-Type","value":"text/javascript"},{"name":"Connection","value":"keep-alive"},{"name":"ETag","value":"\"57435757\""},{"name":"Last-Modified","value":"Mon, 19 Jan 2015 09:50:21 GMT"},{"name":"Expires","value":"Thu, 28 May 2015 06:24:55 GMT"},{"name":"Age","value":"170777"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Accept-Ranges","value":"bytes"},{"name":"Content-Encoding","value":"gzip"},{"name":"Vary","value":"Accept-Encoding"}],"id":170,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:12.932Z","url":"http://img2.bdstatic.com/static/fashion/pkg/default_d059dbe.js"} 2015-05-23T13:51:12 [DEBUG] WebPage - updateLoadingProgress: 52 [DEBUG - 2015-05-23T05:51:12.932Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/javascript","headers":[{"name":"Server","value":"JSP3/2.0.6"},{"name":"Date","value":"Sat, 23 May 2015 05:51:12 GMT"},{"name":"Content-Type","value":"text/javascript"},{"name":"Connection","value":"keep-alive"},{"name":"ETag","value":"\"57435757\""},{"name":"Last-Modified","value":"Mon, 19 Jan 2015 09:50:21 GMT"},{"name":"Expires","value":"Thu, 28 May 2015 06:24:55 GMT"},{"name":"Age","value":"170777"},{"name":"Cache-Control","value":"max-age=604800"},{"name":"Accept-Ranges","value":"bytes"},{"name":"Content-Encoding","value":"gzip"},{"name":"Vary","value":"Accept-Encoding"}],"id":170,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:12.932Z","url":"http://img2.bdstatic.com/static/fashion/pkg/default_d059dbe.js"} [DEBUG - 2015-05-23T05:51:12.981Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":43,"contentType":"image/gif","headers":[{"name":"Cache-Control","value":"private, max-age=0, no-cache"},{"name":"Content-Length","value":"43"},{"name":"Content-Type","value":"image/gif"},{"name":"Date","value":"Sat, 23 May 2015 05:51:12 GMT"},{"name":"Pragma","value":"no-cache"},{"name":"Server","value":"apache"},{"name":"X-Content-Type-Options","value":"nosniff"}],"id":167,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:12.981Z","url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=1468%2C1468&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=1051636179&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3"} 2015-05-23T13:51:12 [DEBUG] Network - Resource request error: 5 ( "Operation canceled" ) URL: "http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=1468,1468&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=1051636179&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3" [DEBUG - 2015-05-23T05:51:12.981Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceError - {"errorCode":5,"errorString":"Operation canceled","id":167,"url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=1468,1468&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=1051636179&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3"} [DEBUG - 2015-05-23T05:51:12.981Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"image/gif","headers":[{"name":"Cache-Control","value":"private, max-age=0, no-cache"},{"name":"Content-Length","value":"43"},{"name":"Content-Type","value":"image/gif"},{"name":"Date","value":"Sat, 23 May 2015 05:51:12 GMT"},{"name":"Pragma","value":"no-cache"},{"name":"Server","value":"apache"},{"name":"X-Content-Type-Options","value":"nosniff"}],"id":167,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:12.981Z","url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=1468%2C1468&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=1051636179&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3"} 2015-05-23T13:51:13 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:13 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:51:13 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:51:13 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:13 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:13 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:51:13 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:13 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:13 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:51:11 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:51:13 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360271; domain=.image.baidu.com; path=/" 2015-05-23T13:51:13 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360272|; domain=.hm.baidu.com; path=/" [DEBUG - 2015-05-23T05:51:13.014Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":null,"headers":[{"name":"Cache-Control","value":"max-age=0, must-revalidate"},{"name":"Date","value":"Sat, 23 May 2015 05:51:12 GMT"},{"name":"Etag","value":"20661c0706a23b25c1b8fe847b3fc48e"},{"name":"P3p","value":"CP=\"CURa ADMa DEVa PSAo PSDo OUR BUS UNI PUR INT DEM STA PRE COM NAV OTC NOI DSP COR\""},{"name":"Server","value":"apache"},{"name":"Set-Cookie","value":"HMVT=737dbb498415dd39d8abf5bc2404b290|1432360272|; Path=/; Domain=hm.baidu.com"}],"id":169,"redirectURL":null,"stage":"end","status":304,"statusText":"Not Modified","time":"2015-05-23T05:51:13.014Z","url":"http://hm.baidu.com/h.js?737dbb498415dd39d8abf5bc2404b290"} 2015-05-23T13:51:13 [DEBUG] WebPage - updateLoadingProgress: 100 [DEBUG - 2015-05-23T05:51:13.014Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _oneShotCallback - onLoadFinished [DEBUG - 2015-05-23T05:51:13.014Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - onLoadFinished: success 2015-05-23T13:51:13 [DEBUG] WebPage - setupFrame "" 2015-05-23T13:51:13 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:13 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:51:13 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:51:13 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:13 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:13 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:51:13 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:13 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:13 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360271; domain=.image.baidu.com; path=/" 2015-05-23T13:51:13 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360272|; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:13 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:51:13 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:51:13 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:13 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:51:13 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:51:13 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:13 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:13 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:51:13 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:13 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:13 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360272|; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:13 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:51:13 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:51:13 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360273; domain=.image.baidu.com; path=/" [DEBUG - 2015-05-23T05:51:13.018Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: false [DEBUG - 2015-05-23T05:51:13.018Z] SessionReqHand - _SuccessHandler - status: success 2015-05-23T13:51:13 [DEBUG] HTTP Response - Status Code 200 OK 2015-05-23T13:51:13 [DEBUG] HTTP Response - Sending Header "Cache" = "no-cache" 2015-05-23T13:51:13 [DEBUG] HTTP Response - Sending Header "Content-Length" = "74" 2015-05-23T13:51:13 [DEBUG] HTTP Response - Sending Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:51:13 [DEBUG] HTTP Request - URI /wd/hub/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source 2015-05-23T13:51:13 [DEBUG] HTTP Request - Method GET 2015-05-23T13:51:13 [DEBUG] HTTP Request - HTTP Version 1.1 2015-05-23T13:51:13 [DEBUG] HTTP Request - Query String 2015-05-23T13:51:13 [DEBUG] HTTP Request - Receiving Header "Accept-Encoding" = "identity" 2015-05-23T13:51:13 [DEBUG] HTTP Request - Receiving Header "Host" = "127.0.0.1:32999" 2015-05-23T13:51:13 [DEBUG] HTTP Request - Receiving Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:51:13 [DEBUG] HTTP Request - Receiving Header "Connection" = "close" 2015-05-23T13:51:13 [DEBUG] HTTP Request - Receiving Header "Accept" = "application/json" 2015-05-23T13:51:13 [DEBUG] HTTP Request - Receiving Header "User-Agent" = "Python-urllib/2.7" [DEBUG - 2015-05-23T05:51:13.039Z] RouterReqHand - _handle - {"headers":{"Accept":"application/json","Accept-Encoding":"identity","Connection":"close","Content-Type":"application/json;charset=UTF-8","Host":"127.0.0.1:32999","User-Agent":"Python-urllib/2.7"},"httpVersion":"1.1","method":"GET","url":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","urlParsed":{"anchor":"","query":"","file":"source","directory":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/","path":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","relative":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","port":"","host":"","password":"","user":"","userInfo":"","authority":"","protocol":"","source":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","queryKey":{},"chunks":["session","ac4aab20-010f-11e5-a1b5-e503e60d48a0","source"]}} 2015-05-23T13:51:13 [DEBUG] HTTP Response - Status Code 200 OK 2015-05-23T13:51:13 [DEBUG] HTTP Response - Sending Header "Cache" = "no-cache" 2015-05-23T13:51:13 [DEBUG] HTTP Response - Sending Header "Content-Length" = "154895" 2015-05-23T13:51:13 [DEBUG] HTTP Response - Sending Header "Content-Type" = "application/json;charset=UTF-8" [DEBUG - 2015-05-23T05:51:13.058Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"application/json, text/javascript, */*; q=0.01"},{"name":"Referer","value":"http://image.baidu.com/channel/fashion"}],"id":171,"method":"GET","time":"2015-05-23T05:51:13.057Z","url":"http://image.baidu.com/user/msg?t=1432360273056"} [DEBUG - 2015-05-23T05:51:13.058Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"application/json, text/javascript, */*; q=0.01"},{"name":"Referer","value":"http://image.baidu.com/channel/fashion"}],"id":172,"method":"GET","time":"2015-05-23T05:51:13.058Z","url":"http://image.baidu.com/user/medal?uid=0&t=1432360273058"} [DEBUG - 2015-05-23T05:51:13.076Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":98,"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:51:13 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30730768370780491786052313"},{"name":"Content-Length","value":"98"}],"id":172,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:13.076Z","url":"http://image.baidu.com/user/medal?uid=0&t=1432360273058"} [DEBUG - 2015-05-23T05:51:13.077Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:51:13 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30730768370780491786052313"},{"name":"Content-Length","value":"98"}],"id":172,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:13.077Z","url":"http://image.baidu.com/user/medal?uid=0&t=1432360273058"} [DEBUG - 2015-05-23T05:51:13.078Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":72,"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:51:13 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30730719660763714570052313"},{"name":"Content-Length","value":"72"}],"id":171,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:13.078Z","url":"http://image.baidu.com/user/msg?t=1432360273056"} [DEBUG - 2015-05-23T05:51:13.078Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:51:13 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30730719660763714570052313"},{"name":"Content-Length","value":"72"}],"id":171,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:13.078Z","url":"http://image.baidu.com/user/msg?t=1432360273056"} 2015-05-23T13:51:14 [DEBUG] HTTP Request - URI /wd/hub/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url 2015-05-23T13:51:14 [DEBUG] HTTP Request - Method POST 2015-05-23T13:51:14 [DEBUG] HTTP Request - HTTP Version 1.1 2015-05-23T13:51:14 [DEBUG] HTTP Request - Query String 2015-05-23T13:51:14 [DEBUG] HTTP Request - Receiving Header "Accept-Encoding" = "identity" 2015-05-23T13:51:14 [DEBUG] HTTP Request - Receiving Header "Content-Length" = "140" 2015-05-23T13:51:14 [DEBUG] HTTP Request - Receiving Header "Host" = "127.0.0.1:32999" 2015-05-23T13:51:14 [DEBUG] HTTP Request - Receiving Header "Accept" = "application/json" 2015-05-23T13:51:14 [DEBUG] HTTP Request - Receiving Header "User-Agent" = "Python-urllib/2.7" 2015-05-23T13:51:14 [DEBUG] HTTP Request - Receiving Header "Connection" = "close" 2015-05-23T13:51:14 [DEBUG] HTTP Request - Receiving Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:51:14 [DEBUG] HTTP Request - Method POST/PUT 2015-05-23T13:51:14 [DEBUG] HTTP Request - Content Body: {"url": "http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1", "sessionId": "ac4aab20-010f-11e5-a1b5-e503e60d48a0"} [DEBUG - 2015-05-23T05:51:14.949Z] RouterReqHand - _handle - {"headers":{"Accept":"application/json","Accept-Encoding":"identity","Connection":"close","Content-Length":"140","Content-Type":"application/json;charset=UTF-8","Host":"127.0.0.1:32999","User-Agent":"Python-urllib/2.7"},"httpVersion":"1.1","method":"POST","post":"{\"url\": \"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1\", \"sessionId\": \"ac4aab20-010f-11e5-a1b5-e503e60d48a0\"}","url":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","urlParsed":{"anchor":"","query":"","file":"url","directory":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/","path":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","relative":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","port":"","host":"","password":"","user":"","userInfo":"","authority":"","protocol":"","source":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","queryKey":{},"chunks":["session","ac4aab20-010f-11e5-a1b5-e503e60d48a0","url"]}} [DEBUG - 2015-05-23T05:51:14.950Z] SessionReqHand - _postUrlCommand - Session 'ac4aab20-010f-11e5-a1b5-e503e60d48a0' is about to load URL: http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1 2015-05-23T13:51:14 [DEBUG] WebPage - updateLoadingProgress: 10 [DEBUG - 2015-05-23T05:51:14.950Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8"}],"id":173,"method":"GET","time":"2015-05-23T05:51:14.950Z","url":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"} [DEBUG - 2015-05-23T05:51:14.961Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360272|; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:51:13 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360273; domain=.image.baidu.com; path=/" [DEBUG - 2015-05-23T05:51:15.061Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true [DEBUG - 2015-05-23T05:51:15.161Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true [DEBUG - 2015-05-23T05:51:15.174Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":85284,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Set-Cookie","value":"userid=deleted; expires=Fri, 23-May-2014 05:51:13 GMT; path=/"},{"name":"Tracecode","value":"30749647510763714570052313"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Transfer-Encoding","value":"chunked"}],"id":173,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.174Z","url":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"} [DEBUG - 2015-05-23T05:51:15.175Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Cache-Control","value":"max-age=0"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Referer","value":"http://image.baidu.com/channel/fashion"},{"name":"Accept","value":"*/*"}],"id":174,"method":"GET","time":"2015-05-23T05:51:15.175Z","url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=2160%2C2160&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=1515038212&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3"} 2015-05-23T13:51:15 [DEBUG] WebPage - setupFrame "" 2015-05-23T13:51:15 [DEBUG] WebPage - updateLoadingProgress: 30 2015-05-23T13:51:15 [DEBUG] WebPage - updateLoadingProgress: 44 [DEBUG - 2015-05-23T05:51:15.255Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"}],"id":175,"method":"GET","time":"2015-05-23T05:51:15.255Z","url":"http://image.baidu.com/detail/info?fr=channel&tag1=%E5%8A%A8%E6%BC%AB&tag2=%E5%85%A8%E9%83%A8&column=%E5%8A%A8%E6%BC%AB&tag=%E5%85%A8%E9%83%A8&ie=utf-8&oe=utf-8&word=1&t=1432360275254"} [DEBUG - 2015-05-23T05:51:15.265Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Origin","value":"http://image.baidu.com"},{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Content-Type","value":"application/x-www-form-urlencoded; charset=UTF-8"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"},{"name":"Content-Length","value":"17"}],"id":176,"method":"POST","time":"2015-05-23T05:51:15.265Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.265Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Origin","value":"http://image.baidu.com"},{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Content-Type","value":"application/x-www-form-urlencoded; charset=UTF-8"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"},{"name":"Content-Length","value":"16"}],"id":177,"method":"POST","time":"2015-05-23T05:51:15.265Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.266Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Origin","value":"http://image.baidu.com"},{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Content-Type","value":"application/x-www-form-urlencoded; charset=UTF-8"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"},{"name":"Content-Length","value":"17"}],"id":178,"method":"POST","time":"2015-05-23T05:51:15.266Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.266Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Origin","value":"http://image.baidu.com"},{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Content-Type","value":"application/x-www-form-urlencoded; charset=UTF-8"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"},{"name":"Content-Length","value":"17"}],"id":179,"method":"POST","time":"2015-05-23T05:51:15.266Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.267Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Origin","value":"http://image.baidu.com"},{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Content-Type","value":"application/x-www-form-urlencoded; charset=UTF-8"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"},{"name":"Content-Length","value":"18"}],"id":180,"method":"POST","time":"2015-05-23T05:51:15.267Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.267Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Origin","value":"http://image.baidu.com"},{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Content-Type","value":"application/x-www-form-urlencoded; charset=UTF-8"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"},{"name":"Content-Length","value":"16"}],"id":181,"method":"POST","time":"2015-05-23T05:51:15.267Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.267Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Origin","value":"http://image.baidu.com"},{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Content-Type","value":"application/x-www-form-urlencoded; charset=UTF-8"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"},{"name":"Content-Length","value":"17"}],"id":182,"method":"POST","time":"2015-05-23T05:51:15.267Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.268Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Origin","value":"http://image.baidu.com"},{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Content-Type","value":"application/x-www-form-urlencoded; charset=UTF-8"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"},{"name":"Content-Length","value":"18"}],"id":183,"method":"POST","time":"2015-05-23T05:51:15.268Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.268Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Origin","value":"http://image.baidu.com"},{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Content-Type","value":"application/x-www-form-urlencoded; charset=UTF-8"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"},{"name":"Content-Length","value":"17"}],"id":184,"method":"POST","time":"2015-05-23T05:51:15.268Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.269Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Origin","value":"http://image.baidu.com"},{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Content-Type","value":"application/x-www-form-urlencoded; charset=UTF-8"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"},{"name":"Content-Length","value":"17"}],"id":185,"method":"POST","time":"2015-05-23T05:51:15.268Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.269Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Origin","value":"http://image.baidu.com"},{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Content-Type","value":"application/x-www-form-urlencoded; charset=UTF-8"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"},{"name":"Content-Length","value":"18"}],"id":186,"method":"POST","time":"2015-05-23T05:51:15.269Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.269Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Origin","value":"http://image.baidu.com"},{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Content-Type","value":"application/x-www-form-urlencoded; charset=UTF-8"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"},{"name":"Content-Length","value":"17"}],"id":187,"method":"POST","time":"2015-05-23T05:51:15.269Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.270Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Origin","value":"http://image.baidu.com"},{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Content-Type","value":"application/x-www-form-urlencoded; charset=UTF-8"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"},{"name":"Content-Length","value":"18"}],"id":188,"method":"POST","time":"2015-05-23T05:51:15.270Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.270Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Origin","value":"http://image.baidu.com"},{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Content-Type","value":"application/x-www-form-urlencoded; charset=UTF-8"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"},{"name":"Content-Length","value":"18"}],"id":189,"method":"POST","time":"2015-05-23T05:51:15.270Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.272Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Origin","value":"http://image.baidu.com"},{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Content-Type","value":"application/x-www-form-urlencoded; charset=UTF-8"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"},{"name":"Content-Length","value":"18"}],"id":190,"method":"POST","time":"2015-05-23T05:51:15.272Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.273Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Origin","value":"http://image.baidu.com"},{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Content-Type","value":"application/x-www-form-urlencoded; charset=UTF-8"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"},{"name":"Content-Length","value":"18"}],"id":191,"method":"POST","time":"2015-05-23T05:51:15.273Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.273Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Origin","value":"http://image.baidu.com"},{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Content-Type","value":"application/x-www-form-urlencoded; charset=UTF-8"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"},{"name":"Content-Length","value":"18"}],"id":192,"method":"POST","time":"2015-05-23T05:51:15.273Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.274Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Origin","value":"http://image.baidu.com"},{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Content-Type","value":"application/x-www-form-urlencoded; charset=UTF-8"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"},{"name":"Content-Length","value":"17"}],"id":193,"method":"POST","time":"2015-05-23T05:51:15.274Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.274Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Origin","value":"http://image.baidu.com"},{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Content-Type","value":"application/x-www-form-urlencoded; charset=UTF-8"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"},{"name":"Content-Length","value":"17"}],"id":194,"method":"POST","time":"2015-05-23T05:51:15.274Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.274Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"Origin","value":"http://image.baidu.com"},{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Content-Type","value":"application/x-www-form-urlencoded; charset=UTF-8"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"},{"name":"Content-Length","value":"18"}],"id":195,"method":"POST","time":"2015-05-23T05:51:15.274Z","url":"http://image.baidu.com/albumlist/getlike"} 2015-05-23T13:51:15 [DEBUG] WebPage - updateLoadingProgress: 55 [DEBUG - 2015-05-23T05:51:15.325Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"}],"id":196,"method":"GET","time":"2015-05-23T05:51:15.325Z","url":"http://image.baidu.com/channel/favdownload?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1&t3=&idlist=9421289371%2C9420585969%2C9628641263%2C9387498651%2C9421097071%2C9621440012%2C9385548780%2C9420745179%2C9620508755%2C9433097486%2C9554047603%2C9399468471%2C9554752920%2C9557663128%2C9430700999%2C9531380380%2C11187392075%2C9628644841%2C9387498794%2C9521553516%2C9353679627%2C9539105403%2C9387403595%2C9386701871%2C9433097474%2C9534172115%2C9419343822%2C9632052808%2C4854176596%2C9430669625"} [DEBUG - 2015-05-23T05:51:15.338Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"*/*"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"},{"name":"If-None-Match","value":"20661c0706a23b25c1b8fe847b3fc48e"}],"id":197,"method":"GET","time":"2015-05-23T05:51:15.338Z","url":"http://hm.baidu.com/h.js?737dbb498415dd39d8abf5bc2404b290"} 2015-05-23T13:51:15 [DEBUG] WebPage - updateLoadingProgress: 67 [DEBUG - 2015-05-23T05:51:15.339Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Set-Cookie","value":"userid=deleted; expires=Fri, 23-May-2014 05:51:13 GMT; path=/"},{"name":"Tracecode","value":"30749647510763714570052313"},{"name":"Vary","value":"Accept-Encoding"},{"name":"Transfer-Encoding","value":"chunked"}],"id":173,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.339Z","url":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"} [DEBUG - 2015-05-23T05:51:15.358Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":43,"contentType":"image/gif","headers":[{"name":"Cache-Control","value":"private, max-age=0, no-cache"},{"name":"Content-Length","value":"43"},{"name":"Content-Type","value":"image/gif"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Pragma","value":"no-cache"},{"name":"Server","value":"apache"},{"name":"X-Content-Type-Options","value":"nosniff"}],"id":174,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.358Z","url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=2160%2C2160&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=1515038212&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3"} 2015-05-23T13:51:15 [DEBUG] Network - Resource request error: 5 ( "Operation canceled" ) URL: "http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=2160,2160&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=1515038212&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3" [DEBUG - 2015-05-23T05:51:15.358Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceError - {"errorCode":5,"errorString":"Operation canceled","id":174,"url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=2160,2160&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=1515038212&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3"} [DEBUG - 2015-05-23T05:51:15.358Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"image/gif","headers":[{"name":"Cache-Control","value":"private, max-age=0, no-cache"},{"name":"Content-Length","value":"43"},{"name":"Content-Type","value":"image/gif"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Pragma","value":"no-cache"},{"name":"Server","value":"apache"},{"name":"X-Content-Type-Options","value":"nosniff"}],"id":174,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.358Z","url":"http://log.hm.baidu.com/hm.gif?cc=1&ck=1&cl=32-bit&ds=1024x768&ep=2160%2C2160&et=3&ja=0&ln=en-US&lo=0<=1432360254&nv=0&rnd=1515038212&si=737dbb498415dd39d8abf5bc2404b290&st=4&v=1.0.92&lv=3"} [DEBUG - 2015-05-23T05:51:15.363Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true [DEBUG - 2015-05-23T05:51:15.364Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":3600,"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30752740330780491786052313"},{"name":"Transfer-Encoding","value":"chunked"}],"id":175,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.364Z","url":"http://image.baidu.com/detail/info?fr=channel&tag1=%E5%8A%A8%E6%BC%AB&tag2=%E5%85%A8%E9%83%A8&column=%E5%8A%A8%E6%BC%AB&tag=%E5%85%A8%E9%83%A8&ie=utf-8&oe=utf-8&word=1&t=1432360275254"} 2015-05-23T13:51:15 [DEBUG] WebPage - updateLoadingProgress: 70 [DEBUG - 2015-05-23T05:51:15.364Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30752740330780491786052313"},{"name":"Transfer-Encoding","value":"chunked"}],"id":175,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.364Z","url":"http://image.baidu.com/detail/info?fr=channel&tag1=%E5%8A%A8%E6%BC%AB&tag2=%E5%85%A8%E9%83%A8&column=%E5%8A%A8%E6%BC%AB&tag=%E5%85%A8%E9%83%A8&ie=utf-8&oe=utf-8&word=1&t=1432360275254"} [DEBUG - 2015-05-23T05:51:15.366Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":3120,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30753382660210131978052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":196,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.366Z","url":"http://image.baidu.com/channel/favdownload?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1&t3=&idlist=9421289371%2C9420585969%2C9628641263%2C9387498651%2C9421097071%2C9621440012%2C9385548780%2C9420745179%2C9620508755%2C9433097486%2C9554047603%2C9399468471%2C9554752920%2C9557663128%2C9430700999%2C9531380380%2C11187392075%2C9628644841%2C9387498794%2C9521553516%2C9353679627%2C9539105403%2C9387403595%2C9386701871%2C9433097474%2C9534172115%2C9419343822%2C9632052808%2C4854176596%2C9430669625"} 2015-05-23T13:51:15 [DEBUG] WebPage - updateLoadingProgress: 73 [DEBUG - 2015-05-23T05:51:15.366Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30753382660210131978052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":196,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.366Z","url":"http://image.baidu.com/channel/favdownload?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1&t3=&idlist=9421289371%2C9420585969%2C9628641263%2C9387498651%2C9421097071%2C9621440012%2C9385548780%2C9420745179%2C9620508755%2C9433097486%2C9554047603%2C9399468471%2C9554752920%2C9557663128%2C9430700999%2C9531380380%2C11187392075%2C9628644841%2C9387498794%2C9521553516%2C9353679627%2C9539105403%2C9387403595%2C9386701871%2C9433097474%2C9534172115%2C9419343822%2C9632052808%2C4854176596%2C9430669625"} [DEBUG - 2015-05-23T05:51:15.386Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":101,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30753780670277240842052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":178,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.386Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.386Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30753780670277240842052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":178,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.386Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.387Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":101,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30753793640277240842052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":179,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.387Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.388Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30753793640277240842052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":179,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.387Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.389Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":100,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30753807940210131978052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":181,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.389Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.389Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":100,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30753783790747002890052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":177,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.389Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.390Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30753807940210131978052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":181,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.389Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.390Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30753783790747002890052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":177,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.390Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.394Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":101,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30753798160277240842052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":176,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.394Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.394Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30753798160277240842052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":176,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.394Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.397Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":103,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30753790780746937354052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":180,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.397Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.397Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30753790780746937354052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":180,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.397Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.410Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":103,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30753989480294018058052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":182,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.410Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.411Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30753989480294018058052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":182,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.411Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.413Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":102,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30754033970864443402052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":185,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.412Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.413Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30754033970864443402052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":185,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.413Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.413Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":101,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30754031190277240842052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":184,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.413Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.413Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30754031190277240842052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":184,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.413Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.416Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":103,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30754074110713448458052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":186,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.416Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.416Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30754074110713448458052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":186,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.416Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.417Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":102,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30753996240294018058052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":183,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.417Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.417Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30753996240294018058052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":183,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.417Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.421Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":101,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30754139370763714570052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":187,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.421Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.421Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30754139370763714570052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":187,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.421Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.433Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":102,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30754244960294018058052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":190,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.433Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.433Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30754244960294018058052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":190,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.433Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.436Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":103,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30754264160310795274052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":188,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.436Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.436Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30754264160310795274052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":188,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.436Z","url":"http://image.baidu.com/albumlist/getlike"} 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:51:13 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360273; domain=.image.baidu.com; path=/" 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360275|; domain=.hm.baidu.com; path=/" [DEBUG - 2015-05-23T05:51:15.441Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":null,"headers":[{"name":"Cache-Control","value":"max-age=0, must-revalidate"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Etag","value":"20661c0706a23b25c1b8fe847b3fc48e"},{"name":"P3p","value":"CP=\"CURa ADMa DEVa PSAo PSDo OUR BUS UNI PUR INT DEM STA PRE COM NAV OTC NOI DSP COR\""},{"name":"Server","value":"apache"},{"name":"Set-Cookie","value":"HMVT=737dbb498415dd39d8abf5bc2404b290|1432360275|; Path=/; Domain=hm.baidu.com"}],"id":197,"redirectURL":null,"stage":"end","status":304,"statusText":"Not Modified","time":"2015-05-23T05:51:15.441Z","url":"http://hm.baidu.com/h.js?737dbb498415dd39d8abf5bc2404b290"} 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360273; domain=.image.baidu.com; path=/" 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360275|; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:51:15 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "HMACCOUNT=8A6AC9A3FED60621; expires=Mon, 18-Jan-2038 00:00:00 GMT; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "BAIDUID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 22-May-2016 05:50:53 GMT; domain=.baidu.com; path=/" 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "BDV_TRACE=1432360254685:; expires=Sat, 30-May-2015 05:50:54 GMT; domain=v.baidu.com; path=/" 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "mc_2015-05-23="1140@1"; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "PUSH_TIMESTAMP=1432360254875; expires=Sat, 23-May-2015 06:50:54 GMT; domain=bubble.baidu.com; path=/rs/message/" 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "LDID=8853D1664B0E04464AB1DB64BBF57918:FG=1; expires=Fri, 16-Feb-2018 05:50:55 GMT; domain=pos.baidu.com; path=/" 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "ISBID=1429799A83F7710AA238AA6C05FFA47F:FG=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "ISUS=1; expires=Sun, 24-May-2015 05:50:55 GMT; domain=cb.baidu.com; path=/" 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "HMVT=737dbb498415dd39d8abf5bc2404b290|1432360275|; domain=.hm.baidu.com; path=/" 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "Hm_lvt_737dbb498415dd39d8abf5bc2404b290=1432360027,1432360114,1432360172,1432360254; expires=Sun, 22-May-2016 05:51:15 GMT; domain=.image.baidu.com; path=/" 2015-05-23T13:51:15 [DEBUG] CookieJar - Saved "Hm_lpvt_737dbb498415dd39d8abf5bc2404b290=1432360275; domain=.image.baidu.com; path=/" [DEBUG - 2015-05-23T05:51:15.445Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":102,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30754329060310795274052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":192,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.445Z","url":"http://image.baidu.com/albumlist/getlike"} 2015-05-23T13:51:15 [DEBUG] WebPage - updateLoadingProgress: 82 [DEBUG - 2015-05-23T05:51:15.445Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":101,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30754422350780491786052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":193,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.445Z","url":"http://image.baidu.com/albumlist/getlike"} 2015-05-23T13:51:15 [DEBUG] WebPage - updateLoadingProgress: 85 [DEBUG - 2015-05-23T05:51:15.445Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30754329060310795274052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":192,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.445Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.446Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30754422350780491786052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":193,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.446Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.446Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":102,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30754257920881220618052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":189,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.446Z","url":"http://image.baidu.com/albumlist/getlike"} 2015-05-23T13:51:15 [DEBUG] WebPage - updateLoadingProgress: 87 [DEBUG - 2015-05-23T05:51:15.446Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30754257920881220618052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":189,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.446Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.447Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":103,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30754315350864443402052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":191,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.447Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.447Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30754315350864443402052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":191,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.447Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.455Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"application/json, text/javascript, */*; q=0.01"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"}],"id":198,"method":"GET","time":"2015-05-23T05:51:15.455Z","url":"http://image.baidu.com/user/msg?t=1432360275455"} [DEBUG - 2015-05-23T05:51:15.456Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"X-Requested-With","value":"XMLHttpRequest"},{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"application/json, text/javascript, */*; q=0.01"},{"name":"Referer","value":"http://image.baidu.com/channel?c=%E5%8A%A8%E6%BC%AB&t=%E5%85%A8%E9%83%A8&s=1"}],"id":199,"method":"GET","time":"2015-05-23T05:51:15.456Z","url":"http://image.baidu.com/user/medal?uid=0&t=1432360275456"} [DEBUG - 2015-05-23T05:51:15.462Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":101,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30754457880713448458052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":194,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.462Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.462Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30754457880713448458052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":194,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.462Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.463Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true [DEBUG - 2015-05-23T05:51:15.463Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":104,"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30754483510713448458052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":195,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.463Z","url":"http://image.baidu.com/albumlist/getlike"} 2015-05-23T13:51:15 [DEBUG] WebPage - updateLoadingProgress: 90 [DEBUG - 2015-05-23T05:51:15.464Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"text/html","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Encoding","value":"gzip"},{"name":"Content-Type","value":"text/html"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30754483510713448458052313"},{"name":"Vary","value":"Accept-Encoding"}],"id":195,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.464Z","url":"http://image.baidu.com/albumlist/getlike"} [DEBUG - 2015-05-23T05:51:15.476Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":72,"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30754664430713448458052313"},{"name":"Content-Length","value":"72"}],"id":198,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.476Z","url":"http://image.baidu.com/user/msg?t=1432360275455"} [DEBUG - 2015-05-23T05:51:15.476Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30754664430713448458052313"},{"name":"Content-Length","value":"72"}],"id":198,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.476Z","url":"http://image.baidu.com/user/msg?t=1432360275455"} [DEBUG - 2015-05-23T05:51:15.480Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"bodySize":98,"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30754694870797269002052313"},{"name":"Content-Length","value":"98"}],"id":199,"redirectURL":null,"stage":"start","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.480Z","url":"http://image.baidu.com/user/medal?uid=0&t=1432360275456"} [DEBUG - 2015-05-23T05:51:15.480Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceReceived - {"contentType":"application/json; charset=utf-8;","headers":[{"name":"Connection","value":"keep-alive"},{"name":"Content-Type","value":"application/json; charset=utf-8;"},{"name":"Date","value":"Sat, 23 May 2015 05:51:15 GMT"},{"name":"Server","value":"Apache"},{"name":"Tracecode","value":"30754694870797269002052313"},{"name":"Content-Length","value":"98"}],"id":199,"redirectURL":null,"stage":"end","status":200,"statusText":"OK","time":"2015-05-23T05:51:15.480Z","url":"http://image.baidu.com/user/medal?uid=0&t=1432360275456"} 2015-05-23T13:51:15 [DEBUG] WebPage - updateLoadingProgress: 100 [DEBUG - 2015-05-23T05:51:15.480Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _oneShotCallback - onLoadFinished [DEBUG - 2015-05-23T05:51:15.480Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - onLoadFinished: success 2015-05-23T13:51:15 [DEBUG] WebPage - setupFrame "" [DEBUG - 2015-05-23T05:51:15.563Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: false [DEBUG - 2015-05-23T05:51:15.563Z] SessionReqHand - _SuccessHandler - status: success 2015-05-23T13:51:15 [DEBUG] HTTP Response - Status Code 200 OK 2015-05-23T13:51:15 [DEBUG] HTTP Response - Sending Header "Cache" = "no-cache" 2015-05-23T13:51:15 [DEBUG] HTTP Response - Sending Header "Content-Length" = "74" 2015-05-23T13:51:15 [DEBUG] HTTP Response - Sending Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:51:15 [DEBUG] HTTP Request - URI /wd/hub/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source 2015-05-23T13:51:15 [DEBUG] HTTP Request - Method GET 2015-05-23T13:51:15 [DEBUG] HTTP Request - HTTP Version 1.1 2015-05-23T13:51:15 [DEBUG] HTTP Request - Query String 2015-05-23T13:51:15 [DEBUG] HTTP Request - Receiving Header "Accept-Encoding" = "identity" 2015-05-23T13:51:15 [DEBUG] HTTP Request - Receiving Header "Host" = "127.0.0.1:32999" 2015-05-23T13:51:15 [DEBUG] HTTP Request - Receiving Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:51:15 [DEBUG] HTTP Request - Receiving Header "Connection" = "close" 2015-05-23T13:51:15 [DEBUG] HTTP Request - Receiving Header "Accept" = "application/json" 2015-05-23T13:51:15 [DEBUG] HTTP Request - Receiving Header "User-Agent" = "Python-urllib/2.7" [DEBUG - 2015-05-23T05:51:15.565Z] RouterReqHand - _handle - {"headers":{"Accept":"application/json","Accept-Encoding":"identity","Connection":"close","Content-Type":"application/json;charset=UTF-8","Host":"127.0.0.1:32999","User-Agent":"Python-urllib/2.7"},"httpVersion":"1.1","method":"GET","url":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","urlParsed":{"anchor":"","query":"","file":"source","directory":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/","path":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","relative":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","port":"","host":"","password":"","user":"","userInfo":"","authority":"","protocol":"","source":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/source","queryKey":{},"chunks":["session","ac4aab20-010f-11e5-a1b5-e503e60d48a0","source"]}} 2015-05-23T13:51:15 [DEBUG] HTTP Response - Status Code 200 OK 2015-05-23T13:51:15 [DEBUG] HTTP Response - Sending Header "Cache" = "no-cache" 2015-05-23T13:51:15 [DEBUG] HTTP Response - Sending Header "Content-Length" = "551383" 2015-05-23T13:51:15 [DEBUG] HTTP Response - Sending Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:51:19 [DEBUG] HTTP Request - URI /wd/hub/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url 2015-05-23T13:51:19 [DEBUG] HTTP Request - Method POST 2015-05-23T13:51:19 [DEBUG] HTTP Request - HTTP Version 1.1 2015-05-23T13:51:19 [DEBUG] HTTP Request - Query String 2015-05-23T13:51:19 [DEBUG] HTTP Request - Receiving Header "Accept-Encoding" = "identity" 2015-05-23T13:51:19 [DEBUG] HTTP Request - Receiving Header "Content-Length" = "164" 2015-05-23T13:51:19 [DEBUG] HTTP Request - Receiving Header "Host" = "127.0.0.1:32999" 2015-05-23T13:51:19 [DEBUG] HTTP Request - Receiving Header "Accept" = "application/json" 2015-05-23T13:51:19 [DEBUG] HTTP Request - Receiving Header "User-Agent" = "Python-urllib/2.7" 2015-05-23T13:51:19 [DEBUG] HTTP Request - Receiving Header "Connection" = "close" 2015-05-23T13:51:19 [DEBUG] HTTP Request - Receiving Header "Content-Type" = "application/json;charset=UTF-8" 2015-05-23T13:51:19 [DEBUG] HTTP Request - Method POST/PUT 2015-05-23T13:51:19 [DEBUG] HTTP Request - Content Body: {"url": "http://image.baidu.com/channel/travel#%E7%83%AD%E9%97%A8%E6%8E%A8%E8%8D%90&%E5%85%A8%E9%83%A8&null&0", "sessionId": "ac4aab20-010f-11e5-a1b5-e503e60d48a0"} [DEBUG - 2015-05-23T05:51:19.359Z] RouterReqHand - _handle - {"headers":{"Accept":"application/json","Accept-Encoding":"identity","Connection":"close","Content-Length":"164","Content-Type":"application/json;charset=UTF-8","Host":"127.0.0.1:32999","User-Agent":"Python-urllib/2.7"},"httpVersion":"1.1","method":"POST","post":"{\"url\": \"http://image.baidu.com/channel/travel#%E7%83%AD%E9%97%A8%E6%8E%A8%E8%8D%90&%E5%85%A8%E9%83%A8&null&0\", \"sessionId\": \"ac4aab20-010f-11e5-a1b5-e503e60d48a0\"}","url":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","urlParsed":{"anchor":"","query":"","file":"url","directory":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/","path":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","relative":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","port":"","host":"","password":"","user":"","userInfo":"","authority":"","protocol":"","source":"/session/ac4aab20-010f-11e5-a1b5-e503e60d48a0/url","queryKey":{},"chunks":["session","ac4aab20-010f-11e5-a1b5-e503e60d48a0","url"]}} [DEBUG - 2015-05-23T05:51:19.360Z] SessionReqHand - _postUrlCommand - Session 'ac4aab20-010f-11e5-a1b5-e503e60d48a0' is about to load URL: http://image.baidu.com/channel/travel#%E7%83%AD%E9%97%A8%E6%8E%A8%E8%8D%90&%E5%85%A8%E9%83%A8&null&0 2015-05-23T13:51:19 [DEBUG] WebPage - updateLoadingProgress: 10 [DEBUG - 2015-05-23T05:51:19.361Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - page.onResourceRequested - {"headers":[{"name":"User-Agent","value":"Scrapy/0.24.5 (+http://scrapy.org)"},{"name":"Accept","value":"text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8"}],"id":200,"method":"GET","time":"2015-05-23T05:51:19.361Z","url":"http://image.baidu.com/channel/travel#%E7%83%AD%E9%97%A8%E6%8E%A8%E8%8D%90&%E5%85%A8%E9%83%A8&null&0"} [DEBUG - 2015-05-23T05:51:19.371Z] Session [ac4aab20-010f-11e5-a1b5-e503e60d48a0] - _execFuncAndWaitForLoadDecorator - Page Loading in Session: true