爬蟲程序無法正常運(yùn)行
? ? obj_spider.craw(root_url) 這一行總是報(bào)錯(cuò)，我仔細(xì)檢查了一下代碼不知道哪里有問題，爬出來的結(jié)果全是craw failed
mugichya
2016-07-19
3 回答
舉報(bào)
0/150
提交
取消
2016-07-31
怎么在Eclipse的PyDev中使用debug
2016-07-28
craw的方法中有root_url這個(gè)參數(shù)嗎？
2016-07-28
沒遇見過，你使用debug了嗎
def?craw(self,root_url): ????????count?=?1 ????????self.urls.add_new_url(root_url) ????????while?self.urls.has_new_url(): ????????????try: ????????????????new_url?=?self.urls.get_new_url() ????????????????print('craw?%d?:?%s'?%(count,new_url)) ????????????????html_cont?=?self.downloader.download(new_url) ????????????????new_urls,new_data?=?self.parser.parse(new_url,html_cont) ????????????????self.urls.add_new_urls(new_urls) ????????????????self.outputer.collect_data(new_data) ????????????????if?count?==?10: ????????????????????break ????????????????count?=?count?+?1 ????????????except?Exception?as?e: ????????????????print('craw?failed',e)???? ????????self.outputer.output_html()在craw中有root_url這個(gè)參數(shù)嗎？