你和我遇到的問題一樣 ?主要是縮進(jìn)問題；我現(xiàn)在只能出一條就停止了。

new_urls, new_data = self.parser.parser(new_url, html_cont)

這句代碼怎么理解，分別給new_urls,new_data復(fù)制么？

http://baike.baidu.com/link?url=sP2Dq8raiXUsDeUd8GbiC1C1HcvMO8I8dkoUi5UcIiDwFckEBG9G4KHTKVsCPWoPh1y4LDZZKtEeIA59EYISx_

換成http://baike.baidu.com/view/4072022.htm

#conding:utf8
from spirder import manager, downloader, parser, output


class spirdermain(object):
??? def __init__(self):
??????? self.manager=manager.UrlManager()
??????? self.downloader=downloader.HtmlDownloader()
??????? self.parser=parser.HtmlParser()
??????? self.output=output.HtmlOutput()
?????? ?
??? def craw(self, root_url):
??????? count=1
??????? self.manager.add_new_url(root_url)
??????? while self.manager.has_new_url():
??????????? try:
??????????????? new_url=self.manager.get_new_url()
??????????????? print 'craw %d:%s'%(count,new_url)
??????????????? html_cont=self.downloader.downloader(new_url)
??????????????? new_urls,new_data=self.parser.parser(new_url,html_cont)
??????????????? self.manager.add_new_urls(new_urls)
??????????????? self.output.collect_data(new_data)
??????????????? if count==1000:
??????????????????? break
??????????????? count=count+1
??????????? except:
??????????????? print 'craw failed'
??????? self.output.output_html()?? ?

if __name__=="_main_":
??? root_url="http://baike.baidu.com/link?url=sP2Dq8raiXUsDeUd8GbiC1C1HcvMO8I8dkoUi5UcIiDwFckEBG9G4KHTKVsCPWoPh1y4LDZZKtEeIA59EYISx_"
??? obj_spirder=spirdermain()
??? obj_spirder.craw(root_url)

額，這是代碼。。。。。英文打錯(cuò)了，打成spirder了，但是應(yīng)該沒問題的