Python3
html頁面出現(xiàn)亂碼,解決方法:
1)打開文件時加上編碼:
fout = open('output.html', 'w', encoding='utf-8')
2)視頻中在寫入標題和內(nèi)容時加入了編碼轉(zhuǎn)換,去掉,不要加,直接這樣寫:
fout.write("<td>%s</td>" % data['title'])
html頁面出現(xiàn)亂碼,解決方法:
1)打開文件時加上編碼:
fout = open('output.html', 'w', encoding='utf-8')
2)視頻中在寫入標題和內(nèi)容時加入了編碼轉(zhuǎn)換,去掉,不要加,直接這樣寫:
fout.write("<td>%s</td>" % data['title'])
2018-04-28
第二條就沒有了的朋友,是因為百度改規(guī)則了,你們老是去爬。
html_parser 找到這里,改成: links = soup.find_all('a', href=re.compile(r"/item/.*"))
就可以了。
html_parser 找到這里,改成: links = soup.find_all('a', href=re.compile(r"/item/.*"))
就可以了。
2018-04-24
File "E:/python_work/Spider/baike_spider/spider_main.py", line 35, in <module>
obj_spider.craw(root_url)
File "E:/python_work/Spider/baike_spider/spider_main.py", line 13, in craw
self.urls.add_new_url(root_url)
AttributeError: 'SpiderMain' object has no attribute 'urls'
obj_spider.craw(root_url)
File "E:/python_work/Spider/baike_spider/spider_main.py", line 13, in craw
self.urls.add_new_url(root_url)
AttributeError: 'SpiderMain' object has no attribute 'urls'
2018-04-23
我的環(huán)境:
Mac OS X ,pyCharm, Chrom,Python 3.6.5
我的鏈接:
https://github.com/TheoKm/Baike_Spider#baike_spider
Mac OS X ,pyCharm, Chrom,Python 3.6.5
我的鏈接:
https://github.com/TheoKm/Baike_Spider#baike_spider
2018-04-21
首先肯定明磊大佬的說法。
即使去掉encoding:'uft-8'依然報錯,參見:https://bytes.com/topic/python/answers/556312-lookuperror-unknown-encoding-utf-8-a。
f.write('<td>{0}</td>' .format(data['url']))
f.write('<td>{0}</td>' .format(data['title']))
f.write('<td>{0}</td>' .format(data['summary']))
即使去掉encoding:'uft-8'依然報錯,參見:https://bytes.com/topic/python/answers/556312-lookuperror-unknown-encoding-utf-8-a。
f.write('<td>{0}</td>' .format(data['url']))
f.write('<td>{0}</td>' .format(data['title']))
f.write('<td>{0}</td>' .format(data['summary']))
2018-04-21