                        課程
                    
                        /后端開(kāi)發(fā)
                        
                            /Python
                        
                        /Python開(kāi)發(fā)簡(jiǎn)單爬蟲(chóng)

爬蟲(chóng)這課程的代碼呢？

沒(méi)有老師的代碼？全是思路？？？？

韓Shaw

2018-01-22

源自：Python開(kāi)發(fā)簡(jiǎn)單爬蟲(chóng) 5-1

關(guān)注問(wèn)題我要回答

1508

操作

收起

2 回答

chenjunjie 回答被采納 +2 積分
2018-01-22

#?coding:utf8
import?urllib2
import?cookielib

url="http://www1.szu.edu.cn"

print?"第一種方法"
response1=urllib2.urlopen(url)
print?response1.getcode()
print?len(response1.read())


print?"第二種方法"
request=urllib2.Request(url)?
request.add_header("user-agent",?"Mozilla/5.0?")
response2=urllib2.urlopen(request)
print?response2.getcode()
print?len(response2.read())


print?"第三種方法"
cj=cookielib.CookieJar()
opener=urllib2.build_opener(urllib2.HTTPCookieProcessor(cj))
urllib2.install_opener(opener)
response3=urllib2.urlopen(url)
print?response3.getcode()
print?cj
print?response3.read()