我想在這個頁面中抓取所有這些電影評論。 紅圈的哪一部分我試圖用這段代碼爬行。（我用的是Jupiter Notebook-Anaconda3）import requestsfrom bs4 import BeautifulSouptest_url = "https://movie.naver.com/movie/bi/mi/pointWriteFormList.nhn?code=174903&type=after&page=1"resp = requests.get(test_url)soup = BeautifulSoup(resp.content, 'html.parser')soupscore_result = soup.find('div', {'class': 'score_result'})lis = score_result.findAll('li')lis[:3]from urllib.request import urljoin #When I ran this block and next block it didn't save any reviews.review_text=[]#review_text = lis[0].find('p').getText()list_soup =soup.find_all('li', 'p')for item in list_soup:review_text.append(item.find('p').get_text())review_text[:5] #Nothing was saved.正如我在第三塊和第四塊中所寫的那樣，沒有任何保存。問題是什么？
1 回答
慕村9548890
TA貢獻1884條經(jīng)驗 獲得超4個贊
這將得到你想要的。在 Jupyter Notebook 中的 python 中測試（最新）
import requests
from bs4 import BeautifulSoup
from bs4.element import NavigableString
test_url = "https://movie.naver.com/movie/bi/mi/pointWriteFormList.nhn?code=174903&type=after&page=1"
resp = requests.get(test_url)
soup = BeautifulSoup(resp.content, 'html.parser')
movie_lst = soup.select_one('div.score_result')
ul_movie_lst = movie_lst.ul
for movie in ul_movie_lst:
if isinstance(movie, NavigableString):
continue
score = movie.select_one('div.star_score em').text
name = movie.select_one('div.score_reple p span').text
review = movie.select_one('div.score_reple dl dt em a span').text
print(score + "\t" + name)
print("\t" + review)
添加回答
舉報
0/150
提交
取消