我正在使用美麗湯和python來抓取網(wǎng)頁，并僅從網(wǎng)站中提取段落標簽中的文本。這是我想抓取的頁面我想要所有段落標簽中的所有文本。
1 回答
慕沐林林
TA貢獻2016條經(jīng)驗 獲得超9個贊
始終使用硒作為節(jié)省資源的最后手段。
from selenium import webdriver
url = 'https://www.who.int/csr/disease/coronavirus_infections/faq_dec12/en/'
driver = webdriver.Chrome()
try:
driver.get(url)
div_text = driver.find_element_by_id('primary').text
with open('website_content.txt','w') as f:
f.write(div_text)
except Exception as e:
print(e)
finally:
if driver is not None:
driver.close()
你可以通過要求和美麗的湯來實現(xiàn)同樣的事情，如下所示：
import requests as rq
from bs4 import BeautifulSoup
response = rq.get(url)
if response.status_code == 200:
soup = BeautifulSoup(response.text,'html.parser')
div_text = soup.find('div',{'id':'primary'}).text
with open('website_content.txt','w') as f:
f.write(div_text)
添加回答
舉報
0/150
提交
取消