我正在用 python 開發(fā)一個(gè)網(wǎng)絡(luò)爬蟲。這是我的代碼：from selenium.webdriver.chrome.options import Optionsfrom selenium import webdriverfrm bs4 import BeautifulSoupchrome_options = Options()chrome_options.add_argument("--headless")driver = webdriver.Chrome(options=chrome_options)driver.get("https://www.hapag-lloyd.com/en/home.html")source = driver.page_sourcesoup = BeautifulSoup(source, 'html.parser')print(soup)但返回的 html 與我在瀏覽器上看到的不同（請(qǐng)檢查最后幾行）：<html><head><meta content="no-cache" http-equiv="Pragma"/><meta content="-1" http-equiv="Expires"/><meta content="no-cache" http-equiv="CacheControl"/><meta content="text/html; charset=utf-8" http-equiv="Content-Type"/><link href="data:;base64,iVBORw0KGgo=" rel="shortcut icon"/><script>(function(){window["bobcmn"] = "111110101010102000000022000000052000000002a4b927ad200000096300000000300000000300000006/TSPD/300000008TSPD_101300000005https3000000b0081ecde62cab2000d65f90c7efd5185e314a8800e00a5aad11b1a439eb174c6c3f64d45284e14d9508dcf0830d0a2800346a2db5907272d4309ad725a7dc856ab98589c10724bd284477ca152744f4ac2102b44d72e2a1e9200000000200000000";SS(RegExp("\x3c")[l(1372127,sZ)](function(){return"\x3c"})&!RegExp(l(42811,sZ))[l(1372127,sZ)](function(){return"'x3'+'d';"}));})();</script><script src="/TSPD/081ecde62cab200082f75af3905bec19af31f4aaf7bd4079c3ac5a62a6fb4096cfcec166097ddde7?type=7" type="text/javascript"></script><noscript>Please enable JavaScript to view the page content.<br/>Your support ID is: 17324345507588527622.</noscript></head><body><form action="" enctype="multipart/form-data" method="post"><input name="_pd" type="hidden" value=""/></form></body></html>它報(bào)告“請(qǐng)啟用 JavaScript 以查看頁(yè)面內(nèi)容。您的支持 ID 是：17324345507588527622?！薄Ｎ也榱艘恍┢渌税l(fā)起的查詢。這個(gè)問題應(yīng)該通過使用chrome來解決。我還嘗試使用 requests-html 獲取 html。但程序只是繼續(xù)運(yùn)行并且不返回任何東西。
python selenium webdriver 不顯示所有 html
白豬掌柜的
2023-08-18 17:10:12
