我已經(jīng)開(kāi)始了一個(gè)私人項(xiàng)目：在 Visual Studio Code (1.41.0) 中使用 Python 和 BeautifulSoup 進(jìn)行網(wǎng)頁(yè)抓取。我能夠抓取與我的&ldquo;問(wèn)題網(wǎng)站&rdquo;具有相同結(jié)構(gòu)的另一個(gè)網(wǎng)站。然而現(xiàn)在我遇到了，BeautifulSoup 沒(méi)有找到所有 div 標(biāo)簽（每個(gè)站點(diǎn)應(yīng)該有 20 個(gè)，而我只找到了其中 3 個(gè)）。<div class="css-15dj4ut"></div>我從 中得到了所有<div class="css-fh99y9 excbu0j0">...</div>，但沒(méi)有從 中得到<div class="css-roynbj excbu0j0"></div>。你知道為什么嗎？迭代每個(gè) url 以訪問(wèn)每個(gè)站點(diǎn)。for i in range(0, endIndex):try:? ? if i == 0:? ? ? ? urls.append(basicUrl)? ? ? ? page = urllib.request.urlopen(urls[i])? ? ? ? soup = BeautifulSoup(page, 'html.parser')? ? ? ? getSurgeonName(soup)? ? else:? ? ? ? urls.append(basicUrl + urlAddon + str(i + 1))? ? ? ? page = urllib.request.urlopen(urls[i])? ? ? ? soup = BeautifulSoup(page, 'html.parser')? ? ? ? getSurgeonName(soup)except:? ? print("An URL request error occured.")函數(shù)版本1：def getSurgeonName(soup):? ? # gets just first 3 surgeons of site? ? docName = re.compile('css-15dj4ut')? ? docNameTags = soup.find_all('div', attrs={'class': docName})? ? for a in docNameTags:? ? ? ? ? ? docNameList.append(a.getText())功能版本2：def getSurgeonName(soup):? ? parentClass = re.compile('css-fh99y9 excbu0j0')? ? parentItems = soup.find_all('div', attrs={'class': parentClass})? ? for parent in parentItems:? ? ? ? ? ?children = parent.findChildren('div', {"class": "css-15dj4ut"})?? ? ? ? ? ?docNameList.append(children[0].getText())? ? parentClass = re.compile('css-roynbj excbu0j0')? ? parentItems = soup.find_all('div', attrs={'class': parentClass})? ? for parent in parentItems:? ? ? ? ? ?children = parent.findChildren('div', {'class': 'css-15dj4ut'})?? ? ? ? ? ?docNameList.append(children[0].getText())