插入數(shù)據(jù)self.post.insert(data)時報錯pymongo.errors.ServerSelectionTimeoutError
2019-02-16 11:39:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://movie.douban.com/robots.txt> (referer: None)
2019-02-16 11:40:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://movie.douban.com/top250> (referer: None)
2019-02-16 11:40:30 [scrapy.core.scraper] ERROR: Error processing {'description': '希望讓人自由。',
?'evaluate_number': '1318433人評價',
?'introduction': '1994/美國/犯罪劇情',
?'movie_name': '肖申克的救贖',
?'serial_number': '1',
?'star_level': '9.6'}
Traceback (most recent call last):
? File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks
? ? current.result = callback(current.result, *args, **kw)
? File "/Users/sky/work/practice/pycharm/douban/douban/douban/pipelines.py", line 25, in process_item
? ? self.post.insert(data)
? File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/pymongo/collection.py", line 3161, in insert
? ? check_keys, manipulate, write_concern)
? File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/pymongo/collection.py", line 607, in _insert
? ? bypass_doc_val, session)
? File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/pymongo/collection.py", line 595, in _insert_one
? ? acknowledged, _insert_command, session)
? File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/pymongo/mongo_client.py", line 1247, in _retryable_write
? ? with self._tmp_session(session) as s:
? File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/contextlib.py", line 112, in __enter__
? ? return next(self.gen)
? File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/pymongo/mongo_client.py", line 1576, in _tmp_session
? ? s = self._ensure_session(session)
? File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/pymongo/mongo_client.py", line 1563, in _ensure_session
? ? return self.__start_session(True, causal_consistency=False)
? File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/pymongo/mongo_client.py", line 1516, in __start_session
? ? server_session = self._get_server_session()
? File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/pymongo/mongo_client.py", line 1549, in _get_server_session
? ? return self._topology.get_server_session()
? File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/pymongo/topology.py", line 427, in get_server_session
? ? None)
? File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/pymongo/topology.py", line 199, in _select_servers_loop
? ? self._error_message(selector))
pymongo.errors.ServerSelectionTimeoutError: 218.98.27.210:27017: timed out
2019-02-16 11:41:00 [scrapy.core.scraper] ERROR: Error processing {'description': '風華絕代。',
?'evaluate_number': '973528人評價',
?'introduction': '1993/中國大陸香港/劇情愛情同性',
?'movie_name': '霸王別姬',
?'serial_number': '2',
?'star_level': '9.6'}
Traceback (most recent call last):
? File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks
? ? current.result = callback(current.result, *args, **kw)
? File "/Users/sky/work/practice/pycharm/douban/douban/douban/pipelines.py", line 25, in process_item
? ? self.post.insert(data)
? File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/pymongo/collection.py", line 3161, in insert
? ? check_keys, manipulate, write_concern)
? File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/pymongo/collection.py", line 607, in _insert
? ? bypass_doc_val, session)
? File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/pymongo/collection.py", line 595, in _insert_one
? ? acknowledged, _insert_command, session)
? File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/pymongo/mongo_client.py", line 1247, in _retryable_write
? ? with self._tmp_session(session) as s:
? File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/contextlib.py", line 112, in __enter__
? ? return next(self.gen)
? File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/pymongo/mongo_client.py", line 1576, in _tmp_session
? ? s = self._ensure_session(session)
? File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/pymongo/mongo_client.py", line 1563, in _ensure_session
? ? return self.__start_session(True, causal_consistency=False)
? File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/pymongo/mongo_client.py", line 1516, in __start_session
? ? server_session = self._get_server_session()
? File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/pymongo/mongo_client.py", line 1549, in _get_server_session
? ? return self._topology.get_server_session()
? File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/pymongo/topology.py", line 427, in get_server_session
? ? None)
? File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/pymongo/topology.py", line 199, in _select_servers_loop
? ? self._error_message(selector))
pymongo.errors.ServerSelectionTimeoutError: 218.98.27.210:27017: timed out
2019-02-16 11:41:00 [scrapy.extensions.logstats] INFO: Crawled 2 pages (at 2 pages/min), scraped 0 items (at 0 items/min)
2019-02-16
mongodb連接超時,試試看你MongoDB數(shù)據(jù)庫在你本地是否能訪問得到吧?