我有 3 列（DM1_ID、DM2_ID、對(duì)）pandas 數(shù)據(jù)框，包含 100 萬(wàn)條記錄。此外，我有一個(gè)包含鍵和多個(gè)值的字典。該函數(shù)檢查字典值并獲取鍵并將該鍵放入 new_ID 字段中。函數(shù)對(duì)于 pandas 數(shù)據(jù)幀的一小部分工作正常，但是當(dāng)我將其應(yīng)用于整個(gè)數(shù)據(jù)幀時(shí)，它會(huì)給我“StopIteration”錯(cuò)誤。 DM1_ID DM2_ID pairs86503 11945.0 11945.0 [11945.0, 11945.0]86504 11945.0 362380.0 [11945.0, 362380.0]86505 11945.0 538395.0 [11945.0, 538395.0]86506 538395.0 591587.0 [11945.0, 591587.0]86507 11946.0 11946.0 [11946.0, 11946.0]86508 362380.0 200589 [362380.0, 200589.0]86509 564785.0 11946.0 [564785.0, 11946.0]f = lambda x: next(k for k,v in jdic.items() if any(i in v for i in x))jdic = {10045: [1, 6, 7,10045, 15, 45, 55, 80], 11945: [11945, 362380,20589, 10, 27, 538395, 591587], 3: [3, 21, 28, 32, 35], 11946: [11946, 39, 564785]}largeFile13000['new_ID'] = largeFile13000['pairs'].apply(f)largeFile13000.drop('pairs', axis=1, inplace=True)largeFile13000.head()# final result I'm expecting is DM1_ID DM2_ID new_ID86503 11945.0 11945.0 1194586504 11945.0 362380.0 1194586505 11945.0 538395.0 1194586506 538395.0 591587.0 1194586507 11946.0 11946.0 11946 86508 362380.0 200589 1194586509 564785.0 11946.0 11946# errorStopIteration Traceback (most recent call last)<ipython-input-14-ddbcd19d6baa> in <module>----> 1 largeFile13000['new_ID'] = largeFile13000['pairs'].apply(f) 2 largeFile13000.drop('pairs', axis=1, inplace=True) 3 largeFile13000.head()c:\users\ravindu\appdata\local\programs\python\python37\lib\site-packages\pandas\core\series.py in apply(self, func, convert_dtype, args, **kwds) 3589 else: 3590 values = self.astype(object).values-> 3591 mapped = lib.map_infer(values, f, convert=convert_dtype) 3592 3593 if len(mapped) and isinstance(mapped[0], Series):pandas\_libs\lib.pyx in pandas._libs.lib.map_infer()有誰(shuí)可以幫我解決這個(gè)問(wèn)題嗎？提前致謝。
1 回答
斯蒂芬大帝
TA貢獻(xiàn)1827條經(jīng)驗(yàn) 獲得超8個(gè)贊
從您的數(shù)據(jù)來(lái)看，本質(zhì)上您只需要查找一列，例如“DM1_ID”，因?yàn)橄鄳?yīng)的“DM2_ID”應(yīng)該屬于jdic中的同一鍵。在這種情況下，這很容易做到。我只是把你的字典翻過(guò)來(lái)。
jdic = {10045: [1, 6, 7,10045, 15, 45, 55, 80], 11945: [11945, 362380,20589, 10, 27, 538395, 591587], 3: [3, 21, 28, 32, 35], 11946: [11946, 39, 564785]}
ndic = {}
for key in jdic:
for i in jdic[key]:
ndic[i] = key
然后應(yīng)用條件。
largeFile13000['new_ID'] = largeFile13000['DM1_ID'].apply(lambda x: ndic[x])
順便說(shuō)一句，我不知道你是否有什么具體原因以這種方式構(gòu)建字典jdic。對(duì)于這種明顯的多對(duì)一關(guān)系，最好使用“多”方作為密鑰。
添加回答
舉報(bào)
0/150
提交
取消