多進程之Pool與多線程pool 及tqdm和for 並對比pandas處理結果

又叕又碰到這個多進程問題了,其實線程也行,下面再次進行demo測試

召回中遇到的,存儲召回的items

For Video Recommendation in Deep learning QQ Group 277356808
 

For Visual in deep learning QQ Group 629530787
 

I'm here waiting for you
 

wanna have a date with someone in Beijing please join in the QQ Group 737813700

 

from multiprocessing import Process,Pool

Pool(32)與Pool(64)相比沒有慢多少,一個是116s,一個是90s,因此保險考慮32爲好

遇到一個問題:多進程Pool中

AttributeError: Can't pickle local object 'update_model.<locals>.delete_copy_items'

下面小demo復現

Traceback (most recent call last):
  File "multiprocess_Process_Pool_.py", line 99, in <module>
    update_model()
  File "multiprocess_Process_Pool_.
發表評論
所有評論
還沒有人評論,想成為第一個評論的人麼? 請在上方評論欄輸入並且點擊發布.
相關文章