You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
multiprocessing pools work fine unless any kind of error condition arises...
properly detect segmentation faults, out of memory, &c. concurrent.futures does this, but doesn't take an initializer ... (works on both python 3.3 and backported python 2 version)
robustness: retry failed jobs (but this might make things worse in certain cases, so better to design jobs so that half-finished jobs can be resumed later)
do not rely on copy-on-write memory inherited from parent process; load data in child processes.
Full Python traceback from children. parser.workerfunc() decorator does this.
The text was updated successfully, but these errors were encountered:
multiprocessing pools work fine unless any kind of error condition arises...
concurrent.futures
does this, but doesn't take aninitializer
... (works on both python 3.3 and backported python 2 version)multiprocessing
andconcurrent.futures
; cf. http://bugs.python.org/issue9205 )parser.workerfunc()
decorator does this.The text was updated successfully, but these errors were encountered: