U md@s|dZddlmZddlmZddlmZddlmZ ddl m Z dd giZ d d gZ edd dZddZdd Zdd ZdS)z, Thin wrappers around `concurrent.futures`. )contextmanager) length_hint) cpu_count)tqdm) TqdmWarningz github.com/Z casperdcl thread_map process_mapccsPt|dd}|p|}t|||}|||V|dkrB|`n ||dS)z>get (create if necessary) and then restore `tqdm_class`'s lock_lockN)getattrZget_lockset_lockr ) tqdm_class lock_nameZold_locklockrP/home/sam/Atlas/atlas_env/lib/python3.8/site-packages/tqdm/contrib/concurrent.py ensure_locks    rc Os|}d|kr t|d|d<|dt}|dtdtd}|dd}|d d }t||d Z} |||j| fd <} t|| j |f|d|if|W5QRW5QRSQRXW5QRXd S)a Implementation of `thread_map` and `process_map`. Parameters ---------- tqdm_class : [default: tqdm.auto.tqdm]. max_workers : [default: min(32, cpu_count() + 4)]. chunksize : [default: 1]. lock_name : [default: "":str]. totalrr max_workers  chunksizerr )r)rZ initializerZinitargsN) copyrpop tqdm_autominrrr listmap) Z PoolExecutorfn iterables tqdm_kwargskwargsrrrrZlkexrrr _executor_maps    r%cOsddlm}t||f||S)a Equivalent of `list(map(fn, *iterables))` driven by `concurrent.futures.ThreadPoolExecutor`. Parameters ---------- tqdm_class : optional `tqdm` class to use for bars [default: tqdm.auto.tqdm]. max_workers : int, optional Maximum number of workers to spawn; passed to `concurrent.futures.ThreadPoolExecutor.__init__`. [default: max(32, cpu_count() + 4)]. r)ThreadPoolExecutor)concurrent.futuresr&r%)r r!r"r&rrrr6s cOsvddlm}|rLd|krLttt|}|dkrLddlm}|d|tddd |krd|}d |d <t ||f||S) a Equivalent of `list(map(fn, *iterables))` driven by `concurrent.futures.ProcessPoolExecutor`. Parameters ---------- tqdm_class : optional `tqdm` class to use for bars [default: tqdm.auto.tqdm]. max_workers : int, optional Maximum number of workers to spawn; passed to `concurrent.futures.ProcessPoolExecutor.__init__`. [default: min(32, cpu_count() + 4)]. chunksize : int, optional Size of chunks sent to worker processes; passed to `concurrent.futures.ProcessPoolExecutor.map`. [default: 1]. lock_name : str, optional Member of `tqdm_class.get_lock()` to use [default: mp_lock]. r)ProcessPoolExecutorri)warnzIterable length %d > 1000 but `chunksize` is not set. This may seriously degrade multiprocess performance. Set `chunksize=1` or more.r) stacklevelrZmp_lock) r'r(maxrrwarningsr)rrr%)r r!r"r(Zlongest_iterable_lenr)rrrr Hs   N)r )__doc__ contextlibroperatorrosrautorrZstdr __author____all__rr%rr rrrrs