o i @sddlZddlZddlZddlmZddlmZmZmZm Z m Z m Z m Z ddl mZmZddlmZddgZe eefZeee edffZd d Zd ed ed e edeefddZdedefddZdded eedefddZded ed e edefddZdS)N) Collection)DictListOptionalSetTupleTypeUnion) IterDataPipe MapDataPipe)DILL_AVAILABLEtraverse traverse_dps DataPipeGraphcCsdS)NZSTUBrrre/var/www/html/eduruby.in/lip-sync/lip-sync-env/lib/python3.10/site-packages/torch/utils/data/graph.py_stub_unpicklersrscan_obj only_datapipecachereturnc s2t}t|}trddlm}||}nd}gdd}fdd}ttf} zO| D]} | ||r;| |q-z| Wntj t t fyYtrV| nYnwW| D]} | d|rk| dq]trxddlm} | dS| D]} | d|r| dq|trddlm} | dww) Nr)PicklercSsd}t|tr i}|D]\}}t|tttfr|||<q |St|ttfr=g}|D]}t|tttfr:||q+|St|tttfrG|}|SN) isinstancedictitemsr r rtuplelistappend)Z ori_statestatekvrrr getstate_hook"s$  z0_list_connected_datapipes..getstate_hookcs8|ks t|vr t|t|tdfS)Nr)idNotImplementedErrorraddr)objrZcaptured_connectionsrrr reduce_hook2s  z._list_connected_datapipes..reduce_hook)extendF)ioBytesIOpicklerr Zdillr r Zset_reduce_ex_hookZset_getstate_hookdump PickleErrorAttributeError TypeErrorr)) rrrfpZ dill_Picklerdr"r(Zdatapipe_classesclsZ dill_extendrr'r_list_connected_datapipessV              r5datapipecCst}t|d|dS)a Traverse the DataPipes and their attributes to extract the DataPipe graph. This only looks into the attribute from each DataPipe that is either a DataPipe and a Python collection object such as ``list``, ``tuple``, ``set`` and ``dict``. Args: datapipe: the end DataPipe of the graph Returns: A graph represented as a nested dictionary, where keys are ids of DataPipe instances and values are tuples of DataPipe instance and the sub-graph T)rr)set_traverse_helper)r6rrrrrTs cCs:d}|s|d7}t|t|durd}t}t|||S)a1 [Deprecated] Traverse the DataPipes and their attributes to extract the DataPipe graph. When ``only_dataPipe`` is specified as ``True``, it would only look into the attribute from each DataPipe that is either a DataPipe and a Python collection object such as ``list``, ``tuple``, ``set`` and ``dict``. Note: This function is deprecated. Please use `traverse_dps` instead. Args: datapipe: the end DataPipe of the graph only_datapipe: If ``False`` (default), all attributes of each DataPipe are traversed. This argument is deprecating and will be removed after the next release. Returns: A graph represented as a nested dictionary, where keys are ids of DataPipe instances and values are tuples of DataPipe instance and the sub-graph zV`traverse` function and will be removed after 1.13. Please use `traverse_dps` instead.zM And, the behavior will be changed to the equivalent of `only_datapipe=True`.NF)warningswarn FutureWarningr7r8)r6rmsgrrrrr es  cCst|ttfstdt|dt|}||vriS||t|||}||ifi}|D]}||d t |||q0|S)Nz.Expected `IterDataPipe` or `MapDataPipe`, but z is found) rr r RuntimeErrortyper#r%r5copyupdater8)r6rrZdp_idrr3itemrrrr8s   r8r)r*r,r9collections.abcrtypingrrrrrrr Ztorch.utils.datar r Z%torch.utils.data._utils.serializationr __all__ZDataPipeintrrboolr5rr r8rrrrs $  "="