o !‘i% ã @sjUddlmZmZddlmZgZeeed<dedefdd„Zded ed eee e e e ffd d „Z d S)é)ÚListÚTuple)ÚChunkStorageMetadataÚ__all__Úshard1Úshard2cCsdt|jƒ}t|ƒD]&}|j||j||j|krdS|j||j||j|kr/dSq dS)z' Checks if two shards overlap. FT)ÚlenÚoffsetsÚrangeÚsizes)rrZndimsÚi©r úv/var/www/html/eduruby.in/lip-sync/lip-sync-env/lib/python3.10/site-packages/torch/distributed/checkpoint/resharding.pyÚ"_check_shard_metadata_pair_overlap s ÿrÚ saved_shardÚ current_shardÚreturnc Csˆg}tt|j|j|j|jƒƒD]2\}\}}}}t||||ƒ}|t||ƒ} ||kr2d} ||} n||} d} | || | | f¡q|S)aZ Return the overlapping region between saved_shard and current_shard. There returned list has the same number of elements as the tensor's dimension. For each element, we produce a tuple with the following contents: (dimension, `saved_shard` offset, `current_shard` offset, length) Offsets are relative to each shard. r)Ú enumerateÚzipr r ÚminÚmaxÚappend) rrZnarrowsÚdimZsaved_shard_offsetZcurrent_shard_offsetZsaved_shard_sizeZcurrent_shard_sizeZ min_range_endÚlengthZoffset_for_saved_tensorZoffset_for_current_tensorr r rÚ+_shards_get_overlap_region_wrt_saved_tensors: üÿ û þÿ ÿrN) ÚtypingrrZ%torch.distributed.checkpoint.metadatarrÚstrÚ__annotations__rÚintrr r r rÚs ÿÿþ