o i @s^UddlmZgZeeed<dededefddZded edeee e e e ffd d Z d S) )ChunkStorageMetadata__all__shard1shard2returncCsdt|j}t|D]&}|j||j||j|krdS|j||j||j|kr/dSq dS)zCheck if two shards overlap.FT)lenoffsetsrangesizes)rrndimsir i/sda-disk/www/egybert/egybert_env/lib/python3.10/site-packages/torch/distributed/checkpoint/resharding.py"_check_shard_metadata_pair_overlaps  r saved_shard current_shardc Csg}tt|j|j|j|jD]2\}\}}}}t||||}|t||} ||kr2d} ||} n||} d} ||| | | fq|S)a[ Return the overlapping region between saved_shard and current_shard. There returned list has the same number of elements as the tensor's dimension. For each element, we produce a tuple with the following contents: (dimension, `saved_shard` offset, `current_shard` offset, length) Offsets are relative to each shard. r) enumerateziprr minmaxappend) rrnarrowsdimsaved_shard_offsetcurrent_shard_offsetsaved_shard_sizecurrent_shard_size min_range_endlengthoffset_for_saved_tensoroffset_for_current_tensorr r r+_shards_get_overlap_region_wrt_saved_tensors8     r!N) %torch.distributed.checkpoint.metadatarrliststr__annotations__boolrtupleintr!r r r rs