o ib@sddlZGdddZdS)Nc@s|eZdZdZdeejBfddZeddZ dedBfd d Z de dBfd d Z dejfd dZddZ ddZddZdS)_remote_devicea@ Represents a device on a remote worker. Args: remote_device (str or torch.device): Represents a device on a remote worker. The string format should be one of the following: 1. "/", where the device field can be parsed as torch.device type. E.g., "trainer0/cpu", "trainer0", "ps0/cuda:0". In addition, the device field can be optional and the default value is "cpu". 2. "rank:/", where is the rank of the process and device can be parsed as torch.device type. E.g., "rank:0/cpu", "rank:0", "rank:0/cuda:0" 3. and are optional and formats like "cpu" and "cuda:1", just represent local devices. remote_devicecCsNd|d}d|_d|_d|_t|tjr||_n@t|trP|d}t|dkr0|\|_|_n)t|dkrLt |drC|d|_n|d|_d|_n t |t dt ||jdure|jset |t|j|_|jdur|jd }t|dkr|dd kr|drt|d|_d|_dSt |t|dkrt |dSdS) NzCould not parse remote_device: zU. The valid format is '/' or 'rank:/' or ''/rcpuz Invalid type for remote_device: :rank) _worker_name_rank_device isinstancetorchdevicestrsplitlenr_is_valid_local_device ValueError TypeErrortypeisdigitint)selfr PARSE_ERRORfieldsra/sda-disk/www/egybert/egybert_env/lib/python3.10/site-packages/torch/distributed/remote_device.py__init__s@              z_remote_device.__init__cCs&zt|WdStyYdSw)NTF)rr Exception)rrrrrJs   z%_remote_device._is_valid_local_devicereturnNcC|jS)zlReturn the name of remote worker representing the remote device and ``None`` if no worker name is available.)r rrrr worker_nameSz_remote_device.worker_namecCr!)z Returns the rank of remote worker representing the remote device. Returns ``None`` if no rank is available. )r r"rrrr Wsz_remote_device.rankcCr!)z-Return the local device on the remote worker.)r r"rrrr^r$z_remote_device.devicecCsz|jdur'|jdur|jd|jS|jdur"d|jd|jSt|jS|jdur0|jS|jdur9|jStd)Nrzrank:zInvalid state!)r r r r RuntimeErrorr"rrr__repr__bs      z_remote_device.__repr__cCs.t|to|j|jko|j|jko|j|jkSN)r rr r r )rotherrrr__eq__rs    z_remote_device.__eq__cCst|jt|jAt|jASr')hashr r r r"rrr__hash__ysz_remote_device.__hash__)__name__ __module__ __qualname____doc__rrrr staticmethodrr#rr r&r)r+rrrrrs2  r)rrrrrrs