o i{ @sddlZddlZejdefddZejdefddZejddeeeefdeeeeffd d Zejdefd d Z ejdefd dZ ejdefddZ ejdefddZ ejdefddZ ejdefddZdS)NreturncCs$zddl}WdStyYdSw)zCheck if JAX is installed.rNTF)jax ImportError)rrU/sda-disk/www/egybert/egybert_env/lib/python3.10/site-packages/torch/utils/_pallas.pyhas_jax_packages  rcCs2tsdSz ddlm}WdStyYdSw)z0Check if Pallas (JAX experimental) is available.Fr)pallasT)rjax.experimentalrr)plrrrhas_pallas_packages  r rrrfallbackc CsZzddl}|jd}dd|ddD\}}}|||fWStttfy,|YSw)z/Get JAX version as (major, minor, patch) tuple.rN.css|]}t|VqdS)N)int).0vrrr 'sz"get_jax_version..)r __version__splitr ValueErrorAttributeError)r r version_partsmajorminorpatchrrrget_jax_version s  rcC@tsdSzddl}|d}t|dkWStyYdSw)z&Check if JAX has CUDA backend support.FrNgpurrdeviceslen Exceptionrr rrrhas_jax_cuda_backend-  r$cCr)z%Check if JAX has TPU backend support.FrNtpurr#rrrhas_jax_tpu_backend<r%r'cCstS)z,Checks for a full Pallas-on-CPU environment.)r rrrrhas_cpu_pallasKsr(cCsto tjo tS)z-Checks for a full Pallas-on-CUDA environment.)r torchcuda is_availabler$rrrrhas_cuda_pallasQsr,cCs totS)z,Checks for a full Pallas-on-TPU environment.)r r'rrrrhas_tpu_pallasWs r-cCstptptS)z Check if Pallas backend is fully available for use. Requirements: - JAX package installed - Pallas (jax.experimental.pallas) available - A compatible backend (CUDA or TPU) is available in both PyTorch and JAX. )r(r,r-rrrr has_pallas]s r.)r ) functoolsr)cacheboolrr tuplerrr$r'r(r,r-r.rrrrs( *