o 0iE@s|ddlmZddlZddlmZmZmZmZmZm Z ddl m Z m Z ddl mZdZd e fd efd d Zd dZddZdS))PathN)is_hpu_availableis_mlu_availableis_musa_availableis_npu_availableis_sdaa_availableis_xpu_available) ClusterConfigdefault_json_config_file)SubcommandHelpFormatterzFCreate a default config file for Accelerate with only a few flags set.no save_locationc CsLt|}|jjddd|rtd|ddS|}|dvr)td|d|d }trKtj }||d <d|d <|d krGd |d<nd|d<t ritj }||d <d|d <|d krdd|d<nd|d<nt rtj }||d <d|d <|d krd|d<nd|d<ntrtj }||d <d|d <|d krd|d<npd|d<nktjrtj }||d <d|d <|d krd|d<nPd|d<nKtrtj } | |d <d|d <| d krd|d<n2d|d<n-trtj } | |d <d|d <| d krd|d<nd|d<nd} d|d <d |d <d|d<d|d<d|d<tdi|}|||S)a Creates and saves a basic cluster config to be used on a local machine with potentially multiple GPUs. Will also set CPU if it is a CPU-only machine. Args: mixed_precision (`str`, *optional*, defaults to "no"): Mixed Precision to use. Should be one of "no", "fp16", or "bf16" save_location (`str`, *optional*, defaults to `default_json_config_file`): Optional custom save location. Should be passed to `--config_file` when using `accelerate launch`. Default location is inside the huggingface cache folder (`~/.cache/huggingface`) but can be overridden by setting the `HF_HOME` environmental variable, followed by `accelerate/default_config.yaml`. T)parentsexist_okz Configuration already exists at zZ, will not override. Run `accelerate config` manually or pass a different `save_location`.F)rfp16bf16fp8zL`mixed_precision` should be one of 'no', 'fp16', 'bf16', or 'fp8'. Received LOCAL_MACHINE)compute_environmentmixed_precision num_processesuse_cpur MULTI_MLUdistributed_typeNO MULTI_SDAA MULTI_MUSA MULTI_HPU MULTI_GPU MULTI_XPU MULTI_NPUrdebugenable_cpu_affinityN)rparentmkdirexistsprintlower ValueErrorrtorchmlu device_countrsdaarmusarhpucuda is_availabler xpurnpur to_json_file) rrpathconfignum_mlus num_sdaas num_musasnum_hpusnum_gpusnum_xpusnum_npusr%r%d/sda-disk/www/egybert/egybert_env/lib/python3.10/site-packages/accelerate/commands/config/default.pywrite_basic_config$s                        rAcCsL|jd|ttd}|jdtddd|jdgdtd d d |jtd |S) Ndefault)rhelpformatter_classz --config_fileaTThe path to use to store the config file. Will default to a file named default_config.yaml in the cache location, which is the content of the environment `HF_HOME` suffixed with 'accelerate', or if you don't have such an environment variable, your cache directory ('~/.cache' or the content of `XDG_CACHE_HOME`) suffixed with 'huggingface'.r)rBrCdestz--mixed_precision)rrrzWhether or not to use mixed precision training. Choose between FP16 and BF16 (bfloat16) training. BF16 training is only supported on Nvidia Ampere GPUs and PyTorch 1.10 or later.r)choicestyperCrB)func) add_parser descriptionr add_argumentr str set_defaultsdefault_config_command)parserrr%r%r@default_command_parsers   rPcCs(t|j|j}|rtd|dSdS)Nz"accelerate configuration saved at )rArrr))args config_filer%r%r@rNsrN)pathlibrr,utilsrrrrrr config_argsr r config_utilsr rJrLrArPrNr%r%r%r@s   a