o ‚›iÜã@sBdZddlmZddlmZddlmZmZe e ¡Z dd„Z dS)z’ Liger Kernel integration for applying optimized Triton kernels to transformer models. See https://github.com/linkedin/Liger-Kernel for details. é)ÚPreTrainedModel)Úunwrap_peft_model)Úis_liger_kernel_availableÚloggingcCsXtƒstdƒ‚ddlm}|pi}t|ƒ}t|tƒr%|dd|i|¤ŽdSt d¡dS)al Apply Liger Kernel optimizations to a model instance. Liger Kernel provides optimized Triton kernels for common transformer operations. This function patches the model in-place with those kernels. Args: model: The model to patch. Must be a `PreTrainedModel` or a PEFT wrapper around one. kernel_config: Kernel configuration. z‡You have set `use_liger_kernel` to `True` but liger-kernel >= 0.3.0 is not available. Please install it with `pip install liger-kernel`é)Ú_apply_liger_kernel_to_instanceÚmodelzRThe model is not an instance of PreTrainedModel. No liger kernels will be applied.N©) rÚ ImportErrorÚliger_kernel.transformersrrÚ isinstancerÚloggerÚwarning)rÚ kernel_configrÚ base_modelr r úa/sda-disk/www/egybert/egybert_env/lib/python3.10/site-packages/transformers/integrations/liger.pyÚapply_liger_kernels ÿ  rN) Ú__doc__Úmodeling_utilsrÚ trainer_utilsrÚutilsrrÚ get_loggerÚ__name__r rr r r rÚs