o i^ @sdZddlmZddlZddlmZmZmZddlZddl m Z ddl m Z ddl mZdd lmZer:dd lmZd7ddZGdddZd8d9ddZd8d:ddZd;d"d#Z     dd?d5d6ZdS)@zM Python implementation of function wrapping functionality for functorch.dim. ) annotationsN)AnyOptional TYPE_CHECKING)tree_map)DimEntry)EnableAllLayers) TensorInfo)Callabletensor torch.TensorreturncCs|S)z8Handle tensor conversion for torch function integration.)r rrU/sda-disk/www/egybert/egybert_env/lib/python3.10/site-packages/functorch/dim/_wrap.pyhandle_from_tensorsrc@s(eZdZdZ dddd Zdd d Zd S)WrappedOperatorzP This class wraps PyTorch operations to support first-class dimensions. dimorigr wrapper_implementationdim_namestrcCsz||_||_t|dd|_t|dd|_||_d|_d|_d|_d|_ d|_ |jr9|jr;|jd|jd |_dSdSdS) N__name____doc__FrrTz Argument 'z5' can be either an integer or a torchdim.Dim object. ) rrgetattrnamedocr is_pointwise dim_offsetkeepdim_offset single_dimreduce)selfrrrrrr__init__ s zWrappedOperator.__init__rcs.d fdd }tj|jddd j|_|S) z@Create a wrapped function that calls our wrapper implementation.argsrkwargsrcsjg|Ri|S)N)r)r%r&r#rr wrapped_func6sz.WrappedOperator.function..wrapped_func)rr)assignedupdatedN)r%rr&rrr) functoolsupdate_wrapperrrr)r#r(rr'rfunction3s  zWrappedOperator.functionN)r)rr rr rr)rr )r __module__ __qualname__rr$r-rrrrrs  rFrrndimintkeepdimboolrcCs^ddlm}t||r|rtdt|St|tr,|}|dkr(||8}|dks t|StS)z:Convert single dimension specification to DimEntry object.r)Dimz8cannot preserve first-class dimensions with keepdim=Truer)rr4 isinstance ValueErrorrr1)rr0r2r4irrr _wrap_dimBs   r8list[DimEntry]cCsFt|||}g}|s|||S|D] }|t|||q|S)z|j|i|Stj 1}j dusKJ| j j t |}t j |d<|j|i|}||jWdS1swwYt|ds|j|i|Sd}|jr|d} | dur|jt|kr|jd} | t|kr|| } | durt| }} t|| |} g} dgtj }| D]U}d}tj D] \}}||kr|}nq|durtj D]\}}t|d r||r|}nq|durd d j D}td |d |d||<| |qg|jrD|sDtj D]\}}||sA|q3nj ddt| dkrW| d}nt| }t |}|}jduskJt j|d<|j|vr~|||j<n|jd}|t|krt |}|||<|j|i|}dfdd }t||S)zJ This is the core method that handles dimension-aware operations. z%Expected at least one argument (self)NrrTF)ensure_batchedensure_presentr2matchescSsg|]}t|qSr)r).0levelrrr sz&patched_dim_method..zTensor with dimensions z does not contain objrrcs,t|tjrddlm}||jS|S)Nr)Tensor)r5torchrHrfrom_positional has_device)rGrHinfo new_levelsrr wrap_results  z'patched_dim_method..wrap_result)rGrrr)r6getrrlenr createrr levels batchedtensorinplace_update_layerslistr from_batchedrKr"r r3r0r? enumeratehasattrrCr;tuplecopyr r)r@r%r&dim_argdim_idxguardnew_argsr=r2 keepdim_arg keepdim_idxr0dims dim_indicesseenr>midxr7rE level_strs py_indices new_kwargsrOrrLrpatched_dim_method_s                     rirr r Optional[int]r r Optional[str]r!Optional[bool]r"cCsT|pd}t|t|}|dur||_|dur||_|dur||_|dur&||_|S)a Wrap a PyTorch function to support first-class dimensions. Args: orig: Original function to wrap dim_offset: Offset for dimension argument (default: 0) keepdim_offset: Offset for keepdim argument (default: 1) dim_name: Name of dimension parameter (default: "dim") single_dim: Whether function takes single dimension (default: False) reduce: Whether function reduces dimensions (default: True) rN)rrirr r!r"r-)rrr rr!r"r@rrr_wraps rmrfunctypesrZOptional[dict]cCs(|duri}ddlm}|||||S)z@ Handle __torch_function__ calls for wrapped operators. Nr)_Tensor)rrq__torch_function__)r@rnror%r&rqrrrcall_torch_functions  rs)r r rr )F)rrr0r1r2r3rr)rrr0r1r2r3rr9)r@rr%rr&rrr)NNNNN)rr rrjr rjrrkr!rlr"rlrr )rN) r@rrnr rorZr%rZr&rprr)r __future__rr+typingrrrrItorch.utils._pytreer _dim_entryr_enable_all_layersr _tensor_infor collections.abcr rrr8r?rirmrsrrrrs2        '  z '