o i; @sdZddlZddlZddlmZddlmZeeZ Gdddej Z Gdd d Z Gd d d Z    dd edBd edBdedBdedBfddZddZdS)zACollection of utils to be used by backbones and their components.N) repo_exists)loggingc@seZdZdZdZdS) BackboneTypetimm transformersN)__name__ __module__ __qualname__TIMM TRANSFORMERSr r ]/sda-disk/www/egybert/egybert_env/lib/python3.10/site-packages/transformers/backbone_utils.pyrsrcseZdZdZdedBdedBfddZddZed d Zej dee fd d Zed d Z e j de e dfee Bfdd Z fddZZS)BackboneConfigMixinzv A Mixin to support handling the `out_features` and `out_indices` attributes for the backbone configurations. out_featuresN out_indicescs|_t|tr t|n|_jj}}|dur1|dur1tjdg}jdg}n#|durC|durCfdd|D}n|durT|durTfdd|D}||__dS)ap Sets output indices and features to new values and aligns them with the given `stage_names`. If one of the inputs is not given, find the corresponding `out_features` or `out_indices` for the given `stage_names`. Args: out_features (`list[str]`, *optional*): The names of the features for the backbone to output. Defaults to `config._out_features` if not provided. out_indices (`list[int]` or `tuple[int]`, *optional*): The indices of the features for the backbone to output. Defaults to `config._out_indices` if not provided. Nrcsg|]}j|qSr ) stage_namesindex).0layerselfr r BszJBackboneConfigMixin.set_output_features_output_indices..cg|]}j|qSr rridxrr rrD) _out_features isinstancetuplelist _out_indicesverify_out_features_out_indiceslenr)rrrr rr"set_output_features_output_indices&s z6BackboneConfigMixin.set_output_features_output_indicescs,jdur tdjduretjtfstdtjtfddjDr7tdjdjtjttjkrKtdjjfd d jD}kretd |djj durtj tsztd tj t fd dj D}tfdd|Drtdjdj t|tt|krdj }||j krd|dnd7}t||t t |krdd t t |j dddD}td|dj jdurj durtjtj krtdjfdd j DkrtddSdSdS)z_ Verify that out_indices and out_features are valid for the given stage_names. Nz2Stage_names must be set for transformers backbonesz out_features must be a list got c3s|]}|jvVqdSNrrfeatrr r TszFBackboneConfigMixin.verify_out_features_out_indices..z.out_features must be a subset of stage_names: z got z2out_features must not contain any duplicates, got csg|] }|jvr|qSr rr(rr rr[szGBackboneConfigMixin.verify_out_features_out_indices..z@out_features must be in the same order as stage_names, expected z out_indices must be a list, got c3s*|]}|dkr|tjn|VqdS)rN)r%rrrr rr*es(c3s&|]}|ttjvr|VqdSr')ranger%rrrr rr*fs$z2out_indices must be valid indices for stage_names z, got z1out_indices must not contain any duplicates, got z(equivalent to z))cSsg|]\}}|qSr r )r_rr r rroscSs|dS)Nrr )xr r rpszEBackboneConfigMixin.verify_out_features_out_indices..)keyz?out_indices must be in the same order as stage_names, expected zHout_features and out_indices should have the same length if both are setcrr rrrr rryrzQout_features and out_indices should correspond to the same stages if both are set) r ValueErrorrr r"typeanyr%setr#r!sortedzip)r sorted_featspositive_indicesmsgsorted_negativer rrr$JsV     z3BackboneConfigMixin.verify_out_features_out_indicescC|jSr'r+rr r rr|z BackboneConfigMixin.out_featurescCs|j|dddS) Set the out_features attribute. This will also update the out_indices attribute to match the new out_features. Nrr)r&rrr r rrscCr<r')r#rr r rrr=zBackboneConfigMixin.out_indices.cCs&|durt|n|}|jd|ddS) Set the out_indices attribute. This will also update the out_features attribute to match the new out_indices. Nr?)r"r&rrr r rrscs.t}|dd|d<|dd|d<|S)z Serializes this instance to a Python dictionary. Override the default `to_dict()` from `PreTrainedConfig` to include the `out_features` and `out_indices` attributes. rNrr#r)superto_dictpop)routput __class__r rrDs zBackboneConfigMixin.to_dict)rr r __doc__r"r&r$propertyrsetterstrrr!intrD __classcell__r r rGrr!s" $2   rcseZdZUdZedBed<dZeed<dfdd Zddd Z dd d Z e d d Z e j deefdd Z e ddZej deeeeBfddZe ddZe ddZddZ   d dedBdedBdedBfddZZS)! BackboneMixinN backbone_typeThas_attentionsreturncs~tj|i||dd}|durtj|_ntj|_|jtjkr*|j|ddS|jtjkr6|dSt d|jd)z Method to initialize the backbone. This method is called by the constructor of the base class after the pretrained model weights have been loaded. timm_backboneN)backbonezbackbone_type z not supported.) rC__init__rErr rPr _init_timm_backbone_init_transformers_backboner2)rargskwargsrSrGr rrUs     zBackboneMixin.__init__cCst|jdd}t|jdd}dd|jjD|_dd|jjD|_t|jj}|j}|dur=||kr=t d|d|durN||jkrNt d |d |j|j_|j ||dS) zj Initialize the backbone model from timm. The backbone must already be loaded to backbone rNrcSg|]}|dqS)moduler rstager r rrz5BackboneMixin._init_timm_backbone..cSrZ)num_chsr r\r r rrr^z!Config has `out_features` set to z which doesn't match `out_features` from backbone's feature_info. Please check if your checkpoint has correct out features/indices saved.z Config has `stage_names` set to z which doesn't match `stage_names` from backbone's feature_info. Please check if your checkpoint has correct `stage_names` saved.) getattrconfig feature_infoinfor num_featuresr"r module_namer2r&)rrTout_features_from_configstage_names_from_configrrr r rrVs      z!BackboneMixin._init_timm_backbonecCs|jj|_|jd|_dSr')rarr$rdrr r rrWs   z)BackboneMixin._init_transformers_backbonecC|jjSr')rarrr r rrzBackboneMixin.out_featuresrcC ||j_dS)r>N)rarr@r r rr cCrhr')rar#rr r rrrizBackboneMixin.out_indicesrcCrj)rAN)rarrBr r rrrkcsfddtjDS)Ncsi|] \}}|j|qSr )rd)rir]rr r sz6BackboneMixin.out_feature_channels..) enumeraterrr rrout_feature_channelssz"BackboneMixin.out_feature_channelscsfddjDS)Ncrr )ro)rnamerr rrrz*BackboneMixin.channels..)rrr rrchannelsszBackboneMixin.channelscsT|js |dd|jtjkr#tt|jj fdd| D}||i|S)Noutput_attentionscsi|] \}}|vr||qSr r )rkv signaturer rrmsz>BackboneMixin.forward_with_filtered_kwargs..) rQrErPrr dictinspectrvforward parametersitems)rrXrYr rurforward_with_filtered_kwargss   z*BackboneMixin.forward_with_filtered_kwargsoutput_hidden_statesrr return_dictcCstd)Nz7This method should be implemented by the derived class.)NotImplementedError)r pixel_valuesr}rrr~r r rryszBackboneMixin.forward)rRN)NNN)rr r rPr__annotations__rQboolrUrVrWrJrrKr"rLrr!rMrorqr|ryrNr r rGrrOs:    !     rOdefault_backbonedefault_config_typedefault_config_kwargstimm_default_kwargscKsxddlm}ddlm}|dd}|di} |ddur$|dn|} |dd|durK|rK| durK|durK| sK|d d d| i|}||fS| dur|durt| rt|| \} } || d } | | | d i| }||fS|d d d| i| }||fS|dur|durt d |d |pi}||d i|}||fSt |t r|d }||} | |}||fS)Nr)PreTrainedConfig)CONFIG_MAPPINGuse_timm_backboneTbackbone_kwargsrTuse_pretrained_backbonerS model_typezG`backbone_config` is `None`. Initializing the config with the default `z` vision config.r )configuration_utilsr models.autorrEgetrget_config_dictupdateloggerrcr rw from_dict)backbone_configrrrrrYrrrrrT config_dictr. config_classbackbone_model_typer r r%consolidate_backbone_kwargs_to_configsH          rcCs@ddlm}t|dd}|dur|j|d}|S|j|d}|S)a> Loads the backbone model from a config object. If the config is from the backbone model itself, then we return a backbone model with randomly initialized weights. If the config is from the parent model of the backbone model itself, then we load the pretrained backbone weights if specified. r) AutoBackbonerN)ra)rrr` from_config)rarrrTr r r load_backboneCs   r)NNNN)rIenumrxhuggingface_hubrutilsr get_loggerrrEnumrrrOrLrwrrr r r rs.   }u 2