o ':j@sjddlmZddlmZddlmZmZmZmZddl mm Z Gdddej Z Gdddej Z dS) ) OrderedDictN)ABNACT_LEAKY_RELUACT_ELUACT_NONEcs4eZdZdZdddedffdd ZddZZS) ResidualBlocka^Configurable residual block Parameters ---------- in_channels : int Number of input channels. channels : list of int Number of channels in the internal feature maps. Can either have two or three elements: if three construct a residual block with two `3 x 3` convolutions, otherwise construct a bottleneck block with `1 x 1`, then `3 x 3` then `1 x 1` convolutions. stride : int Stride of the first `3 x 3` convolution dilation : int Dilation to apply to the `3 x 3` convolutions. groups : int Number of convolution groups. This is used to create ResNeXt-style blocks and is only compatible with bottleneck blocks. norm_act : callable Function to create normalization / activation Module. dropout: callable Function to create Dropout Module. rNc stt|t|dkrt|dkrtdt|dkr%|dkr%tdt|dk}|dkp4||dk} |s||d} t| _dtj||dd||d |d fd ||dfd tj|d|ddd|d |d fd | fg} |dur| ddd|fg| dd} nb||d} t| _dtj||ddddd dfd ||dfd tj|d|dd||d ||dfd ||dfdtj|d|ddddd dfd| fg} |dur| ddd|fg| dd} t t | |_ | r tj||dd|dd d|_ ||d|_ t|j _dSdS)N0channels must contain either two or three valuesr/groups > 1 are only valid if len(channels) == 3conv1rFstridepaddingbiasdilationbn1conv2bn2dropoutrrrrrrgroupsrconv3bn3)superr__init__len ValueErrorr activationnnConv2d Sequentialrconvs proj_convproj_bn) self in_channelschannelsrrrnorm_actr is_bottleneckneed_proj_convrlayersr __class__2/home/ubuntu/htdocs/OOTD3/SCHP/modules/residual.pyr!sR  $   $ zResidualBlock.__init__cCsvt|dr||}||}n|}|||}|jjjtkr+tj||jjj ddS|jjjt kr9tj |ddS|S)Nr'T)negative_slopeinplace)r5) hasattrr'r(r&rr"r functional leaky_relusloperelu)r)xresidualr2r2r3forwardVs   zResidualBlock.forward)__name__ __module__ __qualname____doc__rrr= __classcell__r2r2r0r3r s5rcs0eZdZdddedffdd ZddZZS)IdentityResidualBlockrNc stt|t|dkrt|dkrtdt|dkr%|dkr%tdt|dk}|dkp4||dk} |||_|s|dtj||dd||d |d fd ||dfd tj|d|ddd|d |d fg} |d ur{| ddd|fg| dd } nVdtj||dd|dd dfd ||dfd tj|d|ddd|d ||dfd||dfdtj|d|ddddd dfg} |d ur| ddd|fg| dd } tt | |_ | rtj||dd|dd d|_ d Sd S)aConfigurable identity-mapping residual block Parameters ---------- in_channels : int Number of input channels. channels : list of int Number of channels in the internal feature maps. Can either have two or three elements: if three construct a residual block with two `3 x 3` convolutions, otherwise construct a bottleneck block with `1 x 1`, then `3 x 3` then `1 x 1` convolutions. stride : int Stride of the first `3 x 3` convolution dilation : int Dilation to apply to the `3 x 3` convolutions. groups : int Number of convolution groups. This is used to create ResNeXt-style blocks and is only compatible with bottleneck blocks. norm_act : callable Function to create normalization / activation Module. dropout: callable Function to create Dropout Module. r r r rr r rrFrrrNrrrrrr) rrCrr r!rr#r$r%rr&r') r)r*r+rrrr,rr-r.r/r0r2r3rgsD  $ $ zIdentityResidualBlock.__init__cCsJt|dr||}||}n |}||}||}|||S)Nr')r6rr'cloner&add_)r)r;rshortcutoutr2r2r3r=s      zIdentityResidualBlock.forward)r>r?r@rrr=rBr2r2r0r3rCfsDrC) collectionsrtorch.nnr#bnrrrrtorch.nn.functionalr7ModulerrCr2r2r2r3s ]