o b4hL@s ddlmZddlZddlmZddlZddlZddl m Z ddl Z ddl mZmZddlmZddlmZmZddZd d Zd d ZGd dde jZGddde jZGddde jZGddde jZGddde jZGddde jZGddde jZ dS))divisionN)hd) Specificity JaccardIndex)BinaryAccuracy) SensitivityHausdorffDistancecCstjdddS)z 3D max pooling for downsampling. kernel_sizestride)nn MaxPool3drr*/home/xmoravc/AI_project/model/csnet_3d.py downsample srcCstj||dddS)z)3D transposed convolution for upsampling.r r )r ConvTranspose3d) in_channels out_channelsrrrdeconvsrcGs|D];}|D]4}t|tjst|tjr)tj|j|jdur(|jj qt|tj r<|jj d|jj qqdS)zEInitialize weights using Kaiming normal for Conv3D and Linear layers.N) modules isinstancer Conv3dLinearinitkaiming_normalweightbiasdatazero_ BatchNorm3dfill_)modelsmodelmrrrinitialize_weightss     r&c(eZdZdZfddZddZZS) ResEncoder3dz@Residual block with two Conv3D layers and a 1x1 skip connection.csrtt|tj||ddd|_t||_tj||ddd|_t||_ tj dd|_ tj||dd|_ dS)Nrr paddingFinplacer ) superr(__init__r rconv1r!bn1conv2bn2ReLUreluconv1x1selfrr __class__rrr0&s  zResEncoder3d.__init__cCsL||}||||}||||}||}||}|SN)r7r6r2r1r4r3)r9xresidualoutrrrforward/s  zResEncoder3d.forward__name__ __module__ __qualname____doc__r0r@ __classcell__rrr:rr($  r(cr') Decoder3dz%Decoder block with two Conv3D layers.c s`tt|ttj||dddt|tjddtj||dddt|tjdd|_dS)Nr)rr*Fr,) r/rHr0r Sequentialrr!r5convr8r:rrr0:s   zDecoder3d.__init__cCs||}|Sr<)rJ)r9r=r?rrrr@Es zDecoder3d.forwardrArrr:rrH8s  rHcr')SpatialAttentionBlock3dz7Spatial attention using anisotropic convolutions in 3D.cstt|tj||dddd|_tj||dddd|_tj||dddd|_tj||d d |_t t d |_ tj d d |_dS) N)rr)r)rrrr*)r)rr)rrr)rrr))rrrrr.dim)r/rKr0r rquerykeyjudgevalue ParametertorchzerosgammaSoftmaxsoftmaxr9rr:rrr0Lsz SpatialAttentionBlock3d.__init__cCs|\}}}}}|||d|||ddd}|||d|||}|||d|||ddd} t||} t| |} t| | } || } | ||d|||} t| | }||||||}|j ||}|S)z :param x: input( BxCxHxWxZ ) :return: affinity value + x B: batch size C: channels H: height W: width D: slice number (depth) rMrr r) sizerPviewpermuterQrRrUmatmulrYrSrW)r9r=BCHWD proj_queryproj_key proj_judge affinity1 affinity2affinity proj_valueweightsr?rrrr@Us &&     zSpatialAttentionBlock3d.forwardrArrr:rrKJrGrKcr')ChannelAttentionBlock3dz&Channel-wise attention for 3D volumes.cs2tt|ttd|_tjdd|_ dS)NrrMrN) r/rlr0r rTrUrVrWrXrYrZr:rrr0ssz ChannelAttentionBlock3d.__init__cCs|\}}}}}|||dddd}|||d}|||dddd} t||} t|| } t| | } tj| dddd| | } || } |||d}t| |}||||||}|j||}|S)zR :param x: input( BxCxHxWxD ) :return: affinity value + x rMrr rT)keepdim) r[r\r]rUr^max expand_asrYrW)r9r=r_r`rarbrcrdrerfrgrhriZ affinity_newrjrkr?rrrr@xs     zChannelAttentionBlock3d.forwardrArrr:rrlq rlcr')AffinityAttention3dzBAffinity attention combining spatial and channel attention for 3D.cs&tt|t||_t||_dSr<)r/rqr0rKsabrlcabrZr:rrr0s zAffinityAttention3d.__init__cCs$||}||}|||}|S)z sab: spatial attention block cab: channel attention block :param x: input tensor :return: sab + cab )rrrs)r9r=rrrsr?rrrr@s   zAffinityAttention3d.forwardrArrr:rrqrprqcr')CSNet3DzPCSNet3D: A full encoder-decoder 3D segmentation network with affinity attention.cstt|t|d|_tdd|_tdd|_tdd|_tdd|_t |_ t d|_ t j dddd|_tdd|_tdd|_tdd|_tdd|_tdd|_tdd|_tdd|_tdd|_t j d|dd|_t|d S) zv :param classes: the object classes number. :param channels: the channels of the input image.  @irr.N)r/rtr0r( enc_inputencoder1encoder2encoder3encoder4rrqaffinity_attentionr rattention_fuserHdecoder4decoder3decoder2decoder1rdeconv4deconv3deconv2deconv1finalr&)r9classeschannelsr:rrr0s&               zCSNet3D.__init__cCs||}||}||}||}||}||}||}||} || } || } | | } || } tj || fdd} | | }| |}tj ||fdd}| |}| |}tj ||fdd}||}||}tj ||fdd}||}||}t|}|S)NrrN)rzrr{r|r}r~rrrUcatrrrrrrrrsigmoid)r9r=rzZdown1Zenc1Zdown2Zenc2Zdown3Zenc3Zdown4Z input_feature attentionrZup4Zdec4Zup3Zdec3Zup2Zdec2Zup1Zdec1rrrrr@s4                    zCSNet3D.forwardrArrr:rrts rtcsxeZdZdZ  dfdd Zd d Zd d Zd dZddZddZ dddZ ddZ ddZ ddZ ddZZS)CSNet3DLightningaQ PyTorch LightningModule for CSNet3D training, validation, and testing. This module wraps the 3D segmentation model and provides complete metric tracking, optional tiny-structure evaluation, and Hausdorff distance measurement. Args: classes (int): Number of output classes (usually 1). channels (int): Number of input channels. lr (float): Learning rate. threshold (float): Threshold for converting probabilities to binary predictions. noise (float): Noise label for saved sample naming. log_to_logger (bool): Enable/disable logging to the Lightning logger. tiny_structures_eval (bool): Evaluate small structures separately using mask. model_noise (float): Distinguishing tag for saving. eval_hd (bool): Enable Hausdorff distance computation using MedPy. -C6??rTFc sZtt|t|||_||_|g|_g|_||_ t |_ d|_ g|_||_||_td|jt|dt|dtd|dddtd|dddtd |d d t|dt|dtd|d ddtd|d ddtd |d d t|dt|dtd|d ddtd|d ddtd |d d d |_tjtj|j dddtjtj|j ddddS)Nz ./sampleszSelf eval_hd: ) thresholdrmicrobinary) num_classesraveragetaskmacro_) percentiler)accuracy sensitivity specificityjaccardhausdorff_distancenone)trainvaltest validationT)exist_okr)r/rr0rtr$lrsave_hyperparametersZvalidation_samplesZ test_samplesrr BCELoss criterion samples_path test_outputs log_to_loggereval_hdprintrrrrrmetricsosmakedirspathjoin) r9rrrrnoiserZ model_noiserr:rrr0sD     zCSNet3DLightning.__init__cCs ||Sr<)r$)r9r=rrrr@!s zCSNet3DLightning.forwardcs<tjjjjdd}tjj|fdd}||dS)NgMb@?)r weight_decaycsd|jjdS)Nrg?)trainer max_epochs)epochr9rr'z7CSNet3DLightning.configure_optimizers..) optimizer lr_scheduler)rUoptimAdamWr$ parametersrrLambdaLR)r9r schedulerrrrconfigure_optimizers$s    z%CSNet3DLightning.configure_optimizerscCD|j}|jD]}|j|D]}|j||||j||<q qdSr<devicertor9rstagerQrrr on_fit_start*   zCSNet3DLightning.on_fit_startcCrr<rrrrr on_test_start0rzCSNet3DLightning.on_test_startc Cs|\}}}t|j|j|}||}|||}|d||} |d||} |d||} |d||} |jrD|d||\} }n tdtd} }|||||| | | | | |f S)NrrrrrrM)rUonesshaperrrrtensor)r9batchrimagestargetsopenedZtiny_structures_maskpredslossaccsensspecjaccmy_hdhd_95rrr common_step6s  zCSNet3DLightning.common_stepc Cs| r|dn|} |j| d|| | d|j| d|| | d|j| d|| | d|j| d|| | d|j| d|| | d|jri|j| d|| | d|j| d || | ddSdS) Nz tinyz losson_epochon_stepz accz sensitivityz specificityz jaccardz hausdorff distancez hausdorff distance 95)logr) r9rrrrrrrprefixrtinyZ log_name_prefrrr log_metricsHszCSNet3DLightning.log_metricsc CsN|||jd\ }}}}}}} } } } } |jr%|j||| | | | | ddd |S)NrFr)rrrr)r9r batch_idxrrrtiny_struc_masksrrrrrrrrrr training_stepSs zCSNet3DLightning.training_stepc Csf|||jd\ }}}}}}} } } } } |jr%|j||| | | | | ddd |dkrt|jdD]}||ddddddddf}||ddddddddf}||ddddddddf}t t j |jdd|d|t t j |jdd|d|t t j |jdd |d|q0|S) NrTrrrpred_.npyimage_target_)rrrrrangersqueezedetachcpunpsaverrrrnumpy)r9rrrrrrrrrrrrriZcur_predZ cur_imageZ cur_targetrrrvalidation_step[s...&&(z CSNet3DLightning.validation_stepc Cs|||jd\ }}}}}}} } } } } |jr%|j||| | | | | ddd ||jk}|tj }|tj }g}t ||D]\}}t ||}| |qEt |}|jre|jd|ddd|dkrt|jdD]V}||ddddddddf}||ddddddddf}ttj|jdd |d |ttj|jdd |d |qp||| | | || | d }|j ||S) NrTrztest hausdorff distanceFrrrrr)rrrrrrmy_hausdorff_distancemy_hausdorff_distance_95)rrrrrrrastyperuint8ziprappendnanmeanrrrrrrrrrrr)r9rrrrrrrrrrrrrZ bin_predsgtsZhausdorff_distpredgtZhd_valZbatch_hdrZpred_npZimage_npoutputrrr test_stepos@    22"$ zCSNet3DLightning.test_stepcCs(dd|jD}t|}t|}dd|jD}t|}|}|}dd|jD}t|}|}|} dd|jD} t| } | } | } dd|jD} t| } | }| }dd|jD}t|}|}|}dd|jD}t|}t|}d d|jD}t|}t|}td td |d d |td|d d | td| d d | td|d d |td|d d |td|d d |td|d d |td|d d |tdS)NcSg|]}|dqS)rr.0r=rrr rz6CSNet3DLightning.on_test_epoch_end..cSr)rrrrrrrrcSr)rrrrrrrrcSr)rrrrrrrrcSr)rrrrrrrrcSr)rrrrrrrrcSr)rrrrrrrrcSr)rrrrrrrrzTest set resultesz Loss: mean = z.3fz, var = z Accuracy: mean = z Sensitivity: mean = z Specificity: mean = z Jaccard: mean = z Hausdorff distance: mean = z" My Hausdorff distance: mean = z% My Hausdorff distance 95: mean = )rrmeanvarrUstackitemr)r9Z hd_valuesZmean_hdZvar_hdlossesZ mean_lossZvar_lossZaccsZmean_accZvar_accZsenssZ mean_sensZvar_sensspecsZ mean_specZvar_specZjaccsZ mean_jaccZvar_jaccrZ mean_my_hdZ var_my_hdZmy_hd_95Z mean_my_hd_95Z var_my_hd_95rrron_test_epoch_endsN                      z"CSNet3DLightning.on_test_epoch_end)rrrTrF)TF)rBrCrDrEr0r@rrrrrrrrr rFrrr:rrs*  (r)! __future__ros.pathrZ medpy.metricrrrrUtorch.nnr pytorch_lightningpl torchmetricsrrtorchmetrics.classificationrZutils.my_metricsrrrrr&Moduler(rHrKrlrqrtLightningModulerrrrrs(     'D