Low-dose CT Image Reconstruction Method Based on CNN and Transformer Coupling Network

QIAO Yiyu; QIAO Zhiwei

doi:10.15953/j.ctta.2022.114

Volume 31 Issue 6

Nov. 2022

Turn off MathJax

Article Contents

Abstract

References

CT Theory and Applications > 2022 > 31(6): 697-707. > DOI: 10.15953/j.ctta.2022.114

QIAO Y Y, QIAO Z W. Low-dose CT image reconstruction method based on CNN and transformer coupling network[J]. CT Theory and Applications, 2022, 31(6): 697-707. DOI: 10.15953/j.ctta.2022.114. (in Chinese).

Citation:

PDF (3681 KB)

Low-dose CT Image Reconstruction Method Based on CNN and Transformer Coupling Network

QIAO Yiyu,
QIAO Zhiwei^,

School of Computer and Information Technology, Shanxi University, Taiyuan 030006, China

More Information

Received Date: June 11, 2022
Revised Date: July 25, 2022
Accepted Date: July 26, 2022
Available Online: August 11, 2022
Published Date: November 02, 2022

Abstract

Abstract

Under the condition that the number of projection angles is constant, reducing the radiation dose under each angle is an effective way to realize low-dose CT. However, the reconstructed images obtained through this method can be very noisy. At present, the deep learning image denoising method represented by convolutional neural networks (CNN) has become a classical method for low-dose CT image denoising. Inspired by the good performance of transformer in computer vision tasks, this paper proposes a CNN transformer coupling network (CTC) to further improve the performance of CT image denoising. CTC network makes comprehensive use of local information association ability of CNN and global information capture ability of transformer, constructs eight core network blocks composed of CNN components and an improved transformer component, which are interconnected based on residual connection mechanism and information reuse mechanism. Compared with the existing four denoising networks, CTC network demonstrate better denoising ability and can realize high-precision low-dose CT image reconstruction.
- low dose CT,
- self attention mechanism,
- convolutional neural network,
- residual connection

FullText(HTML)

References (25)

References

[1]	BRENNER D J, HALL E J. Computed tomography: An increasing source of radiation exposure[J]. New England Journal of Medicine, 2013, 357(22): 2277−2284.
[2]	KOLTAI P J, WOOD G W. Three dimensional CT reconstruction for the evaluation and surgical planning of facial fractures[J]. Otolaryngology-Head and Neck Surgery, 1986, 95(1): 10−15. doi: 10.1177/019459988609500103
[3]	MING C, LI L, CHEN Z, et al. A few-view reweighted sparsity hunting (FRESH) method for CT image reconstruction[J]. Journal of X-ray Science and Technology, 2013, 21(2): 161−176. doi: 10.3233/XST-130370
[4]	KANG E, MIN J, YE J C. A deep convolutional neural network using directional wavelets for low-dose X-ray CT reconstruction[J]. Medical Physics, 2017, 44(10): e360−e375. doi: 10.1002/mp.12344
[5]	PRASOON A, PETERSON K, IGEL C, et al. Deep feature learning for knee cartilage segmentation using a triplanar convolutional neural network[C]//International Conference on Medical Image Computing and Computer-assisted Intervention. Springer, Berlin, Heidelberg, 2013: 246-253.
[6]	YANG Q, YAN P, ZHANG Y, et al. Low-dose CT image denoising using a generative adversarial network with wasserstein distance and perceptual loss[J]. IEEE Transactions on Medical Imaging, 2018: 1348−1357.
[7]	HE K, ZHANG X, REN S, et al. Deep residual learning for image recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2016: 770-778.
[8]	YANG D, SUN J. BM3 D-Net: A convolutional neural network for transform-domain collaborative filtering[J]. IEEE Signal Processing Letters, 2017, 25(1): 55−59.
[9]	SINGH R, WU W, WANG G, et al. Artificial intelligence in image reconstruction: The change is here[J]. Physica Medica, 2020, 79: 113−125. doi: 10.1016/j.ejmp.2020.11.012
[10]	ZHANG K, ZUO W, CHEN Y, et al. Beyond a gaussian denoiser: Residual learning of deep CNN for image denoising[J]. IEEE Transactions on Image Processing, 2016, 26(7): 3142−3155.
[11]	CHEN H, ZHANG Y, KALRA M K, et al. Low-dose CT with a residual encoder-decoder convolutional neural network (RED-CNN)[J]. IEEE Transactions on Medical Imaging, 2017, 36(99): 2524−2535.
[12]	ZHANG K, ZUO W, ZHANG L. FFDNet: Toward a fast and flexible solution for CNN based image denoising[J]. IEEE Transactions on Image Processing, 2018.
[13]	ANWAR S, BARNES N. Real image denoising with feature attention[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision. 2019: 3155-3164.
[14]	TIAN C, XU Y, ZUO W. Image denoising using deep CNN with batch renormalization[J]. Neural Networks, 2020, 121: 461−473. doi: 10.1016/j.neunet.2019.08.022
[15]	MA Y, WEI B, FENG P, et al. Low-dose CT image denoising using a generative adversarial network with a hybrid loss function for noise learning[J]. IEEE Access, 2020, 8. DOI: 10.1109/ACCESS.2020.2986388.
[16]	LIANG J, CAO J, SUN G, et al. Swinir: Image restoration using swin transformer[C]// Proceedings of the IEEE/CVF International Conference on Computer Vision. 2021: 1833-1844.
[17]	YUAN K, GUO S, LIU Z, et al. Incorporating convolution designs into visual transformers[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision. 2021: 579-588.
[18]	VASWANI A, SHAZEER N, PARMAR N, et al. Attention is all you need[J]. Advances in Neural Information Processing Systems, 2017. https://doi.org/10.48550/arXiv.1706.03762.
[19]	DOSOVITSKIY A, BEYER L, KOLESNIKOV A, et al. An image is worth 16×16 words: Transformers for image recognition at scale[J]. arXiv Preprint arXiv: 2010.11929, 2020.
[20]	LIU Z, LIN Y, CAO Y, et al. Swin transformer: Hierarchical vision transformer using shifted windows[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision. 2021: 10012-10022.
[21]	WANG Z, CUN X, BAO J, et al. Uformer: A general U-shaped transformer for image restoration[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2022: 17683-17693.
[22]	HAN K, WANG Y, CHEN H, et al. A survey on vision transformer[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2022.
[23]	HUANG G, LIU Z, Van der MAATEN L, et al. Densely connected convolutional networks[C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2017: 4700-4708.
[24]	ZHANG J Y, YAN C, HUANG X X. Edge detection of images based on improved Sobel operator and genetic algorithms[C]//2009 International Conference on Image Analysis and Signal Processing. IEEE, 2009: 31-35.
[25]	TOLSTIKHIN I O, HOULSBY N, KOLESNIKOV A, et al. MLP-mixer: An all-MLP architecture for vision[J]. Advances in Neural Information Processing Systems, 2021: 34.

[1]	ZHANG Ran, KONG Huihua, LI Jiaxin, SONG Yijiao. Dense Sandstone Material Decomposition Based on Improved Convolutional Neural Network[J]. CT Theory and Applications, 2025, 34(1): 117-128. DOI: 10.15953/j.ctta.2024.131
[2]	LIU Zhichao, XU Zhiwen, ZHAO Sai, ZHANG Youxin, NIE Cong, LEI Ziqiao. Deep Learning Computer-aided Diagnostic Model for Non-small Cell Lung Cancer Based on Convolutional Neural Network and Attention Mechanism[J]. CT Theory and Applications. DOI: 10.15953/j.ctta.2025.020
[3]	QIAN Peizhang, QIAO Zhiwei, DU Congcong. Fast EPRI Imaging Based on 3MNet Denoising Network[J]. CT Theory and Applications, 2023, 32(1): 55-66. DOI: 10.15953/j.ctta.2022.065
[4]	DU Congcong, QIAO Zhiwei. Sparse CT Reconstruction Based on Adversarial Residual Dense Deep Neural Network[J]. CT Theory and Applications, 2022, 31(2): 163-172. DOI: 10.15953/j.ctta.2021.032
[5]	WANG Chongxu, CHEN Ping, PAN Jinxiao, LIU Bin. Research on Material Decomposition of Dual-energy CT Image Based on Iterative Residual Network[J]. CT Theory and Applications, 2022, 31(1): 47-54. DOI: 10.15953/j.1004-4140.2022.31.01.05
[6]	HUANG Dongyun, XIA Jun, LIN Yuwen, CHEN Jiakuan, CHEN Haibin. The Application Value of Accurate Diagnosis of CT Image of Skull Base Fractures based on Convolutional Neural Network[J]. CT Theory and Applications, 2021, 30(6): 769-776. DOI: 10.15953/j.1004-4140.2021.30.06.13
[7]	DONG Xiaoying, CHEN Ping. Segmentation of Liver Tumors Based on Bottleneck Residual Attention Mechanism U-net[J]. CT Theory and Applications, 2021, 30(6): 661-670. DOI: 10.15953/j.1004-4140.2021.30.06.01
[8]	CHEN Kang, DI Guidong, ZHANG Jiajia, ZHOU You, WU Yao, ZHANG Guangzhi. Reservoir Prediction Based on Improved U-Net Convolutional Neural Network[J]. CT Theory and Applications, 2021, 30(4): 403-416. DOI: 10.15953/j.1004-4140.2021.30.04.01
[9]	LIU Jiang, TU Qicui, LI Bingying, HUANG Xin, ZHANG Guangzhi, ZHANG Jiajia, WU Yao, ZHU Shengwei. Fault Prediction Method Based on Convolutional Neural Network[J]. CT Theory and Applications, 2020, 29(5): 522-533. DOI: 10.15953/j.1004-4140.2020.29.05.02
[10]	CAI Ning, WANG Shijie, CHEN Lujie, ZHANG Yikun, CHEN Yang, LUO Shouhua, GU Ning. Low-dose Micro-CT Imaging Method Based on Progressive Network Processing[J]. CT Theory and Applications, 2020, 29(4): 435-446. DOI: 10.15953/j.1004-4140.2020.29.04.06

Cited By

Cited by

Periodical cited type(3)

1.	周成，刘洋，邱迎伟，何代均，闫宇，罗敏，雷有缘. 基于最邻近层自监督学习人工智能降噪用于泌尿系结石超低剂量CT. 中国医学影像技术. 2024(08): 1249-1253 .
2.	李昊岳，薛智元，陆萍萍，张珂. 深度学习用于颞骨CT成像应用进展. 中国医学影像技术. 2024(09): 1432-1435 .
3.	李金霞，李静静，肖丹，赵宏波，朱守平. 基于Z轴相关性Zero-Shot Noise2Noise降低低剂量CT图像噪声. 中国医学影像技术. 2024(11): 1764-1768 .

Other cited types(2)

Corresponding author: QIAO Zhiwei, zqiao@sxu.edu.cn

School of Computer and Information Technology, Shanxi University, Taiyuan 030006, China

Get Citation

PDF

XML

Article views (1691) PDF downloads (370) Cited by(5)

Low-dose CT Image Reconstruction Method Based on CNN and Transformer Coupling Network

Abstract

References

Related Articles

Cited by

Periodical cited type(3)

Other cited types(2)

Catalog

Corresponding author: QIAO Zhiwei, zqiao@sxu.edu.cn

Related

Low-dose CT Image Reconstruction Method Based on CNN and Transformer Coupling Network

Abstract

References

Related Articles

Cited by

Periodical cited type(3)

Other cited types(2)

Catalog

Corresponding author: QIAO Zhiwei, zqiao@sxu.edu.cn

Related

Export File

Citation

Format

Content