Skip to main content

2024 | OriginalPaper | Buchkapitel

10. Fusion and Radiomics Study of Multimodal Medical Images

verfasst von : Qingfeng Chen

Erschienen in: Association Analysis Techniques and Applications in Bioinformatics

Verlag: Springer Nature Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

With the tremendous technological advances in the medical field, various medical imaging devices have emerged to produce images that enhance clinical medical diagnosis, and different medical imaging modalities are now widely used in clinical applications of diseases.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat QU G H, ZHANG D L, YAN P F. Medical image fusion by wavelet transform modulus maxima.[J]. Foreign Medical Science Radiomedicine and Nuclear Medicine, 2001, 9 (4): 184. QU G H, ZHANG D L, YAN P F. Medical image fusion by wavelet transform modulus maxima.[J]. Foreign Medical Science Radiomedicine and Nuclear Medicine, 2001, 9 (4): 184.
2.
Zurück zum Zitat LIU Y, YANG J, SUN J. PET/CT Medical Image Fusion Algorithm Based on Multiwavelet Transform[C] //Advanced Computer Control (ICACC), 2010 2nd International Conference on. 2010, 5: 264–268. LIU Y, YANG J, SUN J. PET/CT Medical Image Fusion Algorithm Based on Multiwavelet Transform[C] //Advanced Computer Control (ICACC), 2010 2nd International Conference on. 2010, 5: 264–268.
3.
Zurück zum Zitat YANG L, GUO B L, NI W. Multimodality medical image fusion based on multiscale geometric analysis of contourlet transform[J]. Neurocomputing, 2008, 72(1–3): 203–211. YANG L, GUO B L, NI W. Multimodality medical image fusion based on multiscale geometric analysis of contourlet transform[J]. Neurocomputing, 2008, 72(1–3): 203–211.
4.
Zurück zum Zitat YIN M, LIU X, LIU Y, et al. Medical Image Fusion With Parameter-Adaptive Pulse Coupled Neural Network in Nonsubsampled Shearlet Transform Domain[J]. IEEE Transactions on Instrumentation and Measurement, 2018, 68(1): 49–64.CrossRef YIN M, LIU X, LIU Y, et al. Medical Image Fusion With Parameter-Adaptive Pulse Coupled Neural Network in Nonsubsampled Shearlet Transform Domain[J]. IEEE Transactions on Instrumentation and Measurement, 2018, 68(1): 49–64.CrossRef
5.
Zurück zum Zitat ARIF M, WANG G. Fast curvelet transform through genetic algorithm for multimodal medical image fusion[J]. Soft Comput, 2020, 24: 1815–1836.CrossRef ARIF M, WANG G. Fast curvelet transform through genetic algorithm for multimodal medical image fusion[J]. Soft Comput, 2020, 24: 1815–1836.CrossRef
6.
Zurück zum Zitat SHABANZADE F, KHATERI M, LIU Z. MR and PET image fusion using nonparametric Bayesian joint dictionary learning[J]. IEEE Sens. Lett., 2019, 3 (7): 2019–2022.CrossRef SHABANZADE F, KHATERI M, LIU Z. MR and PET image fusion using nonparametric Bayesian joint dictionary learning[J]. IEEE Sens. Lett., 2019, 3 (7): 2019–2022.CrossRef
7.
Zurück zum Zitat BHARDWAJ J, NAYAK A. Haar wavelet transform-based optimal Bayesian method for medical image fusion[J]. Medical & Biological Engineering & Computing, 2020, 58 (10): 2397–2411.CrossRef BHARDWAJ J, NAYAK A. Haar wavelet transform-based optimal Bayesian method for medical image fusion[J]. Medical & Biological Engineering & Computing, 2020, 58 (10): 2397–2411.CrossRef
8.
Zurück zum Zitat WANG Y P, DANG J W, LI Q, et al. Multimodal medical image fusion using fuzzy radial basis function neural networks[C] // International Conference on Wavelet Analysis & Pattern Recognition, 2007, 2: 778–782. WANG Y P, DANG J W, LI Q, et al. Multimodal medical image fusion using fuzzy radial basis function neural networks[C] // International Conference on Wavelet Analysis & Pattern Recognition, 2007, 2: 778–782.
9.
Zurück zum Zitat WANG Z, MA Y. Medical image fusion using m-PCNN[J]. Information Fusion, 2008, 9(2): 176–185. WANG Z, MA Y. Medical image fusion using m-PCNN[J]. Information Fusion, 2008, 9(2): 176–185.
10.
Zurück zum Zitat Teng J H, Wang S H, Zhang J Z, et al. Neuro-fuzzy logic based fusion algorithm of medical images[C] //International Congress on Image & Signal Processing. IEEE, 2010:1552–1556. Teng J H, Wang S H, Zhang J Z, et al. Neuro-fuzzy logic based fusion algorithm of medical images[C] //International Congress on Image & Signal Processing. IEEE, 2010:1552–1556.
11.
Zurück zum Zitat SIVASANGUMANI S, GOMATHI P S, KALAAVATHI B. Regional firing characteristic of PCNN-based multimodal medical image fusion in NSCT domain[J]. International Journal of Biomedical Engineering & Technology, 2015, 18 (3): 199–209.CrossRef SIVASANGUMANI S, GOMATHI P S, KALAAVATHI B. Regional firing characteristic of PCNN-based multimodal medical image fusion in NSCT domain[J]. International Journal of Biomedical Engineering & Technology, 2015, 18 (3): 199–209.CrossRef
12.
Zurück zum Zitat LIU Y, CHEN X, CHENG J, et al. A medical image fusion method based on convolutional neural networks[C] // 2017 20th International Conference on Information Fusion (Fusion). IEEE, 2017:1–7. LIU Y, CHEN X, CHENG J, et al. A medical image fusion method based on convolutional neural networks[C] // 2017 20th International Conference on Information Fusion (Fusion). IEEE, 2017:1–7.
13.
Zurück zum Zitat HOU R, ZHOU D, NIE R, et al. Brain CT and MRI medical image fusion using convolutional neural networks and a dual-channel spiking cortical model[J]. Medical & Biological Engineering & Computing, 2018, 57(4):887–900.CrossRef HOU R, ZHOU D, NIE R, et al. Brain CT and MRI medical image fusion using convolutional neural networks and a dual-channel spiking cortical model[J]. Medical & Biological Engineering & Computing, 2018, 57(4):887–900.CrossRef
14.
Zurück zum Zitat KAVITHA C T, CHELLAMUTHU C. Medical image fusion based on hybrid intelligence[J]. Applied Soft Computing Journal, 2014, 20:83–94.CrossRef KAVITHA C T, CHELLAMUTHU C. Medical image fusion based on hybrid intelligence[J]. Applied Soft Computing Journal, 2014, 20:83–94.CrossRef
15.
Zurück zum Zitat RAMLAL S D, SACHDEVA J, AHUJA C K, et al. An improved multimodal medical image fusion scheme based on hybrid combination of nonsubsampled contourlet transform and stationary wavelet transform[J]. International Journal of Imaging Systems and Technology, 2019, 29(2): 146–160.CrossRef RAMLAL S D, SACHDEVA J, AHUJA C K, et al. An improved multimodal medical image fusion scheme based on hybrid combination of nonsubsampled contourlet transform and stationary wavelet transform[J]. International Journal of Imaging Systems and Technology, 2019, 29(2): 146–160.CrossRef
16.
Zurück zum Zitat LEI B, CHEN S, NI D, et al. Discriminative Learning for Alzheimer’s Disease Diagnosis via Canonical Correlation Analysis and Multimodal Fusion[J]. Frontiers in Aging Neuroscience, 2016, 8: 1–17. LEI B, CHEN S, NI D, et al. Discriminative Learning for Alzheimer’s Disease Diagnosis via Canonical Correlation Analysis and Multimodal Fusion[J]. Frontiers in Aging Neuroscience, 2016, 8: 1–17.
17.
Zurück zum Zitat AHMED O B, BENDIS-PINEAU J, ALLARD M, et al. Recognition of Alzheimer’s disease and Mild Cognitive Impairment with multimodal image-derived biomarkers and Multiple Kernel Learning[J]. Neurocomputing, 2017, 220: 98–110.CrossRef AHMED O B, BENDIS-PINEAU J, ALLARD M, et al. Recognition of Alzheimer’s disease and Mild Cognitive Impairment with multimodal image-derived biomarkers and Multiple Kernel Learning[J]. Neurocomputing, 2017, 220: 98–110.CrossRef
18.
Zurück zum Zitat CHAVAN S S, MAHAJAN A, TALBAR S N, et al. Nonsubsampled rotated complex wavelet transform (NSRCxWT) for medical image fusion related to clinical aspects in neurocysticercosis[J]. Computers in Biology & Medicine, 2016, 81:64–78.CrossRef CHAVAN S S, MAHAJAN A, TALBAR S N, et al. Nonsubsampled rotated complex wavelet transform (NSRCxWT) for medical image fusion related to clinical aspects in neurocysticercosis[J]. Computers in Biology & Medicine, 2016, 81:64–78.CrossRef
19.
Zurück zum Zitat ZHANG H, WANG X, LIU C, et al. Detection of coronary artery disease using multi-modal feature fusion and hybrid feature selection[J]. Physiological Measurement, 2020, 41(11): 115007.CrossRef ZHANG H, WANG X, LIU C, et al. Detection of coronary artery disease using multi-modal feature fusion and hybrid feature selection[J]. Physiological Measurement, 2020, 41(11): 115007.CrossRef
20.
Zurück zum Zitat HAMZAH N A, OMAR Z, HANAFI M, et al. Multimodal Medical ImageFusion as a Novel Approach for Aortic Annulus Sizing[J], Cardiovasc Eng, 2020, 101–122. HAMZAH N A, OMAR Z, HANAFI M, et al. Multimodal Medical ImageFusion as a Novel Approach for Aortic Annulus Sizing[J], Cardiovasc Eng, 2020, 101–122.
21.
Zurück zum Zitat PICCINELLI M, DAHIYA N, FOLKS R D, et al. Validation of Automated Biventricular Myocardial Segmentation from Coronary Computed Tomographic Angiography for Multimodality Image Fusion[J]. Cold Spring Harbor Laboratory Press, 2021. PICCINELLI M, DAHIYA N, FOLKS R D, et al. Validation of Automated Biventricular Myocardial Segmentation from Coronary Computed Tomographic Angiography for Multimodality Image Fusion[J]. Cold Spring Harbor Laboratory Press, 2021.
22.
Zurück zum Zitat TAKAHASHI S, TAKAHASHI W, TANAKA S, et al. Radiomics Analysis for Glioma Malignancy Evaluation Using Diffusion Kurtosis and Tensor Imaging [J]. International journal of radiation oncology, biology, physics, 2019, 105:784–791.CrossRef TAKAHASHI S, TAKAHASHI W, TANAKA S, et al. Radiomics Analysis for Glioma Malignancy Evaluation Using Diffusion Kurtosis and Tensor Imaging [J]. International journal of radiation oncology, biology, physics, 2019, 105:784–791.CrossRef
23.
Zurück zum Zitat VAMVAKAS A, WILLIAMS S, THEODOROU K, et al. Imaging biomarker analysis of advanced multiparametric MRI for glioma grading[J]. Physica Medica, 2019, 60C: 188–198.CrossRef VAMVAKAS A, WILLIAMS S, THEODOROU K, et al. Imaging biomarker analysis of advanced multiparametric MRI for glioma grading[J]. Physica Medica, 2019, 60C: 188–198.CrossRef
24.
Zurück zum Zitat PENG H, HUO J, LI B, et al. Predicting Isocitrate Dehydrogenase(IDH) Mutation Status in Gliomas Using Multiparameter MRI Radiomics Features[J]. Journal of Magnetic Resonance Imaging, 2021, 53: 1399–1407. PENG H, HUO J, LI B, et al. Predicting Isocitrate Dehydrogenase(IDH) Mutation Status in Gliomas Using Multiparameter MRI Radiomics Features[J]. Journal of Magnetic Resonance Imaging, 2021, 53: 1399–1407.
25.
Zurück zum Zitat TAN Y, ZHANG S T, WEI J W, et al. A radiomics nomogram may improve the prediction of IDH genotype for astrocytoma before surgery[J], European radiology, 2019, 29(7): 3325–3337.CrossRef TAN Y, ZHANG S T, WEI J W, et al. A radiomics nomogram may improve the prediction of IDH genotype for astrocytoma before surgery[J], European radiology, 2019, 29(7): 3325–3337.CrossRef
26.
Zurück zum Zitat JI E P, KIM H S, PARK S Y, et al. Prediction of Core Signaling Pathway by Using Diffusion- and Perfusion-based MRI Radiomics and Next-generation Sequencing in Isocitrate Dehydrogenase Wild-type Glioblastoma[J]. Radiology, 2020, 294(2): 388–397.CrossRef JI E P, KIM H S, PARK S Y, et al. Prediction of Core Signaling Pathway by Using Diffusion- and Perfusion-based MRI Radiomics and Next-generation Sequencing in Isocitrate Dehydrogenase Wild-type Glioblastoma[J]. Radiology, 2020, 294(2): 388–397.CrossRef
27.
Zurück zum Zitat ZHANG Q, PENG Y, LIU W, et al. Radiomics Based on Multimodal MRI for the Differential Diagnosis of Benign and Malignant Breast Lesions[J]. Journal of Magnetic Resonance Imaging, 2020, 52(2): 596–607.CrossRef ZHANG Q, PENG Y, LIU W, et al. Radiomics Based on Multimodal MRI for the Differential Diagnosis of Benign and Malignant Breast Lesions[J]. Journal of Magnetic Resonance Imaging, 2020, 52(2): 596–607.CrossRef
28.
Zurück zum Zitat LIU Z, LI Z, QU J, et al. Radiomics of Multiparametric MRI for Pretreatment Prediction of Pathologic Complete Response to Neoadjuvant Chemotherapy in Breast Cancer: A Multicenter Study[J]. Clin Cancer Res, 2019, 25: 3538–3547. LIU Z, LI Z, QU J, et al. Radiomics of Multiparametric MRI for Pretreatment Prediction of Pathologic Complete Response to Neoadjuvant Chemotherapy in Breast Cancer: A Multicenter Study[J]. Clin Cancer Res, 2019, 25: 3538–3547.
29.
Zurück zum Zitat QI Y, ZHANG S, WEI J, et al. Multiparametric MRI-Based Radiomics for Prostate Cancer Screening with PSA in 4–10 ng/mL to Reduce Unnecessary Biopsies[J], Journal of Magnetic Resonance Imaging, 2020, 51: 1890–1899. QI Y, ZHANG S, WEI J, et al. Multiparametric MRI-Based Radiomics for Prostate Cancer Screening with PSA in 4–10 ng/mL to Reduce Unnecessary Biopsies[J], Journal of Magnetic Resonance Imaging, 2020, 51: 1890–1899.
30.
Zurück zum Zitat HAN Y, CHAI F, WEI J, et al. Identification of Predominant Histopathological Growth Patterns of Colorectal Liver Metastasis by Multi-Habitat and Multi-Sequence Based Radiomics Analysis[J]. Front Onco, 2020, 10: 1363.CrossRef HAN Y, CHAI F, WEI J, et al. Identification of Predominant Histopathological Growth Patterns of Colorectal Liver Metastasis by Multi-Habitat and Multi-Sequence Based Radiomics Analysis[J]. Front Onco, 2020, 10: 1363.CrossRef
31.
Zurück zum Zitat FANG M, KAN Y, DONG D, et al. Multi-Habitat Based Radiomics for the Prediction of Treatment Response to Concurrent Chemotherapy and Radiation Therapy in Locally Advanced Cervical Cancer[J]. Front Oncol, 2020, 10: 563.CrossRef FANG M, KAN Y, DONG D, et al. Multi-Habitat Based Radiomics for the Prediction of Treatment Response to Concurrent Chemotherapy and Radiation Therapy in Locally Advanced Cervical Cancer[J]. Front Oncol, 2020, 10: 563.CrossRef
32.
Zurück zum Zitat BEIG N, BERA K, PRASANNA P, et al. Radiogenomic-Based Survival Risk Stratification of Tumor Habitat on Gd-T1w MRI Is Associated with Biological Processes in Glioblastoma[J]. Clin Cancer Res, 2020, 26: 1866–1876.CrossRef BEIG N, BERA K, PRASANNA P, et al. Radiogenomic-Based Survival Risk Stratification of Tumor Habitat on Gd-T1w MRI Is Associated with Biological Processes in Glioblastoma[J]. Clin Cancer Res, 2020, 26: 1866–1876.CrossRef
33.
Zurück zum Zitat DU D, GU J, CHEN X, et al. Integration of PET/CT Radiomics and Semantic Features for Differentiation between Active Pulmonary Tuberculosis and Lung Cancer[J]. Mol Imaging Biol, 2021, 23: 287–29. DU D, GU J, CHEN X, et al. Integration of PET/CT Radiomics and Semantic Features for Differentiation between Active Pulmonary Tuberculosis and Lung Cancer[J]. Mol Imaging Biol, 2021, 23: 287–29.
34.
Zurück zum Zitat LV W, YUAN Q, WANG Q, et al. Radiomics Analysis of PET and CT Components of PET/CT Imaging Integrated with Clinical Parameters: Application to Prognosis for Nasopharyngeal Carcinoma[J]. Mol Imaging Biol, 2019, 21: 954–964. LV W, YUAN Q, WANG Q, et al. Radiomics Analysis of PET and CT Components of PET/CT Imaging Integrated with Clinical Parameters: Application to Prognosis for Nasopharyngeal Carcinoma[J]. Mol Imaging Biol, 2019, 21: 954–964.
35.
Zurück zum Zitat HAIDER S P, MAHAJAN A, ZEEVI T, et al. PET/CT radiomics signature of human papilloma virus association in oropharyngeal squamous cell carcinoma[J]. European journal of nuclear medicine and molecular imaging, 2020, 47: 2978–2991.CrossRef HAIDER S P, MAHAJAN A, ZEEVI T, et al. PET/CT radiomics signature of human papilloma virus association in oropharyngeal squamous cell carcinoma[J]. European journal of nuclear medicine and molecular imaging, 2020, 47: 2978–2991.CrossRef
36.
Zurück zum Zitat UMUTLU L, KIRCHNER J, BRUCKMANN N, et al. Multiparametric Integrated 18 F-FDG PET/MRI-Based Radiomics for Breast Cancer Phenotyping and Tumor Decoding[J]. Cancers, 2021, 13: 2928.CrossRef UMUTLU L, KIRCHNER J, BRUCKMANN N, et al. Multiparametric Integrated 18 F-FDG PET/MRI-Based Radiomics for Breast Cancer Phenotyping and Tumor Decoding[J]. Cancers, 2021, 13: 2928.CrossRef
37.
Zurück zum Zitat VALDORA F, HOUSSAMI N, ROSSI F, et al. Rapid review: Radiomics and breast cancer[J]. Breast Cancer Res Treat, 2018, 169: 217–229.CrossRef VALDORA F, HOUSSAMI N, ROSSI F, et al. Rapid review: Radiomics and breast cancer[J]. Breast Cancer Res Treat, 2018, 169: 217–229.CrossRef
38.
Zurück zum Zitat YANG X, LIU M, REN Y, et al. Using contrast-enhanced CT and non-contrast-enhanced CT to predict EGFR mutation status in NSCLC patients-a radiomics nomogram analysis[J]. Eur Radiol, 2022, 32: 2693–2703.CrossRef YANG X, LIU M, REN Y, et al. Using contrast-enhanced CT and non-contrast-enhanced CT to predict EGFR mutation status in NSCLC patients-a radiomics nomogram analysis[J]. Eur Radiol, 2022, 32: 2693–2703.CrossRef
39.
Zurück zum Zitat CHENG J, WEI J, TONG T, et al. Prediction of Histopathologic Growth Patterns of Colorectal Liver Metastases with a Noninvasive Imaging Method[J]. Ann Surg Oncol, 2019, 26: 4587–4598.CrossRef CHENG J, WEI J, TONG T, et al. Prediction of Histopathologic Growth Patterns of Colorectal Liver Metastases with a Noninvasive Imaging Method[J]. Ann Surg Oncol, 2019, 26: 4587–4598.CrossRef
40.
Zurück zum Zitat CEN C, LIU L, LI X, et al. Pancreatic Ductal Adenocarcinoma at CT: A Combined Nomogram Model to Preoperatively Predict Cancer Stage and Survival Outcome[J]. Front Oncol, 2021, 11: 594510. CEN C, LIU L, LI X, et al. Pancreatic Ductal Adenocarcinoma at CT: A Combined Nomogram Model to Preoperatively Predict Cancer Stage and Survival Outcome[J]. Front Oncol, 2021, 11: 594510.
41.
Zurück zum Zitat LI Z, WANG X, LI M, et al. Multi-modal radiomics model to predict treatment response to neoadjuvant chemotherapy for locally advanced rectal cancer[J]. World J Gastroenterol, 2020, 26: 2388–2402. LI Z, WANG X, LI M, et al. Multi-modal radiomics model to predict treatment response to neoadjuvant chemotherapy for locally advanced rectal cancer[J]. World J Gastroenterol, 2020, 26: 2388–2402.
42.
Zurück zum Zitat ZHANG Y, HE K, GUO Y, et al. A Novel Multimodal Radiomics Model for Preoperative Prediction of Lymphovascular Invasion in Rectal Cancer[J]. Front Oncol, 2020, 10: 457. ZHANG Y, HE K, GUO Y, et al. A Novel Multimodal Radiomics Model for Preoperative Prediction of Lymphovascular Invasion in Rectal Cancer[J]. Front Oncol, 2020, 10: 457.
Metadaten
Titel
Fusion and Radiomics Study of Multimodal Medical Images
verfasst von
Qingfeng Chen
Copyright-Jahr
2024
Verlag
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-99-8251-6_10

Premium Partner