Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content

Swin-MMC: Swin-Based Model for Myopic Maculopathy Classification in Fundus Images

  • Conference paper
  • First Online:
Myopic Maculopathy Analysis (MICCAI 2023)

Abstract

Myopic maculopathy is a highly myopic retinal disorder that often occurs in highly myopic patients, serving as a major cause of visual impairment and blindness in numerous countries. Currently, fundus images serve as a prevalent diagnostic tool for myopic maculopathy. However, its efficacy relies on the expertise of clinicians, making the process labor-intensive. Thus, we propose a model specifically designed for the image classification of myopic maculopathy, named Swin-MMC, based on the Swin Transformer model architecture, which achieves outstanding performance on the test dataset. To achieve a finer-grained classification of myopic maculopathy in fundus images, we have innovatively and for the first time proposed the use of enhanced ArcFace loss in medical image classification. Then, based on the Swin-MMC model, we introduce a weak label strategy that effectively mitigates overfitting. Our approach achieves significantly improved results on the test dataset and can be easily used for various datasets and classification tasks. We conduct a series of experiments in the MMAC2023 challenge. In the testing phase, our average performance metric reaches 86.60%. In the further testing phase, our model’s performance improves to 88.23%, ultimately securing the championship in the MMAC2023 challenge. The codes allowing replication of this study have been made publicly available at https://github.com/LuliDreamAI/MICCAI_TASK1.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Almalik, F., Yaqub, M., Nandakumar, K.: Self-ensembling vision transformer (SEViT) for robust medical image classification. In: Wang, L., Dou, Q., Fletcher, P.T., Speidel, S., Li, S. (eds.) Medical Image Computing and Computer Assisted Intervention - MICCAI 2022. MICCAI 2022. LNCS, vol. 13433, pp. 376–386. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-16437-8_36

  2. Bilal, A., Zhu, L., Deng, A., Lu, H., Wu, N.: Ai-based automatic detection and classification of diabetic retinopathy using u-net and deep learning. Symmetry 14(7), 1427 (2022)

    Article  Google Scholar 

  3. Chen, R., et al.: Automatic recognition of ocular surface diseases on smartphone images using densely connected convolutional networks. In: 2021 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), pp. 2786–2789. IEEE (2021)

    Google Scholar 

  4. Dai, L., et al.: A deep learning system for detecting diabetic retinopathy across the disease spectrum. Nat. Commun. 12(1), 3242 (2021)

    Article  Google Scholar 

  5. Deng, J., Guo, J., Xue, N., Zafeiriou, S.: ArcFace: additive angular margin loss for deep face recognition. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 4690–4699 (2019)

    Google Scholar 

  6. Dosovitskiy, A., et al.: An image is worth 16x16 words: transformers for image recognition at scale. arXiv preprint arXiv:2010.11929 (2020)

  7. Fang, Z., Xu, Z., He, X., Han, W.: Artificial intelligence-based pathologic myopia identification system in the ophthalmology residency training program. Front. Cell Dev. Biol. 10, 1053079 (2022)

    Article  Google Scholar 

  8. Gummadi, S.D., Ghosh, A.: Classification of ocular diseases: a vision transformer-based approach. In: Roy, S., Sinwar, D., Dey, N., Perumal, T., Tavares, J.M.R.S. (eds.) Innovations in Computational Intelligence and Computer Vision. ICICV 2022, LNNS, vol. 680, pp. 325–337. Springer, Singapore (2023). https://doi.org/10.1007/978-981-99-2602-2_25

  9. Holden, B.A., et al.: Global prevalence of myopia and high myopia and temporal trends from 2000 through 2050. Ophthalmology 123(5), 1036–1042 (2016)

    Article  Google Scholar 

  10. Hossain, K.F., Kamran, S.A., Ong, J., Lee, A.G., Tavakkoli, A.: Revolutionizing space health (Swin-FSR): advancing super-resolution of fundus images for SANS visual assessment technology. In: Greenspan, H., et al. Medical Image Computing and Computer Assisted Intervention - MICCAI 2023, MICCAI 2023, LNCS, vol. 14226, pp 693–703. Springer, Cham (2023). https://doi.org/10.1007/978-3-031-43990-2_65

  11. Khan, I.A., Sajeeb, A., Fattah, S.A.: An automatic ocular disease detection scheme from enhanced fundus images based on ensembling deep CNN networks. In: 2020 11th International Conference on Electrical and Computer Engineering (ICECE), pp. 491–494. IEEE (2020)

    Google Scholar 

  12. Liu, R., et al.: Deepdrid: diabetic retinopathy-grading and image quality estimation challenge. Patterns 3(6), 100512 (2022)

    Google Scholar 

  13. Liu, Z., et al.: Swin transformer: Hierarchical vision transformer using shifted windows. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 10012–10022 (2021)

    Google Scholar 

  14. Lu, L., et al.: Ai-model for identifying pathologic myopia based on deep learning algorithms of myopic maculopathy classification and “plus” lesion detection in fundus images. Front. Cell Dev. Biol. 9, 719262 (2021)

    Google Scholar 

  15. Nawaz, M., et al.: An efficient deep learning approach to automatic glaucoma detection using optic disc and optic cup localization. Sensors 22(2), 434 (2022)

    Article  Google Scholar 

  16. Ohno-Matsui, K., et al.: International photographic classification and grading system for myopic maculopathy. Am. J. Ophthalmol. 159(5), 877–883 (2015)

    Article  Google Scholar 

  17. Potapenko, I., et al.: Automated artificial intelligence-based system for clinical follow-up of patients with age-related macular degeneration. Acta Ophthalmol. 100(8), 927–936 (2022)

    Article  Google Scholar 

  18. Sebastian, A., Elharrouss, O., Al-Maadeed, S., Almaadeed, N.: A survey on deep-learning-based diabetic retinopathy classification. Diagnostics 13(3), 345 (2023)

    Article  Google Scholar 

  19. Sun, Y., et al.: A deep network using coarse clinical prior for myopic maculopathy grading. Comput. Biol. Med. 154, 106556 (2023)

    Article  Google Scholar 

  20. Velpula, V.K., Sharma, L.D.: Multi-stage glaucoma classification using pre-trained convolutional neural networks and voting-based classifier fusion. Front. Physiol. 14, 1–117588 (2023)

    Article  Google Scholar 

  21. Wang, R., et al.: Efficacy of a deep learning system for screening myopic maculopathy based on color fundus photographs. Ophthalmol Therapy 12(1), 469–484 (2023)

    Article  Google Scholar 

  22. Xie, Z., et al.: Simmim: a simple framework for masked image modeling. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 9653–9663 (2022)

    Google Scholar 

  23. Zang, P., Hormel, T.T., Hwang, T.S., Bailey, S.T., Huang, D., Jia, Y.: Deep-learning-aided diagnosis of diabetic retinopathy, age-related macular degeneration, and glaucoma based on structural and angiographic oct. Ophthalmol. Sci. 3(1), 100245 (2023)

    Article  Google Scholar 

Download references

Acknowledgements

The authors of this paper declare that the classification method they implemented for participation in the MMAC 2023 challenge, targeting myopic maculopathy, utilized the Swin model trained on the publicly available and widely recognized dataset, ImageNet21k, and fine-tuned on the ImageNet1k dataset. The ImageNet21k dataset consists of approximately 14 million images and 21,000 classes, and the ImageNet1k dataset contains around 1,000,000 images across 1,000 categories. Moreover, no additional datasets other than those provided by the organizers were used. The proposed solution is fully automatic and devoid of any manual intervention. Lastly, this work was supported by the National Key Research and Development Program of China (No. 2022YFF0606303).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ye Ding .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Lu, L., Pan, X., Jin, P., Ding, Y. (2024). Swin-MMC: Swin-Based Model for Myopic Maculopathy Classification in Fundus Images. In: Sheng, B., Chen, H., Wong, T.Y. (eds) Myopic Maculopathy Analysis. MICCAI 2023. Lecture Notes in Computer Science, vol 14563. Springer, Cham. https://doi.org/10.1007/978-3-031-54857-4_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-54857-4_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-54856-7

  • Online ISBN: 978-3-031-54857-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics