SwinCup: Cascaded swin transformer for histopathological structures segmentation in colorectal cancer

Zidan, Usama and Gaber, Mohamed Medhat and Abdelsamea, Mohammed M. (2022) SwinCup: Cascaded swin transformer for histopathological structures segmentation in colorectal cancer. Expert Systems with Applications, 216. p. 119452. ISSN 0957-4174

1-s2.0-S095741742202471X-main.pdf - Published Version
Available under License Creative Commons Attribution.

Download (2MB)


Transformer models have recently become the dominant architecture in many computer vision tasks, including image classification, object detection, and image segmentation. The main reason behind their success is the ability to incorporate global context information into the learning process. By utilising self-attention, recent advancements in the Transformer architecture design enable models to consider long-range dependencies. In this paper, we propose a novel transformer, named Swin Transformer with Cascaded UPsampling (SwinCup) model for the segmentation of histopathology images. We use a hierarchical Swin Transformer with shifted windows as an encoder to extract global context features. The multi-scale feature extraction in a Swin transformer enables the model to attend to different areas in the image at different scales. A cascaded up-sampling decoder is used with an encoder to improve its feature aggregation. Experiments on GLAS and CRAG histopathology colorectal cancer datasets were used to validate the model, achieving an average 0.90 (F1 score) and surpassing the state-of-the-art by (23%).

Item Type: Article
Identification Number: https://doi.org/10.1016/j.eswa.2022.119452
20 December 2022Accepted
30 December 2022Published Online
Uncontrolled Keywords: Transformers, Histology image analysis, Gland segmentation, Deep learning, Self-supervision
Subjects: CAH11 - computing > CAH11-01 - computing > CAH11-01-01 - computer science
Divisions: Faculty of Computing, Engineering and the Built Environment > School of Computing and Digital Technology
Depositing User: Gemma Tonks
Date Deposited: 16 Jan 2023 11:21
Last Modified: 16 Jan 2023 11:21
URI: https://www.open-access.bcu.ac.uk/id/eprint/14119

Actions (login required)

View Item View Item


In this section...