Please use this identifier to cite or link to this item:
http://hdl.handle.net/1942/43606
Full metadata record
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Li, Tianxiao | - |
dc.contributor.author | CHEN, Junhong | - |
dc.contributor.author | Huang, Yiheng | - |
dc.contributor.author | Huang, Kesi | - |
dc.contributor.author | Xia, Qiqiang | - |
dc.contributor.author | Asim, Muhammad | - |
dc.contributor.author | Liu, Wenyin | - |
dc.date.accessioned | 2024-08-29T11:01:34Z | - |
dc.date.available | 2024-08-29T11:01:34Z | - |
dc.date.issued | 2024 | - |
dc.date.submitted | 2024-08-14T18:12:38Z | - |
dc.identifier.citation | Advanced Intelligent Computing Technology and Applications: Proceedings, Part VI, p. 193 -206 | - |
dc.identifier.isbn | 978-981-97-5596-7 | - |
dc.identifier.isbn | 978-981-97-5597-4 | - |
dc.identifier.issn | 0302-9743 | - |
dc.identifier.issn | 1611-3349 | - |
dc.identifier.uri | http://hdl.handle.net/1942/43606 | - |
dc.description.abstract | Referring image segmentation is a challenging task at the intersection of computer vision and natural language processing, aiming to segment out an object referred to by a natural language expression from an image. Recently despite significant progress on this task, existing methods still face challenges in effectively integrating visual and language information and enhancing the model's ability to capture fine-grained details within images. These challenges primarily originate from a lack of a mechanism capable of deeply and comprehensively fusing visual features with language features and effectively utilizing cross-modal features. To address these problems, we propose the Spectrum-driven Multi-scale Visual Transformer (SMVT), which incorporates two innovative designs: Spectrum-driven Fusion Attention (SFA) and the Cross-modal Feature Refinement Enhancement (CFRE) module. SFA, by guiding the fusion of visual and linguistic features at the spectral domain level, effectively captures fine-grained features in images and enhances the model's sensitivity to local spectral domain information , thereby responding more accurately to the detail requirements in language descriptions. CFRE module, by refining and enhancing cross-modal features at different layers, enhances the complementarity and the ability to capture fine-grained cross-modal features across different layers, promoting the precise alignment of visual and language features. These two modules enable the SMVT to more effectively process visual and language information. Experiments on three benchmark datasets have shown that our method surpasses state-of-the-art approaches. | - |
dc.language.iso | en | - |
dc.relation.ispartofseries | Lecture Notes in Computer Science | - |
dc.rights | The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2024 D.-S. Huang et al. (Eds.): ICIC 2024, LNCS 14867, pp. 193–206, 2024. | - |
dc.title | SMVT: Spectrum-Driven Multi-scale Vision Transformer for Referring Image Segmentation | - |
dc.type | Proceedings Paper | - |
local.bibliographicCitation.conferencename | 20th International Conference, ICIC 2024 | - |
local.bibliographicCitation.conferenceplace | Tianjin, China | - |
dc.identifier.epage | 206 | - |
dc.identifier.spage | 193 | - |
dc.identifier.volume | 14867 | - |
local.bibliographicCitation.jcat | C1 | - |
local.type.refereed | Refereed | - |
local.type.specified | Proceedings Paper | - |
local.relation.ispartofseriesnr | 14867 | - |
dc.identifier.doi | 10.1007/978-981-97-5597-4_17 | - |
dc.identifier.eissn | 1611-3349 | - |
local.provider.type | CrossRef | - |
local.bibliographicCitation.btitle | Advanced Intelligent Computing Technology and Applications: Proceedings, Part VI | - |
local.uhasselt.international | yes | - |
item.fullcitation | Li, Tianxiao; CHEN, Junhong; Huang, Yiheng; Huang, Kesi; Xia, Qiqiang; Asim, Muhammad & Liu, Wenyin (2024) SMVT: Spectrum-Driven Multi-scale Vision Transformer for Referring Image Segmentation. In: Advanced Intelligent Computing Technology and Applications: Proceedings, Part VI, p. 193 -206. | - |
item.accessRights | Restricted Access | - |
item.fulltext | With Fulltext | - |
item.contributor | Li, Tianxiao | - |
item.contributor | CHEN, Junhong | - |
item.contributor | Huang, Yiheng | - |
item.contributor | Huang, Kesi | - |
item.contributor | Xia, Qiqiang | - |
item.contributor | Asim, Muhammad | - |
item.contributor | Liu, Wenyin | - |
Appears in Collections: | Research publications |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
978-981-97-5597-4_17.pdf Restricted Access | Published version | 1.82 MB | Adobe PDF | View/Open Request a copy |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.