Talk:Vision transformer

This article is within the scope of WikiProject Computer science, a collaborative effort to improve the coverage of Computer science related articles on Wikipedia. If you would like to participate, please visit the project page, where you can join the discussion and see a list of open tasks.Computer scienceWikipedia:WikiProject Computer scienceTemplate:WikiProject Computer scienceComputer science

Low

This article has been rated as Low-importance on the project's importance scale.

Things you can help WikiProject Computer science with:

Here are some tasks awaiting attention:

Article requests :
- Requested articles/Applied arts and sciences/Computer science, computing, and Internet
Cleanup :
- Computer science articles needing attention
- Computer science articles needing expert attention
Copyedit :
- Computing
Expand :
- Computer science
Infobox :
- Computer science articles without infoboxes
Maintain :
- Timeline of computing 2020–present
Photo :
- Find pictures for the biographies of computer scientists (see List of computer scientists)
- Computing articles needing images
Stubs :
- Computer science stubs
Unreferenced :
- WikiProject Computer science/Unreferenced BLPs
Project-related :
- Tag all relevant articles in Category:Computer science and sub-categories with {{WikiProject Computer science}}

Artificial Intelligence

	This article is within the scope of WikiProject Artificial Intelligence, a collaborative effort to improve the coverage of Artificial intelligence on Wikipedia. If you would like to participate, please visit the project page, where you can join the discussion and see a list of open tasks.Artificial IntelligenceWikipedia:WikiProject Artificial IntelligenceTemplate:WikiProject Artificial IntelligenceArtificial Intelligence
???	This article has not yet received a rating on the project's importance scale.

Technology

This article is within the scope of WikiProject Technology, a collaborative effort to improve the coverage of technology on Wikipedia. If you would like to participate, please visit the project page, where you can join the discussion and see a list of open tasks.TechnologyWikipedia:WikiProject TechnologyTemplate:WikiProject TechnologyTechnology

Including Neighborhood Attention Transformer?

Latest comment: 6 months ago1 comment1 person in discussion

It's another transformer similar to Swin Transformer, both taking inspiration from CNN. Neighbor attention is very similar to Swin's approach, both using square-shaped blocks of patches. Though, there's some significant difference in how the squares are structured.

While Neighborhood Attention had good results (supposedly beating swin), it's relative unknown and not used much compared to swin (likely due to difficulty to use/ requiring custom kernel). So I'm not sure if it's got enough notability to be included. Anothercat613 (talk) 19:38, 28 January 2026 (UTC)Reply

This page was redesigned at the edge.

A page that knows where it met you.

Talk:Vision transformer

Including Neighborhood Attention Transformer?