Description: I'm Ali Hassani, computer science PhD student at Georgia Tech. My primary research interest is studying deep learning architectures, specifically attention-based models.
CS PhD student at University of Oregon
I am a computer science PhD student at University of Oregon, and am advised by Prof. Humphrey Shi . My research interests are attention-based models, representation learning, and self-supervision. More recently, we released NAT (accepted to CVPR 2023!) and DiNAT , which are hierarchical vision transformers built upon Neighborhood Attention, our proposed sliding-window attention. Check out our PyTorch extension, NATTEN , available now via PyPI.
GitHub / Google Scholar / Twitter