illustration of zoomed in eye on top of a computer screen on green gradient background

Computer Vision

Enabling computers and devices to understand what they see.

Microsoft at CVPR 2024: Innovations in computer vision and AI research

DecodingTrust: A Comprehensive Assessment of Trustworthiness in GPT Models

Exploring how context, culture, and character matter in avatar research

FeatUp: A Model-Agnostic Framework for Features at Any Resolution

Current selections

Sort by: Most recent

Clear selections

Search within these results

Content Types

People

Stephen Lin (202)

Antonio Criminisi (171)

Rick Szeliski (102)

Baining Guo (87)

Jianfeng Gao (72)

Neel Joshi (66)

Andrew D. Wilson (65)

Jianlong Fu (59)

Lijuan Wang (57)

Cha Zhang (56)

Dongdong Chen (54)

Dong Chen (53)

Yan Lu (48)

Caleb Robinson (48)

Cuiling Lan (42)

Harry Shum (42)

Chong Luo (41)

Yang Liu (40)

John Snyder (39)

Juan M. Lavista Ferres (35)

Linjie Li (35)

Qi Dai (34)

John Winn (33)

Andrew Blake (31)

Abigail Sellen (30)

Cecily Morrison (28)

Nebojsa Jojic (27)

Jiaolong Yang (27)

Yifan Yang (26)

Furu Wei (25)

Vibhav Vineet (23)

Xiyang Dai (23)

Anthony Ortiz (22)

Rahul Dodhia (21)

Ganesh Ananthanarayanan (19)

Tadas Baltrusaitis (19)

Kevin Lin (19)

Ed Cutrell (18)

Yue Dong (18)

Bei Liu (18)

Fangyun Wei (18)

Jiahao Li (17)

Dongsheng Li (17)

Yuqing Yang (17)

Yasuyuki Matsushita (17)

Bin Li (16)

Zinan Lin (16)

Vineeth N Balasubramanian (16)

Hoifung Poon (15)

Matthew Johnson (15)

Zhirong Wu (15)

Victor Bahl (14)

Lei Cui (14)

Wenxuan Xie (14)

Shikhar Sharma (14)

Hannes Schulz (14)

Ross Cutler (14)

Noel Codella (14)

Martin Grayson (13)

Spencer Fowers (13)

Sheng Zhang (13)

Eric Horvitz (12)

Manik Varma (12)

Akshay Nambi (12)

Tanuja Ganu (12)

Ishani Chakraborty (12)

Li Dong (11)

Daniel Coelho de Castro (11)

Tengchao Lv (11)

Chung-Ching Lin (11)

Xinyang Jiang (11)

Anton Schwaighofer (10)

Ran Gal (10)

Jinglu Wang (10)

Tristan Naumann (10)

Naoto Usuyama (10)

Shruthi Bannur (10)

Sicheng Xu (10)

Aditya Nori (9)

Jonathan M. Carlson (9)

Matthai Philipose (9)

Qiang Huo (9)

Sumit Basu (9)

Jeffrey Delmerico (9)

Xiaoyi Zhang (9)

Girmaw Abebe Tadesse (9)

Reuben Tan (9)

David Sweeney (8)

Michel Galley (8)

Tom Minka (8)

Venkat Padmanabhan (8)

Xun Guo (8)

Luming Liang (8)

Stephanie Hyland (8)

Gilles Quentin Hacheme (8)

Will Guyman (8)

Smitha Saligrama (8)

Cameron Runde (8)

Zhengyuan Yang (8)

Nicolas Villar (7)

Anja Thieme (7)

Camilla Longden (7)

Oscar Koller (7)

Ondrej Miksik (7)

Silvano Galliani (7)

Mohit Jain (7)

Shaohan Huang (7)

Yizhong Zhang (7)

Fernando Pérez-García (7)

Andrea Britto Mattos Lima (7)

Zongyu Guo (7)

Fatemeh Saleh (7)

Chin-Yew Lin (6)

Dongmei Zhang (6)

Katja Hofmann (6)

Lars Liden (6)

Peter Lee (6)

Richard Banks (6)

Xiulian Peng (6)

Javier Hernandez (6)

Cliff Wong (6)

Kai Qiu (6)

Rui Wang (6)

Lei Chu (6)

Shiqi Jiang (6)

Harshita Sharma (6)

Simone Fobi Nsutezo (6)

Thiago V. Spina (6)

Asma Ben Abacha (6)

Akram Zaytar (6)

Remi Pautrat (6)

Zhongqi Yue (6)

A.J. Brush (5)

Andrey Kolobov (5)

Aviv Hurvitz (5)

Ece Kamar (5)

Ivan Tashev (5)

Lei Ji (5)

Xiaodong Liu (5)

Nipun Kwatra (5)

Amber Hoak (5)

David Tittsworth (5)

Swadheen Shukla (5)

Christoph Vogel (5)

Danqing Huang (5)

Xiao Li (5)

Yang Liu (5)

Yixi Xu (5)

Hao Cheng (5)

Prof. Darren Cosker (5)

Qianhui Wu (5)

Harkirat Behl (5)

Whitney Hudson (5)

Christopher O'Dowd (5)

Lohit Petikam (5)

Kenza Bouzid (5)

Gabriele Goletto (5)

Rita Faia Marques (5)

Dan Bohus (4)

John Langford (4)

Mike Shepperd (4)

Sanjeev Mehrotra (4)

Sriram Rajamani (4)

Weizhu Chen (4)

Yaobo Liang (4)

Li Zhao (4)

Sean Andrist (4)

Guoxin Wang (4)

Hannah Richardson (nee Murfet) (4)

Qianxi Zhang (4)

Nikolaos Karianakis (4)

Victor Fragoso (4)

Kevin Hsieh (4)

Shahrzad Gholami (4)

Fanny Nina Paravecino (4)

Andrea Tupini (4)

Anthony Cintron Roman (4)

Xiang Ming (4)

Maximilian Ilse (4)

Yansen Wang (4)

Yangyu Huang (4)

Caihua Shan (4)

Amrita Gupta (4)

Tianyu Ding (4)

Sam Bond-Taylor (4)

Kwan Yun (4)

Amit Sharma (3)

Bodhi Priyantha (3)

Christopher Bishop (3)

Emre Kiciman (3)

Fan Yang (3)

Nicolo Fusi (3)

David Heckerman (3)

Kenji Takeda (3)

Kori Inkpen (3)

Henrique S. Malvar (3)

Michel Naim Gerguis (3)

Peter Bodík (3)

Qingwei Lin 林庆维 (3)

Shi Han (3)

Shujie Liu (3)

Shuo Chen (3)

Siân Lindley (3)

Scott Saponas (3)

Surajit Chaudhuri (3)

Yao Qian (3)

Harsha Simhadri (3)

Lester Mackey (3)

Luiz Belussi (3)

Andromachi Chatzieleftheriou (3)

P. Anandan (3)

Johnny Johnson (3)

Michael Hansen (3)

Yu Wang (3)

John Stairs (3)

Alex Lu (3)

Saravan Rajmohan (3)

Sheng Zhao (3)

Donglin Bai (3)

Mahdi Rad (3)

Allen Kim (3)

Xin Jin (3)

Dongqi Han (3)

Zhongqi Miao (3)

Wen-wai Yim (3)

Pashmina Cameron (3)

Ren Yang (3)

Guanghui Qin (3)

Baolin Peng (3)

Alec Wolman (2)

Christian Borgs (2)

Bozidar Radunovic (2)

Jim Gray (2)

Hitesh Ballani (2)

John Helmes (2)

Jinyu Li (2)

Kalika Bali (2)

Karin Strauss (2)

Margus Veanes (2)

Muscle Wu (2)

Qiufeng Yin (2)

Ranveer Chandra (2)

Sean Rintel (2)

Shamsi Iqbal (2)

Shuvendu Lahiri (2)

Siddhartha Sen (2)

Vassily Lyutsarev (2)

Hanna Wallach (2)

Xing Xie (2)

Sergey Yekhanin (2)

Moshe Lutz (2)

Bichlien Nguyen (2)

Solon Barocas (2)

Chinmay Singh (2)

Mihaela Vorvoreanu (2)

Nagarajan Natarajan (2)

Scarlett Li (2)

Jimmy Hall (2)

Pratik Ghosh (2)

Neil Tenenholtz (2)

Ran Gilad-Bachrach (2)

Xiubo Geng (2)

Kevin Kaichuang Yang (2)

Barun Patra (2)

Patrick Misteli (2)

Xia Song (2)

Lorin Crawford (2)

Felipe Oviedo (2)

Ashley J. Llorens (2)

Weiwei Yang (2)

Kristen Severson (2)

Ava P. Amini (2)

Robin Abraham (2)

Jayashree Mohan (2)

Victor Ruehle (2)

Jue Zhang (2)

Srinivasan Iyengar (2)

Thomas Roca, PhD (2)

Rogerio Bonatti (2)

Shideh Rezaeifar (2)

Scott Freitas (2)

Jaspreet Bagga (2)

Matheus R. F. Mendonça (2)

Xi (Ada) Wang (2)

Judith Amores (2)

Nicholas Jing Yuan (2)

Jameson Merkow (2)

Saikat Chakraborty (2)

Ade Famoti (2)

Mansi Khemka (2)

Amit Misra (2)

Flora Liu (2)

Juan Manuel Zambrano Chaves (2)

Hui Xue (2)

Varun Jain (2)

Henrik Turbell (2)

Yuhang He (2)

Thomas Lin (2)

Wenhui Wang (2)

Zhiliang Peng (2)

Ziyu Wan (2)

Fabian Falck (2)

Maia Stiber (2)

Rishi Sharma (2)

Linda Yilin Wen (2)

Anoop Gupta (1)

Josh Benaloh (1)

Brendan Lucier (1)

Chris Hawblitzel (1)

Chris Quirk (1)

Chris Sienkiewicz (1)

Chris White (1)

Scott Counts (1)

Christian Paquin (1)

Chuck Thacker (1)

Daniel Cletheroe (1)

Darren Edge (1)

David Johnston (1)

Doug Burger (1)

Dongdong Zhang (1)

Ethan Jackson (1)

Gabe Cohn (1)

Gordon Bell (1)

E. Glen Weyl (1)

G. Ramalingam (1)

Hannes Gamper (1)

Hugh Williams (1)

Íñigo Goiri (1)

Jaron Lanier (1)

Jacki O'Neill (1)

Jennifer Chayes (1)

Jennifer Wortman Vaughan (1)

Jonathan Lester (1)

Jake Hofman (1)

Jonathan Larson (1)

Karen Easterbrook (1)

Krishna Chintalapudi (1)

Ken Woodberry (1)

Leslie Lamport (1)

Lily Sun (1)

Miro Dudík (1)

Jeremiah (Miah) Wander (1)

Michel Pahud (1)

Vishnu Navda (1)

Nishanth Chandran (1)

Nicole Immorlica (1)

Nikhil Swamy (1)

Pallavi Choudhury (1)

Bo-June (Paul) Hsu (1)

Paolo Costa (1)

Patrick Longa (1)

Rick Rashid (1)

Reuben Olinsky (1)

Ricardo Bianchini (1)

Rich Draves (1)

Rick Rogahn (1)

Ryen W. White (1)

Ryota Tomioka (1)

Sharad Agarwal (1)

Santiago Zanella-Béguelin (1)

Sasa Junuzovic (1)

Shobana Balakrishnan (1)

Srinath Setty (1)

Sumit Gulwani (1)

Thomas Karagiannis (1)

Ramarathnam Venkatesan (1)

Vivek Narasayya (1)

Xin Ma (1)

Yan Huang (1)

Yan Xia (1)

Ben Zorn (1)

Swami Manohar (1)

Stavros Volos (1)

Paul Smolensky (1)

Matthias Troyer (1)

Nathan Evans (1)

Robert Sim (1)

Qi Chen (1)

Pat Sweeney (1)

Irene Zhang (1)

Adam Atkinson (1)

Haoyu Dong (1)

Advait Sarkar (1)

Matthew Dixon (1)

Xingdi Yuan (1)

Ted Meeds (1)

Marc-Alexandre Côté (1)

Sunayana Sitaram (1)

Dan R. K. Ports (1)

Dimitra Emmanouilidou (1)

Landon Cox (1)

Karthik Ramachandra (1)

Sonia Jaffe (1)

Sebastian Braun (1)

Francesca Parmigiani (1)

James Clegg (1)

Bo Qiao (1)

Boris Köpf (1)

Andrew Paverd (1)

Kate Lytvynets (1)

Sudha Rao (1)

Eduardo Salinas (1)

Jianxun Lian (1)

Robert Gmyr (1)

Lukas Gruber (1)

Xiaofei Wang (1)

Shruti Tople (1)

Jiaqi Chu (1)

Mike Walker (1)

Vu Le (1)

Huaying Xue (1)

Xenofon Foukas (1)

Kelvin Chan (1)

Brian Caswell (1)

Yiwen Zhu (1)

Rohit Pillai (1)

Madeleine Daepp (1)

Anna Pavlenko (1)

Joyce Cahoon (1)

Chad Atalla (1)

Amanda K. Hall (1)

Samuel Chege Maina (1)

Kevin Larson (1)

Luis França (1)

Esha Choukse (1)

Huseyin Inan (1)

Mattan Serry (1)

Mario Gini (1)

Harsh Vijay (1)

Millicent Ochieng (1)

Jesús Camacho-Rodríguez (1)

Douglas J. Kelly (1)

Rianne van den Berg (1)

Gaurav Mittal (1)

Sameer Segal (1)

Jake Smith (1)

Chang Xu (1)

Serena Hillman (1)

Chenglong Wang (1)

Kali Frost (1)

Jyoti Aneja (1)

Javier Zazo (1)

Luna K. Qiu (1)

Darren Tanner (1)

Giovanni Cherubin (1)

Fangkai Yang (1)

Gust Verbruggen (1)

Srikant Bharadwaj (1)

Yuge Zhang (1)

Tammy Glazer (1)

Lucas A. Meyer (1)

Xiao Liu (1)

Burcu Canakci (1)

Menglin Xia (1)

Chris Parnin (1)

Corby Rosset (1)

Si Qin (1)

Mukul Singh (1)

Sarah Fakhoury (1)

Sergio Valcarcel Macua (1)

Sarah Smith (1)

Suraj Jog (1)

Chaojie Zhang (1)

Ursula Hardy (1)

Lucia Ronchi Darre (1)

Stephen Schneider (1)

Xiaoting Qin (1)

Aashaka Shah (1)

Renee St. Amant (1)

Kirill Kalinin (1)

Lev Tankelevitch (1)

Weijian Xu (1)

Andrzej Banburski-Fahey (1)

Arman Salimi (1)

Yupan Huang (1)

Jennifer Marsman (1)

Vivan Amin (1)

Sarah Alamdari (1)

Jeya Maria Jose Valanarasu (1)

Lukas Schäfer (1)

Chuheng Zhang (1)

Sushrut Karmalkar (1)

Emily Sheng (1)

Jean Garcia-Gathright (1)

Mercy Ranjit (1)

Zilong Wang (1)

Meygha Machado (1)

Galen Mullins (1)

Kevin Qu (1)

Alexander Ersoy (1)

Alberto Santamaria-Pang (1)

Tristan Lazard (1)

Juheon (1)

Yaoyao Chang (1)

Cynthia Lo (1)

Waqas Zamir (1)

Wassim Hamidouche (1)

Lu Wang (1)

Wei-Ning Chen (1)

Riashat Islam (1)

Tim Pearce (1)

Carl Chalmers (1)

Hannah Washington (1)

Vivek Mathur (1)

Payod Panda (1)

Rachel Lawrence (1)

Yadong Lu (1)

Olivier Jaubert (1)

Ana Lawry Aguila (1)

Sunnie S. Y. Kim (1)

Leonardo F. R. Ribeiro (1)

Moein Shariatnia (1)

Lokesh Nagalapatti (1)

Published Date

Publication

ArK: Augmented Reality with Knowledge Emergent Infrastructure

Qiuyuan Huang, James Park, Abhinav Gupta, Pan Lu, Paul Bennett, Ran Gong, Subhojit Som, Baolin Peng, Owais Khan Mohammed, Chris Pal, Yejin Choi, Jianfeng Gao

Selected as the project in HackBox 2023; Shipped to Office Teams | April 2023

Project Project

Publication

A Large-scale Robustness Analysis of Video Action Recognition Models

Madeline Chantry Schiappa, Naman Biyani, Prudvi Kamtam, Shruti Vyas, Hamid Palangi, Vibhav Vineet, Yogesh Rawat

April 2023

Publication

Instruction Tuning with GPT-4

Baolin Peng, Chunyuan Li, Pengcheng He, Michel Galley, Jianfeng Gao

MSR-TR-2023-35 | April 2023

Published by Microsoft

Project Page: https://instruction-tuning-with-gpt-4.github.io/

Project

Publication

GEMEL: Model Merging for Memory-Efficient, Real-Time Video Analytics at the Edge

Arthi Padmanabhan , Neil Agarwal , Anand Iyer, Ganesh Ananthanarayanan, Yuanchao Shu, Nikolaos Karianakis, Guoqing Harry Xu , Ravi Netravali

USENIX NSDI | April 2023

Project

Publication

RECL: Responsive Resource-Efficient Continuous Learning for Video Analytics

Mehrdad Khani , Ganesh Ananthanarayanan, Kevin Hsieh, Junchen Jiang , Ravi Netravali , Yuanchao Shu, Mohammad Alizadeh, Victor Bahl

USENIX NSDI | April 2023

Project

Bringing specialized healthcare to rural and underserved communities with live 3D communication Our paper, “Participatory Development of a 3D Telemedicine system during Covid: the future of remote consultations” received the Top Paper award at BAPRAS…

Publication

Universal Few-shot Learning of Dense Prediction Tasks with Visual Token Matching

Donggyun Kim, Jinwoo Kim, Seongwoong Cho, Chong Luo, Seunghoon Hong

ICLR 2023 | March 2023

Outstanding Paper

Video

Learning to Exploit Temporal Structure for Biomedical Vision-Language Processing

March 24, 2023

Presented by the Microsoft Health Futures team at CVPR 2023. [Publication] Learning to Exploit Temporal Structure for Biomedical Vision-Language Processing

05:38

Tool

Temporal Vision-Language Processing (BioViL-T)

BioViL-T is a Vision-Language model trained on sequences of biomedical image and text data at a scale. It does not require manual annotations and can leverage historical raw clinical image acquisitions and clinical notes. The…

Access Publication Publication

Publication

Extreme Masking for Learning Instance and Distributed Visual Representations

Zhirong Wu, Zihang Lai, Xiao Sun, Stephen Lin

Transactions on Machine Learning Research | March 2023

Computer Vision

Highlights