About me

I am an Associate Professor in the College of Information and Computer Sciences at the University of Massachusetts, Amherst and the co-director of the Computer Vision Lab. I am affilated with the Center of Data Science. Prior to this I spent three years as a Research Assistant Professor at TTI Chicago, a philanthropically endowed academic computer science institute in the University of Chicago campus. I obtained my Ph.D. under the supervision of Jitendra Malik from the University of California at Berkeley in 2011, and a B.Tech. in Computer Science and Engineering from IIT Kanpur in 2006. In the past I have enjoyed working at AWS AI, Google, INRIA LEAR group, Microsoft Research India, the CLSP center at Johns Hopkins University, and Oxford University. My research is funded by the National Science Foundation, including a CAREER, as well as faculty grants from Facebook, NVIDIA, and Adobe.

My research focusses on computer vision with a particular emphasis on algorithms for high-level recognition. My goal is enable cheap and robust sensing of the visual world using cameras powered by computer vision. For an overview of my research take a look at my recent publications, CV and research statement (visualized as a word cloud). I am also on Google scholar.

I'm on a sabbatical from Fall'21 - Spring'22 based in Delft, NL. I'm visiting the University of Amsterdam.

A better computer science department rankings for PhD students: http://csrankings.org.

Recent news

5/22 Congratulations to Gopal Sharma for graduating with a PhD! Gopal was co-advised by Evangelos Kalogerakis and is off to a post-doc at University of British Columbia.
5/22 Climate Change AI grant for material design with Prof. Peng Bai.
5/22 Guest lecture at the CV summer school at Amsterdam.
3/22 I will be an Area Chair for ECCV 22.
3/22 Attended the AI for the Social Good Dagstuhl Seminar.
3/22 Recent papers @ CVPR 22 and IJCV 22.
3/22 Co-organizing FGVC9 workshop @ CVPR 22. Submit your ongoing work (deadline March 25 via CMT).
12/21 I was a program chair for ICVGIP 2021.
11/21 Congrats to Gustavo Perez for winning the CICS Outstanding Synthesis Award for the StarcNet project, and Jong-Chyi for winning the CICS Outstanding TA Award (Press)
10/21 Jong-Chyi will present a paper at BMVC'21. Zezhou and Matheus will present their papers at ICCV'21.
10/21 Recent talks at UVA, TU Delft, KU Leuven, CVIT Summer School, AIBee.
10/21 Congratulations to Matheus Gadelha, Jong-Chyi Su and Chenyun Wu for successfully defending their PhDs!
6/21 Zityan, Jong-Chyi, Zhaowei will present their papers at CVPR'21. Jong-Chyi organized the Semi-Supervised iNaturalist challenge @ FGVC8. Tech report and dataset released.
2/21 StarcNet appears at the Astrophysics journal. Congrats Gustavo and Matteo.
12/20 I'll serve as an Area Chair for CVPR 2021 and ICCV 2021.
9/20 Promoted to Associate Professor with Tenure! Many thanks to students, collaborators, mentors, colleagues, friends and family for their support along the way.
8/20 Teaching Computer Vision @ UMass
8/20 NSF grant awarded in collaboration with Colarado State and Univ. of Oklahoma on using CV and ML to study aerial insectivores.
7/20 Four papers accepted to ECCV 2020. PrGAN appears at IJCV.
7/20 Official code for Task2Vec available.
6/20 CVPR 2020 updates:
+ I gave a talk at the deep declarative networks workshop.
+ Chenyun and Matheus presented their papers at the main conference.
+ Matheus and Jong-Chyi presented their papers at the visual learning with limited labels workshop.
+ Jong-Chyi co-organized the semi-supervised challenge at the FGVC7 workshop.
+ Talks and competetion results from the FGVC7 workshop posted.
2/20 Organizing Fine-grained Visual Categorization (FGVC7) workshop at CVPR 2020. Call for papers posted.
12/19 How has nocturnal bird migration shifted in the last 20+ years? See our latest paper at Nature Climate Change.
12/19 Our bird roost detection project will appear at AAAI 2020.
12/19 Congrats to Zezhou and Matheus for winning the best poster and an honorable mention at the New England Computer Vision Workshop held at Brown University this year.
12/19 I will serve as an Area Chair for CVPR 2020 and ECCV 2020
10/19 At ICCV I'll be (1) giving invited talks at the Extreme Vision Modeling workshop, the Computer Vision for Wildlife Conservation workshop, and a tutorial on higher-order image representations; and (2) presenting two papers.
9/19 Teaching Computer Vision @ UMass
9/19 NSF grant awarded on 3D shape understanding with Rui Wang
8/19 Recent preprints and upcoming papers (see publications):
+ MistNet appears in Methods in Ecology and Evolution (press release)
+ Two papers to appear at ICCV 19 and one at 3DV 19
+ Two papers to appear at CVPR 19 and one at AAAI 19, UBICOMP 19, KDD 19
+ Journal accepted on IEEE Trans. on Info. Theory
+ ArXiv highlights: Task2Vec, PrGAN++
2/19 Invited talk at ICERM @ Brown University. Talk slides.
1/19 Co-organizing FGVC6 workshop at CVPR 19.
+ Several competetions are live. Participate to win prizes!
+ Call for papers posted.
1/19 I'll serve as an area chair for CVPR 19 and on the SPC for IJCAI 19.
1/19 Teaching Intro to Computer Vision (370) @ UMass
10/18 NSF grant awarded for machine learning for Astronomy.
8/18 A recent talk at Caltech summarizing our work on 3D shape generation.
7/18 Two papers and a workshop paper accepted to ECCV 18.
6/18 SPLATNet won the best paper honorable mention at CVPR 18. Popular press: UMass, NVIDIA, Medium
6/18 NSF CAREER grant awarded. University press release.
5/18 Upcoming papers and workshops:
+ VisemeNet to appear @ SIGGRAPH 18
+ Two papers: SPLATNet, CSGNet to appear @ CVPR 18
+ Fine-Grained Visual Categorization (FGVC5) workshop @ CVPR 18
4/18 Invited talk at the annual data science resesarch symposium.
1/18 Teaching Intro to Computer Vision (370) @ UMass
12/17 I will serve as an area chair for CVPR 2018.
10/17 Invited talk at the Manifold Learning Workshop @ ICCV 17.
7/17 Dark ecology project funded by NSF. Link to the press release.
7/17 Upcoming papers and recent preprints:
+ 2 papers at 3DV, 3 papers at BMVC 17, 1 at ICCV 17 (see publications)
+ Bilinear CNNs PAMI preprint, arXiv v6, Jun 2017
+ 3D Shape Segmentation with Projective Convolutional Networks, CVPR 17 (oral presentation)
+ 3D Shape Reconstruction from Sketches via Multi-view Convolutional Networks, arXiv, July 17
4/17 Department colloquium speaker at RIT and UoR.
9/16 Teaching Computer Vision @ UMass
6/16 Received NSF grant for language-based understanding of textures, and a gift from Facebook.


Coursework: Tutorials: Workshops:


Current advisees: Past PhD students: Past advisees and collaborators:


I occasionally draw and paint.