About me

I am an Associate Professor in the Manning College of Information and Computer Sciences at the University of Massachusetts, Amherst and the co-director of the Computer Vision Lab. I am also affilated with the Center of Data Science. Prior to this I was a Research Assistant Professor at TTI Chicago, a philanthropically endowed academic computer science institute in the University of Chicago campus. I obtained my PhD under the supervision of Jitendra Malik from the University of California at Berkeley in 2011, and a BTech in Computer Science and Engineering from IIT Kanpur in 2006. In the past I have enjoyed working at the University of Amsterdam, AWS AI, Google, INRIA, Microsoft Research, the CLSP center at JHU, and Oxford University. My research is funded by the National Science Foundation (including a CAREER), NASA, as well as awards from Climate Change AI, Facebook, NVIDIA, and Adobe.

My research focusses on computer vision with a particular emphasis on algorithms for high-level recognition. My goal is enable cheap and robust sensing of the visual world using cameras powered by computer vision. For an overview of my research take a look at my recent publications, CV and research statement (visualized as a word cloud). I am also on Google scholar.

A better computer science department rankings for PhD students: http://csrankings.org.

Recent news

9/22 Check out the latest papers from our group that appear at CVPR, ECCV, ICPR, ACM Multimedia, IJCV and the Astrophysical Journal this year.
9/22 I am back from a sabbatical and will be teaching Computer Vision @ UMass.
9/22 NASA grant on mapping rivers from satellite imagery.
5/22 Congrats Gopal Sharma for his PhD! Gopal was co-advised by Evangelos Kalogerakis and is off to a post-doc at University of British Columbia.
5/22 Climate Change AI grant for material design with Prof. Peng Bai.
5/22 Guest lecture at the CV summer school at Amsterdam.
3/22 I will be an Area Chair for ECCV 22 and WACV 23.
3/22 Attended the AI for the Social Good Dagstuhl Seminar.
3/22 Recent papers @ CVPR 22 and IJCV 22.
3/22 Co-organizing FGVC9 workshop @ CVPR 22. Submit your ongoing work by 3/25 via CMT.
12/21 I was a program chair for ICVGIP 2021.
11/21 Congrats Gustavo Perez for winning the CICS Outstanding Synthesis Award for the StarcNet project, and Jong-Chyi for winning the CICS Outstanding TA Award (Press).
10/21 Jong-Chyi will present a paper at BMVC 21. Zezhou and Matheus will present their papers at ICCV 21.
10/21 Recent talks at UVA, TU Delft, KU Leuven, CVIT Summer School, AIBee.
9/21 I'm on a sabbatical during AY 21-22 visiting the University of Amsterdam.
6/21 Zityan, Jong-Chyi, Zhaowei will present their papers at CVPR'21. Jong-Chyi organized the Semi-Supervised iNaturalist challenge @ FGVC8. Tech report and dataset released.
2/21 StarcNet appears at the Astrophysics journal. Congrats Gustavo and Matteo.
12/20 I'll serve as an Area Chair for CVPR 2021 and ICCV 2021.
9/20 Promoted to Associate Professor with Tenure! Many thanks to students, collaborators, mentors, colleagues, friends and family for their support along the way.
8/20 Teaching Computer Vision @ UMass
8/20 NSF grant awarded in collaboration with Colarado State and Univ. of Oklahoma on using CV and ML to study aerial insectivores.
7/20 Four papers accepted to ECCV 2020. PrGAN appears at IJCV.
7/20 Official code for Task2Vec available.
6/20 CVPR 2020 updates:
+ I gave a talk at the deep declarative networks workshop.
+ Chenyun and Matheus presented their papers at the main conference.
+ Matheus and Jong-Chyi presented their papers at the visual learning with limited labels workshop.
+ Jong-Chyi co-organized the semi-supervised challenge at the FGVC7 workshop.
+ Talks and competetion results from the FGVC7 workshop posted.
2/20 Organizing Fine-grained Visual Categorization (FGVC7) workshop at CVPR 2020. Call for papers posted.
12/19 How has nocturnal bird migration shifted in the last 20+ years? See our latest paper at Nature Climate Change.
12/19 Our bird roost detection project will appear at AAAI 2020.
12/19 Congrats to Zezhou and Matheus for winning the best poster and an honorable mention at the New England Computer Vision Workshop held at Brown University this year.
12/19 I will serve as an Area Chair for CVPR 2020 and ECCV 2020
10/19 At ICCV I'll be (1) giving invited talks at the Extreme Vision Modeling workshop, the Computer Vision for Wildlife Conservation workshop, and a tutorial on higher-order image representations; and (2) presenting two papers.
9/19 Teaching Computer Vision @ UMass
9/19 NSF grant awarded on 3D shape understanding with Rui Wang
8/19 Recent preprints and upcoming papers (see publications):
+ MistNet appears in Methods in Ecology and Evolution (press release)
+ Two papers to appear at ICCV 19 and one at 3DV 19
+ Two papers to appear at CVPR 19 and one at AAAI 19, UBICOMP 19, KDD 19
+ Journal accepted on IEEE Trans. on Info. Theory
+ ArXiv highlights: Task2Vec, PrGAN++
2/19 Invited talk at ICERM @ Brown University. Talk slides.
1/19 Co-organizing FGVC6 workshop at CVPR 19.
+ Several competetions are live. Participate to win prizes!
+ Call for papers posted.
1/19 I'll serve as an area chair for CVPR 19 and on the SPC for IJCAI 19.
1/19 Teaching Intro to Computer Vision (370) @ UMass
10/18 NSF grant awarded for machine learning for Astronomy.
8/18 A recent talk at Caltech summarizing our work on 3D shape generation.
7/18 Two papers and a workshop paper accepted to ECCV 18.
6/18 SPLATNet won the best paper honorable mention at CVPR 18. Popular press: UMass, NVIDIA, Medium
6/18 NSF CAREER grant awarded. University press release.
5/18 Upcoming papers and workshops:
+ VisemeNet to appear @ SIGGRAPH 18
+ Two papers: SPLATNet, CSGNet to appear @ CVPR 18
+ Fine-Grained Visual Categorization (FGVC5) workshop @ CVPR 18
4/18 Invited talk at the annual data science resesarch symposium.
1/18 Teaching Intro to Computer Vision (370) @ UMass
12/17 I will serve as an area chair for CVPR 2018.
10/17 Invited talk at the Manifold Learning Workshop @ ICCV 17.
7/17 Dark ecology project funded by NSF. Link to the press release.
7/17 Upcoming papers and recent preprints:
+ 2 papers at 3DV, 3 papers at BMVC 17, 1 at ICCV 17 (see publications)
+ Bilinear CNNs PAMI preprint, arXiv v6, Jun 2017
+ 3D Shape Segmentation with Projective Convolutional Networks, CVPR 17 (oral presentation)
+ 3D Shape Reconstruction from Sketches via Multi-view Convolutional Networks, arXiv, July 17
4/17 Department colloquium speaker at RIT and UoR.
9/16 Teaching Computer Vision @ UMass
6/16 Received NSF grant for language-based understanding of textures, and a gift from Facebook.

Teaching

Coursework: Tutorials: Workshops:

Students

Current advisees: Past PhD students: Past advisees and collaborators:

Misc

I occasionally draw and paint.