kalyan sunkavalli     

Kalyan Sunkavalli

I am a Senior Research Scientist at Adobe Research. I received my Ph.D. from Harvard University in 2012 under the supervision of Hanspeter Pfister. I received my Masters in 2006 from Columbia University. I graduated from the Indian Institute of Technology, Delhi in 2003.

My research interests lie at the intersection of Computer Vision and Graphics; in particular, my work focuses on understanding different aspects of visual appearance in images and videos -- illumination, geometry, reflectance, color, texture, motion, etc. -- and building tools that enable users to edit and enhance them.

Internships at Adobe: I am always looking for strong graduate students to collaborate with. If you are interested in interning at Adobe with me, send me an email (sunkaval@a***e.com) detailing what your research interests are, and what you would like to work on during the internship.

CV | Google Scholar | LinkedIn


     Materials for Masses: SVBRDF Acquisition with a Single Mobile Phone Image
Zhengqin Li, Kalyan Sunkavalli, Manmohan Chandraker
ECCV 2018 (oral)
     MT-VAE: Learning Motion Transformations to Generate Multimodal Human Dynamics
Xinchen Yan, Akash Rastogi, Ruben Villegas, Kalyan Sunkavalli, Eli Shechtman, Sunil Hadap, Ersin Yumer, Honglak Lee
ECCV 2018
project | paper
     Compositing-aware Image Search
Hengshuang Zhao, Xiaohui Shen, Zhe Lin, Kalyan Sunkavalli, Brian Price, Jia Jiaya
ECCV 2018
     Automatic Adaptation of Person Association for Multiview Tracking in Group Activities
Minh Vo, Ersin Yumer, Kalyan Sunkavalli, Sunil Hadap, Yaser Sheikh, Srinivasa Narasimhan
arxiv | project | paper | video
     Deep Image-based Relighting using Optimal Sparse Samples
Zexiang Xu, Kalyan Sunkavalli, Sunil Hadap, Ravi Ramamoorthi
project | paper | video
     Illuminant Spectra-based Source Separation Using Flash Photography
Zhuo Hui, Kalyan Sunkavalli, Sunil Hadap, Aswin C. Sankaranarayanan
CVPR 2018 (oral)
arxiv | paper | video | supplementary
     A Perceptual Measure for Deep Single Image Camera Calibration
Yannick Hold-Geoffroy, Kalyan Sunkavalli, Jonathan Eisenmann, Matthew Fisher, Emiliano Gambaretto, Sunil Hadap, Jean-François Lalonde
CVPR 2018
arxiv | project | paper | supplementary
     Fast Video Object Segmentation by Reference-Guided Mask Propagation
Seoung Wug Oh, Joon-Young Lee, Kalyan Sunkavalli, Seon Joo Kim
CVPR 2018 (spotlight)
paper | code
     Learning to Predict Indoor Illumination from a Single Image
Marc-Andre Gardner, Kalyan Sunkavalli, Ersin Yumer, Xiaohui Shen, Emiliano Gambaretto, Christian Gagné, Jean-François Lalonde
SIGGRAPH Asia 2017
arxiv | project | paper | supplementary | data
     Reflectance Capture using Univariate Sampling of BRDFs
Zhuo Hui, Kalyan Sunkavalli, Joon-Young Lee, Sunil Hadap, Jian Wang, Aswin C. Sankaranarayanan
ICCV 2017
paper | video
     Scene Parsing with Global Context Embedding
Wei-Chih Hung, Yi-Hsuan Tsai, Xiaohui Shen, Zhe Lin, Kalyan Sunkavalli, Xin Lu, Ming-Hsuan Yang
ICCV 2017
arxiv | project | paper
     Photometric Stabilization for Fast-forward videos
Xuaner Zhang, Joon-Young Lee, Kalyan Sunkavalli, Zhaowen Wang
Pacific Graphics 2017
arxiv | paper
     Nautilus: Recovering Regional Symmetry Transformations for Image Editing
Michal Lukáč, Daniel Sýkora, Kalyan Sunkavalli, Eli Shechtman, Ondřej Jamriška, Nathan Carr, Tomáš Pajdla
project | paper
     Portrait Lighting Transfer using a Mass Transport Approach
Zhixin Shu, Sunil Hadap, Eli Shechtman, Kalyan Sunkavalli, Sylvain Paris, Dimitris Samaras
TOG 2017
project | paper | supplementary
     Deep Outdoor Illumination Estimation
Yannick Hold-Geoffroy, Kalyan Sunkavalli, Sunil Hadap, Emiliano Gambaretto, Jean-François Lalonde
CVPR 2017 (oral)
arxiv | project | paper | supplementary | demo
     Neural Face Editing with Intrinsic Image Disentangling
Zhixin Shu, Ersin Yumer, Sunil Hadap, Kalyan Sunkavalli, Eli Shechtman, Dimitris Samaras
CVPR 2017 (oral)
arxiv | project | paper
     Deep Image Harmonization
Yi-Hsuan Tsai, Xiaohui Shen, Zhe Lin, Kalyan Sunkavalli, Xin Lu, Ming-Hsuan Yang
CVPR 2017
arxiv | project | paper | code and data
     Consistent Video Filtering for Camera Arrays
Nicolas Bonneel, James Tompkin, Deqing Sun, Oliver Wang, Kalyan Sunkavalli, Sylvain Paris, Hanspeter Pfister
Eurographics 2017
project | paper | supplementary
     Single-image RGB Photometric Stereo With Spatially-varying Albedo
Ayan Chakrabarti, Kalyan Sunkavalli
3DV 2016 (oral)
arxiv | project | paper | code and data
     Removing Shadows from Images of Documents
Steve Bako, Soheil Darabi, Eli Shechtman, Jue Wang, Kalyan Sunkavalli, Pradeep Sen
ACCV 2016
project | paper
     Appearance Harmonization for Single Image Shadow Removal
Li-Qian Ma, Jue Wang, Eli Shechtman, Kalyan Sunkavalli, Shi-Min Hu
Pacific Graphics 2016
     Shading-aware Multi-view Stereo
Fabian Langguth, Kalyan Sunkavalli, Sunil Hadap, Michael Goesele
ECCV 2016
project | paper | supplementary | code
     Sky is Not the Limit: Semantic-Aware Sky Replacement
Yi-Hsuan Tsai, Xiaohui Shen, Zhe Lin, Kalyan Sunkavalli, Ming-Hsuan Yang
project | paper | supplementary
     White Balance under Mixed Illumination using Flash Photography
Zhuo Hui, Aswin Sankaranarayanan, Kalyan Sunkavalli, Sunil Hadap
ICCP 2016
project | paper
     Automatic Content-Aware Color and Tone Stylization
Joon-Young Lee, Kalyan Sunkavalli, Zhe Lin, Xiaohui Shen, In So Kweon
CVPR 2016 (spotlight)
arxiv | paper | data

This is the technology behind the Smart Looks feature in Photoshop Elements 14.
     PatchMatch-based Automatic Lattice Detection for Near-Regular Textures
Siying Liu, Tian-Tsong Ng, Kalyan Sunkavalli, Minh Do, Eli Shechtman, Nathan Carr
ICCV 2015
paper | supplementary
     Blind Video Temporal Consistency
Nicolas Bonneel, James Tompkin, Kalyan Sunkavalli, Deqing Sun, Sylvain Paris, Hanspeter Pfister
SIGGRAPH Asia 2015
project | paper | video
     High-Quality Hair Modeling from A Single Portrait Photo
Mengelei Chai, Linjie Luo, Kalyan Sunkavalli, Nathan Carr, Sunil Hadap, Kun Zhou
SIGGRAPH Asia 2015
paper | video

This work was demoed at Adobe MAX 2015 Sneaks as 3D Portraits.
     Smooth Loops for Unconstrained Video
Laura Sevilla-Lara, Jonas Wulff, Kalyan Sunkavalli, Eli Shechtman
EGSR 2015
project | paper | video
     Interactive Intrinsic Video Editing
Nicolas Bonneel, Kalyan Sunkavalli, James Tompkin, Deqing Sun, Sylvain Paris, Hanspeter Pfister
SIGGRAPH Asia 2014
project | paper | video
     Time-lapse Photometric Stereo and Applications
Fangyang Shen, Kalyan Sunkavalli, Nicolas Bonneel, Szymon Rusinkiewicz, Hanspeter Pfister, Xin Tong
Pacific Graphics 2014
project | paper
     Automatic scene inference for 3D object compositing
Kevin Karsch, Kalyan Sunkavalli, Sunil Hadap, Nathan Carr, Hailin Jin, Rafael Fonte, Michael Sittig, David Forsyth
TOG 2014
project | paper | video | supplementary

We demoed our work as part of Adobe MAX 2014 Sneaks.
     Example-based Video Color Grading
Nicolas Bonneel, Kalyan Sunkavalli, Sylvain Paris, Hanspeter Pfister
project | paper | video | code

Our work was demoed at Adobe MAX 2013 Sneaks.
     Video Snapshots: Creating High-Quality Images from Video Clips
Kalyan Sunkavalli, Neel Joshi, Sing Bing Kang, Michael F. Cohen, Hanspeter Pfister
TVCG 2012
project | paper | supplementary results
     Video Face Replacement
Kevin Dale, Kalyan Sunkavalli, Micah K. Johnson, Daniel Vlasic, Wojciech Matusik, Hanspeter Pfister
SIGGRAPH Asia 2011
project | paper | video

Our work was featured in the SIGGRAPH Asia 2011 Technical Papers trailer and has received some press coverage.
     Visibility Subspaces: Uncalibrated Photometric Stereo with Shadows
Kalyan Sunkavalli, Todd Zickler, Hanspeter Pfister
ECCV 2010
project | paper | poster | presentation | data
     Multi-scale Image Harmonization
Kalyan Sunkavalli, Micah K. Johnson, Wojciech Matusik, Hanspeter Pfister
project | paper | supplementary results | presentation | code | data

Our work was featured on the inside cover of the Proceedings of SIGGRAPH 2010 and on the highlights of SIGGRAPH 2010.
     Image Restoration using Online Photo Collections
Kevin Dale, Micah K. Johnson, Kalyan Sunkavalli, Wojciech Matusik, Hanspeter Pfister
ICCV 2009
project | paper
     What do color changes reveal about an outdoor scene?
Kalyan Sunkavalli, Fabiano Romeiro, Wojciech Matusik, Todd Zickler, Hanspeter Pfister
CVPR 2008 (oral)
project | paper | video | presentation | data
     Factored Time-Lapse Video
Kalyan Sunkavalli, Wojciech Matusik, Hanspeter Pfister, Szymon Rusinkiewicz
project | paper | video | presentation | data
     Time-Varying BRDFs
Bo Sun, Kalyan Sunkavalli, Ravi Ramamoorthi, Peter Belhumeur, Shree Nayar
TVCG 2007
project | paper | video | presentation | data
     First steps toward an electronic field guide for plants
Gaurav Agarwal, Peter Belhumeur, Steven Feiner, David Jacobs, W. John Kress, Ravi Ramamoorthi, Norman A. Bourg, Nandan Dixit, Haibin Ling, Dhruv Mahajan, Rusty Russell, Sameer Shirdhonkar, Kalyan Sunkavalli, Sean White
Taxon 2006
project | paper
     Parsing News Video Using Integrated Audio-video Features
S. Kalyan Krishna, Raghav Subbarao, Santanu Chaudhury, Arun Kumar
PReMI 2005