Paul Debevec Home Page

Paul Debevec, VES
Chief Research Officer, Eyeline Studios
Governor, Visual Effects, Academy of Motion Pictures
Adjunct Research Professor, USC CS

USC
ICT

www.debevec.org

Welcome! This site presents most of the work I have been involved with in computer graphics, including research papers, computer animations, art projects, software, and educational resources.

Recent Events:

2022
2/3	Talk at HPA Tech Retreat, Palm Springs
5/3	Talk at FMX, Stuttgart
7/6	Opening Keynote at Mundos Digitales, A Coruna
8/2	Podcast for CGPro
10/20	Talk at VIEW, Turin
11/8	Panel at RealTime Conference
2023
TBA	Virtual Production Podcast

Corridor Crew Interview & Sodium Vapor Video High Res Videos: The Campanile Movie \| Rendering with Natural Light \| Fiat Lux \| Light Stage 1 \| The Parthenon
2022 Lifetime Achievement Emmy Award
			Materials Announcement/Citation \| Writeup \| Emmy ceremony photos \| Full ceremony \| Awards host serenade \| Acceptance remarks Articles Hollywood Reporter \| Michigan Engineering \| Daily Cal \| Berkeley Engineering \| USC ICT \| FXGuide
Research at Netflix & Eyeline Studios 2021-
DifFRelight Diffusion-Based Facial Performance Relighting SIGGRAPH Asia 2024	Fitting Spherical Gaussians to Dynamic HDRI Sequences SIGGRAPH Asia Posters 2024	Recreating the Sodium Vapor Matting Process SIGGRAPH 2024 Posters	Magenta Green Screen: Spectrally Multiplexed Alpha Matting with Deep Colorization DigiPro 2023	Jointly Optimizing Color Rendition and In-Camera Backgrounds in an RGB Virtual Production Stage DigiPro 2022	HDR Lighting Dilation for Dynamic Range Reduction on Virtual Production Stages SIGGRAPH 2022 Posters
Research at Google Daydream 2016-2021
Project Starline SIGGRAPH 2024 ETech	NeRFactor: Neural Factorization of Shape and Reflectance Under Unknown Illumination SIGGRAPH Asia 2021	Total Relighting: Learning to Relight Portraits for Background Replacement SIGGRAPH 2021	Baking Neural Radiance Fields for Real-Time View Synthesis ICCV 2021	Neural Light Transport for Relighting and View Synthesis ACM TOG 2021	The Phenomenon of Eclipsed Bokeh SIGGRAPH 2020 Posters
Light Stage Super-Resolution: Continuous High-Frequency Relighting SIGGRAPH Asia 2020	Deep Relightable Textures: Volumetric Performance Capture with Neural Rendering SIGGRAPH Asia 2020	Learning Illumination from Diverse Portraits SIGGRAPH Asia 2020 Technical Communications	Immersive Light Field Video with a Layered Mesh Representation SIGGRAPH 2020	The Relightables Volumetric Performance Capture SIGGRAPH Asia 2019	Low Cost Panoramic Light Field Video SIGGRAPH Asia 2019 Posters
Single Image Portrait Relighting SIGGRAPH 2019	Deep Facial Reflectance Fields from Color Gradient Illumination SIGGRAPH 2019	Compositing Light Field Video Using Multiplane Images SIGGRAPH 2019 Posters	DeepView: View Synthesis with Learned Gradient Descent CVPR 2019	DeepLight: Learning Illumination for Mobile Mixed Reality CVPR 2019	Acquiring and Rendering Panoramic Light Field Stills for Virtual Reality SIGGRAPH Asia 2018

Favorite Projects
3D Scanning the President of the United States White House Maker Faire 2014	The Light Stages at UC Berkeley and USC ICT 2010 Academy Awards SIGGRAPH Asia 2012 2019 Academy Awards	Digital Emily: Achieving a Photoreal Digital Actor SIGGRAPH 2008 Expo CVMP 2009 IEEE CG&A 2010	Digital Ira: Creating a Real-Time Photoreal Digital Actor SIGGRAPH 2013 Real-Time Live	Rendering for an (Award Winning!) Interactive 360� Light Field Display SIGGRAPH 2007	Achieving Eye Contact in Live 3D Teleconferencing SIGGRAPH 2009

Tutorials, Software, and Datasets
High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting, 2ed. Morgan Kaufmann 2010	Virtual Cinematography: Relighting Through Computation IEEE Computer Aug 2006	HDR Shop: High Dynamic Range Image Processing and Manipulation	Light Probe Image Gallery Released SIGGRAPH 99	High-Res Light Probe Gallery Released SIGGRAPH 2006	Light Stage Data Gallery Released SIGGRAPH 2006

Films (YouTube Playlist)
The Campanile Movie SIGGRAPH 97 Electronic Theater	Rendering with Natural Light SIGGRAPH 98 Electronic Theater	Fiat Lux SIGGRAPH 99 Electronic Theater	Image-Based Lighting SIGGRAPH 2000 Electronic Theater	The Parthenon SIGGRAPH 2004 Electronic Theater	Welcome to Light Fields Steam VR & SIGGRAPH 2018 Immersive Pavillion

Graphics Research at USC ICT 2000-2016
Practical Multispectral Lighting Reproduction SIGGRAPH 2016	Driving High-Resolution Facial Scans with Video Performance Capture ACM TOG 2014	Skin Microstructure Deformation with Displacement Map Convolution SIGGRAPH 2015	Time-Offset Conversations on a Life-Sized Automultiscopic Projector Array SIGGRAPH 2015 ETech CVPR WCCD 2016	Acquiring Reflectance and Shape from SH Illumination SIGGRAPH 2013	Measurement-Based Synthesis of Facial Microgeometry Eurographics 2013
DeepView: View Synthesis with Learned Gradient Descent CVPR 2019	Deep Light: DeepLight Learning Illumination for Unconstrained Mobile Mixed Reality CVPR 2019	FlashMob: Near-Instant Capture of High-Resolution Facial Geometry and Reflectance Eurographics 2016	A Single-Shot Light Probe SIGGRAPH 2012 Talks	An Autostereoscopic Projector Array Optimized for 3D Facial Display SIGGRAPH 2013 E-Tech	Geometry-Corrected Light Field Rendering for Creating a Holographic Stereogram IEEE CVPRW 2012
Multiview Face Capture using Polarized Spherical Gradient Illumination SIGGRAPH Asia 2011	Practical Image-Based Relighting and Editing with Spherical-Harmonics and Local Lights CVMP 2011	Facial Cartography: Interactive High-Resolution Scan Correspondence SCA 2011	Prototyping a Light Field Display Involving Direct Observation of a Video Projector Array PROCAMS 2011 Best Paper Award	Comprehensive Facial Performance Capture Eurographics 2011	Circularly Polarized Spherical Illumination Reflectometry SIGGRAPH Asia 2010
Dynamic Shape Capture using Multi-View Photometric Stereo SIGGRAPH Asia 2009	Estimating Specular Roughness and Anisotropy from Second Order Spherical Gradient Illumination EGSR 2009	Separation of Diffuse and Specular Reflections using Environmental Illumination ICCP 2009	Compressive Light Transport Sensing ACM TOG 2009	Practical Modeling and Acquisition of Layered Facial Reflectance SIGGRAPH Asia 2008	Facial Performance Synthesis using Polynomial Displacement Maps SIGGRAPH Asia 2008
A Framework for Capture and Synthesis of High Resolution Facial Geometry and Performance NTU PhD Thesis, 2008	Viewfinder: How to Seamlessly "Flickrize" Google Earth 2008	Real-time Geometry and Reflectance Capture for Digital Face Replacement ICT-TR-04-2008	Postproduction Facial Performance Relighting Using Reflectance Transfer SIGGRAPH 2007	Rendering for an Interactive 360� Light Field Display SIGGRAPH 2007	Specular and Diffuse Normal Maps from Polarized Spherical Gradient Illumination EGSR2007
Relighting Human Locomotion with Flowed Reflectance Fields EGSR 2006 SIGGRAPH 2006 CAF	Efficient Estimation of Spatially-Varying SSS Parameters Live Capture Now Online! VMV 2006	Concave Surround Optics for Rapid Multiview Imaging ASC 2006 SIGGRAPH 2006 Poster	A Reflective Light Stage ICT-TR-04.2006	Simulating Spatially Varying Lighting on a Live Performance CVMP 2006 SIGGRAPH 2005 Sketch	A Median Cut Algorithm for Light Probe Sampling SIGGRAPH 2005 Poster
Performance Relighting with Time-Multiplexed Illumination SIGGRAPH 2005	Acquisition of Time-Varying Participating Media SIGGRAPH 2005	A Dual Light Stage EGSR 2005	Direct HDR Capture of the Sun and Sky AFRIGRAPH 2004	Estimating Reflectance Properties under Natural Illumination ICT-TR-06-2004	Animatable Facial Reflectance Fields EGSR 2004
Real-time High Dynamic Range Texture Mapping EGWR 2001	A Photometric Approach to Digitizing Cultural Artifacts VAST 2001	A Lighting Reproduction Approach to Live-Action Compositing SIGGRAPH 2002	Capturing and Rendering with Incident Light Fields EGSR 2003	Optimizing Color Matching in a Lighting Reproduction System EGSR 2003	Linear Light Source Reflectometry SIGGRAPH 2003
Graphics Research at UC Berkeley 1996-2000
Modeling and Rendering Architecture from Photographs SIGGRAPH 96 ACM Seminal Graphics Paper	Recovering High Dynamic Range Radiance Maps from Photographs SIGGRAPH 97 ACM Seminal Graphics Paper	Efficient View-Dependent IBR with Projective Texture-Mapping EGRW 98	Rendering Synthetic Objects into Real Scenes SIGGRAPH 98	Inverse Global Illumination SIGGRAPH 99	Acquiring the Reflectance Field of a Human Face [+Demo!] SIGGRAPH 2000 ACM Seminal Graphics Paper
complete list of publications

Additional Online Resources
SIGGRAPH 2007 Computer Animation Festival	SIGGRAPH 98-2000 Course on Image-Based Modeling, Rendering, and Lighting	The Story of Reflection Mapping	SIGGRAPH 2003 Course on Image-Based Lighting	The Parthenon Sculpture Gallery

Early Image-Based Projects
The Chevette Project 1991	Facial Feature Recognition with Neural Networks 1992	Immersion '94 1994	Rouen Revisited SIGGRAPH 96 Art Gallery	St. Paul's Cross 1997

Miscellany
Chaotic Dynamic Simulation of Free-Throw Space 1992	Knee Visualization from MR Images 1993	3D Drawing in Microsoft Office 1992-1995	Pinhole Photography with a Regular Camera 1997
More Pictures and Movies
Bio \| Films \| Publication List \| Resources \| Press Clippings