The Convergence of Photogrammetry, Light Fields, and Volumetric Capture
Tim Macmillan – CEO – Area4 Professional
Paul Debevec – USC Institute for Creative Technologies
Digitizing the real world using arrays of cameras has been a topic of research for decades, but only today are practical systems becoming available which allow dynamic performances to recorded in ways they can later be seen from any viewpoint and any lighting. I will show how techniques from photogrammetry, view-dependent texture mapping, light field imaging, and volumetric capture are producing the next generation of content creation tools which are equally well suited to linear and interactive content and will enable the next generation of virtual production.
CEO – Area4 Professional
Adjunct Research Professor – USC Institute for Creative Technologie
Paul is an Adjunct Research Professor of Computer Science at the USC Institute for Creative Technologies where he founded the Vision and Graphics Laboratory, and a Senior Staff Engineer at Google. Debevec’s computer graphics research has been recognized with ACM SIGGRAPH’s first Significant New Researcher Award in 2001 for “Creative and Innovative Work in the Field of Image-Based Modeling and Rendering”, a Scientific and Engineering Academy Award in 2010 for “the design and engineering of the Light Stage capture devices and the image-based facial rendering system developed for character relighting in motion pictures”, and the SMPTE Progress Medal in 2017 in recognition of his “achievements and ongoing work in pioneering techniques for illuminating computer-generated objects based on measurement of real-world illumination and their effective commercial application in numerous Hollywood films”. In 2014, he was profiled in The New Yorker magazine’s “Pixel Perfect: The Scientist Behind the Digital Cloning of Actors”. In 2019, Paul received a second Academy Award for Scientific and Technical Achievement for the invention of the Polarized Spherical Gradient Illumination facial appearance capture method, used to create digital actors in motion pictures such as Avatar, Blade Runner: 2049, and Gemini Man.
USC Institute for Creative Technologies
At the University of Southern California Institute for Creative Technologies (ICT), leaders in the artificial intelligence, graphics, virtual reality and narrative communities are working to advance immersive techniques and technologies to solve problems facing service members, students and society. ICT brings film and game industry artists together with computer and social scientists to study and develop immersive media for military training, health therapies, education and more. Research projects explore and expand how people engage with computers, through virtual characters, video games and simulated scenarios. ICT is a recognized leader in the development of virtual humans who look, think and behave like real people. ICT’s groundbreaking research and advanced technology demonstrations are both making an impact today and paving the way for what is possible in the future.