[go: up one dir, main page]

Ricardo Martin-Brualla

I am research scientist interested in 3D generation and understanding. I work at Google Seattle, where I lead a team working on generating 3D assets for all products in Google Search, using NeRFs and Generative AI. Our tech is already launched for shoes!

We are hiring research scientists and software engineers, please reach out if you are interested in a role!

Previously at Google, I worked on Project Starline for five years, a futuristic 3D telepresence system. Before that, two of my projects went viral online: timelapse mining from Internet photos in 2015, and a timelapse of Seattle from the Space Needle in 2018.

I did my PhD in Computer Science and Engineering at the University of Washington in 2016 with Steve Seitz as my advisor. and my bachelors at Barcelona Tech / UPC. I taught Computer Vision at the University of Washington in 2018. I grew up in Madrid and attended the Deutsche Schule Madrid, where I learned a lot of German.

I love traveling and seeing other parts of the world, ideally by human power. In 2021 and 2023, my wife and I crossed Alaska from Ketchikan to Kotzibue on foot, packraft and cycling. We wrote a blog about it at north2arctic, and also have an instagram about it. After my PhD in 2016, I backpacked across Iceland, and explored Madagascar and Central Asia. After my undergrad in 2010, I traveled by bicycle around New Zealand, visiting the antipodes of my house in Madrid. I also went to Vanuatu and climbed a remote volcano to see lava bubbling.

Email  /  Google Scholar  /  Twitter  /  Github

profile photo
Research
CAT3D: Create Anything in 3D with Multi-View Diffusion Models
Ruiqi Gao, Aleksander Holynski, Philipp Henzler, Arthur Brussee, Ricardo Martin-Brualla, Pratul P Srinivasan, Jonathan T Barron, Ben Poole
NeurIPS, 2024
project page / arXiv

IllumiNeRF: 3D Relighting without Inverse Rendering
Xiaoming Zhao, Pratul P Srinivasan, Dor Verbin, Keunhong Park, Ricardo Martin-Brualla, Philipp Henzler
NeurIPS, 2024
project page / arXiv / code

LFM-3D: Learnable Feature Matching Across Wide Baselines Using 3D Signals
Arjun Karpur, Guilherme Perrotta, Ricardo Martin-Brualla, Howard Zhou, André Araujo
3DV, 2024
project page / arXiv

NAVI: Category-Agnostic Image Collections with High-Quality 3D Shape and Pose Annotations
Varun Jampani, Kevis-Kokitsi Maninis, Andreas Engelhardt, Arjun Karpur, Karen Truong, Kyle Sargent, Stefan Popov, André Araujo, Ricardo Martin-Brualla, Kaushal Patel, Daniel Vlasic, Vittorio Ferrari, Ameesh Makadia, Ce Liu, Yuanzhen Li, Howard Zhou
NeurIPS, 2023
project page / arXiv / code

CamP: Camera Preconditioningfor Neural Radiance Fields
Keunhong Park, Philipp Henzler, Ben Mildenhall, Jonathan T Barron, Ricardo Martin-Brualla
Siggraph Asia, 2023
project page / arXiv

SCADE: NeRFs from Space Carving with Ambiguity-Aware Depth Estimates
Mikaela Angelina Uy, Ricardo Martin-Brualla, Leonidas Guibas, Ke Li
CVPR, 2023
project page / arXiv / code / video

Novel view synthesis with diffusion models
Daniel Watson, William Chan, Ricardo Martin-Brualla, Jonathan Ho, Andrea Tagliasacchi, Mohammad Norouzi
ICLR, 2023
project page / arXiv

NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw Images
Ben Mildenhall, Peter Hedman, Ricardo Martin-Brualla, Pratul P Srinivasan, Jonathan T Barron
CVPR, 2022
project page / arXiv / video

Project Starline: A high-fidelity telepresence system
Jason Lawrence, Dan B Goldman, Supreeth Achar, Gregory M Blascovich, Joseph G Desloge, Tommy Fortes, Eric M Gomez, Sascha Haberling, Hugues Hoppe, Andy Huibers, Claude Knaus, Brian Kuschak, Ricardo Martin-Brualla, Harris Nover, Andrew Ian Russell, Steven M Seitz, Kevin Tong
SIGGRAPH Asia, 2021
paper / video

Advances in Neural Rendering
Ayush Tewari, Justus Thies, Ben Mildenhall, Pratul P Srinivasan, Edgar Tretschk, Yifan Wang, Christoph Lassner, Vincent Sitzmann, Ricardo Martin-Brualla, Stephen Lombardi, Tomas Simon, Christian Theobalt, Matthias Niessner, Jonathan T. Barron, Gordon Wetzstein, Michael Zollhöfer, Vladislav Golyanik
Eurographics STAR report, 2022
arXiv

Time-travel rephotography
Xuan Luo, Xuaner Zhang, Paul Yoo, Ricardo Martin-Brualla, Jason Lawrence, Steven M Seitz
SIGGRAPH Asia, 2021
project page / arXiv / code

Featured in Two Minute Papers

HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fields
Keunhong Park, Utkarsh Sinha, Peter Hedman, Jonathan T Barron, Sofien Bouaziz, Dan B Goldman, Ricardo Martin-Brualla, Steven M Seitz
SIGGRAPH Asia, 2021
project page / arXiv / code

Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields
Jonathan T Barron, Ben Mildenhall, Matthew Tancik, Peter Hedman, Ricardo Martin-Brualla, Pratul P Srinivasan
ICCV, 2021
project page / arXiv / code / video

Best Paper Honorable Mention (top 5 papers)

Nerfies: Deformable neural radiance fields
Keunhong Park, Utkarsh Sinha, Jonathan T Barron, Sofien Bouaziz, Dan B Goldman, Steven M Seitz, Ricardo Martin-Brualla
ICCV, 2021
project page / arXiv / video

Press: Gizmodo. Featured in Two Minute Papers.

Neural RGB-D Surface Reconstruction
Dejan Azinović, Ricardo Martin-Brualla, Dan B Goldman, Matthias Nießner, Justus Thies
CVPR, 2022
project page / arXiv / video

Nerf in the wild: Neural radiance fields for unconstrained photo collections
Ricardo Martin-Brualla, Noha Radwan, Mehdi SM Sajjadi, Jonathan T Barron, Alexey Dosovitskiy, Daniel Duckworth
CVPR, 2021
project page / arXiv / video

Press: PetaPixel Featured in Two Minute Papers

IBRNet: Learning multi-view image-based rendering
Qianqian Wang, Zhicheng Wang, Kyle Genova, Pratul P Srinivasan, Howard Zhou, Jonathan T Barron, Ricardo Martin-Brualla, Noah Snavely, Thomas Funkhouser
CVPR, 2021
project page / arXiv / code

No Shadow Left Behind: Removing Objects and their Shadows using Approximate Lighting and Geometry
Edward Zhang, Ricardo Martin-Brualla, Janne Kontkanen, Brian L Curless
CVPR, 2021
project page / paper

Sharf: Shape-conditioned radiance fields from a single view
Konstantinos Rematas, Ricardo Martin-Brualla, Vittorio Ferrari
ICML, 2021
project page / arXiv / code

FiG-NeRF: Figure-Ground Neural Radiance Fields for 3D Object Category Modelling
Christopher Xie, Keunhong Park, Ricardo Martin-Brualla, Matthew Brown
3DV, 2021
project page / arXiv / video

State of the art on neural rendering
Ayush Tewari, Ohad Fried, Justus Thies, Vincent Sitzmann, Stephen Lombardi, Kalyan Sunkavalli, Ricardo Martin-Brualla, Tomas Simon, Jason Saragih, Matthias Nießner, Rohit Pandey, Sean Fanello, Gordon Wetzstein, Jun-Yan Zhu, Christian Theobalt, Maneesh Agrawala, Eli Shechtman, Dan B Goldman, Michael Zollhöfer
Eurographics STAR report, 2020
arXiv

KeystoneDepth: History in 3D
Xuan Luo, Yanmeng Kong, Jason Lawrence, Ricardo Martin-Brualla, Steven M Seitz
3DV, 2020
project page / paper / video

Gelato: Generative latent textured objects
Ricardo Martin-Brualla, Rohit Pandey, Sofien Bouaziz, Matthew Brown, Dan B Goldman
ECCV, 2020
project page / arXiv

Multi-view image fusion
Marc Comino Trinidad, Ricardo Martin Brualla, Florian Kainz, Janne Kontkanen
ICCV, 2019
project page / paper

Neural rerendering in the wild
Moustafa Meshry, Dan B Goldman, Sameh Khamis, Hugues Hoppe, Rohit Pandey, Noah Snavely, Ricardo Martin-Brualla
CVPR, 2019
arXiv / code / video

Best Paper Award Finalist (top 1% of submissions)

Volumetric capture of humans with a single rgbd camera via semi-parametric learning
Rohit Pandey, Anastasia Tkach, Shuoran Yang, Pavel Pidlypenskyi, Jonathan Taylor, Ricardo Martin-Brualla, Andrea Tagliasacchi, George Papandreou, Philip Davidson, Cem Keskin, Shahram Izadi, Sean Fanello
CVPR, 2019
arXiv / video

Lookingood: Enhancing performance capture with real-time neural re-rendering
Ricardo Martin-Brualla, Rohit Pandey, Shuoran Yang, Pavel Pidlypenskyi, Jonathan Taylor, Julien Valentin, Sameh Khamis, Philip Davidson, Anastasia Tkach, Peter Lincoln, Adarsh Kowdle, Christoph Rhemann, Dan B Goldman, Cem Keskin, Steven M Seitz, Shahram Izadi, Sean Fanello,
SIGGRAPH Asia, 2018
arXiv / video

3D time-lapse reconstruction from internet photos
Ricardo Martin-Brualla, David Gallup, Steven M Seitz
ICCV, 2015
project page / paper / video

Press: PetaPixel

Time-lapse mining from internet photos
Ricardo Martin-Brualla, David Gallup, Steven M Seitz
SIGGRAPH, 2015
project page / paper / video

Press: WIRED, BBC, Seattle Times & more.

The 3d jigsaw puzzle: Mapping large indoor spaces
Ricardo Martin-Brualla, Yanling He, Bryan C Russell, Steven M Seitz
ECCV, 2014
project page / paper / video

3D Wikipedia: Using online text to automatically label and navigate reconstructed geometry
Bryan C Russell, Ricardo Martin-Brualla, Daniel J Butler, Steven M Seitz, Luke Zettlemoyer
SIGGRAPH Asia, 2013
project page / paper / video

Press: New Scientist, Gizmodo

Viewport: A distributed, immersive teleconferencing system with infrared dot pattern
Cha Zhang, Qin Cai, Philip A Chou, Zhengyou Zhang, Ricardo Martin-Brualla
IEEE MultiMedia, 2013
paper

The role of query sessions in extracting instance attributes from web search queries
Marius Pasca, Enrique Alfonseca, Enrique Robledo-Arnuncio, Ricardo Martin-Brualla, Keith Hall
European Conference on Information Retrieval, 2010
paper

Instance sense induction from attribute sets
Ricardo Martin-Brualla, Enrique Alfonseca, Marius Pasca, Keith Hall, Enrique Robledo-Arnuncio, Massimiliano Ciaramita
Coling, 2010
paper