Zan Gojcic

Zan Gojcic

Senior Research Manager
NVIDIA

zan.gojcic@gmail.com
Google Scholar
@ZGojcic
github.com/zgojcic

I'm a Senior Research Manager at NVIDIA in Zurich, leading a team focused on advancing neural reconstruction and generative world simulation for PhysicalAI. Our mission is to develop high-fidelity simulation environments that enable autonomous agents to be trained and evaluated in closed-loop systems.

Publications

Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillation

ArXiv 2025

Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillation

Sherwin Bahmani, Tianchang Shen, Jiawei Ren, Jiahui Huang, Yifeng Jiang, Haithem Turki, Andrea Tagliasacchi, David B. Lindell, Zan Gojcic, Sanja Fidler, Huan Ling, Jun Gao*, Xuanchi Ren*

ProjectPaperCode
UniRelight: Learning Joint Decomposition and Synthesis for Video Relighting

NeurIPS 2025 - Spotlight

UniRelight: Learning Joint Decomposition and Synthesis for Video Relighting

Kai He, Ruofan Liang, Jacob Munkberg, Jon Hasselgren, Nandita Vijaykumar, Alexander Keller, Sanja Fidler, Igor Gilitschenski, Zan Gojcic, Zian Wang

ProjectPaper
LuxDiT: Lighting Estimation with Video Diffusion Transformer

NeurIPS 2025

LuxDiT: Lighting Estimation with Video Diffusion Transformer

Ruofan Liang, Kai He, Zan Gojcic, Igor Gilitschenski, Sanja Fidler, Nandita Vijaykumar, Zian Wang

ProjectPaper
Feed-Forward Bullet-Time Reconstruction of Dynamic Scenes from Monocular Videos

NeurIPS 2025

Feed-Forward Bullet-Time Reconstruction of Dynamic Scenes from Monocular Videos

Hanxue Liang*, Jiawei Ren*, Ashkan Mirzaei*, Antonio Torralba, Ziwei Liu, Igor Gilitschenski, Sanja Fidler, Cengiz Oztireli, Huan Ling, Zan Gojcic*, Jiahui Huang*

ProjectPaper
Controllable Weather Synthesis and Removal with Video Diffusion Models

ICCV 2025

Controllable Weather Synthesis and Removal with Video Diffusion Models

Chih-Hao Lin, Zian Wang, Ruofan Liang, Yuxuan Zhang, Sanja Fidler, Shenlong Wang, Zan Gojcic

ProjectPaper
Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Models

CVPR 2025 - Oral (Best Paper Award candidate)

Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Models

Jay Zhangjie Wu*, Yuxuan Zhang*, Haithem Turki, Xuanchi Ren, Jun Gao, Mike Zheng Shou, Sanja Fidler, Zan Gojcic*, Huan Ling*

ProjectPaperCode
3DGUT: Enabling Distorted Cameras and Secondary Rays in Gaussian Splatting

CVPR 2025 - Oral

3DGUT: Enabling Distorted Cameras and Secondary Rays in Gaussian Splatting

Qi Wu*, Janick Martinez Esturo*, Ashkan Mirzaei, Nicolas Moenne-Loccoz, Zan Gojcic

ProjectPaperCode
DiffusionRenderer: Neural Inverse and Forward Rendering with Video Diffusion Models

CVPR 2025 - Oral

DiffusionRenderer: Neural Inverse and Forward Rendering with Video Diffusion Models

Ruofan Liang*, Zan Gojcic, Huan Ling, Jacob Munkberg, Jon Hasselgren, Zhi-Hao Lin, Jun Gao, Alexander Keller, Nandita Vijaykumar, Sanja Fidler, Zian Wang*

ProjectPaperCode
OmniRe: Omni Urban Scene Reconstruction

ICLR 2025 - Spotlight

OmniRe: Omni Urban Scene Reconstruction

Ziyu Chen, Jiawei Yang, Jiahui Huang, Riccardo de Lutio, Janick Martinez Esturo, Boris Ivanovic, Or Litany, Zan Gojcic, Sanja Fidler, Marco Pavone, Li Song, Yue Wang

ProjectPaperCode
3D Gaussian Ray Tracing: Fast Tracing of Particle Scenes

SiGGRAPH Asia 2024

3D Gaussian Ray Tracing: Fast Tracing of Particle Scenes

Nicolas Moenne-Loccoz*, Ashkan Mirzaei*, Or Perel, Riccardo De Lutio, Janick Martinez Esturo, Gavriel State, Sanja Fidler, Nicholas Sharp*, Zan Gojcic*

ProjectPaperCode
Photorealistic Object Insertion with Diffusion-Guided Inverse Rendering

ECCV 2024

Photorealistic Object Insertion with Diffusion-Guided Inverse Rendering

Ruofan Liang, Zan Gojcic, Merlin Nimier-David, David Acuna, Nandita Vijaykumar, Sanja Fidler, Zian Wang

ProjectPaper
Memorize What Matters: Emergent Scene Decomposition from Multitraverse

NeurIPS 2024 - Spotlight

Memorize What Matters: Emergent Scene Decomposition from Multitraverse

Yiming Li, Zehong Wang, Yue Wang, and Zhiding Yu, Zan Gojcic, Marco Pavone, Chen Feng, Jose M Alvarez

ProjectPaperCode
RefFusion: Reference Adapted Diffusion Models for 3D Scene Inpainting

ArXiv 2024

RefFusion: Reference Adapted Diffusion Models for 3D Scene Inpainting

Ashkan Mirzaei, Riccardo De Lutio, Seung Wook Kim, David Acuna, Jonathan Kelly, Sanja Fidler, Igor Gilitschenski, Zan Gojcic

ProjectPaper
Outdoor Scene Extrapolation with Hierarchical Generative Cellular Automata

CVPR 2024 - Highlight

Outdoor Scene Extrapolation with Hierarchical Generative Cellular Automata

Dongsu Zhang , Francis Williams , Zan Gojcic , Karsten Kreis , Sanja Fidler , Young Min Kim , Amlan Kar

ProjectPaperCode
Adaptive Shells for Efficient Neural Radiance Field Rendering

SiGGRAPH Asia 2023

Best Paper Award

Adaptive Shells for Efficient Neural Radiance Field Rendering

Zian Wang*, Tianchang Shen*, Merlin Nimier-David*, Nicholas Sharp, Jun Gao, Alexander Keller, Sanja Fidler, Thomas Müller, Zan Gojcic

ProjectPaper
Flexible Isosurface Extraction for Gradient-Based Mesh Optimization

SiGGRAPH Asia 2023

Flexible Isosurface Extraction for Gradient-Based Mesh Optimization

Tianchang Shen, Jacob Munkberg, Jon Hasselgren, Kangxue Yin, Zian Wang, Wenzheng Chen, Zan Gojcic, Sanja Fidler, Nicholas Sharp*, Jun Gao*

ProjectPaperCode
Neural LiDAR Fields for Novel View Synthesis

ICCV 2023

Neural LiDAR Fields for Novel View Synthesis

Shengyu Huang, Zan Gojcic, Zian Wang, Francis Williams, Yoni Kasten, Sanja Fidler, Konrad Schindler, Or Litany

ProjectPaper
Towards Viewpoint Robustness in Bird’s Eye View Segmentation

ICCV 2023

Towards Viewpoint Robustness in Bird’s Eye View Segmentation

Tzofi Klinghoffer, Jonah Philion, Wenzheng Chen, Or Litany, Zan Gojcic, Jungseock Joo, Ramesh Raskar, Sanja Fidler, Jose Alvarez

ProjectPaper
Neural Kernel Surface Reconstruction

CVPR 2023

Neural Kernel Surface Reconstruction

Jiahui Huang, Zan Gojcic, Matan Atzmon, Or Litany, Sanja Fidler, Francis Williams

ProjectPaperCode
Neural Fields meet Explicit Geometric Representations for Inverse Rendering of Urban Scenes

CVPR 2023

Neural Fields meet Explicit Geometric Representations for Inverse Rendering of Urban Scenes

Zian Wang, Tianchang Shen, Jun Gao, Shengyu Huang, Jacob Munkberg, Jon Hasselgren, Zan Gojcic, Wenzheng Chen, Sanja Fidler

ProjectPaper
LION: Latent Point Diffusion Models for 3D Shape Generation

NeurIPS 2022

LION: Latent Point Diffusion Models for 3D Shape Generation

Xiaohui Zeng, Arash Vahdat, Francis Williams, Zan Gojcic, Or Litany, Sanja Fidler, Karsten Kreis

ProjectPaperCode
GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Images

NeurIPS 2022

GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Images

Jun Gao, Tianchang Shen, Zian Wang, Wenzheng Chen, Kangxue Yin, Daiqing Li, Or Litany, Zan Gojcic, Sanja Fidler

ProjectPaperCode
Dynamic 3D Scene Analysis by Point Cloud Accumulation

ECCV 2022

Dynamic 3D Scene Analysis by Point Cloud Accumulation

Shengyu Huang, Zan Gojcic, Jiahui Huang, Andreas Wieser, Konrad Schindler

ProjectPaperCode
Multiway Non-rigid Point Cloud Registration via Learned Functional Map Synchronization

T-PAMI 2022

Multiway Non-rigid Point Cloud Registration via Learned Functional Map Synchronization

Jiahui Huang, Tolga Birdal, Zan Gojcic, Leonidas Guibas, Shi-Min Hu

ProjectPaperCode
Neural Fields as Learnable Kernels for 3D Reconstruction

CVPR 2022

Neural Fields as Learnable Kernels for 3D Reconstruction

Francis Williams*, Zan Gojcic*, Sameh Khamis, Sanja Fidler, Or Litany

ProjectPaper
Weakly Supervised Learning of Rigid 3D Scene Flow

CVPR 2021 - Oral

Weakly Supervised Learning of Rigid 3D Scene Flow

Zan Gojcic, Or Litany, Andreas Wieser, Leonidas Guibas, Tolga Birdal

ProjectPaperCode
Registration of 3D Point Clouds with Low Overlap

CVPR 2021 - Oral

Registration of 3D Point Clouds with Low Overlap

Shengyu Huang*, Zan Gojcic*, Mikhail Usvyatsov, Andreas Wieser, Konrad Schindler

ProjectPaperCode
CaSPR: Learning Canonical Spatiotemporal Point Cloud Representations

NeurIPS 2020 - Spotlight

CaSPR: Learning Canonical Spatiotemporal Point Cloud Representations

Davis Rempe, Tolga Birdal, Yongheng Zhao, Zan Gojcic, Srinath Sridhar, Leonidas Guibas

ProjectPaperCode
Learning Multiview 3D Point Cloud Registration

CVPR 2020

Learning Multiview 3D Point Cloud Registration

Zan Gojcic*, Caifa Zhou*, Jan D. Wegner, Leonidas Guibas, Tolga Birdal

PaperCode
The Perfect Match: 3D Point Cloud Matching with Smoothed Densities

CVPR 2020

The Perfect Match: 3D Point Cloud Matching with Smoothed Densities

Zan Gojcic, Caifa Zhou, Jan D. Wegner, Andreas Wieser

PaperCode

Experience

11/2021 - Ongoing

Senior Research Manager — NVIDIA

Manager: Prof. Sanja Fidler

3/2021 - 9/2021

Research Scientist Intern — NVIDIA Toronto AI Lab

Manager: Prof. Sanja Fidler

1/2020 - 3/2020

Research Intern — Geometric Computation group – Stanford University

Advisor: Prof. Leonidas Guibas

Education

2017—2021

ETH Zurich

Ph.D. in 3D Computer Vision

Advisor: Prof. Andreas Wieser

2013—2016

TU Graz

MSc. S. in Geomatics Science

2010—2013

Univeristy of Ljubljana

BSc. S. in Geoinformation