Sergey Zakharov

I am a Senior Research Scientist and Technical Lead at Toyota Research Institute. My research goal is to build intelligent systems with a reliable 3D understanding of the physical world — so they can reconstruct it, generate it, and act in it.

My research spans 3D reconstruction, generative modeling, implicit neural representations, world models and simulation, domain adaptation, and self-supervised learning, with a strong focus on generalization and real-world transfer. I earned my PhD from the Technical University of Munich under Slobodan Ilic.

news

Jun 2026 RecGen and AnyView are accepted to ECCV’26!
Jun 2026 Humanoid Everyday receives Best Paper at EAI Workshop, CVPR’26! Also Oral Presentation at “From Data to Decisions” Workshop, ICRA’26.
Jun 2026 Gave a talk on “Synthetic Worlds for Scalable Robot Learning” at the Synthetic Data for Robot Learning workshop at ICRA’26. Also co-organizing the Beyond Teleoperation workshop (June 5)!
Apr 2026 SceneSmith accepted to ICML’26 as a Spotlight (top 2.2%)!

selected publications

  1. RecGen: 3D Multi-Object Scene Reconstruction from Sparse Observations
    ECCV 2026
  2. SceneSmith: Agentic Generation of Simulation-Ready Indoor Scenes
    Nicholas PfaffThomas CohnSergey ZakharovRick Cory, and Russ Tedrake
    ICML 2026Spotlight
  3. 0123.png
    Zero-1-to-3: Zero-shot One Image to 3D Object
    ICCV 2023
  4. Autolabeling 3D Objects with Differentiable Rendering of SDF Shape Priors
    Sergey Zakharov*Wadim Kehl*, Arjun Bhargava, and Adrien Gaidon
    CVPR 2020Oral
  5. DPOD: 6D Pose Object Detector and Refiner
    Sergey ZakharovIvan Shugurov, and Slobodan Ilic
    ICCV 2019
  6. hb.png
    HomebrewedDB: RGB-D Dataset for 6D Pose Estimation of 3D Objects
    Roman KaskmanSergey ZakharovIvan Shugurov, and Slobodan Ilic
    ICCVW 2019