sites.google.com

             Zhong Li(李众)            

  Senior CV/ML Research Engineer

Apple Inc.  

   Email: zhonglee323@gmail.com

Short Bio

I am currently a Senior Research Engineer at Apple Inc., specializing in 3D Generative AI, Image Editing, and 3D Computer Vision. At Apple, I contribute to the diffusion-based models behind Spatial Reframing in Photos and to the generative 3D object and material creation in the Reality Composer Pro Assistant

Previously, I served as a Senior Staff Research Scientist at OPPO US Research, where I led R&D for next-generation mobile AR/VR to enable efficient, dynamic, and portable immersive 3D experiences.

I obtained my Ph.D. in Computer Science from the University of Delaware, where I was mentored by Prof. Jingyi Yu. During my doctoral studies, my work centered on 3D non-rigid dynamic human shape reconstruction, dynamic mesh sequence compression, and human semantic segmentation.

Education

Spatial Reframing 

Turns a flat photo into a mini 3D scene, re-photographs it from the angle you want, and uses a generative AI model to realistically fill in whatever the original shot didn't capture.

NEWS

  • Two papers accepted to CVPR 2024 in Seattle.

  • One paper  accepted ACM MM 2023 in Ottawa.

  • Two papers accepted to ICCV 2023 in Paris.

  • We are consistently seeking highly motivated Ph.D. interns on various AR/VR topics including but not limit to 2D/3D human body/face modeling and understanding, novel view synthesis, image-based rendering, and relighting.  Drop me an email if interested.

Selected Publications(corresponding author, *project mentor)

DualMat: PBR Material Estimation via Coherent Dual-Path Diffusion  

Yifeng Huang, Zhang Chen, Yi Xu, Minh Hoai, and Zhong Li.  

ACM International Conf. on Multimedia (ACM MM),  2025

[Paper(PDF)][Project Page]

Scalable High-Fidelity 3D Hand Shape Reconstruction via Graph-Image Frequency Mapping and Graph Frequency Decomposition

Tianyu Luan, Yuanhao Zhai, Jingjing Meng, Zhong Li, Zhang Chen, Yi Xu, and Junsong Yuan.

IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2025.

[Paper (PDF)]

PanoDreamer: Consistent Text to 360-Degree Scene Generation

Zhexiao Xiong, Zhang Chen, Zhong Li, Yi Xu, and Nathan Jacobs.

To appear at IEEE Conference on Computer Vision and Pattern Recognition Workshop (CVPRW), 2025.

Paper (PDF) 

OrientDream: Streamlining Text-to-3D Generation with Explicit Orientation Control

Yuzhong Huang, Zhong Li*, Zhang Chen, Zhiyuan Ren, Guosheng Lin, Fred Morstatter, Yi Xu.

arXiv preprint, 2024. Paper (PDF) 

accepted in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP),2025

PanoFree: Tuning-Free Holistic Multi-view Image Generation with Cross-view Self-Guidance. 

Aoming Liu, Zhong Li, Zhang Chen, Nannan Li, Yi Xu and Bryan A. Plummer.

European Conference on Computer Vision (ECCV), 2024.

[Paper(PDF)][Project Page]

NeuralTO: Neural Reconstruction and View Synthesis of Translucent Objects 

Yuxiang Cai,  Jiaxiong Qiu,  Zhong Li, Bo Ren.

ACM Transactions on Graphics (SIGGRAPH), 2024.

[Paper(PDF)]

NeuSmoke: Efficient Smoke Reconstruction and View Synthesis with Neural Transportation Fields

Jiaxiong Qiu, Ruihong Cen, Zhong Li, Han Yan, Ming-Ming Cheng, Bo Ren

(SIGGRAPH Asia) 2024 Conference Papers

[Paper(PDF)][Video]

Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesis

Zhan Li, Zhang ChenZhong Li, Yi Xu.

To appear at IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024.

[Project Page][Paper(PDF)][Code]

Spectrum AUC Difference (SAUCD): Human Aligned 3D Shape Evaluation.

Tianyu Luan,  Zhong Li *, Lele Chen, Xuan Gong, Lichang Chen, Yi Xu, Junsong Yuan.

To appear at IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024.

[Paper(PDF)]

OpenIllumination: A Multi-Illumination Dataset for Inverse Rendering Evaluation on Real Objects

Isabella Liu, Linghao Chen, Ziyang Fu, Liwen Wu, Haian Jin, Zhong Li, Chin Ming Ryan Wong, Yi Xu, Ravi Ramamoorthi, Zexiang Xu, Hao Su

To appear at Neural Information Processing Systems(NeurIPS), 2023, Datasets and Benchmarks track.

[Project Page][Paper(PDF)][Code]

High Fidelity 3D Hand Shape Reconstruction via Scalable Graph Frequency Decomposition

Tianyu Luan, Yuanhao Zhai, Jingjing Meng, Zhong Li, Zhang Chen, Yi Xu, Junsong Yuan.

To appear at IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023.

[Paper(PDF)] 

 Real-Time Lighting Estimation for Augmented Reality via Differentiable Screen-Space Rendering

Liu, Celong, Lingyu Wang, Zhong Li, Shuxue Quan, and Yi Xu.

IEEE Transactions on Visualization & Computer Graphics (TVCG) , 2022.

[Paper(PDF)]

Robustfusion: Robust volumetric performance reconstruction under human-object interactions from monocular rgbd stream

Su, Zhuo and Xu, Lan and Zhong, Dawei and Li, Zhong and Deng, Fan and Quan, Shuxue and Fang, Lu

IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) , 2022.

[Paper(PDF)]

PoP-Net: Pose over Parts Network for Multi-Person 3D Pose Estimation from a Depth Image

Yuliang Guo, Zhong Li, Zekun Li, Xiangyu Du, Shuxue Quan and Yi Xu

IEEE Winter Conference on Computer Vision (WACV), 2022

[Paper(PDF)] [Datasets]

3D Fluid Flow Reconstruction Using Compact Light Field PIV  

Zhong Li, Yu Ji, Jingyi Yu, Jinwei Ye

European Conference on Computer Vision (ECCV), 2020

[Paper(PDF)][Video]

Talking-head Generation with Rhythmic Head Motion

Lele Chen, Guofeng Cui, Celong Liu, Zhong Li, Ziyi Kou, Yi Xu, and Chenliang Xu

European Conference on Computer Vision (ECCV), 2020

[Paper(PDF)][Video]

Structure from Motion on XSlit Cameras 

Wei Yang, Yingliang Zhang, Jinwei Ye, Yu Ji, Zhong Li, Mingyuan Zhou, and Jingyi Yu.

IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 2019. 

[Paper(PDF)]

3D Human Avatar Digitization from a Single Image 

Zhong Li , Lele Chen, Celong Liu, , Yu Gao, Yuanzhou Ha , Chenliang Xu , Shuxue Quan, Yi Xu  

Computer & Graphics  (C & G), 2021.

ACM SIGGRAPH VRCAI (VRCAI), 2019.(Best paper award) . 

[Paper(PDF)][Journal Extension]


Professional Activity

Journal reviewer: 

  • IEEE Transactions on Pattern Analysis and Machine Intelligence(TPAMI)

  • International Journal of Computer Vision (IJCV)

  • IEEE Transactions on Image Processing(TIP)

  • IEEE Transactions on Circuits and Systems(TCAS)

  • IEEE Transactions on Multimedia Computing Communications and Applications(TOMM)

  • CVIU, Computer & Graphics, Machine Vision & Applications, The Visual Computer Journal(TVCJ), Image and Vision Computing,Science China,Display,Measurement

Conference program committee member and reviewer: 

  • CVPR 2021/2022/2023/2024/2025, ICCV 2021,2023. ECCV 2022/2024

  • NeurIPS 2023,2024, ICLR 2024, ICML 2025 

  • AAAI 2020/2021/2024/2025, IJCAI 2023

  • ISMAR2022,2023, IEEE VR 2023, ACCV 2024,WACV2025

US PATENT

Teaching

CISC 106: GEN COMPUTER SCIEN FOR ENGNR (Graduate TA 15 fall)

CISC 220: DATA STRUCTURE(Graduate TA 16 spring)

Read the original on sites.google.com ↗