Wei Ye

I am a Staff Research Scientist at Meta Reality Labs, where I have been building the spatial intelligence behind the future of AR/VR since 2020.

Currently, I lead efforts on multimodal LLMs for spatial reasoning, teaching AI to understand and interact with 3D environments. Previously, I led the development of the on-device ML depth estimation system shipped on Quest 3 and Quest 3S. My research lies at the frontier of multimodal large language models, 3D vision, and novel view synthesis.

I received my Ph.D. in ECE from UT Austin, where I was advised by Prof. David Z. Pan, and my B.Eng. from Zhejiang University.

Email  /  Google Scholar  /  GitHub  /  LinkedIn  /  CV

Wei Ye

Publications

See the full list on Google Scholar.

Ri3D: Few-shot Gaussian Splatting with Repair and Inpainting Diffusion Priors

Avinash Paliwal, Xilong Zhou, Wei Ye, Jinhui Xiong, Rakesh Ranjan, Nima Khademi Kalantari

IEEE/CVF International Conference on Computer Vision (ICCV), 2025

CoherentGS: Sparse Novel View Synthesis with Coherent 3D Gaussians

Avinash Paliwal, Wei Ye, Jinhui Xiong, Dmytro Kotovenko, Rakesh Ranjan, Vikas Chandra, Nima Khademi Kalantari

European Conference on Computer Vision (ECCV), 2024

Compressed Depth Map Super-Resolution and Restoration: AIM 2024 Challenge Results

Marcos V. Conde, Florin-Alexandru Vasluianu, Jinhui Xiong, Wei Ye, Rakesh Ranjan, Radu Timofte, et al.

European Conference on Computer Vision Workshops (ECCVW), 2024

Consistent Direct Time-of-Flight Video Depth Super-Resolution

Zhanghao Sun, Wei Ye, Jinhui Xiong, Gyeongmin Choe, Jialiang Wang, Shuochen Su, Rakesh Ranjan

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023

Temporally Consistent Online Depth Estimation in Dynamic Scenes

Zhaoshuo Li, Wei Ye, Dilin Wang, Francis X. Creighton, Russell H. Taylor, Ganesh Venkatesh, Mathias Unberath

IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2023

Multi-Scale High-Resolution Vision Transformer for Semantic Segmentation (HRViT)

Jiaqi Gu, Hyoukjun Kwon, Dilin Wang, Wei Ye, Meng Li, Yu-Hsin Chen, Liangzhen Lai, Vikas Chandra, David Z. Pan

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022

Earlier Publications

Ph.D. work on machine learning for electronic design automation, 2020 and earlier.

Dealing with Aging and Yield in Scaled Technologies

Wei Ye, Mohamed Baker Alawieh, Che-Lun Hsu, Yibo Lin, David Z. Pan

In Dependable Embedded Systems, Springer, 2020 (Book Chapter)

TEMPO: Fast Mask Topography Effect Modeling with Deep Learning

Wei Ye, Mohamed Baker Alawieh, Yuki Watanabe, Shigeki Nojima, Yibo Lin, David Z. Pan

ACM International Symposium on Physical Design (ISPD), 2020 · Best Paper Award

Re-examining VLSI Manufacturing and Yield through the Lens of Deep Learning

Mohamed Baker Alawieh, Wei Ye, David Z. Pan

IEEE/ACM International Conference on Computer-Aided Design (ICCAD), 2020

LithoGAN: End-to-End Lithography Modeling with Generative Adversarial Networks

Wei Ye, Mohamed Baker Alawieh, Yibo Lin, David Z. Pan

ACM/IEEE Design Automation Conference (DAC), 2019 · Best Paper Nomination

Generative Learning in VLSI Design for Manufacturability: Current Status and Future Directions

Yibo Lin, Mohamed Baker Alawieh, Wei Ye, David Z. Pan

Journal of Microelectronic Manufacturing (JOMM), 2019 (Invited)

Litho-GPA: Gaussian Process Assurance for Lithography Hotspot Detection

Wei Ye, Mohamed Baker Alawieh, Meng Li, Yibo Lin, David Z. Pan

IEEE/ACM Design, Automation and Test in Europe (DATE), 2019

LithoROC: Lithography Hotspot Detection with Explicit ROC Optimization

Wei Ye, Yibo Lin, Meng Li, Qiang Liu, David Z. Pan

IEEE/ACM Asia and South Pacific Design Automation Conference (ASPDAC), 2019 (Invited)

Tackling Signal Electromigration with Learning-Based Detection and Multistage Mitigation

Wei Ye, Mohamed Baker Alawieh, Yibo Lin, David Z. Pan

IEEE/ACM Asia and South Pacific Design Automation Conference (ASPDAC), 2019

Machine Learning for Yield Learning and Optimization

Yibo Lin, Mohamed Baker Alawieh, Wei Ye, David Z. Pan

IEEE International Test Conference (ITC), 2018 (Invited)

Power Grid Reduction by Sparse Convex Optimization

Wei Ye, Meng Li, Kai Zhong, Bei Yu, David Z. Pan

ACM International Symposium on Physical Design (ISPD), 2018

Placement Mitigation Techniques for Power Grid Electromigration

Wei Ye, Yibo Lin, Xiaoqing Xu, Wuxi Li, Yiwei Fu, Yongsheng Sun, Canhui Zhan, David Z. Pan

IEEE International Symposium on Low Power Electronics and Design (ISLPED), 2017

Standard Cell Layout Regularity and Pin Access Optimization Considering Middle-of-Line

Wei Ye, Bei Yu, Yong-Chan Ban, Lars Liebmann, David Z. Pan

ACM Great Lakes Symposium on VLSI (GLSVLSI), 2015

Patents

System and Method for Depth Densification and Confidence Map Generation

Jinhui Xiong, Rakesh Ranjan, Zijian He, Wei Ye, Jialiang Wang, Shanghsuan Tsai, Shuochen Su, Yue Zhao

U.S. Patent Application 2025/0252531 A1, 2025 (pending)

Holographic Calling for Artificial Reality

Andrés Pozo, Justin Virskus, Ganesh Venkatesh, Kai Li, Shih-Chii Chen, Anand Kumar, Rakesh Ranjan, ..., Wei Ye, et al.

U.S. Patent 11,461,962, 2022