Ph.D. Student
Department of Computer Science
National Yang Ming Chiao Tung University, Taiwan

Software Engineer, Pixel Camera Team, Google

Email: jayinnn.cs14@nycu.edu.tw

Personal Page / GitHub / LinkedIn / Google Scholar / Personal Blog / CV

About Me

Hi! I’m Jie-Ying (Jay) Lee. I am a Ph.D. student in Computer Science at National Yang Ming Chiao Tung University, advised by Prof. Yu-Lun Liu. I am also a Software Engineer on Google’s Pixel Camera Team, where I develop camera machine learning algorithms.

I received my B.S. in Computer Science from National Yang Ming Chiao Tung University. During my undergraduate studies, I was an exchange student at ETH Zurich.

In Summer 2024, I interned with Google’s Pixel Camera Team, where I integrated the Segment Anything Model (SAM) for mobile devices, hosted by Yu-Lin Chang and Chung-Kai Hsieh. My industry experience also includes positions as an R&D Intern at Microsoft and a Backend Engineer Intern at Appier.

I am actively seeking research collaborations.

Outside of work and research, I enjoy badminton, dance, and photography.

Research Interest

• 3D Reconstruction
  • Neural Radiance Fields (NeRFs)
  • 3D Gaussian Splatting
  • Large-scale Scene Reconstruction
  • Satellite Imagery
• 3D Generation
  • Urban Scene Generation
  • Object Generation and Manipulation
• Image Segmentation
  • Segment Anything Model

News

• Sep. 2025: Joined Google as a Software Engineer on the Pixel Camera Team!
• Sep. 2025: Started my Ph.D. journey at NYCU with Prof. Yu-Lun Liu!
• Jul. 2025: One paper accepted to CoRL 2025: “See, Point, Fly”!
• Jun. 2025: One paper accepted to ICCV 2025: “LightsOut”!
• Mar. 2025: Two papers accepted to CVPR 2025: “AuraFusion360” and “SpectroMotion”!
• Sep. 2024: Began exchange studies in the Department of Computer Science (D-INFK) at ETH Zurich
• Aug. 2024: Co-authored “BoostMVSNeRFs” paper accepted to the ECCV 2024 Wild3D Workshop as a poster presentation
• Jul. 2024: My work, BEVGaussian, won the 陽明交大資工系專題競賽佳作 (3rd place of the NYCU CS Undergraduate Research Competition)!
• Jun. 2024: My work, Unbounded Scene Generation, are awarded the 國科會大專學生研究計畫 (NSTC Research Grant for University Students)!
• May 2024: Co-authored “BoostMVSNeRFs” paper accepted to SIGGRAPH 2024!

Publications

AuraFusion360: Augmented Unseen Region Alignment for Reference-based 360° Unbounded Scene Inpainting

Chung-Ho Wu*, Yang-Jung Chen*, Ying-Huan Chen, Jie-Ying Lee, Bo-Hsu Ke, Chun-Wei Tuan Mu, Yi-Chuan Huang, Chin-Yang Lin, Min-Hung Chen, Yen-Yu Lin, Yu-Lun Liu (*Equal Contribution)

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025

The approach introduces (1) depth-aware unseen mask generation for accurate occlusion identification, (2) Adaptive Guided Depth Diffusion, a zero-shot method for accurate initial point placement without requiring additional training, and (3) SDEdit-based detail enhancement for multi-view coherence.

SpectroMotion: Dynamic 3D Reconstruction of Specular Scenes

Cheng-De Fan, Chen-Wei Chang, Yi-Ruei Liu, Jie-Ying Lee, Jiun-Long Huang, Yu-Chee Tseng, Yu-Lun Liu

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025

SpectroMotion is presented, a novel approach that combines 3D Gaussian Splatting with physically-based rendering (PBR) and deformation fields to reconstruct dynamic specular scenes and is the only existing 3DGS method capable of synthesizing photorealistic real-world dynamic specular scenes.

BoostMVSNeRFs: Boosting MVS-based NeRFs to Generalizable View Synthesis in Large-scale Scenes

Chih-Hai Su*, Chih-Yao Hu*, Shr-Ruei Tsai*, Jie-Ying Lee*, Chin-Yang Lin, Yu-Lun Liu (*Equal Contribution)

ACM Special Interest Group on Computer Graphics and Interactive Techniques (SIGGRAPH), 2024

This paper presents a novel approach called BoostMVSNeRFs to enhance the rendering quality of MVS-based NeRFs in large-scale scenes, and identifies limitations in MVS-based NeRF methods, such as restricted viewport coverage and artifacts due to limited input views.