Jiemin Fang (方杰民)¶

I am a senior researcher and assistant chief expert at Huawei of the TopMinds program, leading a small group that mainly works on 3D/4D reconstruction and generation. My research interests also include neural rendering, representation learning, neural architecture design/search and AutoML.

I obtained my PhD and BE degree from the School of Electronic Information and Communications (EIC) at Huazhong University of Science and Technology (HUST) in 2023 and 2018 respectively, supervised by Prof. Wenyu Liu and Prof. Xinggang Wang.

If you are interested in intern/full-time positions of our group or any other collaboration with me, welcome to contact me via email.

Email | Google Scholar | GitHub | Twitter | DBLP

News¶

Sep. 2024 - GaussianObject is accepted to ACM SIGGRAPH Asia 2024 as a journal paper (ACM TOG)!🎉
Jul. 2024 - Cascade-Zero123 is accepted to ECCV 2024!🎉
May 2024 - Invited to give a talk at VALSE 2024 about 3D/4D Contents Creation with Gaussian Splatting (record at bilibili).
Apr. 2024 - Invited to give a talk at China3DV 2024.
Feb. 2024 - 4D-GS, GaussianDreamer and GaussianEditor are accepted to CVPR 2024!🎉
Jan. 2024 - Invited to give a talk at GAMES Webinar.
Oct. 2023 - Fast High Dynamic Range Radiance Fields for Dynamic Scenes is accepted to 3DV 2024!
Sep. 2023 - SA3D: Segment Anything in 3D with NeRFs is accepted to NeurIPS 2023!
Mar. 2023 - ResizeMix is accepted by Computational Visual Media.
Nov. 2022 - I lead the team to win the Gold Award in The 8^th China International College Students’ “Internet+” Innovation and Entrepreneurship Competition (ranking the 1^st in the group of the industrial proposition track).
Aug. 2022 - TiNeuVox is conditionally accepted to ACM SIGGRAPH Asia 2022.
Jul. 2022 - I am honored to be awarded the HUST Academic Star (华中科技大学“学术新星”)!
Apr. 2022 - Our EfficientPose is chosen for the CVMJ 2021 best paper award.
Mar. 2022 - Two papers are accepted by CVPR 2022.
Jan. 2022 - BINGO is accepted by ICLR 2022.
Jul. 2021 - One paper is accepted by ICCV 2021.
Dec. 2020 - "FNA++: Fast Network Adaptation via Parameter Remapping and Architecture Search" is published in IEEE TPAMI.
Nov. 2020 - I have released a PyTorch toolkit dali-pytorch for accelerating ImageNet training with NVIDIA DALI. It improves the training speed dramatically with maintaining high performance.

Publications¶

*equal contributions. ^†project lead. ^✉corresponding author.

Preprints¶

GaussianDreamerPro: Text to Manipulable 3D Gaussians with Highly Enhanced Quality
Taoran Yi, Jiemin Fang^†, Zanwei Zhou, Junjie Wang, Guanjun Wu, Lingxi Xie, Xiaopeng Zhang, Wenyu Liu, Xinggang Wang, Qi Tian
arxiv:2406.18462, 2024
PDF | Code | Project Page | BibTeX

Segment Any 3D Gaussians
Jiazhong Cen, Jiemin Fang, Chen Yang, Lingxi Xie, Xiaopeng Zhang, Wei Shen, Qi Tian
arxiv:2312.00860, 2023
PDF | Code | Project Page | BibTeX

Generalizable Neural Voxels for Fast Human Radiance Fields
Taoran Yi*, Jiemin Fang*, Xinggang Wang, Wenyu Liu
arxiv:2303.15387, 2023
PDF | Code | Project Page | BibTeX

NeuSample: Neural Sample Field for Efficient View Synthesis
Jiemin Fang, Lingxi Xie, Xinggang Wang, Xiaopeng Zhang, Wenyu Liu, Qi Tian
arXiv:2111.15552, 2021
PDF | Code | Project Page | BibTeX

Conference Papers¶

GaussianObject: High-Quality 3D Object Reconstruction from Four Views with Gaussian Splatting
Chen Yang*, Sikuang Li*, Jiemin Fang^†, Ruofan Liang, Lingxi Xie, Xiaopeng Zhang, Wei Shen, Qi Tian
ACM SIGGRAPH Asia 2024 (ACM TOG)
PDF | Code | Project Page | BibTeX

Cascade-Zero123: One Image to Highly Consistent 3D with Self-Prompted Nearby Views
Yabo Chen*, Jiemin Fang*^✉, Yuyang Huang, Taoran Yi, Xiaopeng Zhang, Lingxi Xie, Xinggang Wang, Wenrui Dai, Hongkai Xiong, Qi Tian
ECCV 2024
PDF | Code | Project Page | BibTeX

4D Gaussian Splatting for Real-Time Dynamic Scene Rendering
Guanjun Wu*, Taoran Yi*, Jiemin Fang^†, Lingxi Xie, Xiaopeng Zhang, Wei Wei, Wenyu Liu, Qi Tian, Xinggang Wang^†
CVPR 2024
PDF | Code | Project Page | BibTeX

GaussianDreamer: Fast Generation from Text to 3D Gaussian Splatting with Point Cloud Priors
Taoran Yi, Jiemin Fang^†, Guanjun Wu, Lingxi Xie, Xiaopeng Zhang, Wenyu Liu, Qi Tian, Xinggang Wang^†
CVPR 2024
PDF | Code | Project Page | BibTeX

GaussianEditor: Editing 3D Gaussians Delicately with Text Instructions
Junjie Wang*, Jiemin Fang*^✉, Xiaopeng Zhang, Lingxi Xie, Qi Tian
CVPR 2024
PDF | Project Page | BibTeX

Segment Anything in 3D with NeRFs
Jiazhong Cen*, Zanwei Zhou*, Jiemin Fang^†, Wei Shen, Lingxi Xie, Dongsheng Jiang, Xiaopeng Zhang, Qi Tian
NeurIPS 2023
PDF | Code | Project Page | BibTeX

Fast High Dynamic Range Radiance Fields for Dynamic Scenes
Guanjun Wu*, Taoran Yi*, Jiemin Fang^†, Wenyu Liu, Xinggang Wang^†
3DV 2024
PDF | Code | Project Page | Video | BibTeX

MSG-Transformer: Exchanging Local Spatial Information by Manipulating Messenger Tokens
Jiemin Fang, Lingxi Xie, Xinggang Wang, Xiaopeng Zhang, Wenyu Liu, Qi Tian
CVPR 2022
CVF | PDF | Code | Video | BibTeX

Bag of Instances Aggregation Boosts Self-supervised Learning
Haohang Xu*, Jiemin Fang*, Xiaopeng Zhang, Lingxi Xie, Xinggang Wang, Wenrui Dai, Hongkai Xiong, Qi Tian
ICLR 2022
PDF | Code | BibTeX

Densely Connected Search Space for More Flexible Neural Architecture Search
Jiemin Fang, Yuzhu Sun, Qian Zhang, Yuan Li, Wenyu Liu, Xinggang Wang
CVPR 2020
PDF | Code | BibTeX

Fast Neural Network Adaptation via Parameter Remapping and Architecture Search
Jiemin Fang*, Yuzhu Sun*, Kangjian Peng*, Qian Zhang, Yuan Li, Wenyu Liu, Xinggang Wang
ICLR 2020
PDF | Code | BibTeX

Temporally Efficient Vision Transformer for Video Instance Segmentation
Shusheng Yang, Xinggang Wang, Yu Li, Yuxin Fang, Jiemin Fang, Wenyu Liu, Xun Zhao, Ying Shan
CVPR 2022 (Oral)
PDF | Code | BibTeX

You Only Look at One Sequence: Rethinking Transformer in Vision through Object Detection
Yuxin Fang, Bencheng Liao, Xinggang Wang, Jiemin Fang, Jiyang Qi, Rui Wu, Jianwei Niu, Wenyu Liu
NeurIPS 2021
PDF | Code | BibTeX

Hierarchical Aggregation for 3D Instance Segmentation
Shaoyu Chen, Jiemin Fang, Qian Zhang, Wenyu Liu, Xinggang Wang
ICCV 2021
PDF | Code | BibTeX

Deep Multi-instance Learning with Dynamic Pooling
Yongluan Yan, Xinggang Wang, Xiaojie Guo, Jiemin Fang, Wenyu Liu, Junzhou Huang
ACML 2018
PDF | BibTeX

Journal Papers¶

FNA++: Fast Network Adaptation via Parameter Remapping and Architecture Search
Jiemin Fang*, Yuzhu Sun*, Qian Zhang, Kangjian Peng, Yuan Li, Wenyu Liu, Xinggang Wang
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 2021
PDF | Code | BibTeX

EAT-NAS: Elastic Architecture Transfer for Accelerating Large-scale Neural Architecture Search
Jiemin Fang*, Yukang Chen*, Xinbang Zhang, Qian Zhang, Chang Huang, Gaofeng Meng, Wenyu Liu, Xinggang Wang
Science China Information Sciences (SCIS) 2021
PDF | Code | BibTeX

EfficientPose: Efficient Human Pose Estimation with Neural Architecture Search
Wenqiang Zhang*, Jiemin Fang*, Xinggang Wang, Wenyu Liu
Computational Visual Media (CVMJ) 2021 (Best Paper Award)
PDF | Code | BibTeX

ResizeMix: Mixing Data with Preserved Object Information and True Labels
Jie Qin*, Jiemin Fang*, Qian Zhang, Wenyu Liu, Xingang Wang, Xinggang Wang
Computational Visual Media (CVMJ) 2023
PDF | BibTeX

Exploring Complicated Search Spaces with Interleaving-Free Sampling
Yunjie Tian, Lingxi Xie, Jiemin Fang, Jianbin Jiao, Qixiang Ye, Qi Tian
IEEE Transactions on Neural Networks and Learning Systems (TNNLS) 2024
PDF | BibTeX

TinyDet: accurately detecting small objects within 1 GFLOPs
Shaoyu Chen, Tianheng Cheng, Jiemin Fang, Qian Zhang, Yuan Li, Wenyu Liu, Xinggang Wang
Science China Information Sciences (SCIS) 2023
PDF | Code | BibTeX

Efficient Task-specific Feature Re-fusion for More Accurate Object Detection and Instance Segmentation
Cheng Wang, Yuxin Fang, Jiemin Fang, Peng Guo, Rui Wu, He Huang, Xinggang Wang, Chang Huang, Wenyu Liu
IEEE Transactions on Circuits and Systems for Video Technology (TCSVT) 2023
PDF | BibTeX

Internships¶

Jan. 2021 - Jun. 2023, Huawei Cloud in Shanghai working with Prof. Qi Tian, Dr. Lingxi Xie and Dr. Xiaopeng Zhang.
Aug. 2018 - Nov. 2020, Horizon Robotics in Beijing working with Dr. Qian Zhang and Dr. Yuan Li.

Academic Services¶

Journal Reviewers¶

IEEE Transactions on Pattern Analysis and Machine Intelligence (IEEE TPAMI)
International Journal of Computer Vision (IJCV)
IEEE Transactions on Visualization and Computer Graphics (IEEE TVCG)
IEEE Transactions on Neural Networks and Learning Systems (IEEE TNNLS)
IEEE Transactions on Multimedia (IEEE TMM)
IEEE Transactions on Circuits and Systems for Video Technology (IEEE TCSVT)
Neural Networks (NN)
Science China Information Sciences (SCIS)
Image and Vision Computing
Machine Vision and Applications
Journal of Big Data

Conference Reviewers¶

ACM SIGGRAPH/SIGGRAPH Asia 2024, 2023
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2024 - 2021
IEEE/CVF International Conference on Computer Vision (ICCV) 2023, 2021
Neural Information Processing Systems (NeurIPS) 2024 - 2021
International Conference on Learning Representations (ICLR) 2024, 2023, 2022
International Conference on Machine Learning (ICML) 2024 - 2021
European Conference on Computer Vision (ECCV) 2024, 2022
AAAI Conference on Artificial Intelligence (AAAI) 2025 - 2021

Competition Experience¶

I led the team to win the Gold Award in The 8^th China International College Students’ “Internet+” Innovation and Entrepreneurship Competition (第八届中国国际“互联网+”大学生创新创业大赛) (ranking the 1^st in the group of the industrial proposition track) in 2022.
I ever participated in RoboMaster Robotics Competition. I worked on embedded development and achieved the national second prize in 2017. Then in 2018, I led the team to win the national second prize.

Awards & Honors¶

Huawei TopMinds Program (华为“天才少年”计划), 2023
HUST Academic Star (华中科技大学“学术新星”), 2022
Best Paper Award of Computational Visual Media, 2021
National Scholarship for PhD Student, 2021
National Scholarship for Master Student, 2020
National Scholarship for Undergraduate Student, 2017

Since Feb. 2021