About me

I am a Ph.D. student of MMLab (Multimedia Laboratory), The Chinese University of Hong Kong, supervised by Dahua Lin. Previously I spent four wonderful years and obtained my Bachelor’s Degree at Zhejiang University. I am excited about all the vision or AI technologies that can change people’s lifestyles, for example, building intelligent agents that can interact with us. My current research is mainly focused on general 3D perception, including different modalities, tasks and scenarios. I am also interested in other extensive 3D vision research and their robotic applications.

News

[2021/10] FCOS3D got the best paper award on the ICCV 3DODI workshop! Thanks for the recognition!
[2021/09] One paper is accepted by NeurIPS 2021.
[2021/09] PGD, our follow-up work of FCOS3D, is accepted by CoRL 2021.
[2021/02] Our further research on voxel representation learning, Cylinder3D, is accepted by CVPR 2021. We also obtained the runner-up in the nuScenes LiDAR Segmentation Challenge.
[2020/12] MMDet3D Team wins the Best PKL Award and best vision-only results in the 3rd nuScenes detection challenge of 5th AI Driving Olympics, NeurIPS 2020.
[2020/11] We release the full technical report for our previously developed LiDAR annotation tool, FLAVA.
[2020/10] Reconfigurable Voxels is accepted to CoRL 2020.
[2020/07] MMDetection3D is finally released! Fork this versatile codebase and have a try, pushing forward this field to general 3D detection together.

Education


The Chinese University of Hong Kong (CUHK): August 2019 - July 2023 (Expected); Ph.D. in Information Engineering

Zhejiang University (ZJU): August 2015 - July 2019; Major: B.E. in Information Engineering; Minor: Advanced Honor Class of Engineering Education (ACEE), Chu Kochen Honors College

Publications

Vision-Only 3D Detection

Probabilistic and Geometric Depth: Detecting Objects in Perspective: Tai Wang, Xinge Zhu, Jiangmiao Pang, Dahua Lin; Conference on Robot Learning (CoRL) 2021; [Paper] [Code] [Poster] [Bibtex]

FCOS3D: Fully Convolutional One-Stage Monocular 3D Object Detection: Tai Wang, Xinge Zhu, Jiangmiao Pang, Dahua Lin; ICCV Workshop on 3D Object Detection from Images (ICCVW) 2021, Best Paper Award; 1st place solution of vision-only methods in the nuScenes 3D detection challenge, NeurIPS 2020; [Paper] [Code] [Slides] [Zhihu] [Bibtex]

SIDE: Center-Based Stereo 3D Detector with Structure-Aware Instance Depth Estimation: Xidong Peng, Xinge Zhu, Tai Wang, Yuexin Ma; IEEE Winter Conference on Applications of Computer Vision (WACV) 2022; [Paper] [Code] [Bibtex]

Voxel Representation Learning in LiDAR-Based Perception

Cylindrical and Asymmetrical 3D Convolution Networks for LiDAR Segmentation: Xinge Zhu*, Hui Zhou*, Tai Wang, Fangzhou Hong, Yuexin Ma, Wei Li, Hongsheng Li, Dahua Lin; IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2021, Oral; IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 2021; [Paper] [Code] [TPAMI version] [Bibtex]

Reconfigurable Voxels: A New Representation for LiDAR-Based Point Clouds: Tai Wang, Xinge Zhu, Dahua Lin; Conference on Robot Learning (CoRL) 2020; [Paper] [Spotlight Talk] [Bibtex]

SSN: Shape Signature Networks for Object Detection from Point Clouds: Xinge Zhu, Yuexin Ma, Tai Wang, Yan Xu, Jianping Shi, Dahua Lin,; European Conference on Computeer Vision (ECCV) 2020; [Paper] [Code] [Bibtex]

Efficient Annotation of LiDAR Point Clouds

FLAVA: Find, Localize, Adjust and Verify to Annotate LiDAR-based Point Clouds: Tai Wang, Conghui He, Zhe Wang, Jianping Shi, Dahua Lin; ACM Symposium on User Interface Software and Technology (UIST) 2020, Poster; [Full Tech Report] [Poster] [Poster Summary] [Demo] [Bibtex]

3D Generation and Reconstruction

Density-aware Chamfer Distance as a Comprehensive Metric for Point Cloud Completion: Tong Wu, Liang Pan, Junzhe Zhang, Tai Wang, Ziwei Liu, Dahua Lin; Advances in Neural Information Processing Systems (NeurIPS), 2021; [Paper] [Code] [Bibtex]

Research Projects


MMDetection3D: The Next-Generation Platform for General 3D detection: A versatile, open-source 3D object detection toolbox based on PyTorch; MMDetection3D Contributors; May 2020 – Now; [Code] [Doc] [Bibtex]

Spherical Convolutional Networks for 3D Mesh Processing: New approaches to generating 3D meshes from scratch with S2 parametrization & extended spherical CNNs; Tai Wang, Weiwei Zhou and Zicheng Liao; Under revision and further development; Mar 2018 – Nov 2018

Experience


Visiting Scholar, Shanghai AI Laboratory: July 2020 - Now. Advisor: Jiangmiao Pang, Kai Chen; Focus: The next-generation platform for general 3D perception

Adjunct Researcher, Sensetime: Nov. 2019 - June 2020. Advisor: Conghui He, Zhe Wang, Jianping Shi; Focus: Efficient annotation of LiDAR point clouds, development of LiDAR perception system

Junior Research Assistant, The Chinese University of Hong Kong (CUHK): Feb. 2019 - May 2019. Advisor: Dahua Lin; Focus: Real-time 3D object detection in autonomous driving

Research Intern, Alibaba-ZJU Joint Institute of Frontier Technologies (AZFT): Dec. 2017 - June 2019. Advisor: Zicheng Liao, Gang Wang. I also worked with Dr. Lechao Cheng.; Focus: Joint analysis of 2D Images and 3D Shapes with machine learning approaches

Selected Awards

Best Paper Award of Workshop on 3D Object Detection from Images, ICCV 2021
1st place of vision-only track and best PKL award of overall track, NuScenes 3D Detection Challenge, NeurIPS 2020
Runner-up of NuScenes LiDAR Segmentation Challenge, NeurIPS 2020
Gold Medal of Kaggle Competition (Top 1% of Lyft 3D Detection Challenge), NeurIPS 2019
Hong Kong PhD Fellowship (HKPFS), 2019
Chu Kochen Scholarship (Highest scholarship at Zhejiang University), 2018
Top 10 Students of ZJU (Highest honor for 5 undergraduates/graduates), 2018
National Scholarship (1.5%), 2017-2018
First Prize in Physics Competition for Undergraduate, 2017

Teaching

Computer Vision (Undergraduate Course), Winter 2018 @ ZJU
IERG2080: Introduction to Systems Programming, Fall 2020 @ CUHK
IERG2470B/ESTR2308: Probability Models and Applications (Elite Students), Spring 2021 @ CUHK

Miscellaneous

Academic Services
I served as a reviewer for CVPR, ICCV, ECCV, NeurIPS, ICLR, CoRL, WACV.

Hobbies
Love: 🏀Basketball (I am a big fan of Stephen Curry and Tracy McGrady), 🎵music/🎤singing and good at 🖌️Chinese calligraphy (learned from MA Liangchen and MA Shanshuang).

Tai Wang 王泰