Weiwei Sun

I am currently a Ph.D. student in Computer Science, University of British Columbia (UBC), co-advised by Dr. Kwang Moo Yi and Dr. Andrea Tagliasacchi.

My research interest includes 3D computer vision and deep learning. My primary focus recently is on 3D learning in the wild settings -- e.g., multi-view setting, real-world point clouds.

News

• 2023 May: Recognized as an outstanding reviewer for CVPR2023!
• 2023 Jan: I gave a talk at Google about explainable models for point cloud learning. See [ Slides].
• 2023 Jan: Co-organize the image matching workshop @ CVPR 2023. For details, see IMW@CVPR23.
• 2022 Dec: One paper (CAT: combination of spatial and channel attention) got accepted by IET computer vision.
• 2022 Sept: TUSK (unsupervised keypoints) got accepted by NeurIPS 2022.
• 2022 Sept: one paper (polygonal geometry learning) got accepted by GeoInformatica.
• 2022 Aug: NeuralBF (principled 3D instance parameterization) got accepted by WACV2023 in the first round.
• 2022 March: Start at Nvidia as a research scientist intern.
• 2021 Sept: CaCa (Canonical capsule) accepted by NeurIPS2021.
• 2021 June: Started at Google as a student researcher working on geometric perception.
• 2021 May: Recognized as an outstanding reviewer for CVPR2021!
• 2020 May: Code for ACNe in Tensorflow 1.8 is released!
• 2020 May: One paper accepted by CVPR2020 workshops, Scalability in Autonomous Driving.
• 2020 Apr: One paper accepted by IV2020.
• 2020 Mar: One paper accepted by CVPR2020.

Selected Publications [Google Scholar]

* below indicates equal contribution
• 3D Gaussian Splatting as Markov Chain Monte Carlo
  Shakiba Kheradmand, Daniel Rebain, Gopal Sharma, Weiwei Sun, Jeff Tseng, Hossam Isack, Abhishek Kar, Andrea Tagliasacchi, Kwang Moo Yi
  ArXiv, 2024.
  

  [Paper]

• PointNeRF++: A multi-scale, point-based Neural Radiance Field.
  Weiwei Sun, Eduard Trulls, Yang-Che Tseng, Sneha Sambandam, Gopal Sharma, Andrea Tagliasacchi, Kwang Moo Yi
  ArXiv, 2023.
  

  [Paper] [Project]

• Densify Your Labels: Unsupervised Clustering with Bipartite Matching for Weakly Supervised Point Cloud Segmentation.
  Shaobo Xia, Jun Yue, Kacper Kania, Leyuan Fang, Andrea Tagliasacchi, Kwang Moo Yi, Weiwei Sun
  ArXiv, 2023.
  

  [Paper] [Project]

• NeuralBF: Neural Bilateral Filtering for Top-down Instance Segmentation on Point Clouds
  Weiwei Sun, Daniel Rebain, Renjie Liao, Vladimir Tankovich, Soroosh Yazdani, Kwang Moo Yi, Andrea Tagliasacchi
  WACV, 2023.
  

  [Paper] [Project]

• TUSK: Task-agnostic Unsupervised Keypoints
  Yuhe Jin, Weiwei Sun, Jan Hosang, Eduard Trulls, Kwang Moo Yi
  NeurIPS , 2022.
  

  [Paper]

• Canonical Capsules: Self-supervised Capsules in Canonical Pose
  Weiwei Sun *, Andrea Tagliasacchi*, Boyang Deng, Sara Sabour, Soroosh Yazdani, Geoffrey Hinton, Kwang Moo Yi
  NeurIPS , 2021.
  

  [Paper] [Project] [Code]

• Vehicle Re-ID for Surround-view Camera System
  Zizhang Wu, Man Wang, Lingxiao Yin, Weiwei Sun, Jason Wang, Huangbin Wu
  CVPR workshop on Scalability in Autonomous Driving , 2020.
  

  [Paper]

• PSDet: Efficient and Universal Parking Slot Detection
  Zizhang Wu, Weiwei Sun, Man Wang, Xiaoquan Wang, Lizhu Ding, Fan Wang
  IV , 2020.
  

  [Paper]

• ACNe: Attentive Context Normalization for Robust Permutation-Equivariant Learning
  Weiwei Sun , Wei Jiang, Eduard Trulls, Andrea Tagliasacchi, Kwang Moo Yi.
  CVPR , 2020.
  

  [Paper] [Code]

• Optimizing Through Learned Errors for Accurate Sports Field Registration
  Wei Jiang, Juan Camilo Gamboa Higuera, Baptiste Angles, Weiwei Sun , Mehrsan Javan, Kwang Moo Yi.
  WACV , 2020.
  

  [Paper] [Code]

• Linearized Multi-Sampling for Differentiable Image Transformation
  Wei Jiang, Weiwei Sun, Andrea Tagliasacchi, Eduard Trulls, Kwang Moo Yi.
  ICCV , 2019. [Oral]
  

  [Paper] [Code]

• Fully Convolutional Networks for Semantic Segmentation of Very High Resolution Remotely Sensed Images Combined With DSM
  Weiwei Sun, and Ruisheng Wang.
  IEEE GRSL, 2018.
  
• Optic disc segmentation for glaucoma screening system using fundus images
  Ahmed Almazroa, Weiwei Sun, Sami Alodhayb, Kaamran Raahemifar, Vasudevan Lakshminarayanan.
  Clinical ophthalmology, 2017.
  
• Optic disc segmentation: level set methods and blood vessels inpainting
  Ahmed Almazroa, Weiwei Sun, Sami Alodhayb, Kaamran Raahemifar, Vasudevan Lakshminarayanan.
  SPIE Medical imaging , 2017.
  
• Optic cup segmentation based on extracting blood vessel kinks and cup thresholding using Type-II fuzzy approach
  Ahmed Almazroa, Sami Alodhayb, R Burman, Weiwei Sun, Kaamran Raahemifar, Vasudevan Lakshminarayanan
  IEEE IEM OPTRONIX , 2015.
  

Experience

• NVIDIA Toronto AI Lab Toronto
  Apr. 2022 – Mar. 2023
  
  Research Scientist Intern
  Advisor: Jun Gao , Tianchang Shen , Sameh Khamis , Or Litany , Sanja Fidler , Zan Gojcic
  Topic: Single-view reconstruction, 3D generative model
  
• Google Remote
  Jun. 2021 – Dec. 2021
  
  Student Researcher
  Advisor: Vladimir Tankovich and Soroosh Yazdani
  Topic: Geometric perception
  
• VIP Lab, University of Waterloo, Waterloo, Canada
  May. 2019 – Dec. 2019
  
  Visiting Ph.D. Student
  Advisor: John S. Zelek
  Topic: Point clouds registration
  
• Perceptron Algorithm Group, Zongmu Technology Co. Ltd, Beijing, China
  May. 2018 – Aug. 2018
  
  Computer Vision Research Intern
  Advisor: Zizhang Wu
  Topic: Image segmentation
  
• School of optometry, University of Waterloo, Waterloo, Canada
  May. 2015 – Aug. 2015
  
  Image Processing Research Intern
  Advisor: Vasudevan Lakshminarayanan
  Topic: Digitial image processing
  

Professional Activities

• Conference Reviewer:
    SIGGRAPH 2023.
    International Conference on Learning Representations (ICLR) 2023.
    International Conference on 3D Vision (3DV) 2022.
    Neural Information Processing Systems (NeurIPS) 2022.
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2022.
    International Conference on Machine Learning (ICML) 2022.
    International Conference on Learning Representations (ICLR) 2022.
    Neural Information Processing Systems (NeurIPS) 2021.
    IEEE International Conference on Computer Vision (ICCV) 2021.
    International Conference on Machine Learning (ICML) 2021.
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2021.
    AAAI Conference on Artificial Intelligence (AAAI) 2021.
    Winter Conference on Applications of Computer Vision (WACV) 2021.
    Neural Information Processing Systems (NeurIPS) 2020.
    Asian Conference on Computer Vision (ACCV) 2020.
    British Machine Vision Conference (BMVC) 2020.
    International Joint Conference on Artificial Intelligence (IJCAI) 2020.
    European Conference on Computer Vision (ECCV) 2020.
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2020.
    AAAI Conference on Artificial Intelligence (AAAI) 2020.
    British Machine Vision Conference (BMVC) 2019.
    IEEE International Conference on Computer Vision (ICCV) 2019: Geometry Meets Deep Learning.
    IEEE International Conference on Computer Vision (ICCV) 2019.
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2019: Image Matching.
  

• Journal Reviewer:
    IEEE Transactions on Pattern Analysis and Machine Intelligence
    International Journal of Computer Vision
    Land Use Policy
    IEEE Transactions on Neural Networks and Learning Systems
    IEEE Transactions on Visualization and Computer Graphics
    Computer Vision and Image Understanding
  

Talks

• Exploring Explainable Models for Point Cloud Learning @ Google Semantic perception group. [ Slides]
  01, 2023
• Canonical Capsules @ NVIDIA AI Lab.
  03, 2022
• Canonical Capsules @ Wuhan University.
  Apr 02, 2022
• Efficient Message Passing for Point Cloud Learning @ SpaceML, University of Victoria. Virtual.
  Dec 16, 2021

Honors & Awards

• Uvic Graduate Fellowship
  2018
• Mitacs Globalink Graduate Fellowship
  2016
• Outstanding Graduate, WHU
  2016
• Mitacs Globalink Summer Internship Award
  2015
• National Motivational Scholarship, Ministry of Education of P.R. China
  2013, 2014

Teaching

• Topics in Computer Graphics - Visual Geometry with Deep Learning
  Fall, 2021, UBC
• Computational Optimization
  Winter, 2021, UBC
• Operating System
  Summer, 2020, UVic
• Computing Engineering
  Fall, 2017, UCalgary