[SGP-2022] Deep Learning on Point Clouds

Point cloud is an important type of geometric data structure. They are simple and unified structures that avoid the combinatorial irregularities and complexities of meshes. These properties make point clouds widely used for 3D reconstruction or visual understanding applications, such as AR, autonomous driving, and robotics. This course will teach how we apply deep learning methods to point cloud data. We will cover the following topics in this short course and will end with some open problems.

• Basic neural architectures to process point cloud as input or to generate point cloud as output
• Scene-level understanding of static and dynamic point clouds
• Point cloud based inverse graphics
• Learning to convert point cloud to other 3D representations
• Learning to map point cloud with data in other modalities (images, languages)