TY - GEN
T1 - Color Enhancement for V-PCC Compressed Point Cloud via 2D Attribute Map Optimization
AU - Bao, Jingwei
AU - Liu, Yu
AU - Li, Zeliang
AU - Zhu, Shuyuan
AU - Yeung, Siu Kei Au
N1 - Publisher Copyright:
© 2024 IEEE.
PY - 2024
Y1 - 2024
N2 - Video-based point cloud compression (V-PCC) converts the dynamic point cloud data into video sequences using traditional video codecs for efficient encoding. However, this lossy compression scheme introduces artifacts that degrade the color attributes of the data. This paper introduces a framework designed to enhance the color quality in the V-PCC compressed point clouds. We propose the lightweight de-compression Unet (LDC-Unet), a 2D neural network, to optimize the projection maps generated during V-PCC encoding. The optimized 2D maps will then be back-projected to the 3D space to enhance the corresponding point cloud attributes. Additionally, we introduce a transfer learning strategy and develop a customized natural image dataset for the initial training. The model was then fine-tuned using the projection maps of the compressed point clouds. The whole strategy effectively addresses the scarcity of point cloud training data. Our experiments, conducted on the public 8i voxelized full bodies long sequences (8iVSLF) dataset, demonstrate the effectiveness of our proposed method in improving the color quality.
AB - Video-based point cloud compression (V-PCC) converts the dynamic point cloud data into video sequences using traditional video codecs for efficient encoding. However, this lossy compression scheme introduces artifacts that degrade the color attributes of the data. This paper introduces a framework designed to enhance the color quality in the V-PCC compressed point clouds. We propose the lightweight de-compression Unet (LDC-Unet), a 2D neural network, to optimize the projection maps generated during V-PCC encoding. The optimized 2D maps will then be back-projected to the 3D space to enhance the corresponding point cloud attributes. Additionally, we introduce a transfer learning strategy and develop a customized natural image dataset for the initial training. The model was then fine-tuned using the projection maps of the compressed point clouds. The whole strategy effectively addresses the scarcity of point cloud training data. Our experiments, conducted on the public 8i voxelized full bodies long sequences (8iVSLF) dataset, demonstrate the effectiveness of our proposed method in improving the color quality.
KW - Image restoration
KW - Point cloud compression
KW - Point cloud reconstruction
KW - Transfer learning
UR - https://www.scopus.com/pages/publications/85218179844
U2 - 10.1109/VCIP63160.2024.10849864
DO - 10.1109/VCIP63160.2024.10849864
M3 - Conference contribution
AN - SCOPUS:85218179844
T3 - 2024 IEEE International Conference on Visual Communications and Image Processing, VCIP 2024
BT - 2024 IEEE International Conference on Visual Communications and Image Processing, VCIP 2024
T2 - 2024 IEEE International Conference on Visual Communications and Image Processing, VCIP 2024
Y2 - 8 December 2024 through 11 December 2024
ER -