TY - GEN
T1 - Chart2Code-MoLA: Efficient Multi-Modal Code Generation via Adaptive Expert Routing
AU - Wang, Yifei
AU - Keung, Jacky
AU - Mao, Zhenyu
AU - Zhang, Jingyu
AU - Cao, Yuchen
N1 - Publisher Copyright:
© 2025 IEEE.
PY - 2025
Y1 - 2025
N2 - Chart-to-code generation is a critical task in automated data visualization, translating complex chart structures into executable programs. While recent Multi-modal Large Language Models (MLLMs) improve chart representation, existing approaches still struggle to achieve cross-type generalization, memory efficiency, and modular design. To address these challenges, this paper proposes C2C-MolA, a multimodal framework that synergizes Mixture of Experts (MoE) with Low-Rank Adaptation (LoRA). The MoE component uses a complexity-aware routing mechanism with domain-specialized experts and load-balanced sparse gating, dynamically allocating inputs based on learnable structural metrics like element count and chart complexity. LoRA enables parameter-efficient updates for resource-conscious tuning, further supported by a tailored training strategy that aligns routing stability with semantic accuracy. Experiments on Chart2Code-160k show that the proposed model improves generation accuracy by up to 17%, reduces peak GPU memory by 18%, and accelerates convergence by 20%, when compared to standard fine-tuning and LoRAonly baselines, particularly on complex charts. Ablation studies validate optimal designs, such as 8 experts and rank-8 LoRA, and confirm scalability for real-world multimodal code generation.
AB - Chart-to-code generation is a critical task in automated data visualization, translating complex chart structures into executable programs. While recent Multi-modal Large Language Models (MLLMs) improve chart representation, existing approaches still struggle to achieve cross-type generalization, memory efficiency, and modular design. To address these challenges, this paper proposes C2C-MolA, a multimodal framework that synergizes Mixture of Experts (MoE) with Low-Rank Adaptation (LoRA). The MoE component uses a complexity-aware routing mechanism with domain-specialized experts and load-balanced sparse gating, dynamically allocating inputs based on learnable structural metrics like element count and chart complexity. LoRA enables parameter-efficient updates for resource-conscious tuning, further supported by a tailored training strategy that aligns routing stability with semantic accuracy. Experiments on Chart2Code-160k show that the proposed model improves generation accuracy by up to 17%, reduces peak GPU memory by 18%, and accelerates convergence by 20%, when compared to standard fine-tuning and LoRAonly baselines, particularly on complex charts. Ablation studies validate optimal designs, such as 8 experts and rank-8 LoRA, and confirm scalability for real-world multimodal code generation.
KW - Chart-to-Code Generation
KW - Low-Rank Adaptation (LoRA)
KW - Mixture of Experts (MoE)
KW - Multi-Modal Learning
UR - https://www.scopus.com/pages/publications/105035183600
U2 - 10.1109/APSEC66846.2025.00061
DO - 10.1109/APSEC66846.2025.00061
M3 - Conference contribution
AN - SCOPUS:105035183600
T3 - Proceedings - Asia-Pacific Software Engineering Conference, APSEC
SP - 575
EP - 586
BT - Proceedings - 2025 32nd Asia-Pacific Software Engineering Conference, APSEC 2025
A2 - Zhang, Tao
A2 - Luo, Xiapu
A2 - Keung, Jacky
A2 - Choi, Eunjong
T2 - 32nd Asia-Pacific Software Engineering Conference, APSEC 2025
Y2 - 2 December 2025 through 5 December 2025
ER -