Skip to main navigation Skip to search Skip to main content

Chart2Code-MoLA: Efficient Multi-Modal Code Generation via Adaptive Expert Routing

  • Yifei Wang
  • , Jacky Keung
  • , Zhenyu Mao
  • , Jingyu Zhang
  • , Yuchen Cao

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

Chart-to-code generation is a critical task in automated data visualization, translating complex chart structures into executable programs. While recent Multi-modal Large Language Models (MLLMs) improve chart representation, existing approaches still struggle to achieve cross-type generalization, memory efficiency, and modular design. To address these challenges, this paper proposes C2C-MolA, a multimodal framework that synergizes Mixture of Experts (MoE) with Low-Rank Adaptation (LoRA). The MoE component uses a complexity-aware routing mechanism with domain-specialized experts and load-balanced sparse gating, dynamically allocating inputs based on learnable structural metrics like element count and chart complexity. LoRA enables parameter-efficient updates for resource-conscious tuning, further supported by a tailored training strategy that aligns routing stability with semantic accuracy. Experiments on Chart2Code-160k show that the proposed model improves generation accuracy by up to 17%, reduces peak GPU memory by 18%, and accelerates convergence by 20%, when compared to standard fine-tuning and LoRAonly baselines, particularly on complex charts. Ablation studies validate optimal designs, such as 8 experts and rank-8 LoRA, and confirm scalability for real-world multimodal code generation.

Original languageEnglish
Title of host publicationProceedings - 2025 32nd Asia-Pacific Software Engineering Conference, APSEC 2025
EditorsTao Zhang, Xiapu Luo, Jacky Keung, Eunjong Choi
Pages575-586
Number of pages12
ISBN (Electronic)9798331566531
DOIs
Publication statusPublished - 2025
Externally publishedYes
Event32nd Asia-Pacific Software Engineering Conference, APSEC 2025 - Macau, China
Duration: 2 Dec 2025 → 5 Dec 2025

Publication series

NameProceedings - Asia-Pacific Software Engineering Conference, APSEC
ISSN (Print)1530-1362

Conference

Conference32nd Asia-Pacific Software Engineering Conference, APSEC 2025
Country/TerritoryChina
CityMacau
Period2/12/25 → 5/12/25

Keywords

  • Chart-to-Code Generation
  • Low-Rank Adaptation (LoRA)
  • Mixture of Experts (MoE)
  • Multi-Modal Learning

Fingerprint

Dive into the research topics of 'Chart2Code-MoLA: Efficient Multi-Modal Code Generation via Adaptive Expert Routing'. Together they form a unique fingerprint.

Cite this