TinyChart

TinyChart: Efficient Chart Understanding with Visual Token Merging and Program-of-Thoughts Learning

Liang Zhang*, Anwen Hu*, Haiyang Xu, Ming Yan, Yichen Xu, Qin Jin†, Ji Zhang, Fei Huang

* Equal Contribution † Corresponding Author

---

Spotlights

• Support chart question answering with both simple direct answers and step-by-step Python programs.
• Support chart-to-table extraction, chart summary generation, and chart redrawing.
• Coming soon
  • Model: TinyChart
  • Code of model inference and evaluation.
  • Source code of launching a local demo.
  • Online Demo on ModelScope and HuggingFace.
  • Training code and data

Examples

Models

Model Card

Model	Download Link
TinyChart@768	Coming Soon

Model Inference

Coming soon.

Local Demo

Coming soon.

Citation

If you found this work useful, consider giving this repository a star and citing our paper as followed:

@misc{zhang2024tinychart,
    title={TinyChart: Efficient Chart Understanding with Visual Token Merging and Program-of-Thoughts Learning}, 
    author={Liang Zhang and Anwen Hu and Haiyang Xu and Ming Yan and Yichen Xu and Qin Jin and Ji Zhang and Fei Huang},
    year={2024},
    eprint={2404.16635},
    archivePrefix={arXiv},
    primaryClass={cs.CV}
}