arXiv Open Access 2024

MICSim: A Modular Simulator for Mixed-signal Compute-in-Memory based AI Accelerator

Cong Wang Zeming Chen Shanshi Huang
Lihat Sumber

Abstrak

This work introduces MICSim, an open-source, pre-circuit simulator designed for early-stage evaluation of chip-level software performance and hardware overhead of mixed-signal compute-in-memory (CIM) accelerators. MICSim features a modular design, allowing easy multi-level co-design and design space exploration. Modularized from the state-of-the-art CIM simulator NeuroSim, MICSim provides a highly configurable simulation framework supporting multiple quantization algorithms, diverse circuit/architecture designs, and different memory devices. This modular approach also allows MICSim to be effectively extended to accommodate new designs. MICSim natively supports evaluating accelerators' software and hardware performance for CNNs and Transformers in Python, leveraging the popular PyTorch and HuggingFace Transformers frameworks. These capabilities make MICSim highly adaptive when simulating different networks and user-friendly. This work demonstrates that MICSim can easily be combined with optimization strategies to perform design space exploration and used for chip-level Transformers CIM accelerators evaluation. Also, MICSim can achieve a 9x - 32x speedup of NeuroSim through a statistic-based average mode proposed by this work.

Topik & Kata Kunci

Penulis (3)

C

Cong Wang

Z

Zeming Chen

S

Shanshi Huang

Format Sitasi

Wang, C., Chen, Z., Huang, S. (2024). MICSim: A Modular Simulator for Mixed-signal Compute-in-Memory based AI Accelerator. https://arxiv.org/abs/2409.14838

Akses Cepat

Lihat di Sumber
Informasi Jurnal
Tahun Terbit
2024
Bahasa
en
Sumber Database
arXiv
Akses
Open Access ✓