arXiv Open Access 2023

InstrumentGen: Generating Sample-Based Musical Instruments From Text

Shahan Nercessian Johannes Imort

Lihat Sumber

Abstrak

We introduce the text-to-instrument task, which aims at generating sample-based musical instruments based on textual prompts. Accordingly, we propose InstrumentGen, a model that extends a text-prompted generative audio framework to condition on instrument family, source type, pitch (across an 88-key spectrum), velocity, and a joint text/audio embedding. Furthermore, we present a differentiable loss function to evaluate the intra-instrument timbral consistency of sample-based instruments. Our results establish a foundational text-to-instrument baseline, extending research in the domain of automatic sample-based instrument generation.

Topik & Kata Kunci

eess.AS cs.LG cs.SD

Penulis (2)

Shahan Nercessian

Johannes Imort

Format Sitasi

APA MLA BibTeX

Nercessian, S., Imort, J. (2023). InstrumentGen: Generating Sample-Based Musical Instruments From Text. https://arxiv.org/abs/2311.04339

Akses Cepat

Lihat di Sumber

Informasi Jurnal

Tahun Terbit: 2023
Bahasa: en
Sumber Database: arXiv
Akses: Open Access ✓