arXiv Open Access 2022

Learning grammar with a divide-and-concur neural network

Sean Deyo Veit Elser
Lihat Sumber

Abstrak

We implement a divide-and-concur iterative projection approach to context-free grammar inference. Unlike most state-of-the-art models of natural language processing, our method requires a relatively small number of discrete parameters, making the inferred grammar directly interpretable -- one can read off from a solution how to construct grammatically valid sentences. Another advantage of our approach is the ability to infer meaningful grammatical rules from just a few sentences, compared to the hundreds of gigabytes of training data many other models employ. We demonstrate several ways of applying our approach: classifying words and inferring a grammar from scratch, taking an existing grammar and refining its categories and rules, and taking an existing grammar and expanding its lexicon as it encounters new words in new data.

Topik & Kata Kunci

Penulis (2)

S

Sean Deyo

V

Veit Elser

Format Sitasi

Deyo, S., Elser, V. (2022). Learning grammar with a divide-and-concur neural network. https://arxiv.org/abs/2201.07341

Akses Cepat

Lihat di Sumber
Informasi Jurnal
Tahun Terbit
2022
Bahasa
en
Sumber Database
arXiv
Akses
Open Access ✓