Wals Roberta Sets 1-36.zip [new] (Real × 2025)

Most distributions include load_data.py . Here is a robust loading snippet:

Since the collection is split into 36 parts, it is likely organized by category (e.g., Bass, Leads, Pads, or specific Synth patches). WALS Roberta Sets 1-36.zip

For a typological classification task (e.g., predicting vowel inventory size): Most distributions include load_data

If the archive includes pre-tokenized sentences from WALS example languages, you could fine-tune RoBERTa: including features like word order

tokenizer = RobertaTokenizer.from_pretrained("./tokenizers/roberta_wals_tokenizer.json")

This is a large database of structural properties of languages, curated by Harald C. L. Luyten and others. It provides valuable data for linguistic research, including features like word order, phonology, and syntax.

Look for papers that discuss WALS data in the context of RoBERTa or similar models. The references or supplementary materials might point to the resource you're seeking.