European languages

Italian speech recognition

Regional accents and fast speech.

Updated 23 September 20266 min readBy the Reson8 research team

Italian spelling tracks pronunciation closely, which helps speech recognition. The difficulties are elsewhere: consonant length distinguishes words, fast speech fuses vowel-final words together, apostrophes and written accents carry grammar, and regional accents are strong enough that the same sentence sounds very different in Milan, Rome and Palermo. Beneath regional Italian lies a layer of dialects that are separate languages in their own right.

Key takeaways

  • Double consonants are phonemic: caro (dear) and carro (cart), sete (thirst) and sette (seven). Missing the length is a real word error.
  • Almost all Italian words end in a vowel, so words run together in fast speech, and elision with apostrophes (l'amico, un'amica) creates tokenisation choices that affect WER.
  • Written accents are compulsory on final stressed vowels and distinguish words: è (is) vs e (and), là vs la, dà vs da.
  • Regional Italian varies strongly in vowels and rhythm. Dialects such as Neapolitan or Sicilian are distinct languages and need separate evaluation.
  • Italian uses a decimal comma and a thousands point: 1.250,50 €.

What makes Italian hard#

Consonant length#

Italian contrasts short and long consonants in the middle of words: pala/palla, nono/nonno (ninth, grandfather), capello/cappello (hair, hat), fato/fatto (fate, done). The difference is duration, often a few tens of milliseconds, and it compresses in fast speech. An error such as ho fatto una copia becoming ho fato una coppia is two substitutions and a change of meaning (copy to couple).

Northern Italian speakers produce less distinct geminates than southern speakers, and some northern accents shorten them noticeably. A model trained on a regional mix has to learn that the same duration can mean single in one accent and double in another.

Raddoppiamento sintattico#

In Tuscany, central and southern Italy, certain words trigger doubling of the next word's first consonant: a casa is pronounced a kkasa, tre gatti as tre ggatti, città bella as città bbella. The doubling is not written. It shows up in the audio, but the transcript must ignore it. A model that has learnt word-internal gemination may occasionally write a double letter where the doubling came from the preceding word.

Vowel-final words and elision#

Nearly every native Italian word ends in a vowel, and adjacent vowels merge in running speech. Lo abbiamo becomes l'abbiamo, una amica becomes un'amica, quello anno becomes quell'anno. The apostrophe carries grammar: un amico (masculine, no apostrophe) versus un'amica (feminine, with one). They sound identical, so a model must infer gender from the noun.

For scoring, l'abbiamo can be one token or two. Different normalisers make different choices, and the difference can move Italian WER by an amount comparable to the gap between competing systems. See word error rate for why this matters.

Written accents#

Italian marks a final stressed vowel with an accent, and several short words are distinguished only by it: è/e, là/la, lì/li, dà/da, sì/si, né/ne. The grave and acute distinction also appears in perché, poiché and né, which take an acute accent, and is commonly miswritten even by native speakers. A transcript that writes e for è changes "and" into "is". Some pipelines strip accents before scoring, which hides these errors.

Clitics and speaking rate#

Object pronouns fuse with infinitives, gerunds and imperatives into a single written word: dammelo (give it to me), portarglielo (to bring it to him), dicendoglielo. A model that writes da me lo for dammelo produces three errors from one word. Italian is also spoken quickly, with a high syllable rate, and conversational speech reduces unstressed syllables.

Regional Italian and dialects#

Italy's linguistic situation has two layers that matter for ASR.

Regional Italian is standard Italian spoken with a regional accent. Most business, customer service and medical speech is of this kind. Features vary sharply:

  • Vowels: standard Italian distinguishes open and closed e and o (pèsca, peach, vs pésca, fishing). The distribution differs across regions, and many speakers do not make the contrast at all.
  • Tuscan: the gorgia toscana turns intervocalic c into a breathy [h], so la casa sounds like la hasa.
  • Northern: voiced s between vowels (casa with /z/), weaker geminates.
  • Southern: strong gemination, reduced final vowels in Naples and parts of the south, different intonation patterns.

Dialects (dialetti) such as Neapolitan, Sicilian, Venetian, Lombard and Piedmontese descend from Latin in parallel with Italian and are not accents of it. Their vocabulary and grammar differ enough that a standard Italian model produces unusable output on sustained dialect speech. In practice, speakers mix dialect words and phrases into Italian, especially in informal calls, which is a form of code-switching. Sardinian and Friulian are recognised minority languages; South Tyrol is majority German-speaking.

For the general effect of accents on accuracy, see accents and regional speech.

Numbers, dates and formatting#

Italian number words are written as one word and elide vowels at the join: ventuno (21, not ventiuno), ventotto (28), trentuno, centottanta (180). Inverse text normalisation must parse these compounds and render them to Italian conventions:

SpokenWrittenNote
milleduecentocinquanta euro e cinquanta1.250,50 €Decimal comma, thousands point; € before or after
ventitré settembre duemilaventisei23/09/2026Day, month, year; months lower-case
il primo ottobreil 1° ottobreOnly the first of the month is an ordinal
le quattordici e trenta14:30 or 14.3024-hour clock common in writing
un miliardo1.000.000.000Un bilione is 1012 and rare

Italian phone numbers are commonly read in small groups rather than single digits, and codice fiscale (tax codes) mix letters and digits in a fixed 16-character format. Both are good candidates for pattern-aware transcription; see structured identifiers.

Data availability and public test sets#

Italian sits in the middle tier of European data availability: well behind English, Spanish, French and German, ahead of most smaller languages. Public sets include:

  • FLEURS (Italian split): read Wikipedia sentences, parallel across languages.
  • Common Voice: a sizeable crowd-sourced Italian subset, mostly read speech.
  • Multilingual LibriSpeech: a few hundred hours of Italian audiobooks.
  • VoxPopuli: European Parliament speeches.
  • CLIPS: a corpus of spoken Italian recorded across regional varieties, useful for accent analysis rather than large-scale training.

As with most languages, the gap is conversational, telephone and regionally labelled speech. If your callers are mostly from one region, sample test audio from that region; national averages can hide large differences. See building your own ASR test set.

How Reson8 approaches this#

Italian is one of the nine European languages Resonant-1 supports in depth. Reson8 has not published a FLEURS figure for Italian, so evaluate on your own audio. For specialist vocabulary such as drug names or product catalogues, text-only domain adaptation applies to Italian as to the other supported languages.

Common questions#

Is Italian easy for speech recognition?

Its spelling is transparent, which helps. Consonant length, accents on short words, elision and regional variation account for most of the errors that remain.

Can an Italian model transcribe Neapolitan or Sicilian?

Not reliably. They are separate languages with their own grammar and vocabulary. Mixed speech with occasional dialect words works better than sustained dialect.

Why does my Italian transcript write e where è is correct?

The two sound the same in most contexts, so the choice depends on the language model reading the sentence correctly. Check that accents are not being stripped in your own post-processing.

References#

  1. Conneau, A. et al. (2022). FLEURS: Few-shot Learning Evaluation of Universal Representations of Speech. arXiv:2205.12446.
  2. Ardila, R. et al. (2020). Common Voice: A Massively-Multilingual Speech Corpus. LREC 2020.
  3. Pratap, V. et al. (2020). MLS: A Large-Scale Multilingual Dataset for Speech Research. Interspeech 2020.
  4. Wang, C. et al. (2021). VoxPopuli: A Large-Scale Multilingual Speech Corpus for Representation Learning, Semi-Supervised Learning and Interpretation. ACL 2021.
  5. Maiden, M. (1995). A Linguistic History of Italian. Longman.

Try Reson8 on your own audio

Speech recognition for European languages that adapts to your vocabulary from text, in under a minute. Free tier, EU-only processing.