Transformers in Automatic Speech Recognition - Laboratoire Interdisciplinaire des Sciences du Numérique Access content directly
Book Sections Year : 2023

Transformers in Automatic Speech Recognition

Marc Evrard
  • Function : Author
  • PersonId : 1220707
  • IdHAL : marcevrard


The Transformer, a model relying entirely on the attention mechanism, brought significant improvements in performance on several natural language processing tasks. This chapter presents its impact on the speech processing domain and, more specifically, on the automatic speech recognition task. A short history of the evolution of automatic speech recognition systems is also given. A selection of important works making use of transformers are presented, as well as pretraining selfsupervised architectures.
No file

Dates and versions

hal-04259186 , version 1 (25-10-2023)



Marc Evrard. Transformers in Automatic Speech Recognition. Human-Centered Artificial Intelligence, 13500, Springer International Publishing, pp.123-139, 2023, Lecture Notes in Computer Science, ⟨10.1007/978-3-031-24349-3_8⟩. ⟨hal-04259186⟩
18 View
0 Download



Gmail Facebook X LinkedIn More