What happens when you combine the best of old-school language models and the power of neural networks? You get NN-grams! In this episode, we break down how this new model blends n-grams (which remember word patterns) with neural networks (which can generalize like a pro). The result? More accurate and faster speech recognition. NN-grams are already outperforming traditional models on tasks like Italian speech recognition, and they’re faster too. Want to know how this hybrid model is changing the speech AI game? Tune in to learn more!

Link to research paper-

https://arxiv.org/abs/1606.07470

Follow us on social media:

Linkedin: https://www.linkedin.com/company/smallest/

Twitter: https://x.com/smallest_AI

Instagram: https://www.instagram.com/smallest.ai/

Discord: https://smallest.ai/discord

In this episode, we dive into the revolutionary Listen, Attend and Spell (LAS) model that transforms how speech-to-text systems work. Unlike traditional methods that separate the process into multiple stages, LAS combines everything into one model, making it faster and more efficient. The system has two key parts: a 'listener' that processes the audio input, and a 'speller' that converts the information into text using attention-based mechanisms. Tune in to learn how LAS outperforms older speech recognition models, achieving impressive accuracy without relying on dictionaries or language models!

Link to research paper-

https://arxiv.org/abs/1508.01211

Follow us on social media:

Linkedin: https://www.linkedin.com/company/smallest/

Twitter: https://x.com/smallest_AI

Instagram: https://www.instagram.com/smallest.ai/

Discord: https://smallest.ai/discord

In this episode, we explore how Scheduled Sampling helps Recurrent Neural Networks (RNNs) make better predictions for tasks like machine translation and image captioning. Normally, during training, RNNs use the actual previous word or token to predict the next one. But when making predictions, the model has to use its own previous predictions, which can lead to mistakes building up. Scheduled Sampling solves this by slowly shifting the model from using the correct token during training to using its own predictions, helping it learn more effectively and reduce errors. Tune in to learn how this approach helped improve results in a major image captioning competition!

Link to research paper-

https://arxiv.org/abs/1506.03099

Follow us on social media:

Linkedin: https://www.linkedin.com/company/smallest/

Twitter: https://x.com/smallest_AI

Instagram: https://www.instagram.com/smallest.ai/

Discord: https://smallest.ai/discord