Introducing the first iteration of our Speech-to-Speech pipeline 🗣️. Choose the LLM you want and converse with it with a latency reaching up to 500ms! Who said we need Speech-to-Speech models to be fast?

Notebook link 🔗🤗.

I wanted to experiment with our CSM port and see how easy it would be to fine-tune using 🤗 Transformers, and it truly is!. Just grabbed an anime voice dataset from the Hub and fine-tuned the model to learn a predefined set of voices. Almost effortless. Here’s a detailed

RT @m_sirovatka: The biggest dataset of human written GPU Code all open-source? 👀 YES Please! We at @GPU_MODE have released around 40k 🚀 hu….

RT @Tu7uruu: Dia TTS from Nari Labs just dropped in the latest 🤗 Transformers release!.Here's a simple training script—LoRA and Flash-Attn….

RT @art_zucker: Holy. `transformers` reached 1B downloads 😭 thanks everyone for making this possible, what an amazing community https://t….

RT @kyutai_labs: Kyutai TTS and Unmute are now open source!.The text-to-speech is natural, customizable, and fast: it can serve 32 users wi….

RT @BrigitteTousi: brb dropping sick beats with @measure_plan's new sacred space:

RT @jffwng: We've open-sourced the Seamless Interaction Dataset on @huggingface -- the world's largest in-person conversation dataset with….

And do the same with Dia!

Play with Kyutai-STT in just a few lines of code:

Transformers v4.53.0 is out! 🚀.Excited to welcome new members to the Audio family:.1.Kyutai STT (1B & 2.6B): A strong Whisper contender with a novel streaming approach for real-time transcription. More on its architecture and why it's cool in upcoming tweets. 2.Dia (1.6B): A TTS.

RT @LysandreJik: "The great unbloating" of transformers continues. Over the past few weeks, 10+ PRs were merged, aiming to simplify code a….

Transformers support is coming today! 🤗

RT @kyutai_labs: Kyutai Speech-To-Text is now open-source! It’s streaming, supports batched inference, and runs blazingly fast: perfect for….

Digging through cryptic researcher codebases stacked on top of each other with incorrect/missing/misleading variable names and papers that do not reflect them is such pain. BUT it perfectly confirms our vision for Transformers: a source of truth. Less time questioning.

RT @leo_bringer: 🚀 Our paper **MDMP** has been accepted at CVPR’25 - HuMoGen 🚀. We propose a multi-modal diffusion model that fuses textual….

RT @ClementDelangue: If AI stays closed-source, proprietary and monopolistic like it is now, it will destroy lots of jobs and just make the….

RT @ClementDelangue: Excited to expand our collaboration with @Azure, thanks for the shoutout @satyanadella!

RT @LysandreJik: The Transformers library is undergoing it's largest pivot to date 🙌. It now cements its role as the central model definiti….

RT @art_zucker: A quick update on the future of the `transformers` library!. In order to provide a source of truth for all models, we are w….