🤖 🗞️ Free AI Generated Digital Humans Newsletter -> Like everyone else, I've been struggling to keep up with the sheer volume of papers and news in the Digital Human space. Over the past few weeks, I've developed an agentic (ish) AI pipeline to find and

Want to get up to three papers like this directly to your inbox and summarised by AI each day? You can sign up for free here:

VisualSpeaker: Visually-Guided 3D Avatar Lip Synthesis. TLDR: Improves speech-driven facial mesh animation by rendering with 3DGS Avatars and running the results through a lip-reading network to get lip sync as a loss. 📜 Paper:

Want to get up to three papers like this directly to your inbox and summarised by AI each day? You can sign up for free here:

HyperGaussians: High-Dimensional Gaussian Splatting for High-Fidelity Animatable Face Avatars. TLDR: Lifts Gaussians to higher dimensions, which can then be conditioned for the problem of Gaussian Avatars. This enables much better reconstruction of high-frequency details and

🤖📰Want to get up to three papers like this directly to your inbox and summarised by AI each day? You can sign up for free here:

ARIG: Autoregressive Interactive Head Generation for Real-time Conversations. TLDR: A method for dyadic conversations (speaking and listening) in real-time. This work uses an autoregressive diffusion MLP with added signals from context learning (by fusing LivePortrait parameters

Want to get up to three papers like this directly to your inbox and summarised by AI each day? You can sign up for free here:

SynMotion: Semantic-Visual Adaptation for Motion Customized Video Generation. TLDR: A DiT-based video generation model designed for motion retargeting. It uses a dual encoder architecture to separate subject and motion, and can be applied to non-human animals. 📽️ Project Page:

3DGH: 3D Head Generation with Composable Hair and Face. TLDR: A Generative model of (static) Gaussian Avatars using a GAN. Here the head and hair are modelled separately with templates, and data is generated synthetically. 📽️ Project Page: 📜 Paper:

💫 Animate any rig using video diffusion models. Not a human-specific method, but really interesting as an idea. AnimaX: Animating the Inanimate in 3D with Joint Video-Pose Diffusion Models. TLDR: Animate any rig with an arbitrary skeleton using multi-view video diffusion

Controllable and Expressive One-Shot Video Head Swapping. TLDR: A reference-net-based approach for one-shot face swapping. This model works with landmark and background conditioning, with the former disentangled using a 3DMM. 📽️ Project Page: 📜 Paper:

One-shot Face Sketch Synthesis in the Wild via Generative Diffusion Prior and Instruction Tuning. TLDR: This work converts photorealstic portraits into sketches. Despite limited data, it is able to do this by optimising text instructions for a diffusion image-to-image model. 📜

SyncTalk++: High-Fidelity and Efficient Synchronized Talking Heads Synthesis Using Gaussian Splatting. TLDR: A Gaussian-Splatting based person-specific talking head model which reduces the effect of OOD audio by training a discrete VQ-VAE over blendshapes. 📽️ Project Page:

AlignHuman: Improving Motion and Fidelity via Timestep-Segment Preference Optimization for Audio-Driven Human Animation. TLDR: This DiT-based method first uses human preference on video for two categories, motion and fidelity. It then trains two LoRAs, one for each category,

🎉 It's been an amazing weekend at #CVPR25, presenting our work GASP and meeting up with colleagues old and new! It's really crazy how many people and papers were there, but a few themes do seem to stand out for Head Avatars:. 🔍 Priors: A lot of works are starting to build

RT @deblinaforAI: The visual computing group from @UniofBath 🇬🇧 at #CVPR25 in full force!.📸Co-chairing #CVPR25 publicity and .organising @W….

RT @SanyalSoubhik: It was fun to be a part of the organising team. In case you missed it, all the talks of the Digital humans symposium are….