Artem Moskalev 🕊️
@artemmoskalev
Followers
1K
Following
5K
Media
30
Statuses
344
ML research scientist working on Geometry ⚭ Language for drug discovery🧬 and robotics 🤖. Previously PhD at the University of Amsterdam. 🦋 artemmoskalev
Amsterdam, Netherlands
Joined February 2017
ICML Spotlight 🚨 Equivariance is too slow and expensive, especially when you need global context. It makes us wonder if it even worths the cost, especially in high-dimensional problems? We present Geometric Hyena Networks — a simple equivariant model orders of magnitude more
2
24
99
Clifford Algebra Neural Networks are undeservedly dismissed for being too slow, but they don't have to be! 🚀Introducing **flash-clifford**: a hardware-efficient implementation of Clifford Algebra NNs in Triton, featuring the fastest equivariant primitives that scale.
6
33
132
This work is a continuation of our work on convolutional networks and symmetry breaking. Equivariance helps. So does breaking it — if done right. We explore the advantages of equivariance and controlled symmetry breaking to boost performance across tasks for point clouds.
1
3
5
An interlude about structure computation, SSM and attention. Myosotis: https://t.co/0RXbej9bFm I hope to tell more in this line of work later. See poster at SPIGM workshop.
1
6
23
Postdoc position available in the BioEmu team at @MSFTResearch AI for Science - Berlin DE or Cambridge UK. Looking for candidates with backgrounds in #MachineLearning #AI Biophysics or Bioinformatics https://t.co/DwGuTO1qlf
BioEmu now published in @ScienceMagazine !! What is BioEmu? Check out this video: https://t.co/PAj96iKvR7
3
20
69
📣 Our team is hiring (research scientist and SWE roles) - perhaps the best place where you can blend graph learning experience with the most advanced AI research :) Application link and all the downsides of our job: https://t.co/POGyCAnfbZ Drop me a CV in PMs too
linkedin.com
Hey; we're #hiring more in Google Research for Graphs & AI !! Instead of telling you why you should apply, let me list the d͟o͟w͟n͟s͟i͟d͟e͟s͟ of the job (𝘴𝘰𝘳𝘳𝘺 𝘏𝘙): 🧩𝗣𝗿𝗼𝗯𝗹𝗲𝗺𝘀 𝘁𝗼𝗼...
6
15
122
📢We are very excited to announce a ✨two-day TAG event ✨(alongside NeurIPS) in San Diego! Join us for an exciting two days filled with incredible speakers, panelists, and multiple poster sessions. 🌟Submission deadline is 1st October AOE. Call for papers is here!
1
13
26
Symmetries+biology is a beautiful combination!
Equi-MRNA: Protein Translation Equivariant Encoding for mRNA Language Models 1. Computational biologists have introduced Equi-mRNA, a new language model for mRNA that uses group-theoretic priors to explicitly encode the inherent symmetries of synonymous codons. This innovative
0
2
11
Job alert 🚨 Our team is looking for ML Research Scientist to join Johnson&Johnson research. We work on geometric deep learning and LLMs in drug discovery. 🧬🤓 Drop me a message if you’re interested, or share if you know someone who’s a great fit! Multiple locations available.
0
3
20
Our code for Hierarchical RNA Language models is out! Multiple training regimes, architectures and evaluations, check it out! Code:
github.com
Hierarchical Encoding for mRNA Language Modeling. Contribute to johnsonandjohnson/HELM development by creating an account on GitHub.
Don't treat the language of biology as natural language! Biology speaks in hierarchical patterns that natural language models don't fully capture. Meet HELM: a novel approach to train LMs that aligns with the intrinsic hierarchy of mRNA sequences. https://t.co/CqKPxRdQFy 1/5
0
0
12
A common takeaway from "the bitter lesson" is we don't need to put effort into encoding inductive biases, we just need compute. Nothing could be further from the truth! Better inductive biases mean better scaling exponents, which means exponential improvements with computation.
20
35
420
Cool!
Blank Bio (@blankbio_) is building foundation models to power a computational toolkit for RNA therapeutics, starting with mRNA design and expanding to target ID, biomarker discovery, and more. https://t.co/7VRxSRgSKK Congrats on the launch, @hsu_jonny, @phil_fradkin & @ianshi3!
0
0
5
Excited to share Flow Matching Policy Gradients: expressive RL policies trained from rewards using flow matching. It’s an easy, drop-in replacement for Gaussian PPO on control tasks.
8
207
1K
🚨 The era of infinite internet data is ending, So we ask: 👉 What’s the right generative modelling objective when data—not compute—is the bottleneck? TL;DR: ▶️Compute-constrained? Train Autoregressive models ▶️Data-constrained? Train Diffusion models Get ready for 🤿 1/n
127
197
1K
Happenning today! Come to see our Geometric Hyena poster! 🤓
Interested in efficient equivariance for long-context? Visit our Geoemtric Hyena poster at ICML! ⭐️ Spotlight⭐️ When: 11 a.m. — 1:30 p.m Wed July 16 Where: East Exhibition Hall A-B #E-3103
0
1
10
Excited to be presenting “The Price of Freedom: Exploring Expressivity and Runtime Tradeoffs in Equivariant Tensor Products” at ICML today, at the East Exhibition Hall in Hall A/B at 4:30 PM! Work done with the amazing YuQing Xie, @_MitKotak and @tesssmidt. #ICML2025
1
4
27
Excited to be in Vancouver for #ICML2025 this week! I’m here to talk about our latest work “Low-distortion and GPU-compatible tree embeddings in hyperbolic space”. If you're interested in graph embeddings and hyperbolic geometry, come and check it out! More details below 👇
2
4
19