Another DNA language model leveraging the reverse complement symmetry of the double helix 🧬 The two strands carry exactly the same information, and are related by 1) reversing the sequence and 2) swapping base pairs A⟷T and C⟷G. Hard-coding this prior into sequence models… Tweet added by Maurice Weiler @maurice_weiler

Maurice Weiler

3 months

Another DNA language model leveraging the reverse complement symmetry of the double helix 🧬 The two strands carry exactly the same information, and are related by 1) reversing the sequence and 2) swapping base pairs A⟷T and C⟷G. Hard-coding this prior into sequence models…

Yair Schiff

@SchiffYair

3 months

We are excited to present Caduceus: bi-directional DNA language model built on Mamba, with long range modeling that respects inherent symmetry of double helix DNA structure. Caduceus is SoTA on several benchmarks, including identifying causal SNPs for gene expression. 🧵1/9

244

Replies

Maurice Weiler

@maurice_weiler

3 months

For a more representation theoretic formulation, check out this RC-equivariant steerable CNN by Vincent Mallet and @jeanphi_vert :

Reverse-Complement Equivariant Networks for DNA Sequences

As DNA sequencing technologies keep improving in scale and cost, there is a growing need to develop machine learning models to analyze DNA sequences, e.g., to decipher regulatory signals from DNA...