Rush Tabesh
@rush_tabesh
Followers
23
Following
17
Media
0
Statuses
4
Rush (Soroush) Tabesh | Ph.D. Student @ ISTAustria | Efficiency in Deep Learning
Vienna, Austria
Joined August 2023
RT @DAlistarh: Our QuEST paper was selected for Oral Presentation at ICLR @sparseLLMs workshop! .QuEST is the first algorithm with Pareto-oβ¦.
github.com
Work in progress. Contribute to IST-DASLab/QuEST development by creating an account on GitHub.
0
9
0
RT @egor_zverev_ai: (1/n) In our #ICLR2025 paper, we explore a fundamental issue that enables prompt injections: ππππ¬β π’π§πππ’π₯π’ππ² ππ¨ π¬ππ©ππ«πβ¦.
0
13
0
Happy to introduce #HALO lower-precision fine-tuning for LLMs. With proper Hadamard transforms, #HALO enables accurate INT8/FP6 fine-tuningβlossless speedups up to 1.41Γ. π Paper: π» Code: #LLM #Quantization.
Happy to release #HALO, a Hadamard-Assisted Lower-Precision scheme that enables INT8/FP6 full #finetuning (FFT) of LLMs. with @mmnnn76 @rush_tabesh @RobertoL_Castro @thoefler @DAlistarh. Paper: Code: 1/4
0
3
4
RT @DAlistarh: The code for RoSA: Accurate Parameter-Efficient Fine-Tuning via Sparse + Low-Rank Adapters is now available: ..
0
5
0