Muhan Zhang
@muhanzhang93
Followers
49
Following
7
Media
2
Statuses
11
Joined February 2018
Thanks for sharing our work!.
PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models. Significantly improved finetuned perf by simply changing the initialization of LoRA's AB matrix from Gaussian/zero to principal components of W. repo: abs:
0
0
1
RT @s_tat1204: Weight MatrixをSVD分解し、特異値が大きい部分のみをLoRAのようにfine tuneする手法 PiSSA の提案。. 特異値の大きい部分、中くらいの部分、小さい部分それぞれのみをfine tuneさせてみたところ、特異値の大きい部分….
0
9
0
Citing sentences from the meta review "This paper presents an ambitious framework that leverages LLMs to handle various graph learning tasks using one model. The proposed method is well-motivated, and also demonstrates reasonably good performance.".
0
0
0
It is recently accepted as a spotlight presentation in ICLR. Paper: Code:
github.com
A fundational graph learning framework that solves cross-domain/cross-task classification problems using one model. - LechengKong/OneForAll
1
0
1
Is it possible to have a single graph model that can predict toxicity based on molecular structure, recommend friends in social networks, classify papers in citation networks, and discover mechanisms of human aging in genetic networks at the same time? Check our latest OFA paper!
1
0
2
RT @HaggaiMaron: PyTorch Geometric High Order, the new library for high-order GNNs by @muhanzhang93 and his team looks great!.In addition….
0
24
0
. Testing Google Scholar's new function which notifies the 100th citation your paper gets!.
scholar.google.com
M Zhang, Y Chen, International Conference on Learning Representations (ICLR 2020), 2020 - Cited by 374
0
0
1