🌊Introducing DPO Mix 7K, a small DPO dataset that does wonders! Yesterday, @_philschmid & @_lewtun showcased its strength with Zephyr Gemma If you're looking for a small, diverse, high quality DPO dataset check it out! Tweet added by Argilla @argilla_io

Argilla

4 months

🌊Introducing DPO Mix 7K, a small DPO dataset that does wonders! Yesterday, @_philschmid & @_lewtun showcased its strength with Zephyr Gemma If you're looking for a small, diverse, high quality DPO dataset check it out!

2

25

103

Argilla

@argilla_io

4 months

We built it filtering & mixing our recent DPO datasets: - Reranked @intel Orca pairs - Cleaned @openbmb UltraFeedback - @ldjconfirmed Capybara DPO It worked very well for us (CapybaraHermes) & others, but never introduced it publicly Now it's time: It deserved its own image!

0

1

6

Acumen Trade Group

@AcumenTradeUSA

4 months

@argilla_io @_philschmid @_lewtun Not sure if you need this one but here it is: @ivanfioravanti @migtissera @Yampeleg

0

2

Replies