Releasing the demo notebook!
You can try CARP-L here, just click "Run all"
You can edit the stories and the critiques. It'll perform prompt softening under the hood using Pegasus.
Cut the CARP: Fishing for zero-shot story evaluation
abs:
a scalable, efficient method for performing qualitatively superior, zero-shot evaluation of stories and a new corpora composed of 1.3M aligned story-critique pairs derived from over 80,000 stories
4
22
118
2
10
47
Replies
CARP's host currently has an outage. Please be patient. If you absolutely need a copy of the model *right now*, DM me and I'll send you a google drive link. A few people have messaged me about this in the last couple of hours.
0
0
1
0
0
0
@lcastricato
Thanks! I just ran the whole thing, editing some of the critiques. Very cool. Now to go for a run and brainstorm ways to use it.
0
0
4