Andrew Baker
@AndrewMBaker
Followers
2K
Following
9K
Media
407
Statuses
2K
Provider of Tweets related to quantified law, natural language processing, legal tech, legal process, service design, and dad-stuff. All views my own.
Chicago, IL
Joined December 2008
.@GreatWolfLodge is the worst. Not recommended. Spend your money elsewhere.
0
0
1
Lots of sessions citing GPT-4 bar exam results. Worth considering this other analysis too. #ILTACON2023
The claim that GPT-4 performed at the 90th percentile on the Uniform Bar Exam appears misleading according to this new preprint. It seems more accurate to say it performs in the 63rd or 68th percentile.
0
1
7
Some light discussion of model performance & evaluation in an AI session. Honestly, market needs a whole dedicated session on that topic. Not easy when dealing w/Generative, unfortunately. Isn’t the fun stuff, but thinking needs to evolve on that in Legal. #ILTACON2023
1
0
5
Speaker in the data science session just covered context windows and document segmentation in a session. Really good to see. Need more of the sharp edges in GenAI pointed out to the industry, not just hocus pocus. #ILTACON2023
0
2
11
Retrieval Augmented Generation (RAG) isn’t a “domain specific LLM.” It’s a usage pattern around an LLM, injecting content into the prompts. The difference here matters a bit. Legal industry needs to unpack RAG a bit more. #ILTACON23
0
0
1
Really solid analysis evaluating performance of Generative AI in our industry. We need more of this in Legal. Requires cross-discip. perspective, as displayed here. Can't rely on product companies and those selling services; need a more objective lens.👏 https://t.co/PfhQ8pJ4qH
1
0
1
Where would we be if 20% of the time spent thinking about what the future could look like because of Generative AI was spent rigorously testing use cases and validating approaches? Collective "Legal Science Fiction" skills are fairly refined, "Legal Science" interest fairly low.
0
1
4
Regardless, this highlights the need for a healthy ecosystem of researchers checking each others' work and rerunning evaluations. Tests need to be run and/or checked by multiple different teams.
1
1
29
The claim that GPT-4 performed at the 90th percentile on the Uniform Bar Exam appears misleading according to this new preprint. It seems more accurate to say it performs in the 63rd or 68th percentile.
14
66
346
Anyone up for some data architecture content at SKILLS on the 9th? Maybe? Maybe not? Painless, I promise. #skillslaw
https://t.co/45v7T6NaAa
linkedin.com
I'll be speaking at SKILLS (Strategic Knowledge & Innovation Legal Leaders Summit) on March 9th about data architecture. Should be fun. #skillslaw #legaldata
0
0
3
I read these “law firms are sitting on so much data” threads & wonder: Have you been in a law firm? Have you run queries against common data sources directly? Ever try mining the text sources you portray as easy pickings? Know what that even entails? “No” is too often the answer.
0
0
6
The hardest people for founders to hire are so called C-level executives, because these people are the best fakers in the world.
236
622
7K
Hey @DoNotPay - How about offering a service for political campaign donors to get refunds of money solicited under false pretenses?
2
1
13
Conducting, in their words, an “evac.” A crew has come to the rescue with some special cane to secure our boat.
0
0
3
I’m legit stuck on “It’s a Small World at Disneyland.” They’ve finally shut the music off. This feels straight out of a horror movie.
5
0
10
Dalle and related models are going to change the game on “creative” endeavors. Will act as a “muse” in the near-term but the origin of more finished concepts / products in the long-run.
my latest #dalle obsession is dreaming up sneaker collabs the prompt is pretty simple: “(artist), (brand) sneakers, digital art, product photography” the results are incredible
0
1
0