Charles Dobson 🇺🇦🇨🇦
@LitigationKM
Followers
329
Following
2K
Media
5
Statuses
275
Working on the future of civil litigation. Former litigator, now litigation KM, pricing, and innovation. Amateur coder & fledgling ML practitioner. Views own.
Toronto, Canada
Joined March 2020
Across Canada, our justice system is under attack. In British Columbia, the New Democratic Party is erasing the law society, eliminating with it the independence of lawyers.
1
1
2
Kharkiv. Not Beirut. Happens almost daily. Not making news anymore.
401
4K
10K
My oldest son is missing. I’d appreciate some shares.
86
2K
2K
this record I made is so fun!! I need the world to hear it!!!
6
36
136
This is a great paper. LLMs cannot plan and reason on their own -- they're pattern-matchers. But that doesn't mean they can't be useful for reasoning. They work best *in conjunction* with systems that can actually plan or reason -- such as symbolic planners.
📢 So our paper on LLM-Modulo Frameworks ( https://t.co/VyrVFowilt) got a spotlight nod at #ICML2024. Expect to see me holding forth in front of our🎗️beribboned🎀 poster on 7/23.. (As for the oral--that will be part of the tutorial https://t.co/v3XCvAexWR the day before.. 😋)
22
246
1K
Annual Twitter Tradition. Fathers Day and Pride in June. People can have complicated feelings this time of year so I'll make the same offer I make every year. If you like the LAST TWEET of this thread, I'll msg you to say, unironically, that I love you and am proud of you. 1/4
1
2
10
This chart is a great rebuttal of the view that RAG will solve hallucination. In the legal domain, it turns out that it does improve precision somewhat, but at the expense of recall. Really great paper by Stanford & Yale researchers assessing legal AI. https://t.co/JdZvCIW7nf
33
211
1K
Canada will be among these "small jurisdictions" too.
UK and US law have infected LLMs (according to Linklaters). I shudder to think what LLMs have learnt from being trained on US contracts: - big slabs of verbose text - pointless legalese The broader conclusions are not surprising: LLMs don't produce reliable legal advice.
0
0
2
Do the RAG GenAI systems of the big law tech companies give the “hallucination-free” drafting assistance they claim? @chrmanning & Mirac Suzgun aided a @Stanford RegLab study showing they do much better than GPT-4 but still hallucinate about 1 time in 6. https://t.co/QUsVir5XUx
hai.stanford.edu
4
27
93
The talk about hallucinations in LLMs has gotten it all wrong. The true hallucinations are by company execs who think it is OK to release to general users products that are based on LLMs that confabulate wildly, as all LLMs do. Time will show a high price paid by society.
24
73
291
Think about this as you run your usual shopping errands this weekend. #RussiaIsATerroristState #PutinIsaWarCriminal
⚡⚡⚡ Two dead, at least 11 injured as a result of a Russian shelling of Kharkiv, according to Regional Administration authorities. "Apparently, the target was a shopping center where many people were inside. This is pure terrorism," says Mayor Ihor Terekhov. 📹: Radio Svoboda
2
9
15
For those interested in watching via Zoom, on June 13 at 12 noon, the @ONCA_en will determine whether the public has any right to know how many cases go to trial or how long they take to get there, and whether the open court principle really applies in Ontario.
1
7
14
Below is an explanation of "Agentic" workflows in ~ 15 LOC. At its core, "Agentic" just means LLMs that can call functions. Another ex of how unnecessary jargon confuses people https://t.co/w0YYsxoyLT
33
62
534
Our paper dissecting AI hype in law by @sayashk, @PeterHndrsn and me is now officially published. https://t.co/xsNWgY5vWD Legal Tech is a well established industry and language models offer many avenues for improving existing products. But a robot lawyer isn't on the cards.
10
80
252
We're not yet scratching the surface of what can be done in law with current LLM tech, but interesting to note this potential underlying limit that we may bump up against eventually.
In the late 1960s top airplane speeds were increasing dramatically. People assumed the trend would continue. Pan Am was pre-booking flights to the moon. But it turned out the trend was about to fall off a cliff. I think it's the same thing with AI scaling — it's going to run
0
0
0
The first @SCJOntario_en Annual Report in more than 5 years just dropped! And it has stats!
2
17
23
FYI, Ontario law people. LSO has released guidance re generative AI. Futures Committee Report to Convocation, April 25, 2024 ( https://t.co/S4l1xwymUk)
0
0
1
that’s right, there is no guarantee of significant improvements, especially since LLM’s are now stealing from each other contaminating the data with their own drivel.
@GaryMarcus I kept hearing people saying that "Right now, they're the worst they will ever be" on the assumption that they can only get better. No! Google Search was better than it is now twenty years ago. There is NO guarantee large data models will get better.
9
16
71