Econolicious
@econo
Followers
248
Following
1K
Media
89
Statuses
1K
Model size growing like Moore's Law.
Just so you know, since the release of the "Attention is All You Need" paper in June 2017 and the open-weight BERT model that followed after it, all pretrained transformers had a context size of 512 tokens, and training longer context models "didn't make sense because of the.
0
0
0
That's the best part. Unfunded graduate student are a losing move.
@Strangelove5150 You do realize private loans have higher rates and don’t qualify for PSLF? Meaning instead of 10 years, it would take me 20+ years to pay this off?.
0
0
0
RT @CausalHuber: Just 1.5 months to go until my book Impact Evaluation in Firms and Organizations is out with @mitpress! An accessible intr….
0
72
0
Barbara Ehrenreich explored the darker side of toxic positivity.
The so-called self-esteem movement of the 1980s and 1990s largely backfired. It aimed to cultivate healthy confidence in children but often ended up encouraging narcissism instead. Rather than teaching kids to associate self-worth with effort and achievement, it showered them
0
0
0
Retention bonus award takes years employment to vest. OK to jump after vesting. Jumping shortly after a sign-on bonus could usually be clawed back.
@dvassallo Dont employers have a clawback arrangement if you leave directly after a bonus?.
0
0
0
RT @__paleologo: I know more than one people who can guess betas and correlations visually. Once I met a person (not joking) who guessed th….
0
60
0
LLM test highlights
0
0
0
RT @itsalexvacca: BREAKING: MIT just completed the first brain scan study of ChatGPT users & the results are terrifying. Turns out, AI isn….
0
39K
0
Can speed run green cards for $5 million each, recruit worldwide.
Sam Altman says Meta is offering $100M signing bonuses to OpenAI staff. Not $100M annual compensation, just the signing bonus!. He clowned Meta: “that’s not how you build a great culture.” Also said none of OpenAI’s best people are leaving. This AI talent war is crazy.
0
0
0
RT @dwarkesh_sp: Japan was richer per capita than the US in the late 1980s. Today it sits at the bottom among developed countries. How do….
0
449
0
Also, why we invented logarithms.
This guy is totally right. Humans are bad at multiplying large numbers. But it’s also PRECISELY why we invented calculators, software, computers, and algorithms. We built those things so that we could get reliable outputs on complex and repetitive computations, day after day.
0
0
0
RT @GaryMarcus: 𝗔𝘀𝘁𝗼𝗻𝗶𝘀𝗵𝗶𝗻𝗴𝗹𝘆 𝗳𝗲𝘄 𝗽𝗲𝗼𝗽𝗹𝗲 𝘀𝗲𝗲𝗺𝘀 𝘁𝗼 𝗵𝗮𝘃𝗲 𝗮𝗽𝗽𝗿𝗲𝗰𝗶𝗮𝘁𝗲𝗱 𝘁𝗵𝗲 𝘁𝗿𝘂𝗲 𝘀𝗶𝗴𝗻𝗶𝗳𝗶𝗰𝗮𝗻𝗰𝗲 𝗼𝗳 𝘁𝗵𝗲 𝗻𝗲𝘄 𝗔𝗽𝗽𝗹𝗲 𝗿𝗲𝗮𝘀𝗼𝗻𝗶𝗻𝗴 𝗽𝗮𝗽𝗲𝗿. I will break it….
0
248
0
If Chicago then gave 1,000 points when the end product was fit for occupancy, this system wouldn't be so bad. But they won't do that.
When Chicago builds affordable housing, a developer gets 11 points for BIPOC involvement, 7 points for women, 7 points for accessibility, and 3 points for containing costs. They ended up with a program where each unit cost up to $1.1 million.
0
0
0