James Chen Profile
James Chen

@jchencxh

Followers
478
Following
7K
Media
38
Statuses
1K

ai research @SCSatCMU mostly representation learning for vision and generalisation

Pittsburgh, PA
Joined June 2023
Don't wanna be here? Send us removal request.
@jchencxh
James Chen
18 minutes
if everyone just had cats, i’d be able to go to sleep right now.
0
0
0
@jchencxh
James Chen
19 minutes
> new neighbor.> dog.> barks
Tweet media one
1
0
0
@jchencxh
James Chen
2 hours
why can't the idea of long-range dynamics/video be learnt *AFTER* pretraining a static observation encoder. this could work as long as your representation of static observations still convey *how* the static scene can change.
1
0
2
@jchencxh
James Chen
3 hours
why shouldn't we have two things for representing video:.1) static observation encoder.2) dynamics model for describing how things change. instead of:.1) one large ViT that eats everything.
1
0
2
@jchencxh
James Chen
3 hours
do you actually *need* to shove the entire video through a big model to get good representations for a video?. how much of it is just pure static content, and how much else are things that can change? perhaps we only need to process multiple timesteps for learning the latter?.
2
0
3
@jchencxh
James Chen
1 day
i’m not watching MI8 in theatres out of protest bc rebecca ferguson is no longer in the franchise.
@navyrexie
tori ➃
2 days
this is lethal
Tweet media one
0
0
7
@jchencxh
James Chen
1 day
just have kids ig?. you don't even need to go full elon with it, you can just produce a few (<15) of your own little cultists (children).
@jchencxh
James Chen
2 days
people found companies because it’s too hard to found a religion or country.
0
0
4
@jchencxh
James Chen
2 days
my curiosity got the better of me and tonight i'll be finding out what the words "garlic epic stuffed crust" entail.
1
0
3
@jchencxh
James Chen
2 days
goomba lab will be the best lab name until @menhguin starts goon lab.
1
0
2
@jchencxh
James Chen
2 days
people found companies because it’s too hard to found a religion or country.
0
0
4
@jchencxh
James Chen
3 days
i don't personally advocate for *exact* architecture implementations, but this provides a very different perspective on architecture design. you should go read a lot of yilun's stuff.
@du_yilun
Yilun Du
3 days
Excited to share Energy-Based Transformers (EBTs), which allows you to implement system 2 thinking in any modality! . EBTs formulate reasoning as an energy optimization problem, allowing models to internally think without complexities like CoT or multiple recurrent latents.
Tweet media one
0
0
4
@jchencxh
James Chen
4 days
the public messaging of this field is sometimes irresponsible. it's overly-optimistic in the wrong places, and insufficiently nuanced in others. likely:.asi will not be here in five years to cure your rare disease. it will however cause economic shifts you aren't prepared for.
0
0
6
@jchencxh
James Chen
6 days
RT @MLStreetTalk: AI is so smart, why are its internals 'spaghetti'? We spoke with @kenneth0stanley and @akarshkumar0101 (MIT) about their….
0
61
0
@jchencxh
James Chen
7 days
whenever there’s a fly that’s obviously a bit slow and not in an annoying place (eg my house) i don’t kill it. i hope that it can spread its slow genes to other flies, so i can kill the flies in my house more easily.
0
0
4
@jchencxh
James Chen
7 days
seems to be something inherently different in how complexity emerges in finite (ViT encoder) vs infinite (LLM) “working space” designs, and thus how simplicity bias seems to benefit the latter more. we don’t understand how to scale the former purely. the largest ViT << LLM sizes.
0
0
0
@jchencxh
James Chen
9 days
the idea of embodied data in robotics is weird. human actions are embodied, but i don’t think a human’s (or an optimal) world model has to be. data should be for learning an (implicit) world model, i don’t know why there’s a tendency to do it from an embodied POV.
0
0
2
@jchencxh
James Chen
10 days
This is obviously satire. Either way, if I were to put it in a single sentence, my main issue with the UK is that it’s a country where agency is not only not rewarded, but is actively fought against. Honestly sad to see a country I grew up in constantly kneecap itself.
0
0
1
@jchencxh
James Chen
10 days
In other news, Westminster has mandated that, to ensure fairness, all British homes no longer possess any heating units (even including ovens.).
@jujulemons
Julia Willemyns
10 days
Imagine letting people die needlessly when we have the technology to save them.
Tweet media one
1
0
1