Yohei
@yoheinakajima
Followers
71,512
Following
8,503
Media
2,878
Statuses
21,645
VC by day, builder by night: @untappedvc , @babyagi_ , @pixelbeastsnft . Build-in-public log:
Seattle, WA
Joined April 2009
Don't wanna be here?
Send us removal request.
Explore trending content on Musk Viewer
Cohen
• 335593 Tweets
#GucciCruise25
• 256882 Tweets
#LeeKnowXGucci
• 241837 Tweets
Liverpool
• 118351 Tweets
Villa
• 108113 Tweets
OpenAI
• 105669 Tweets
Aziz Yıldırım
• 100708 Tweets
Spurs
• 76256 Tweets
GPT-4o
• 63671 Tweets
Diaz
• 62320 Tweets
Mourinho
• 49524 Tweets
Xavi
• 48248 Tweets
DAVI MERECE RESPEITO
• 36416 Tweets
Klopp
• 33380 Tweets
Lions
• 29433 Tweets
Aleaga
• 25910 Tweets
Vitor Roque
• 25742 Tweets
Duran
• 24807 Tweets
#AVLLIV
• 24737 Tweets
Meek
• 22166 Tweets
Lamine Yamal
• 20148 Tweets
Nunez
• 19293 Tweets
Goff
• 17937 Tweets
Richas
• 16068 Tweets
Raphinha
• 14228 Tweets
Gallardo
• 13472 Tweets
Browns
• 13376 Tweets
Watkins
• 13304 Tweets
Chay
• 12851 Tweets
QSMP
• 11098 Tweets
ليفربول
• 10065 Tweets
Pinned Tweet
Okay, let's try this livestream on X thing out!
May 16th 9am PT - The Future of Autonomous Agents
An extended one hour livestream presentation with Q&A by yours truly.
Mark your calendars 📅
6
17
213
🔥1/8
Introducing "🤖 Task-driven Autonomous Agent"
An agent that leverages
@openai
's GPT-4,
@pinecone
vector search, and
@LangChainAI
framework to autonomously create and perform tasks based on an objective.
"Paper":
[More 🔽]
252
1K
6K
I've tracked 1500+ startups (seen 10x more) and talked to 100s of investors in the last year.
Here are some of the exciting trends and startups I've noticed or come across. It's a mix of early & late stuff.
Check 'em out 👇
194
1K
5K
Let it be free!
Open-sourcing “Baby AGI”, a paired down version of the “Task-Driven Autonomous Agent” at 105 lines of code.
Three task agents (execution, creation, prioritization) work in harmony… forever.
131
626
4K
It’s been 18 days since sharing the “paper” on BabyAGI…
The most exciting to me is what people have started building since then, and the discussions around it!
Check them out👇
79
517
3K
Think text-to-image is cool?
Tons of research came out in the last 2 months that will blow your mind:
🗨️speech-to-text
🔊text-to-audio
🔊audio-to-audio
⏯️text-to-video (2x)
🕺text-to-motion (2x)
🧊text-to-3d (3x)
🧠 brain-to-text (2x)
Check these out 👇
52
461
3K
coding isn't dying, just dying as we know it
once AI can build all the apps we have today easily, we'll simply start building more complex apps til they start breaking
coding work will look more like a car mechanic, you're not building the car or car parts, but you know where
131
238
2K
So this “AI founder” experiment is kind of blowing my mind.
I set an objective, and say “your first task is to create your next task”. It then continues to generate and reprioritize its own task list as it executes them one by one.
Only hooked up to search now. Kinda scary.
Huh, well that's starting to work... 🤔
Kind of just goes on... and on... building and reprioritizing a task list for itself...
57
120
1K
69
278
2K
Open-sourcing "MindGraph", a proof of concept starter kit for building and querying against an ever-expanding knowledge graph with natural language!
- multiple input types
- simple interface
- basic search/RAG against knowledge graph
- easily extendable with integrations
- basic
45
288
2K
Friend: How's it going?
Me: Are you on Twitter by chance?
Friend: No, why?
Me: Oh man, let me tell you about my last two week...
45
180
2K
Founders raising for their first angel/pre-seed rounds, here's a list of places to look to build your investor list.
As a reminder, this is the first step to fundraising.
Build your list 👇
79
304
1K
Late night thought:
If LLMs or AI trained on our words are a true threat, and if the most powerful models will be trained on the latest data…
Then maybe spreading love and empathy is the best AI safety method. Every time we say something positive, we make it likely for future
126
190
1K
Most founders don’t realize you can search “angel investor” on LinkedIn and filter by 2nd degree connections to find people one intro away.
22
219
1K
Wild to think that a year ago today, ChatGPT hadn’t come out yet, and the few who were playing w openai models were just finding out that davinci-003 could rhyme
43
115
1K
I open-sourced my prompt to flow chart builder last night 😆
🧮 183 lines of back-end code
👉 (of which 74 lines are one big function call)
🖥️ 195 lines of front-end code
Here's a flow chart describing the app, made using the app...
Alright you hounds, have at it...
Open-sourcing "Instagraph"🌐
Converts text or URL into a visualized knowledge graph.
(probably some errors, you know what to do)
19
84
593
29
144
1K
I gave GPT-4 all the info I have about a startup:
- All of my sloppy meeting notes
- Bullet points extracted from emails w founder
- Deck data extracted by AI
- parts of the AI generated memo based on URL
Reorganized and consolidated into one easy to read memo 🥹
50
91
1K
Huh, well that's starting to work... 🤔
Kind of just goes on... and on... building and reprioritizing a task list for itself...
57
120
1K
👶🤖
@BabyAGI_
updates!!!👶🤖
🌐 is live!
🎞️BabyAGI classic (OG) available as v0.10 branch
🔵
@trychroma
added as alt for
@pinecone
, now default for new users
🏃🏻Default
@openai
model is GPT3-turbo
🦙Llama.ccp integration allows running Llama, Alpaca,
47
155
996
hahaha, no i didn't. yes, i did.
chatting with my AI self.
1) capture vid from browser
2) send to whisper to transcribe
3) send to openai to generate respone
4) send response to d-id to generate vid
48
105
962
great to see everyone at AI rabbithole event today!
as promised, here's my deck with abbreviated narrative.
(video was recorded, will share when available)
30
116
922
I’m afraid the amount of information I’m trying to process daily is above my brain’s token limit.
Apologies for any hallucinations.
62
103
874
Introducing BabyBeeAGI 👶🐝🤖
A buggier, slower, more powerful mod of OG
@babyAGI_
at ~300 lines of code.
✅ Powerful Task Manager
➡️ Task serialization
📋 Local task queue
⚙️ Tools!
🔚 Stops! (usually)
😔 Requires GPT-4
"Paper", Code, & more 👇
33
142
814
here friends, i open-sourced it: prettygraph
at 201 lines of code (69 in back, 132 in front), it's just a quick hack i did for myself to test this UI
25
121
828
Took too long to do this!
Dropped the OG BabyAGI commit (105 lines of code) on
@replit
.
1. Fork it (Use Template) as private
2. Add your OpenAI/Pinecone API key
3. Go to Shell > pip install pinecone-client
4. Update OBJECTIVE
5. Run 🏃♂️
24
93
797
The Assistants API is awesome, had to build something...
Open-sourcing "GPTvsGPT" 🕵️🕵️
(109 lines of code)
A simple template to have two AI Assistants converse. What's exciting is the ability to extend these with retrieval, data, and custom functions.
GH/Replit in thread 🔽
27
107
795
Been talking lots about knowledge graphs and LLMs, specifically for autonomous agents, recently.
Organized some thought here if you want to dig in 👇
KG 🤝 LLM
🧵 (a thread)
30
100
785
Using GPT4V to understand risks of unique corporate structures.
20
102
782
never been a better time to be a generalist w a can-do attitude
29
112
765
The response to
@BabyAGI_
has been beyond my imagination…
So I'm bringing in help!
To start, we have
@fraser
joining us to help lead, with support
@sparkcapital
,
@replit
,
@trychroma
, and more partners to be announced soon!
A bit more on the vision 👇
58
74
742
i can't stop playing with graph ui
this one gradually increases opacity based on distance from the selected node
25
37
703
Imagine pitching a VC that's...
🕑available 24/7
🔍who does their own research, and
📝shares their investment memo with you
Imagine no longer, and meet the GPT VC Associate!
(This is ver 1, let me know what you think!)
41
68
601
side effect of prompt engineering is getting better at giving clearer instructions to humans
53
98
663
Give me an absurd/niche market or customer segment and I’ll reply w a relevant startup.
146
85
629
Finally!
AI model that analyzes music and creates realistic dances 🕺💃🕺💃
wen AI dance battle?
30
149
623
This feels surreal.
This is a chatbot that can read/write/update its own code and logs (including errors). If you look at the summary of recent logs, it’s talking about what it’s doing as it does it.
Once these work well, next step is getting it to chain these skills together
Okay, so now I gave it the ability to query it's own logs!
Here you can see it:
1) Read the query_memory.py file to understand how to read it's own logs
2) Use the get_most_recent_logs function to read recent logs and summarize the activity.
3
3
65
18
71
634
🧵 Introducing AsymmeTrix: Asymmetric Vector Embeddings for Directional Similarity Search! 🔍
Our new approach to vector search & embeddings that models asymmetric relationships between data points.
Github:
👇Read on for key insights! 🚀🔍
32
88
618
anthropic should announce they’ve achieved AGI to put openai in a pickle
41
31
601
Lol I made a program that takes a user input and slowly builds itself into that. You can only run it once, as it's rewriting it's own code.
Been calling it Metamon (Japanese name for the Pokemon Ditto)
29
69
599
Okay this got me thinking… when I’m listening to someone talk, I can start forming my response before they are done talking. Applying it to this…
- somehow stream the speech into model
- have model predict rest of user speech
- form response based on expected user speech
- as
working on a demo of a bot you talk to
the flow:
1. speech to text (
@DeepgramAI
)
2. LLM (
@GroqInc
)
3. text to speech (early access w/
@DeepgramAI
)
Groq speed is a bit variable, but overall really quick
Deepgram is super fast when you stream results (time to first data <280ms)
37
52
432
64
62
605
Embeddings are closer to our subconscious understand of the world. Knowledge graphs are closer to our conscious (logical) understanding of the world.
There’s a lot of value to be unlocked through the seamless combination of the two.
34
73
595
Alright you hounds, have at it...
Open-sourcing "Instagraph"🌐
Converts text or URL into a visualized knowledge graph.
(probably some errors, you know what to do)
19
84
593
Been quietly working on this thru 2020... Excited to finally share
@UntappedVC
, a new VC firm I started w/ my true friend and role model
@jessicajackley
!
Some deets (like our portfolio) below👇
83
47
592
Hear me out: a standard “documentation” endpoint for every API that returns clear and concise API documentation for the purpose of feeding into an LLM to generate API queries.
77
42
591
I just open sourced this proof of concept chatbot that minimizes latency by predicting user response and pre-generating responses, which are used when final message matches predicted message.
As usual, the replies were full of great ideas. So I had AI organize them:
Theoretical
Okay, cleaned it up and now on Github!
Again, this is just a rough proof of concept :)
5
11
86
49
57
554
Can’t believe it took me so long to try this…
Who’s working on an autonomous agent related startup? Drop your url/description below 👇
(I’ll make sure my VC friends see this!)
200
70
562
24 days ago used ChatGPT for a side project
Went viral so had ChatGPT write a “paper”
Went viral again so open sourced code
Went more viral so asked for help
Prev Head of Product at OpenAI joins to help
Life is wild
The response to
@BabyAGI_
has been beyond my imagination…
So I'm bringing in help!
To start, we have
@fraser
joining us to help lead, with support
@sparkcapital
,
@replit
,
@trychroma
, and more partners to be announced soon!
A bit more on the vision 👇
58
74
742
29
41
568
Four layers of memory for AI agents (WIP):
Log memory: raw log data of everything they do
Raw memory: chat logs, docs, web scrapes, etc
Structured memory: objects, people, relationships, etc
Contextual memory: user info, recent memory, world events, etc
Thoughts?
71
46
563
Imagine a CRM that autopopulates itself based on notes, emails, calendar, etc. All content parsed to generate relationships between orgs/people/events/etc.
And then you query w natural language, or better yet give access to your AI agent.
The ideal CRM is one you never look at.
53
50
536
GPT-3 is fun, but the Playground can be limiting.
Here are some free and open templates to use
#gpt3
in various tools with your own API key:
📊Google Sheets
📝Google Doc
✉️Gmail
⚡️Zapier
🗂Airtable
📄Notion
🗣Siri/Shorcuts
Shall we? 👇
29
68
541
Paths to starting your own VC firm (having 2 is great):
- found successful startup
- early employee at top startup
- work at a VC
- work in tech media
- build an audience/community
- build a specialty
- career in finance
- brute force hustle
26
63
535
Unpopular opinion: AGI is defined by the average intellect of people… so not a high bar
98
36
525
How to build a target investor list using Crunchbase. 👇
First, you’ll need Crunchbase Pro. At $25/mo, not bad.
Then, I use Airtable, specifically the Linked Table feature.
33
76
523
This is my version of "prompt engineering"
(knowing what to look for and calling it out when it makes a mistake)
42
36
514
A marketplace for AI agents to hire humans 🧠
Excited to introduce a new project I've been working on called Payman!
Payman is an AI Agent tool that gives Agents the ability to pay people for tasks they cannot do themselves.
While many people imagine a future where humans pay AI agents for services they want completed,
126
147
993
23
90
508
AI generated flow chart describing US presidential election process - four ways (with different prompts)
33
29
501
Hear me out, a fund of fund that cuts $100k-$250k into almost every VC fund sub $15m and then spends all the mgmt fees on a data science team to analyze performance of managers and underlying portfolios.
34
36
479
I’m still proud of the fact that I introduced LLMs to NoCode w this Zapier integration - which I built without permission (this eventually became the official integration).
This was pre-ChatGPT!
It's official! We're launching OpenAI on Zapier 🎉
Thank you,
@yoheinakajima
, for building something amazing that we can now share with everyone!
P.S. Y'all are already building SUPER cool stuff with AI + Zapier.
Here are a few of our favorites ⬇️
81
388
3K
23
33
479
How to raise a seed round. Just one process, adjust accordingly. Missing lots of nuance. 👇
24
91
483
If you’re raising $250k from angels, let’s say it’ll end up being $25k from 10 angels.
Assuming a generous avg 10% conversion from chat to close, that’s 100 investor mtngs.
Conversation rate starts low and goes up during your fundraise, so first 20 may say no.
Don’t give up.
22
56
469
Made myself a custom GPT that can create Actions!
Had it build my first
@todoist
action to add tasks.
First, it searches for developer documentation...
40
36
460
My
@TEDTalks
is live!
Join me in this exploration of "identity" as I touch on our complex nature, the collective conscious, limitations of language, with a strong nudge to see the opportunity today to build a better future with AI.
38
67
447
Just got DALLE3 to generate a 360 image and then loaded it up on a mobile web viewer!
28
35
444
i'm literally just sitting here staring at knowledge graphs being generated about whatever i want
add a web search in the loop, turn all human knowledge into a massive knowledge graph?
38
49
438
Interested in being an LP?
Maybe you dabbled in angel investing, and it’s not for you. But you still want exposure.
Investing in a VC fund is a great idea!
Where do you start? 👇
21
77
431
Announcing “Total Recall 🧠⚡️”
Utilizing 6 embedded scalp sensors and the latest brain-to-text AI, this stores your every thought - for you to access anytime by simply thinking about it - response comes directly to a bone conductive mic in one of the sensors.
Let me explain how
36
47
423
Wait... so people just send you fixes to your code?
Open source is amazing. Just did my first handful of pull requests!
26
15
409
25 files across 9 nested folders with functions that depend on each other, cleanly organized
created by AI based on auto-generated file descriptions which currently shrink 14k+ tokens (full code) down to about 6k tokens*
*this include param description for each function which I
20
46
414
An LLC for every AI agent so they can open bank accounts and stuff
52
27
400
I get asked these often, so thought I’d write up a thread.
Where are we with autonomous agents? What can they do? Should we use one?
My thoughts 👇
23
63
404
Do, a deer, a female deer 🎶
Introducing BabyDeerAGI 👶🦌🤖
Newest mod of OG
@babyagi_
at ~350 lines of code. Added:
🤹🏻♂️Parallel tasks (faster!)
👍 3.5-turbo only (GPT-4 not required)
💬User input tool
✍️Query rewrite in web search tool
📥Saves results
Repo URL below 👇
14
57
403
Something I haven’t talked about much is my deep interest in our brains 🧠
My favorite book is “Train your mind, Change your Brain” by Sharon Begley. A book on neuroplastocity, with learnings from Buddhism.
I’m excited to continue exploring a deeper understanding of ourselves.
43
22
394
We closed our fund 1!
When we started, we be benefited greatly from content shared by other VCs like
@dunkhippo33
.
We wanted to do the same, so analyzed our fundraising data to share with you.
Let’s dig in 👇
50
39
392
Meet BabyElfAGI!
Biggest update to the OG
@babyAGI_
, finally broke out into multiple files:
🛠️ Skills Class allows for easy skill creation
📝 Dynamic Task List example w vector search
🔍 Beta Reflection Agent
🖇️ Can read and write own code (yes it can write new skills and task
21
78
389
Continued experiments with an autonomous CRM that slowly creates a massive knowledge graph.
This time, I'm testing specific edge types, which loses flexibility, but also makes the output easier to query and understand.*
*I'm using function call to get JSON, and the "enum"
55
40
359
and so it begins…
knowledge graphs 🤝 agents
(mindgraph) (babyagi)
24
13
389
Okay
@tldraw
is pretty addicting
1) draw your UI
2) use text to describe
3) highlight (i.e. draw box around), and
4) click the blue "make real" on top right)
6
44
384
Research is an area that AI can provide massive efficiency increase.
So here's a "Gen AI for Research" market map!
💸 Investment
⚖️ Legal
🧬 Academic
🏘️ Real Estate
👨💻 Consulting
❤️🩹 Healthcare
👨👨👦 Customer Research
💰 Wealth advisory
I'll tag the companies in the thread below.
14
57
372
Just made a lil' script to easily fine-tune a small model with synthetically generated data...
...calling it "AutoFineTune"! (~110 lines of code)
Generates 100+ synthetic message pairs with a GPT4 loop and fine-tunes llama-2-7b with
@togethercompute
. To use:
- set objective &
15
38
373
Might be weird to publicly but...
Any venture studios w a strong process & track record for hiring CEOs interested in partnering to incubate baby AGI?
1.4k stars, 210 forks, 29 PRs in a day and a Discord coming. I think I should bring in help.
cc
@scienceinc
@psl
@MadronaVL
53
27
362
Want to see a cool AI demo?
This is our "AI-drafted investment memo" tool, which runs in the background of our CRM.
We can give it a URL, description, or deck. Check out the results!
We use this at
@untappedvc
, and share with our LPs😎
28
37
366
Took me a while but finally coming to terms with the fact that you can’t build a long-term reliable autonomous agent on a closed model…
Unless it’s your closed model of course.
22
32
365
I wanted to share a quick note on the future of Baby AGI...
Full honestly, not sure yet - but exploring ideas. Lots of exciting energy around it that deserves support. Setting up Discord. Lots of discussions to help clarify a vision.
There are PRs/issues with no response, and
31
21
360
Excited to share
@ObviouslyAI
's new AI service!
"Hire a Data Scientist for $1000/mo"
They can help with:
🧹 Data clean-up & merging
📈 Traditional models (regression, classification, etc.)
💬 Custom LLM API (w document retrieval)
⚡️ API/
#nocode
integrations
📞 Data science
14
36
320
I’m an outbound focused VC, meaning I reach out to most of the founders I talk to, not the other way around.
A lot of people ask me about my process. It’s not a secret. Here it is 👇
13
25
362
LLMs are the next evolution of communication technology, for the first time allowing “many-to-one” communication where an individual can communicate with the collective knowledge of many people.
The last big innovation was social, which allowed for “many-to-many” communication,
34
49
360
20k+ github stars, 45+ arxiv citations, 500eth secondaries on my nfts, welcoming 3 kids, while launching a venture fund, here’s my secret 👇
25
9
360
I feel like I intuitiveLy accepted LLMs and why they work, but GPT4Vs ability to understand charts is throwing me off.
Like no way you can throw a whole bunch of charts and descriptions into a model and have it learn to understand them, right?
There’s a gotta be a layer of
38
15
356
Taking a pause from adding complexity to the agent as it's harder to debug.
Took it an opposite direction and stripped out Langchain for now. It can't engage with APIs now, but can still perpetually build and execute tasks (just writing and "thinking").
36
29
344
📜 APPENDIX
🧵Thread (above) generated by GPT4 based on paper
📄Paper generated by GPT4 based on code
📊Graphs in paper generated by GPT4 based on code
💻Code generated by GPT4 based on prompt
*For each, many prompts to adjust initial output
11
28
344
12
11
317
So true. Met a ton of folks smarter than me building with LLMs pre-ChatGPT, and same thing happening now with knowledge graphs.
how to increase your “surface area of luck” — get to the arena early
19
209
2K
9
25
346