Nirant
@NirantK
Followers
12,469
Following
1,081
Media
709
Statuses
7,446
💡 Tweets about LLMs, learning about Search/Ranking | 🛠️⚡️ FastEmbed: @qdrant_engine
localhost
Joined December 2012
Don't wanna be here?
Send us removal request.
Explore trending content on Musk Viewer
jeno
• 467546 Tweets
Meet the Grahams
• 285834 Tweets
#بدر_بن_عبدالمحسن
• 262571 Tweets
Óscar Puente
• 78004 Tweets
Saka
• 54350 Tweets
#ライブ・エール
• 52296 Tweets
Bournemouth
• 42845 Tweets
こどもの日
• 36871 Tweets
サヨナラ
• 32875 Tweets
#霊験お初
• 32090 Tweets
الامير الشاعر
• 27895 Tweets
Havertz
• 21883 Tweets
الفردوس الاعلي
• 20971 Tweets
#ARSBOU
• 19463 Tweets
غاب نور البدر
• 14875 Tweets
Christie
• 13653 Tweets
Ipswich
• 13462 Tweets
アジカン
• 11592 Tweets
Pinned Tweet
After years of cribbing that I'm not a good enough developer, I've done the most developer thing:
Made a Python library for devs:
FastEmbed — simple, fast, efficient for text embedding⚡️
And it'll be maintained by the amazing friends at
@qdrant_engine
🫶
fastembed, lightweight, fast, Python library built for embedding generation by
@qdrant_engine
github:
4
64
312
11
10
131
Really want to meet the people who convinced Infosys to invest in OpenAI in 2015. Damn, what a bet.
26
61
2K
BLR is 3 emotions:
Bellandur, Kadubessanali, Sarjapur and Whitefield: When will I get promoted?
Kora, HSR, Indiranagar: When will my startup raise next round of funding?
Jayanagar, Malleswaram, RR Nagar, JP Nagar: When can I raise the rent for my house in above areas?
30
132
1K
PSA: If you're doing USD to INR conversion mentally, can just use 85 now.
64
25
1K
Hiring is too broken. Govt should have a national employer portal tied to company GST etc.
Every candidate you've ghosted, offered but later said no, orders placed to a vendor and then paid late, all POSH complaints, with action taken or NOT — gets tracked there.
40
80
1K
Parents for 20 years: Wake up early, take a walk in the morning sun
Kid: No
Huberman: direct sunlight within 30 minutes of waking up with forward ambulation really helps
Kid: SIR YES SIR!
8
73
898
Do not spend a single rupee on them
These are somewhere between a scam and incompetence
I regularly get DMs from folks who did a bunch of these "ML" courses in the last hype-cycle with no tangible or learning outcomes
I put these in the same category as Byju's for Adults
🧵 on top paid and free Generative AI courses offered by upskilling startups in India plus other platforms
52
44
168
57
131
880
@codyschneiderxx
Hey Cody, can you please put me in touch with your friend?
I'd love to make a better offer to these engineers as a fellow country man
13
4
502
Reminder that the best thing you can do for your career is get so good that the best people find you and want to work with you
Everything else: offer shopping, leetcode grindmax is less efficient
7
38
425
This is absolutely amazing!
This kills all startups wanting to hack with 4090s in their racks bought off Amazon or Ebay US
GoI protects masses from engineers learning dangerous things like matrix multiplication
Making sure that only Google and Amazon can
"Make in India"
25
42
402
I hear IIM admissions has made a lot of people sad on the Internet
It's a great time to remind yourself that comparably premier software engineers (top 0.01%):
- make more $$,
- work less hours, take less meetings,
- 💕 their job/craft
And probably do so for next 20 years
20
6
403
.
@sama
would ❤️ to host you in BLR!
Creds:
- Run BLR's largest Generative AI meetup
- WA Community with 800+ people & 150 DAU
- Trained LMs since 2019 (Hindi), maintainer of awesome-nlp (14K Github stars)
Who can put me in touch w/ his planning team?
RT for Karma please!
had a great first week of the openai world tour in toronto, DC, rio, lagos, and lisbon.
fun to see what people are building and get (lots of) feature requests, and even fun to talk to policymakers!
madrid, warsaw, paris, london, and munich this week.
213
209
3K
21
121
395
Might not look much, but this is what true Chads in India do — from his own Linkedin: The CEO of IDFC First Bank
16
25
384
Had a dear friend asking me if they should move to BLR from EU recently.
Absolutely amazing how BLR itself has given a clear, decisive answer better than I ever could!
18
13
363
Extremely happy to share that
@qdrant_engine
— the fastest and most cost effective vector search has raised $28M Series A
This raise will help us build our open source ecosystem of tools for efficient and fast search!
27
5
351
@Nithin0dha
Is this a puzzle? Haven't you've given the answer yourself?
Americans with money want to invest here for higher CAGR — while Indians don't have enough wealth for CAGR to matter?
The Americans do, so it makes sense to go there and earn a honest, respectable living?
12
10
339
Great reminder for those thinking about staying back in India, you better:
1. make > 50 LPA,
2. work 40 or fewer hours,
3. learn more
In the US, according to my spending estimates, if you make $100k, you'll save ~$22k a year.
To save an equivalent amount in India, you'd need ₹37 lakh, for an effective PPP of 37.
Post:
5/7
8
11
138
8
19
323
Thank you
@AnalyticsVidhya
for recognising me as one of India's Top 5 GenAI Scientists! 🙏
Glad to be in great company with wayyyyy more persistent mofos like
@bhutanisanyam1
and
@ravithejads
😊
43
4
306
Most investors in India haven't studied a single balance sheet
Many study unrelated things like Twitter, WA groups & YC
"Trends" and thesis are learnt on the fly
Investors resort to spray & pray or FOMO to make investing work
Outcome is fraud & less than FD returns
14
19
289
Extra irony because Krutrim is made by a BITS Pilani + Georgia Tech alum
Only people from iit bombay can apply for ai fellowship at
@Krutrim
. I mean in today's time eligibility and things like these is what makes India remain behind the latest and innovative developments in the world.
74
33
540
10
12
288
Can't believe there are people who love Pasoori without realising that the entire song is cursing that you don't find your love
23
12
283
On working hard: Do it at the beginning of your career
Hard work compounds like interest & the earlier you do it, the more time you have for the benefits to pay off
It’s easier to work hard when you have fewer other responsibilities, which is frequently when you’re young
-
@sama
3
15
274
Myth: India can do AI well because we've both the money and talent in software
Likely: India has the money, but our talent pools are not deep enough
For reference, China has TikTok, Baidu et al and 4 of the top 5 universities in Machine Learning globally are in China
28
7
273
Indian devs getting angry about AI regulation is kinda funny to me 🤣
There are >50K downloads/mo across ALL Indian language models put together: OpenHaathi, Telugu, Kannada & Tamil Llama token expansion LoRAs
No one is even using Indic AI 🤖
Bhailog thoda kuch ship karein?
21
12
263
Banger.
The Employee Provident Fund of India has been hacked by our friend China — and of course EPFO never knew because of the "7 ft high walls" perhaps.
13
41
258
The good thing about Devin is that it can work 168 hrs/week and not just 70 hrs/week like Infosys employees
10
11
249
1/ As vector databases continue raising funds, let's reevaluate the landscape.
Scale is important, but FAISS did billion-vectors in 2017.
What do we use them for? Private Search Engines
They have vast applications across text, images and audio.
15
19
242
This is what Urban Planning done well looks like:
1. 3 well maintained lakes
2. Indian Music Experience
3. Good hospitals, schools, food, coffee: Third Wave, Brahmin's, Dakshin Cafe
All at walking distance
Yes, this is Bengaluru
50
5
230
The problem with this is that I'll not be able to tell what's a hallucination from a human, and what's from a LLM
Introducing
@SadhguruJV
AI
• Contains Sadhguru’s entire (3K+ videos, 1K+ articles) knowledge base
• Rarely hallucinates
• Works well in production
Built using
@embedchain
22
19
162
16
4
235
my fucked up brain is thinking about a girl I knew almost 15 years ago who was a big Atif Aslam fan instead of fixing this FastAPI asyncio bug
faaaak
17
2
228
Unpopular Opinion:
The worst product that people love is not Linkedin, it's Notion
27
5
226
More evidence for my net short position on Indians in India. Lost generation. Beyond point of no return.
Love Bangalore / India, but I have learnt more in last 3 days in Bay Area than I could in a month back home.
Spent 2 months just to try to register a co in India & it’s still not done.
Problem - solution feedback loop from potential customers, Investors & even fellow…
570
292
2K
25
14
222
@adadithya
That is okay: An entire generation is doing jobs that shouldn't have existed to begin with
5
5
216
Why you should never use pgvector (e.g.
@supabase
Vector Store) for production:
😮 pgvector is 20x slower than a decent vector DB (e.g.
@qdrant_engine
)
🤯 And it's a full 18% worse in finding relevant docs for you
And this can happen at as little as 10K documents when chunked!
33
30
217
Engineers working for Desi startups when they could've left for US via MS route
When you look at the positive side of everything and forget about the sinking ship
9
35
221
17
8
210
SDE-3 or higher at Amazon/Google make 80+ LPA cash, before taxes and excluding stocks
I think that's a useful benchmark for the ambitious
10
3
184
There are at least 5 companies which pay $120K or 1 crore INR per annum in Software Engineer III or SDE-3 in India
With the highest cash being Udaan — $97K
17
7
180
Unpopular Opinion: BLR or even India doesn't have enough nerd density for SF Commons to happen or work long term
Look at the graveyard of hackathon and tech community organisers
nerds: curious about tech for the sake of tech, not just paisa and solving a problem/craft
19
8
177
@darpan310
That is amazing no? Would indicate that the abstractions are robust and you can do pretty decent engineering without building expertise in the underlying concepts.
Because if that's the bar, I don't think anyone of us can make a chip from sand? And not many can make a new DB?
5
3
178
Almost as hard as getting my first job for me tbh, easier than college elimination exams though:
Lost 16.9 kg in 366 days
22
1
178
Google Photos resurfaced one of my few good memories from college —
Everyone except me in that photo now lives & works in North America and has a family there
4
2
176
Typed out Career notes for a friend, sharing here:
The universe rewards a specific wish, and punishes a vague desire.
You can improve your odds of success of by beginning with something which appears narrow/small & growing
Big and successful today? Has too much entry barriers
3
21
173
Time for BLR startups to accept leave applications with "lack of motivation due to cuddle weather"
5
7
170
Investors & Journalists often ask if there are teams in India making LLMs. That's missing the point tbh.
The more worrying fact is that we're not even making world-class tools to interact with LLMs:
Orchestration: Langchain
Store: Qdrant
UX: Gradio
Modelstore: Huggingface
14
13
166
.
@C_P_Gurnani
sir since you accepted the challenge, this aligns with your goals:
Requesting you to build and enable:
- Compute cluster 1/5 of this size
- In the next 3-6 months and get it up
- Cheaper than Cloud/Serverless
Very doable:
- Just 500 H100
- 1-2 Tbps network
-…
10
19
163
Announcing the GenerativeAI Makers meetup:
⏰ 24th June, Saturday
📍Bellandur, Bengaluru
🎙️
@zerodhaonline
CTO Kailash Nadh
@amodm
, via Flipkart, Udaan
Moderated by Game Dev
@charu_tak
What questions do you have for them?
Please RT for Karma
9
45
163
Since too many people have asked me India's AI startups that I keep an eye on, here is the list in no particular order:
Dashtoon — PocketFM for Comics
Segmind — Model compression, distillation
E2E — GPU Cloud for India
Sarvam — Indic LLMs+RAG
PortkeyAI — LLM Gateway
Add more?
8
7
164
I hate when people ask questions on twitter just to get engagement.
What are some of the worst examples you’ve seen?
42
1
162
I've averaged about 20 LPA before taxes over the last few years.
But I've also done years where I made 33 LPA
I've taken salary cuts almost every year
I've also done a few odd jobs which I don't talk about on Twitter which have made me a few tens of lakhs in the last 1-2 years
4
0
154
why 50+ LPA? the simpler solution is to get a 1cr+ job out straight out of college — can get to 10 cr in 10 years for sure that way
50+ LPA package straight out of college can result in Rs 10-20 Cr net worth in 10 years (promotions, investments, etc).
many "unicorn" founders don't have this much liquid net worth (and 99% founders don't even reach this stage).
Starting up is not the only way to make it.
94
73
2K
10
2
152
@chandrarsrikant
Giving the credibility of mainstream press like Moneycontrol to scams is a reputation risk for you and them
Please consider speaking to ML/GenAI practitioners in the industry Chandra
Here is a list of folks who I know to be good & their Linkedin
2
14
145
@mryalamanchi
Ask and you shall be given
"Answer as Lord Krishna from Bhagavad Gita"
using
@CohereAI
's latest zero-shot model
For certain tasks, where you are sure data is already in the training set, like Gita or Bibble, you don't need to do all the embedding work. You can handle it through carefully crafted prompts
7
13
134
2
10
145
"Delved" into a 30 yo today
Folks who're >40 years old:
What would you do differently if you were 30 years old today?
Can skip investing and "go to gym" advice 🙈
85
1
146
My controversial opinions continues to remain that Ola/Uber have done more for the country than ~most philanthropic initiatives
If you want a lesson on perseverance and patience in building, Zoho will feature as a model organisation to learn from.
Oh, and their philanthropic intiatives are admirable, to say the least.
1
0
14
12
7
136
Had a blast speaking at AI4Bharat / IIT Madras!
Staying true to my brand, I plugged two amazing solutions from friends: by Dev (BLR) and KissanAI by Dr. Pratik Desai (SF)
Thank you Dr. Pratyush, Dr. Vivek for giving me the opportunity! 🙏
6
6
133
If you or anyone you know is able to get an alcohol license in BLR.
Please ping me, I'll invest!
It has a very high entry barrier and I like those businesses
10
4
133
Only people new to NLP/search believe that ChatGPT can replace Google search
10
5
134
@manasjsaloi
I'd retweet this, but worried it might be like oxygen during COVID years — half the Indians who need it, won't get it
9
0
126
Kailash Nadh blogs about the impact of GPT4 on organisational efficiency
2
11
128
The amazing
#GenerativeAlHack
in Numbers:
🧑🤝🧑 90+ hackers on Day 1, 150+ folks at Demo day
⚡️ 43 submissions, 32 in-person, 11 remote from 6 cities
🙏 13 sponsors from 3 countries, 2 COSS: Weaviate, AppSmith
🤗 20% raised from communities
💰 5 Lakh INR in Prizes
12
11
129
How can you always keep your answers fresh and automatically updated?
Tutorial Colab Notebook here w/ Detailed Diagrams:
Built with (
@CohereAI
+
@OpenAI
+
@qdrant_engine
) using
@llama_index
Live in Albus now!
@CohereAI
+
@OpenAI
- two of the top AI companies powering Q&A across Slack, Notion, Jira, Google Drive,
h/t
@jerryjliu0
@ravithejads
@NirantK
DM for a demo
0
7
26
2
31
129
Best earbuds below 10K INR?
- Audio quality for work calls
- Music: White noise, ambient and bass not important
- Preferably something I can wear while walking
Please RT for Karma too? And like the ones in replies which you endorse!
84
13
127
Folks who can finetune a LLM (vision or text), and have some business relationships — can make $10K for about 120-200 hrs/mo of work
I cannot in good conscience refer the best engineers to a founder offering to pay $4K/mo 🙏
7
2
123
100% of work culture boils down to gross margins xD
90% of building a great work culture comes down to two things:
1. Paying people well
2. Acknowledging that employees have a life outside of work
That's it. Everything else is noise, or not worth the effort.
36
86
715
8
9
119
Can I legally share my Aadhar with an American company i.e. Linkedin, owned by Microsoft?
I vaguely recall that sharing Aadhar with non-Indian entities was illegal?
29
5
115
Startups are better for society, but bad for individuals.
Startups are the mechanism through which society rewards nothing but glory in return for youth. It's how society throws it's youth into the fodder for growth.
What's your opinion on startups that will put you in this situation?
9
1
11
10
5
114
@noheeriye
@FilmHistoryPic
@Meg_Srinivas
I was 5 in '99 Heer. My definition of hot was what burnt the skin in the kitchen (well, that's true again now!)
I still stand by that Deepika in her early 30s was the epitome of youthful grace
She could look at the camera and steal every shot!
#DeepikaForever
7
0
105
Always amusing when Indians patch problems instead of just accepting that our youth are disposable if they don't create "value" or have "impact"
Send them to war. Prepare 4 years for JEE & then 4 years LC grind. And then humiliate them if they can't talk to opposite gender.
#WATCH
| Spring-loaded fans installed in all hostels and paying guest (PG) accommodations of Kota to decrease suicide cases among students, (17.08)
1K
767
3K
7
7
110
Bengaluru climate calendar
Jan: Wow, but windy
Feb: Wow
March: Wow
April: Can manage
May: Getting warm, innit?
June: Funding announcements
July: Wow
Aug: Wow. Why is everyone abroad?
Sep: Appraisal, Traffic Jam
Oct: Appraisal
Nov: Wow
Dec: Americans on leave! Wow
Mumbai climate calendar
Jan: Wow
Feb: Wow
March: Ok
April: Can manage
May: Hai Garmi
June: Rim jhim barsa pani
July: SAILAAB
Aug: Pot-holes
Sep: Ganpati Bappa Morya!
Oct: Pollution
Nov: Pollution
Dec: Who cares? Let's party!
1
7
49
6
8
108
I love how SF has so much marketing attention that there is a perfect, polished video of the 19th WhatsApp engineer — while Flipkart, Swiggy, PayTm engineers are largely forgotten unless they become "successful founders"
5
8
109
GPT3 and Stable Diffusion nerds of Bengaluru — thanks to everyone who showed up, it was a blast to find people talking about Langchain, Dreambooth and everything in between!
Will send out a list of papers and ideas discussed in the coming week
Thanks to
@HasuraHQ
for hosting us
10
4
111
Too old for 30 under 30
Too young for being a "visionary"
Born just in time to `from langchain.llms import OpenAI` and call it a day
4
4
109
Recession-Proofing Your Tech Career in India 🇮🇳 🛡️
1️⃣ I first wrote this in 2019, and this has helped me do well without a steady cashflow since October 2022 on my sabbatical
7
7
108
Based founder
@vipulved
moved from India to US via OSS work in early 2000s, used in 20% email spam filtering 🤯
Built & sold a business to Apple — Led Search/ML there 🙇🏾♂️
Now building
@togethercompute
6
4
110
This is the photo anyone interviewing me for press should use in near future. This is the most formal I can get.
PS: I can't even make this expression in real life. I don't even have a blue suit. This is StableDiffusion.
10
5
109
Absolute master class on prompting, action-agents, when to use and when not to, the math basics (with simple-notation equations!) — even I discovered a small trick wrt RAG and I do this for a living!
Strong recommend!
1
8
108
6 Quick tips on doing RAG better:
1. Retrieval and ranking matter quite a lot:
1a) Chunking: Including section title in your chunks improves that, so does keywords from the documents
1b) Different token-efficient separators in your chunks e.g. ### is a single token in GPT
2
7
105
Deleted all dating apps. Decided to try to meet someone the old-fashioned way: being asked to join as an AI lead at her latest startup pivoting from crypto to AI
13
0
105
Please go work for Amazon. That fintech will hire you in 4-5 years at a much higher compensation. Amazon cash and stock will adjust upwards again over 4-5 years to match P/FCF
Protip: If you can, work for AWS within Amazon.
2
0
106
While crossing the road on a red signal in HSR, a Red Scorpio bumped into my leg — I saw the number plate, it was HR 26 — so I apologised to the car for injuring it and lived to tell this tale.
Saw a black Scorpio with a HR number (yes a Scorpio) giving indicator to change lanes in Gurgaon. Felt like a Black Mirror episode. Still shaken 👁️🗨️😰
72
78
2K
6
1
105
Recession-Proofing Your Tech Career in India 🇮🇳 🛡️
1️⃣ I first wrote this in 2019, and this has helped me do well without a steady cashflow since October 2022 on my sabbatical
2
16
103
@protosphinx
Bangalore International Centre is funded almost entirely by Nilekani and Murthy
That has hosted Nobel laureates, multiple cultural & business lighthouses
Infosys & Premji foundations do more in 2-3 year than Ambanis have done in 3 generations
5
2
102
I've been tinkering in AI since 2015 as an engineer across a few startups
India's best early stage investor in AI is perhaps
@ycombinator
5
2
101
The current
#3
model on
@huggingface
Open LLM Leaderboard is not from Google, OpenAI, Stanford or Meta, but anon who is also a member of the "waifu-training-department"
3 out of Top 6 are indie anon LoRAs!
Absolutely massive win for the spirit of FOSS!
2
11
100
ML which is put to solve problems is about two main skillsets:
1. How to trade off latency, throughput, and cost against each other?
2. How to measure what is good?
The rest is just do — yes, even after OpenAI's GPT4 that is the best there is
3
10
99