Dan Roy
@roydanroy
Followers
45,312
Following
1,729
Media
954
Statuses
23,933
ML / AI researcher, emphasis on theory. Research Director and Canada CIFAR AI Chair, @VectorInst Professor, @UofT (Statistics/CS)
University of Toronto
Joined June 2009
Don't wanna be here?
Send us removal request.
Explore trending content on Musk Viewer
#พิมพ์กรกนก
• 92975 Tweets
Canucks
• 68833 Tweets
#呪術廻戦
• 47030 Tweets
राजीव गांधी
• 46347 Tweets
定額減税
• 34835 Tweets
オールスター
• 34421 Tweets
給与明細
• 29635 Tweets
梅雨入り
• 27165 Tweets
招待コード
• 25130 Tweets
Vancouver
• 22094 Tweets
#TercerGrado
• 21798 Tweets
ショートアニメ
• 21202 Tweets
#RajivGandhi
• 17788 Tweets
梅津さん
• 17726 Tweets
手紙110円
• 16546 Tweets
ZAGATKANDIAZ GalauerPRINCE
• 15844 Tweets
梅津秀行さん
• 15395 Tweets
BikinBAPER LevelMAKSIMAL
• 15247 Tweets
भारत रत्न
• 13983 Tweets
手紙84円
• 13615 Tweets
आधुनिक भारत
• 11779 Tweets
ザレイズ
• 11691 Tweets
値上げ了承
• 10585 Tweets
Someone's trying to scam my students into buying gift cards for "me". Unfortunately, they're too smart.
109
3K
18K
When you finish a PhD in computer science, they take you to a special room and explain that you must never use recursion in real life. Its only purpose is to make programming hard for undergrads.
When you finish a PhD in computer science, they take you to a special room and explain that you must never use recursion in real life. Its only purpose is to make programming hard for undergrads. 😂
23
101
905
32
468
6K
Dear International Students in the US, Does the US really deserve you?
80
345
5K
Got promoted with tenure at University of Toronto :-) Thankful to my brilliant students, collaborators, and mentors.
I can't think of a better place to have landed than Toronto. I took risks without existential fear and struck gold over and over with students in Stats and CS.
143
15
2K
Hey
@karpathy
. If you are interested in an change of scene and pace, we’re looking for someone to tutor our kids in Python on Thursdays 3:15-4:15pm.
24
31
1K
It's easy to reject papers. You can manufacture issues and sink them based on amorphous/vague notions such as novelty, impact, clarity, etc.
Every paper has minor problems that you can amplify. It takes a lot more courage to argue to accept something.
15
103
973
When you finish a PhD in computer science, they take you to a special room and explain that you must never use recursion in real life. Its only purpose is to make programming hard for undergrads. 😂
When you finish a PhD in computer science, they take you to a special room and explain that you must never use recursion in real life. Its only purpose is to make programming hard for undergrads. 😂
2
9
201
23
101
905
I am inspired by my wife, Dr Gintare Karolina Dziugaite (
@KDziugaite
) who JUST TODAY defended her thesis at Cambridge, and, not only completed her PhD research in four years, but also brought two wonderful children into this world. Who else could complete a PhD between naps?!
21
19
838
So... now that we are giving online talks that are recorded, maybe we can invite junior scholars rather than listen to senior researchers give the same talk for the 20th time.
15
73
825
Professional update:
I've been named Research Co-Director of the Vector Institute.
This is an exciting opportunity but also a big responsibility: Vector has grown tremendously since 2017, with now over 700 researchers.
One top priority: attracting next-gen top AI talent. 1/2
👏Exciting news!
@roydanroy
has been named the Vector Research Co-Director, leading the way in cutting-edge AI research along with current Research Director, Graham Taylor. Learn more about his appointment here:
13
7
198
85
16
813
What's the coolest/clearest application of graph neural networks?
57
97
789
For many years, I enjoyed working on problems no one else was thinking about. There was no rush to publish and I could slowly make my way towards the correct formalizations. Like hiking in the backcountry. Now I feel like I'm hiking Yosemite Falls Trail in August.
9
54
687
🎉🙏👏🎉🙏👏 Big life announcement. I’m excited to announce that I’ll be joining the effort for XAI starting September 2023. I’m eager to seek the truth and uncover the true nature of the universe. More info to come.
27
7
672
Congrats to these scientists. Great that it’s coming from India and not the US.
6
128
657
If you write a paper about X because you read Y, give some love to Y. Don't bury that fact in some bullshit literature review. You might think we're competing but we're not.
6
50
659
A theoretical computer scientist was being seriously considered for a prestigious math prize, when a mathematician on the committee asked whether the work was really mathematics. A very well-known mathematical physicist interrupted, "their theorems are just as useless as yours!"
11
79
633
Einstein slept 12 hours a day, played video games for 4 hours a day, regularly procrastinated on Twitter for 3 hours a day, and sat on Zoom for 5 hours a day.
17
19
596
Just got word that a journal article has been accepted. Not usually something I would tweet, but this one is special, because I submitted it on Dec 15, 2011.
10
28
599
This caught my attention, as someone who is interested in decision theory, online learning, and statistical learning.
3
104
557
135 papers submitted, a record! Congratulations to me. Thanks in advance to all of you who will be reviewing these during your summer. Many are just undergrad ML course projects that I was too embarrassed to kill earlier. Sorry not sorry 🙇🤦♂️🪺
20
30
553
If you’ve been affected by Trump’s announcement, and you work in ML theory, consider sending a PostDoc application my way.
4
81
530
Dear ICML author,
Had a good paper rejected? Reconsider submitting it to NeurIPS. The NeurIPS/ICML/etc review system is more wasteful than bitcoin.
What should you do with your work?
Submit your work to TMLR. The community is better at judging impact.
Regards,
Yours Truly
11
32
515
Just had a paper rejected by two workshops. First time that’s happened. ;)
I guess we must really be onto something!!
14
14
514
Claim: Splitting a paper into TeX files for each section is a mistake, needlessly complicating, among other things, search (and replace).
Convince me otherwise. (Unless you use Dropbox for version control, because then I don't care about your opinion. ;)
84
12
469
Saw this beauty in Cambridge, UK. When I looked closer, I thought, only in Cambridge.
7
70
458
I'll believe this when all the grad students around me stop using PyTorch.
11
34
460
I'm happy to report that 25 of my 59 submissions to NeurIPS were accepted! ALL YOUR BASE ARE BELONG TO US U LOSERS WHO SUBMITTED << 59 PAPERS!
16
11
436
Switching to working on deep learning is like buying a Porsche.
29
18
431
New book on probabilistic programming on arXiv. I’m sure the authors
@hyang144
@jwvdm
@frankdonaldwood
will welcome feedback.
5
149
420
Tell me you don’t understand Monte Carlo variance without telling me you don’t understand Monte Carlo variance.
BREAKING: The Rubik’s cube world record has been broken at 3.13 seconds 🎉🤯
5K
53K
383K
30
36
418
Oh my god. Watch this guy who thinks he's doing something good with AI.
Megvii spokesperson discuss their views on how facial recognition technology will change China
25
91
225
22
96
417
If this isn’t a reason to put your papers online (like on arXiv) and not rely on gatekeepers like Nature, and I don’t know what is.
9
62
402
I'm launching a new Twitter service.
You tweet me the name of a paper you're going to cite and for what reason, and I'll respond with a better paper to cite, if one exists.
36
18
396
Yikes. I'm holding my breath.
13
29
373
Dear
@JustinTrudeau
@VectorInst
@MILAMontreal
@CIFAR_News
,
How can Canada lead in AI if we cannot even process visas for top AI researchers gives MONTHS of advance warning?
Please RT.
10
115
373
No no no no no no no no no.
Thankfully, this advise was ignored by the authors. But this wide spread but unspoken belief is why NeurIPS/ICML/ICLR reviewing for empirical papers is totally broken.
26
26
379
My new approach to seminar invites in the time of zoom: I've been co-presenting with students. No extra costs (because zoom) and students get opportunity to talk at fantastic institutions. Two down, hopefully many more like this to go! I recommend sharing the love.
4
31
373
I asked Toronto students how much compute they thought the average NeurIPS author used per paper and 25% of them thought it was over six GPU years. One of them thought it was 800 GPU years. Really not sure what to make of this (The real number is 1 week before the deadline)
12
8
375
I will not be accepting AC roles going forward. They are a waste of my time. They are a waste of the field's time. In fact, conferences proceedings should be drop kicked in favor of some new system. Typical review quality is so poor, we are now a cargo cult.
24
50
366
I'm excited to announce that I moving to Twitter to take over the Engagement team. I'd like to thank all my collaborators for making this possible. My first step will be to introduce the Edit button.
13
2
364
Applying for a faculty position? Turn on google scholar. Don't have a website? Get one. Seriously, people, it's 2017.
14
93
361
ACM: We’d like to congratulate the three fathers of deep learning...
Schmidhuber: Hold my bier.
1
34
357
You’re not going to be hearing about ICML from me. The world is too messed up right now.
#BlackLivesMatter
1
13
354
I think it's a mistake for the US not to think about accelerating global vaccination. Variants created by out of control spread are going to come back to haunt all of us.
14
20
345
Raise your hand if you’re barely keeping your shit together this term. 🖐
26
8
350
It’s an honor to be named a Canada CIFAR AI Chair and to be part of a rapidly growing ecosystem centered around AI here in Canada. Whether you’re an up and coming AI researcher, or a hard working high schooler, you should set your sights on Canada.
As part of the Pan-Canadian AI Strategy, we are announcing an expansion of the Canada CIFAR AI Chairs program, bringing the total number of chairs to 46, from 29 announced last December.
Meet Canada’s AI leaders:
#CIFARAI
2
32
100
33
20
342
The real problem with writing papers with more than 1 idea is that no one reads past the 1st idea and then you have to keep telling people... "no, we did that already, have you read section 5 or appendix J?".
15
23
332
Poster session? That’s not a poster session. THIS is a poster session.
6
17
333
It's time for arXiv to allow anonymous submission (anonymous to arXiv too), but allow the owner to claim ownership at future date (crypto).
15
100
320
WILL ML CONFERENCES PLEASE STOP FORCING US TO PUT THE APPENDICES IN ANOTHER FILE.
10
11
311
I remember reading this paper when it first showed up an arXiv. (Was called l'arXiv back then.) Phenomenal work. I immediately recognized its importance and began working on its application to selling ads.
Oldies but goldies: Joseph Fourier, Théorie analytique de la chaleur, 1822. Introduces sines and cosines series as an approximation method and derived the heat equation PDE.
5
94
370
7
22
301
My wife beat me to receiving a 10 score at ICLR. I didn't even know those existed.
7
2
297
My ICLR reviewers just responded to my rebuttal and they agree totally and love my revisions 8 8 8 and I won a billions dollars and why yes I would like a unicorn!!
6
7
296
We're way beyond the point that attending a single NeurIPS/ICML/etc is more costly than an Oculus/HoloLens + high speed fiber internet. I'd love to see a VR/AR conference for ML. Imagine the savings in time, pollution, etc.
16
36
288
A new undergrad AI club is asking me for paper recommendations for their journal club. Help me give them a semesters worth of ideas by responding to this message.
47
32
292
Just arrived in Addis Ababa, a few days early! Looking forward to
#ICLR2020
!!! Anyone else around?
14
7
293
Your SOTA code may only be SOTA for some random seeds. Nonsense or new reality? I suppose there are trivial ways to close the gap using restarts and validation data.
21
54
290
I need a list of reputable venues for ML researcher. Anyone have one? Clearly it should have NeurIPS/ICML/ICRL/CVPR. Where I'm missing familiarity are journals I've never heard of and subfield conferences and journals.
51
23
289
I’m delighted to announce the delightful news that I can announce my delight and excitement at announcing delight and did I mention delight and wow NeurIPS OOH YEAH D-LIGHT!
7
6
292
Can anyone verify that ChatGPT wasn't trained on the exam it is taking here or in any of the 20 papers on similar topics? And how would you prove this to me?
Capabilities of GPT-4 on Medical Challenge Problems
GPT-4, without any specialized prompt crafting, exceeds the passing score on USMLE by over 20 points and outperforms domain-expert models like Med-PaLM.
2
31
143
28
18
282
Before you go work with some professor, ask yourself: do they just promote themself? or do they also work for their students? Looking at someone's website is a pretty good tell.
8
18
284
Turned down AC chair invite for NeurIPS. With no child care, and no vaccines until June, I need a break.
3
2
283
Here's what success means for my postdocs.
You join my group. Borrow my resources. You start something, either by spinning off something going on or maybe doing something brand new. You get a job and THEN YOU TAKE WHAT YOU CREATED WITH YOU.
Don't accept a postdoc otherwise.
5
14
276
I feel that reviewers who suggest more experiments ought to explain what we might learn from... more experiments. What hypothesis are they testing? As far as I can tell, none.
We seem to be suffering as a community from not teaching our students how to do empirical work.
10
22
271
There needs to be some way to show solidarity with the protesters in Iran. But how?
40
51
269
I'm seeing lots of announcements about people moving from tech ML positions into academic positions. Is the rate of this actually increasing?
31
17
271
@jen_keesmaat
@A_Aspuru_Guzik
Disagree strongly. Many people were prepared and had masks well in advance. Very sensible to wear a mask, like everyone is doing in large cities in much of Asia. Hoarding them for profit quite different. Ultimately, this is a government failure.
1
13
259
Apparently even deep learning summer schools are hyper-competitive now.
12
5
266
This is a gem footnote:
^. Due to the page limit, we omit the proofs of all the theorems.
Why didn't someone tell me that I could do this!?
13
22
267
Happy news for me. A journal paper that's been under review since, essentially, January 2016, has finally been accepted, and just in time for that former student (now Berkeley postdoc) to go on the market! Just sharing my joy now. Details in a week or a so.
5
1
262
What? No.
7
24
259
If you need a good reason not to let one company control AI, simply try to have a conversation with, say, ChatGPT about any topic that's touchy.
11
24
252
On my Iranian grad student's access to
@github
was just blocked. Who can help us fast track this fix. They are in Canada!
13
20
249
My two-part tutorial on "Bayesian learning" from the Logic and Learning FoPSS Summer School is now on Youtube. Check them out. (1) (2) (slides) (workshop)
4
45
248
Proud Toronto advisor moment: my first student,
@victorveitch
, has just accepted his first tenure track position. 🎉 Here’s to a long and successful career, including many academic grandchildren. 😊🥂
Though it's an odd moment for good news, I'm incredibly excited that
1. I'm joining the University of Chicago as an assistant professor of stats/data science on January 1st, and
2. I'll be joining Google as a research scientist until then
30
8
543
3
2
252
My advisor at MIT was Leslie Kaelbling and she encouraged me explore and ask big questions. She was a fantastic sounding board. Grad school was such a great time and a lot of credit goes to Leslie.
4
6
248
I just want to say that the arXiv is amazing and to think that a huge part of it is run by volunteer moderators is inspiring. Here they are:
4
21
243
This just crossed my desk and seems quite interesting
5
27
245
2010: Nonconvex/Deep learning is [wrong].
2022: Thank you for inviting me to deliver this keynote on deep learning.
Funny how we forget how outspoken some people were. All of them saved by some grad students.
9
6
245
Yesterday, I announced that I was moving to Twitter. Apparently, Jack forgot to sign my contract, and the new CEO doesn't like my Edit button ideas, and so I'm going to stay a professor and pick up crocheting.
16
3
243
TLDR: One must be careful with how you lay out your tea leaves before adding hot water and reading them.
Mine and
@GCLinderman
's comment to the Becht et al. 2018 (
@EtienneBecht
) paper has finally appeared in
@NatureBiotech
after over a year of editorial considerations.
There is no response from the authors, so I assume we are all in agreement :-)
11
157
648
2
22
242
Wait a minute. Was I not meant to upload Imagenet as a supplementary file???
5
10
234
This observation is one reason to argue for replacing (or augmenting) best paper awards with multiple Test of Time Awards for 1, 2, 4, 8, 16, 32 years back.
Today 6 years ago, "Attention is All You Need" went on Arxiv! Happy birthday Transformer! 🎂
Fun facts:
- Transformer did not invent attention, but pushed it to the extreme. The first attention paper was published 3 years prior (2014) and had an unassuming title: "Neural Machine
81
995
5K
7
9
235