Anna Huang
@huangcza
Followers
4,526
Following
1,441
Media
7
Statuses
364
Faculty @MIT starting Fall 2024, Research Sc. @GoogleDeepMind #magenta , Canada CIFAR AI Chair @Mila_Quebec . Prev. ML,HCI,music composition @Harvard , @medialab ,USC
Montréal, Canada
Joined April 2013
Don't wanna be here?
Send us removal request.
Explore trending content on Musk Viewer
Davido
• 463920 Tweets
Baba
• 114630 Tweets
Valencia
• 78158 Tweets
Abeg
• 74030 Tweets
Peruzzi
• 70346 Tweets
Nancy
• 62348 Tweets
Wetin
• 55724 Tweets
Madonna
• 55339 Tweets
Pant
• 53252 Tweets
Francis
• 51741 Tweets
Lewandowski
• 47598 Tweets
Idolo
• 46389 Tweets
Araujo
• 45231 Tweets
Rock in Rio
• 44959 Tweets
Burna
• 43844 Tweets
Seinfeld
• 39619 Tweets
Jesus is King
• 36966 Tweets
Werey
• 34098 Tweets
Farouk
• 32277 Tweets
Fermín
• 29539 Tweets
Katy Tur
• 24979 Tweets
Grammy
• 24444 Tweets
オリンピック出場
• 21114 Tweets
Ter Stegen
• 19064 Tweets
Popsy
• 14724 Tweets
Wizzy
• 13721 Tweets
ANA CASTELA NO RIR
• 11152 Tweets
PRE SAVE FOI INTENSO
• 11140 Tweets
Pinned Tweet
Check out our new blog post on music transformer that generates minute-long pieces that I find myself listening to again! It also generates compelling harmonizations and realizes chord progressions.
Which is your favorite? Ours is the Jazz 🎷
👂
40
415
1K
I’m excited I’ll be joining MIT next fall, for a shared interdisciplinary faculty position between Music (
@MIT_MTA
@MIT_SHASS
) & EECS.
I’m recruiting PhD students
@MITEECS
for Fall 2024 (apply by Dec 15), and also Postdocs. See for details. Come join us!
53
80
802
Check out our new blog post on Coconet 🥥, the
#ml
behind the Bach Doodle that’s live now! It’s a flexible infilling model that generates counterpoint through rewriting.
@koning_robot
,
@notwaldorf
,
@ada_rob
,
@fjord41
,
@AaronCourville
,
@douglas_eck
13
165
389
Remember the
#BachDoodle
? We’re excited to release paper on Behind-the-Scenes design,
#ML
, scaling it up, and dataset of 21.6M melodies from around the world!
📜
w/
@fjord41
@ada_rob
@notwaldorf
@bengiswex
Leon Hong
@jaxcooo
5
134
369
Very honored to be a Canada CIFAR AI Chair, and also an adjunct prof
@UMontreal
!
I am recruiting postdocs+students+interns through
@Mila_Quebec
.
If you’re passionate about creativity+music+art, HCI, and ML, see and be sure to apply by Feb 1st, 2022!
Composer turned ML researcher Cheng-Zhi Anna Huang
@huangcza
(
@Mila_Quebec
,
@GoogleAI
) takes a human-centered approach to ML & creativity, expanding artists' creative reach. Huang also helped create Google’s 1st AI Doodle, the “Bach Doodle”.
3
11
57
14
43
252
Passionate about creativity+music+art, HCI, and ML?
I’m still recruiting PhD and master students through
@Mila_Quebec
for Fall 2023.
See for more details and apply by Dec 1st!
2
34
175
Remember the
#aisongcontest
? Follow our
#ismir2020
paper backstage to learn about the challenges musicians face when songwriting with AI, and how we might design ML to better support musicians’ needs and workflows.
Blog post:
1
44
125
Come be my colleague! Two faculty openings
@MIT_MTA
shared
Assistant prof w/
@MITMechE
@MITEECS
(Jan 15)
Tenured Associate/Full prof w/
@MIT_SCC
(Jan 2)
We’re starting a new graduate program in music tech
@MIT
! Come join us!
I’m excited I’ll be joining MIT next fall, for a shared interdisciplinary faculty position between Music (
@MIT_MTA
@MIT_SHASS
) & EECS.
I’m recruiting PhD students
@MITEECS
for Fall 2024 (apply by Dec 15), and also Postdocs. See for details. Come join us!
53
80
802
0
13
76
Passionate about creativity+music+art, and designing delightful user experiences powered by ML?
We're hiring a Frontend/UX Engineer at Magenta!
3
24
72
Only one more week to vote at the
#aisongcontest
!
38 songs, 38 teams of musicians + ML researchers, 38 different approaches to ML as a creative tool. Which one is your jam?
Cast your vote by EOD Wednesday June 30th!
▶️
🥁 The songs of the
#aisongcontest
2021 are online NOW! Here you can hear and evaluate all of them:
1
24
48
1
15
41
Big thanks to blog post and paper coauthors
@iansimon
,
@notwaldorf
,
@ashVaswani
,
@kyosu
, Noam Shazeer,
@fjord41
,
@iamandrewdai
,
@matthoff
and
@deck
for all their contributions! Music Transformer paper at
2
2
33
The
#aisongcontest
is back! Register by 15 March. Submit by 1 June.
This year, we’ll have mentors to help teams get started!
🌱 To GET a mentor:
💜 To BE a mentor:
Details:
Be part of the AI Song Contest 2022! ➡️You can register your team until 15 March 🦾. If you are looking for team members - send us a message!
(In the picture you can see all the wonderful teams and cover art that brought the contest to life last year💜)
#aisongcontest
0
15
32
0
14
32
Only a few more days to vote at the
#aisongcontest
!
Check out this year’s entries to see how musicians + ml researchers are approaching human-ai co-creativity. Which one is your jam?
Cast your vote by Thursday June 30th!
▶️
The AI Song Contest is live! 🤖💜⚡️
Check out the 46 teams and the 15 finalists of the year's edition!
0
15
22
1
13
20
4/ We reduced the model download size to approximately 400KB through post-training weight quantization.
Fun fact: the weights of the TensorFlow.js model that powers this doodle are only ~400KB
The whole doodle JS module, including TensorFlow.js, is ~200KB on the homepage (lots of room for improvement here in the future).
6
72
475
1
0
11
3/ We sped up Coconet from 40s to 2s in
#TensorFlowJS
by using dilated depth-wise separable convolutions, which requires less layers and are more accelerated then conventional convolutions. Also by fusing ops that are used in every Gibbs steps (
@GreenBeanDou
).
2
0
11
2/ The model Coconet 🥥 is an instance of OrderlessNADE and uses Gibbs sampling to generate the harmonizations through rewriting.
📜 Previous blogpost:
📝 Paper from
#ISMIR
2017:
1
0
12
tl; dr
1/ In three days, people spent 350 years worth of time playing with the Bach Doodle, and the “harmonize” button was clicked more than 55 million times.
1
0
11
6/ As the model was trained on Bach Chorales, melodies outside of the soprano range is “out of distribution” and harder to harmonize.
See how Paul Davids discovers this at 6:22 via
@YouTube
1
0
9
5/ We calibrated a speed test based on partial model evaluation time to determine if the harmonization request should be performed locally using
#TensorFlowJS
or sent to remote
#TPU
servers.
@jaxcooo
was able to get a nearly 50/50 split!
1
1
9
8/ Checkout
@notwaldorf
’s amazing interactive visualizations to explore the 21.6M melodies, the dataset and also hear new harmonizations.
There were *21.6M* harmonizations submitted by people to the Bach Doodle!🙀
We are open sourcing this dataset along with a set of fun interactive visualizations to explore the data, discover some familiar top hits and even regional childhood songs! 🎵
📝
5
67
217
0
1
10
Excited about Montréal (Canada)👇 or the Bay Area (US)? Our Frontend/UX Engineer position at Magenta is open to both!
En:
Fr:
0
4
10
Mila is proud to welcome five new Canada CIFAR AI Chairs among its faculty. These world-class researchers will receive long-term funding to support their research activities.
0
6
42
0
1
8
Big thanks to paper coauthors Vincent Koops,
@ednewtonrex
,
@notwaldorf
and
@carryveggies
!
Huge thanks to
@Karen_vanDijk
at VPRO for organizing the
#aisongcontest
and supporting us throughout the process!
1
0
7
Special thanks to
@dadabots
,
@PortraitXO
, Sandra Uitdenbogerd,
@caroline_pegram
and
@_Uncanny_Valley
for letting us embed excerpts from their song entry as examples!
Deepest thanks to all teams in the
#aisongcontest
for their amazing and inspiring contributions!
2
0
6
7/ We found that parallel fifths and octaves were more common when user input was out of distribution, and fewer parallel fifths and octaves were correlated with positive user feedback.
1
0
6
Listen to the songs on soundcloud to see timeline annotations from teams explaining what they did.
#aisongcontest
The songs of the
#aisongcontest
all in one spot? 🤯 We made a playlist for you with many tracks of the contest on Soundcloud:
Listen and don't forget to vote for your favourite!
0
8
13
0
1
5
0
0
1
@psycheloui
@Harvard
@douglas_eck
Thank you Psyche for the shout-out!! And for going out of your way to be there for me!
0
0
1