Gene Kogan Profile Banner
Gene Kogan Profile
Gene Kogan

@genekogan

Followers
26,537
Following
778
Media
905
Statuses
5,098
Explore trending content on Musk Viewer
@genekogan
Gene Kogan
3 years
stylegan3 training on landscapes
186
6K
35K
@genekogan
Gene Kogan
2 years
W.I.P. collage tool for stable diffusion
110
1K
5K
@genekogan
Gene Kogan
7 years
just in case you were wondering, this is what happens when you repeatedly run FaceApp’s smile filter until it can't detect a face anymore
111
1K
3K
@genekogan
Gene Kogan
3 years
Text-to-image with OpenAI's CLIP is getting more and more surreal. Here is "A banquet hall"
Tweet media one
Tweet media two
28
380
2K
@genekogan
Gene Kogan
6 years
NVIDIA's new vid2vid is the first open-source code that lets you fake anybody's face convincingly from one source video. prior "face2face" stuff was either cartoonish or proprietary. interesting times ahead...
35
965
2K
@genekogan
Gene Kogan
6 months
OpenAI's new seed saving feature is really impressive.
Tweet media one
Tweet media two
Tweet media three
Tweet media four
38
51
1K
@genekogan
Gene Kogan
6 years
very cool demo of adjusting attributes of natural scenes interactively (season, time of day, sunlight/cloudiness). code said to be coming soon. this is the photoshop of the future
13
460
1K
@genekogan
Gene Kogan
5 years
The new StyleGAN code is super neat. You can cross-breed latent vectors to get a sort of style transfer effect.
9
276
1K
@genekogan
Gene Kogan
6 years
texture synthesis infinite loop, based on The Great Wave off Kanagawa (Hokusai, ~1830)
13
270
968
@genekogan
Gene Kogan
2 years
The best thing about making generative art for a living is that sometimes buggy code works better than good code.
23
86
956
@genekogan
Gene Kogan
6 years
progressively-grown GAN (Karras et al) trained on ~80,000 paintings
12
217
945
@genekogan
Gene Kogan
5 years
imitating videos with BigGAN: first predict Y from the source, then feed it to the generator. input here is the trailer for Planet Earth
16
214
902
@genekogan
Gene Kogan
3 years
the future of AI-generated video game stock characters looks fine
23
152
807
@genekogan
Gene Kogan
7 years
groovy! i figured out how to loop dreams. watch carefully... this video is only 3 seconds long ♻
9
173
800
@genekogan
Gene Kogan
3 years
Looping text-to-image of "A drawing in the style of M.C. Escher"
8
129
726
@genekogan
Gene Kogan
6 years
upgrading meat puppet to HD. as soon as i can get a good voice model, i’m going to make a parallel state of the union address
14
137
696
@genekogan
Gene Kogan
5 years
Successfully replicated NVIDIA's 512x512 labels-to-landscapes model (GauGAN) for use with SPADE. The model can be downloaded from  It will also be available on @runwayml shortly. Here it is in action!
8
134
577
@genekogan
Gene Kogan
7 years
my new meat puppet. running #pix2pix live on a webcam
14
185
532
@genekogan
Gene Kogan
7 years
you can now visualize layers & classify images ~60fps w/ ofxDarknet. real-time feature extraction in @openframeworks
4
205
532
@genekogan
Gene Kogan
6 years
portrait generator beginning to wake up
8
134
522
@genekogan
Gene Kogan
6 years
walking the latent space along b-splines instead of linear interpolations (zig-zagging). the effect is subtle, but it rounds the corners a bit smoother
10
73
499
@genekogan
Gene Kogan
7 years
CycleGAN "failure cases" are as interesting as the successes. ML papers need more blooper sections
Tweet media one
11
237
490
@genekogan
Gene Kogan
8 months
8 years ago today, I posted this style transfer experiment of a scene in Alice in Wonderland () It was my first "generative AI" (although no one called it that at the time) work to go viral, getting 100k views in a few days. It convinced me to focus on…
18
54
488
@genekogan
Gene Kogan
3 years
Converting CryptoPunks into their real-life counterparts.
Tweet media one
Tweet media two
19
48
482
@genekogan
Gene Kogan
5 years
The Neural Aesthetic is finished! Notes and around 30 hours of video lectures are up here: A big map of all the slides can be browsed here:
Tweet media one
7
119
470
@genekogan
Gene Kogan
3 years
Sometimes if I want advice about something, I start drafting a long message to someone about it. Writing it down forces me to think so clearly that I end up answering my own question, and never end up sending it. The lesson is: write! Writing is an upgraded version of thinking.
12
37
457
@genekogan
Gene Kogan
4 years
This cartoonization code makes basically anything look like anime
19
80
460
@genekogan
Gene Kogan
6 years
if you think AI hype is bad today, read this take from the NY Times in 1958 after perceptrons were invented
Tweet media one
10
137
441
@genekogan
Gene Kogan
6 years
neat! an open-source clone of SimCity 2000. i loved this game as a kid. once the simulation is implemented, will be a great playground for RL agents
Tweet media one
9
166
433
@genekogan
Gene Kogan
1 year
DALL-E = Windows Midjourney = Mac Stable Diffusion = Linux
4
59
436
@genekogan
Gene Kogan
6 years
nice of NVIDIA to open-source the models for their progressive GANs. it's a treasure trove
5
115
431
@genekogan
Gene Kogan
6 years
Kandinsky texture synthesis infinite zoom
6
101
425
@genekogan
Gene Kogan
7 years
really excited to have DarkNet in @openframeworks . here's dense-captioning at 2fps on my laptop. lots of potential
@schwittlick_
Marcel Schwittlick
7 years
ofxDarknet: realtime gpu accelerated neural networks in oF. /w help by @genekogan and @bildpeter @ofxaddons
Tweet media one
6
74
239
5
148
433
@genekogan
Gene Kogan
5 years
working on an "aging mirror" that fast-forwards you ~10-20 years into the future. works in reverse as well! (nice cameo by @sam_hains )
10
60
420
@genekogan
Gene Kogan
4 years
StyleGAN was already pretty good at faces. The improvements in v2 are really visible in the other classes #StyleGAN2
2
69
407
@genekogan
Gene Kogan
6 years
not every day you get to see your work up on a never-ending LED screen. thanks @digilogue_ for inviting me to Istanbul
7
36
407
@genekogan
Gene Kogan
3 years
Flower scroll. The pan is is probably a bit too quick.
14
35
405
@genekogan
Gene Kogan
6 years
looks like i found the meme vector
5
112
390
@genekogan
Gene Kogan
5 years
If you're disillusioned with Siraj and looking for video channels with high-quality, accessible & authentic AI coverage, I would go to @karoly_zsolnai 's "Two Minute Papers" and @xsteenbrugge 's "Arxiv Insights"
12
49
383
@genekogan
Gene Kogan
6 years
student projects at my workshops get more and more sophisticated every year. this week at @ecal_ch , Nathan Vogel wrote a firefox extension which intercepts OpenStreetMap tiles in realtime, sends them to CycleGAN to be turned old-time style, then re-injects them back into the page
7
51
383
@genekogan
Gene Kogan
6 years
How neural networks are trained: @ml4a_ 's longest & most advanced chapter, from linear regression to backprop, is finally drafted. feedback & proofreading is welcome
Tweet media one
Tweet media two
Tweet media three
Tweet media four
5
123
370
@genekogan
Gene Kogan
6 years
1/ New essay: an excavation of the history of mathematics, from deep learning down
5
151
364
@genekogan
Gene Kogan
7 years
some more neural synthesis/deepdream experiments... masks for new channels radiating outward from the center
8
77
367
@genekogan
Gene Kogan
5 years
demo notebook in colab for stringing together interpolations from the newly released #BigGAN models. have fun :)
3
92
365
@genekogan
Gene Kogan
6 years
hi-res texture synthesis, i.e. contentless style transfer. here is one based on Kandinsky's Composition 8 (1600x1260 version at )
Tweet media one
6
51
355
@genekogan
Gene Kogan
5 years
Training a sketch-to-satellite model with SPADE. It generates satellite imagery of Berlin from hand-drawn maps
10
78
347
@genekogan
Gene Kogan
7 years
adversarial generation of 3d point clouds from Achlioptas et al. very nice latent space. seems like 3d is on its way
Tweet media one
4
132
341
@genekogan
Gene Kogan
3 years
I'm very excited to share my first NFT on @withFND , now freshly minted.🌿 This is one of my personal favorite works. ❤️ #NFT #nftart #Cryptoart
30
36
337
@genekogan
Gene Kogan
5 years
I mixed up the golden rule and golden ratio and started treating others 1.62x how I wish others to treat me.
2
50
338
@genekogan
Gene Kogan
3 years
A banana performing stand-up comedy.
Tweet media one
Tweet media two
Tweet media three
Tweet media four
3
53
333
@genekogan
Gene Kogan
4 years
StyleGAN self-portrait
9
33
333
@genekogan
Gene Kogan
5 years
CariGANs -- drawing caricatured faces, like those street artists around Times Square. goes in reverse too. very cute idea (╹◡╹)凸
Tweet media one
4
81
326
@genekogan
Gene Kogan
7 years
run fast-style-transfer on your webcam. including models for kandinsky, hokusai, picasso, lichtenstein & google maps
5
80
321
@genekogan
Gene Kogan
3 years
Trying to animate latent visions. Going for something a bit smoother, but I’m enjoying the stop-motion like feel of my early attempts at it. “Alone on the water”
12
25
327
@genekogan
Gene Kogan
8 years
Turing’s “Can machines think?” is much more often quoted than his “the question is too meaningless to deserve discussion” a few pages later
Tweet media one
3
161
306
@genekogan
Gene Kogan
2 years
Here's what a few years of progress on text-to-image generation looks like, one prompt at a time. "Frank Sinatra as a purple alien in surrealist style" 1) AttnGAN (2018) 2) CLIP+VQGAN (2020) 3) CLIP+Diffusion (2021) 4) DALL-E 2 (2022)
Tweet media one
Tweet media two
Tweet media three
Tweet media four
7
85
313
@genekogan
Gene Kogan
7 years
it's like a Shepard tone. the center mask appears as if it's cascading outwards, but it's an illusion. it always stays in the same place
8
96
309
@genekogan
Gene Kogan
2 years
Going places with #stablediffusion
7
28
302
@genekogan
Gene Kogan
6 years
New York!! I'm looking for an apartment starting Oct/Nov. Know any place that looks like this? Please tell me about it :)
11
41
293
@genekogan
Gene Kogan
6 years
navigation in a nightmare: the map appears to zoom-in forever but never get anywhere
6
65
294
@genekogan
Gene Kogan
8 years
finished my piece for alt-AI: Cubist Mirror!! thanks @openframe_ + @_mayfa
10
91
284
@genekogan
Gene Kogan
4 years
3D photographic inpainting from a single source image Adds a whole new dimension to these puppyslugs
12
56
281
@genekogan
Gene Kogan
6 years
very cool work on text attribute transfer, e.g. sentiment (positive->negative), genre (humorous->romantic), etc... like pix2pix for text! + code at
Tweet media one
3
87
284
@genekogan
Gene Kogan
6 years
massive new dataset of 1M+ indoor scenes with texture, lighting, depth/normals, semantic maps, and more. biggest of its kind that i know of. with a bit of pre-processing, this could be used to train 3d generative models (of just furniture, but still neat)
Tweet media one
2
81
272
@genekogan
Gene Kogan
3 years
CLIP-guided image transformations are really cool. A hint of what Photoshop might look like in the future... Input: a picture of mountains Output: input + "An ukiyo-e painting"
Tweet media one
3
34
267
@genekogan
Gene Kogan
6 years
here's a sneaky way to get applause. make the crowd play the T-Rex game with claps 😂
2
50
262
@genekogan
Gene Kogan
5 years
I'm excited to announce that I'm joining the @RunwayML team as an advisor. I've been tracking Runway since its humble beginnings as an @ITP_NYU thesis project and I'm amazed by its continual growth. We're going to make it better than ever.
10
11
266
@genekogan
Gene Kogan
5 years
4.5 years of GAN progress, visualized to scale (modified from )
Tweet media one
@goodfellow_ian
Ian Goodfellow
5 years
4.5 years of GAN progress on face generation.
Tweet media one
36
1K
4K
3
68
263
@genekogan
Gene Kogan
5 years
The @runwayml beta is public! We're very excited to finally have it out in the open. Give it a try and let us know what you think.
Tweet media one
Tweet media two
Tweet media three
Tweet media four
7
62
258
@genekogan
Gene Kogan
8 years
Machine learning for artists. About my upcoming class at @ITP_NYU :
Tweet media one
12
147
251
@genekogan
Gene Kogan
6 years
some fun new demos combining @p5xjs with tensorflow.js. make music with PoseNet: play pong with your camera:
7
55
248
@genekogan
Gene Kogan
5 years
Trying to reproduce NVIDIA's unreleased labels-to-landscapes model (GauGAN). One cool result after 20 epochs is it renders reflections of stuff over surfaces of water, even though there's nothing in the labels
Tweet media one
Tweet media two
Tweet media three
Tweet media four
5
44
250
@genekogan
Gene Kogan
6 years
very excited to announce i'll be back in New York this fall, starting a residency at @ITP_NYU and rebooting my machine learning for artists course. draft syllabus at
10
31
246
@genekogan
Gene Kogan
5 years
I've made a PyTorch-based fork of neural-style which adds spatial control when using multiple styles (aka masked style transfer). Code is here:
Tweet media one
Tweet media two
6
37
248
@genekogan
Gene Kogan
8 years
super mario levels designed by a recurrent neural net, awesome description by @ageitgey
6
172
237
@genekogan
Gene Kogan
3 years
Going for abstract maths.
Tweet media one
Tweet media two
Tweet media three
Tweet media four
2
28
246
@genekogan
Gene Kogan
4 years
Trying out the new StyleGAN's encoder, projecting real faces into the ffhq model.
3
27
241
@genekogan
Gene Kogan
5 years
I always thought of Schmidhuber as an artist. His emphasis on authenticity, and willingness to write about unusual topics with creativity and rigor at the same time, e.g. Awards don't deserve him.
2
37
240
@genekogan
Gene Kogan
3 years
My first NFT now available on @rariblecom ! 🥳 It is a looping texture synthesis based on Hokusai's iconic Great Wave off Kanagawa. It would be the first artwork I've ever sold. I hope it finds a nice home. #cryptoart #NFT
13
24
237
@genekogan
Gene Kogan
5 years
There is a fake news generator on Colab. Seems as good or better than GPT-2 to me. The prompt is the top headline from the NYTimes, first attempt. Try it out
Tweet media one
9
64
225
@genekogan
Gene Kogan
3 years
CLIP-guided Cubism
1
22
228
@genekogan
Gene Kogan
6 years
over the past two years, i've been very slowly writing a short creative writing piece about the history of mathematics, and i think it's finally done. just proofreading it and posting tomorrow. a hint...
Tweet media one
Tweet media two
Tweet media three
Tweet media four
9
16
225
@genekogan
Gene Kogan
5 years
Open call! If you're into: - nature ☀️🌵🏜️ - art 🎭🎨🎵 - code 💾🤖💻 - yoga 🧘🧘🧘 - building ⚒️🏚️⚙️ - gardening 🌺🌱🌻 I'm helping organize a free & highly unconventional experiment in living & learning in the desert, 2020. Get in touch if interested!
8
44
225
@genekogan
Gene Kogan
5 years
A short introduction to the @abraham_ai_ project to study and build an autonomous artificial artist
6
63
222
@genekogan
Gene Kogan
6 years
Introduction to generative models: Eigenfaces, autoencoders, GANs, ++ tutorials on dataset collection and training your own DCGAN. Week 6 video and slides
2
55
222
@genekogan
Gene Kogan
3 years
The goal of the @abraham_ai_ project is to create an autonomous artificial artist, an agent that makes unique and original artworks through the decentralized curation and governance of AI-based generative art.
20
30
213
@genekogan
Gene Kogan
5 years
updated my fork of the #BigGAN colab notebook with a GUI for easily making A+B mashups and interpolations, auto-saving the images locally or to gdrive. post your best mashups!
Tweet media one
2
48
220
@genekogan
Gene Kogan
6 years
new chapter in @ml4a_ drafted: Convolutional Neural Networks. now four chapters done!
Tweet media one
Tweet media two
Tweet media three
3
56
218
@genekogan
Gene Kogan
2 years
The tentative idea is to make this "multi-player" and integrate it into @abraham_ai_ as a co-creation/co-curation tool.
6
10
220
@genekogan
Gene Kogan
7 years
running face recognition over that one-hour video of GAN-generated celebrity faces released by @NvidiaAI last week ()
Tweet media one
6
61
217
@genekogan
Gene Kogan
8 years
neat work (+code) generating video snippets with GANs. the babies are terrifying though
2
118
207
@genekogan
Gene Kogan
3 months
How it started...
Tweet media one
4
26
208
@genekogan
Gene Kogan
6 years
a paint brush made out of New York City
1
53
208
@genekogan
Gene Kogan
6 years
Videos and slides for my first two classes at @ITP_NYU this semester are now up. 1) The whole class "in 60 minutes": 2) Neural networks:
2
54
208
@genekogan
Gene Kogan
5 years
deeplab-pytorch added to @runwayml . Fast semantic segmentation over 182 classes.
5
32
203