Jonathan Granskog
@jongranskog
Followers
3K
Following
40K
Media
527
Statuses
9K
research @runwayml. vfx/3d graphics, generative models, photography. swedish-speaking finn.
Oslo, Norway
Joined May 2010
Positively surprised by how easy it was to get started with Gemini. API key, captioning, text requests and embeddings all working in just a few minutes. Very nice.
1
0
5
It's not exactly like film grain, but I'm still quite happy with the variation. Better than Lightroom's grain.
0
0
0
Gaussian Splatting for film grain generation. First image is composite, second normalized grain, and third is depth map (size is scaled by luminance).
3
2
12
Claude Code on the phone is pretty nice for personal projects when you lack free time. Launch some agents, review when you have time again. The code is too verbose and it makes mistakes, but it’s easy to correct yourself while reviewing changes.
0
0
2
Grace is presenting our paper poster today at ICCV (#295, 5:45pm PDT). Go learn more about how VLMs can guide image generation for both artistic control and physical accuracy.
✨New preprint: Dual-Process Image Generation! We distill *feedback from a VLM* into *feed-forward image generation*, at inference time. The result is flexible control: parameterize tasks as multimodal inputs, visually inspect the images with the VLM, and update the generator.🧵
0
0
10
Node-based workflows offer so much flexibility especially when combined with general editing models like Aleph. This is just the beginning.
Introducing Workflows, a new way to build your own tools inside of Runway. Now you can create your own custom node-based workflows chaining together multiple models, modalities and intermediary steps for even more control of your generations. Build the Workflows that work for
0
0
26
Some weekend work. Added a multi-pass bloom shader and the ability to add/remove effects based on prompts. Hopefully quite easy to see how it can be extended :)
1
0
14
The best content creation tools are easy to get started with, but also let you delve deeper to control anything and everything. Excited for the future of our tools.
Today we’re releasing another new batch of Runway Apps with a focus on VFX. The first is the Change Weather app. Now you can upload a video and simply describe what conditions you’d like to see. Make a sunny day look overcast or bring torrential downpours. (1/5)
0
0
17
Cursor pretty much soloed converting my code from using a single mega-shader for effects to doing FBO ping-ponging. It was struggling with resetting glViewport but otherwise all good.
1
0
2
Do you ever stop and think about how magical LLMs and VLMs are?
2
0
10
One of my favorite moments wandering around Zurich yesterday was stumbling upon an Ansel Adams exhibition at a tiny gallery in the old town with original signed prints.
5
1
5
It's so far from being a practical editing tool but it's still a joy to edit images with software I've made, and can change to fit my own needs.
0
0
8
Small interface improvements and more. Starting to get to a point where I can implement ML-based features.
1
0
5
Imagine a world where anyone can create any world they want. This world is coming, very soon.
131
199
2K
Almost every winner of our film festival has gone on to make bigger, riskier, more ambitious work. Last week I spoke with one who’s now producing a new feature film using Runway. AI has opened so many doors for creative expression to people who never had them opened before.
There are many legit reasons to be concerned about video generation tech IMO. But conflating video generation as a whole with slop is a mistake, just as it was with text generation. "Not all generated videos" but unironically, and the distinction is important.
5
6
79
Ah.. pytorch MPS doesn't support `grid_sampler_3d`. Tempted to implement it myself. 🫣
1
0
5