Chris Offner
@chrisoffner3d
Followers
881
Following
1,648
Media
282
Statuses
1,080
CS MSc student @ETH_en studying visual computing, 3D computer vision, and machine learning. Recovering VFX artist.
Zürich, Switzerland
Joined December 2020
Don't wanna be here?
Send us removal request.
Explore trending content on Musk Viewer
#WEARE
• 132314 Tweets
TARO WITH ML
• 74856 Tweets
Hansi Flick
• 73979 Tweets
yves
• 63256 Tweets
#FNS鬼レンチャン歌謡祭
• 57284 Tweets
海ちゃん
• 38650 Tweets
National Anthem
• 33834 Tweets
新庄監督
• 31566 Tweets
Moana 2
• 25274 Tweets
ジャイアンツ
• 24061 Tweets
オリックス
• 21251 Tweets
MATTEUS NO ENCONTRO
• 15573 Tweets
PABLO COSMIC RULER
• 13169 Tweets
サヨナラ
• 12691 Tweets
内田有紀
• 11789 Tweets
ヴェルディ
• 11447 Tweets
Pinned Tweet
In real-world robotics or autonomous vehicle use, vibrations, shocks, temperature changes, etc. can misalign the relative position of stereo cameras, so I'm looking into online stereo extrinsics self-calibration. Via Blender and Python I can get pixel-perfect keypoint matches.
4
9
98
Someone turned a bunch of iconic movie scenes into Gaussian splats. I've been thinking for a while which iconic movie shots would lend themselves best to this, i.e. long and stable tracking shots through scenes with little to no movement.
12
107
641
Went hiking today with a lovely group of friends, so we decided to take a group 3D Gaussian Splat instead of a group photo. Nice job staying mostly still. ;)
@LumaLabsAI
8
32
579
Playing with self-attention in latent diffusion models. This animation illustrates that the model learns to represent 3d scene properties like depth and object semantics. The red dot shows which pixel's self-attention map we're seeing.
#Diffusion
#DeepLearning
#StableDiffusion
13
26
283
Yesterday I got to present the
#GaussianSplatting
paper by
@Snosixtytwo
,
@GKopanas
and their co-authors to our seminar on Advanced Topics in Vision.
The dandelion on made for a lovely title slide.
7
10
143
I'm learning about normalising flows and flow matching and found these fantastic animations on . Not sure who created them, possibly the FFJORD authors ()? Great visualisations!
2
13
117
You vs. the disparity map she told you not to worry about
1
6
93
"mrcal is a generic toolkit built to solve the calibration and SFM-like problems we encounter at NASA/JPL"
Great documentation, tutorial, and tools for camera calibration:
1
9
87
My friend Daniel took these photos over Zurich last night while I was sleeping. Daniel, please burst in my door with an axe and drag me outside next time this happens! 🥹 I thought this stuff only happens to fantasy elves and Norwegians.
6
4
81
I have a sadistic urge to test how various feature matchers and stereo matching algorithms perform on scenes like this. 😅
9
4
65
@fchollet
“A good science fiction story should be able to predict not the automobile but the traffic jam.” – Frederik Pohl
"A.I.-Generated Garbage Is Polluting Our Culture"
Will we act against the pollution of our information environment as halfheartedly and ineffectively as we've acted against the pollution of our natural environment?
0
3
13
2
1
62
On the left we see the disparity maps from the initial calibration. However, the stereo rig has since been de-calibrated through shocks and vibration during use. When trying to perform per-frame camera extrinsics re-estimation, I get more complete per-frame disparity maps but
1
3
45
Went for a hike yesterday and came across this pretty little Tell's Chapel by the lakeside. Chucked five photos into
#DUSt3R
. Looks like the benches would require more.
2
3
39
@riverakid1
@JeromeRevaud
@bchidlovskii
@Vinc3nt_Leroy
Witchcraft. 😄 I just ran it on my own images (after changing all mentions of CUDA to [device = "mps" if () else "cpu"]) and wow, this is super cool! 🤩
1
6
32
Every student with only a MacBook to work on will love you for adding an MPS check to your PyTorch device assignment. 🙃
0
4
31
Exchange with my girlfriend:
"I hate it when DL-based methods that are essentially magic work better than well-understood algorithms in 3D vision."
- "Well then you're likely going to hate the next decades of your life." 🫠
4
0
29
Awesome looking course by
@vincesitzmann
. Thank you for making this publicly available! :)
(Don't get discouraged by the "broken" first recording, the subsequent ones work fine)
0
3
18
@yuliangxiu
@ETH
The rumours around this tragedy are deeply unsettling and I hope the circumstances of her passing are investigated with great urgency and diligence.
1
1
18
@JeromeRevaud
I thought you must be joking so I ran it on these two of my own pictures (excuse my dirty dishes 😉) and wow, it works beautifully.
1
4
16
The chatGPT Mac app is pretty neat. It needs an option to increase the font size, but being able to start a prompt just like a Spotlight search (via ⌥ + SPACE) is very convenient!
0
2
17
@xchester16
@LumaLabsAI
If you're interested in the research, the techniques are referred to as Neural Radiance Fields (NeRFs, ) and 3D Gaussian Splatting ().
In practice you can use the Luma app to create 3D Gaussian Splats:
0
1
13
The scan I did of Einstein's locker here at
#ETHZurich
can now be explored interactively on
#GaussianSplatting
#NeRF
#LumaAI
1
2
13
"A.I.-Generated Garbage Is Polluting Our Culture"
Will we act against the pollution of our information environment as halfheartedly and ineffectively as we've acted against the pollution of our natural environment?
0
3
13
@RadianceFields
@Snosixtytwo
@GKopanas
It wasn't recorded yesterday but I might record it myself and put it online some time in the coming weeks.
It's only a minor additional effort for me but might serve many more people than just the couple dozen that took the in-person seminar.
1
0
13
@CSProfKGD
It's funny – I wrote my BSc thesis in theoretical CS, and undergrad algorithms courses are of course all about discrete maths and graph theory. Now in my master's in Visual Computing and ML I use almost none of that. Maybe physics would've been a better undergrad degree for the
3
1
10
@cmuratori
I say that as a current CS MSc student but the problem is that knowing somebody has a CS degree gives you very little information. You can meet three people with CS degrees and it could be that person 1 had lots of coding and software application engineering courses but virtually
2
0
10
This looks like a wonderful complement to OpenAI’s “Spinning Up” tutorial introduction to deep reinforcement learning, with a somewhat different but equally interesting structure.
Despite its relevance, it can be hard to get into RL. This motivated us to write "An Invitation to Deep Reinforcement Learning", a tutorial for readers with only basic ML knowledge. Huge kudos to
@bern_jaeger
for this effort. Help us to spread the word!
4
81
381
0
1
11
Academia: “We propose the first Model that predicts the 3D model of an object from a single input image within just 1 second*.”
…
*) when using five NVIDIA A100 GPUs costing $50,000
#NeRF
0
0
10
Synthetic data allows us to get highly realistic RGB, and perfect depth, normals, motion vectors, and any other geometric ground truth data we may want for 3D (or 2D) computer vision. I'd love to see the CV and CG communities combine into "Visual Computing" (my MSc major). 👁️❤️👾
2
0
9
@rms80
@DummblondGaming
Agreed. Feels like it says "Let's crush your creativity by destroying all the tactile and haptic richness of the art utensils and instruments here, and replace them with a slab of glass." I'm very fond of my iPad but this ad missed the mark. Creatives like physical objects.
0
0
9
When the catchy paper title your team brainstormed for a week still isn't entertaining enough for journalists. :(
1
0
9
I'm reading a dissertation where virtually every single sentence is written in the passive voice, and sentences are way too long. Telltale signs that the author is a native German speaker.
2
0
9
And then the attention maps for all kinds of unrelated pixels also keep obsessing over it. 😱 Stop staring at the corner of my eye, it's impolite!
2
0
8
I plotted the percentage of female bachelor and master students at ETH Zurich in 2022 across the 16 departments.
3
1
8
Whoa. I think this video demonstrates that this will be a really big deal.
0
0
8
My gripe with AI is that it won't tell me if the premise of a question is flawed. Asking it to explain parts of a mathsy paper/lecture often works. But if there's a mistake in the material, it tends to make up some BS explanation instead of saying "This is wrong and here is why".
1
0
8
@jon_barron
@giffmana
@ylecun
@geoffreyhinton
I believe I agree more with Yann than with Geoff but most of all I think it’s just really unfortunate and counterproductive that “AI risk” is now increasingly synonymous with “extinction risk”. There are huge risks I see with AI (and huge benefits) that are not about extinction.
0
0
6
@LMSacasas
I partially agree. The internet does deplete our will power and, via the many ways it shapes our culture, fragments our time and attention so that it becomes way harder to do anything that would require more activation energy, time, and attention, than mindlessly browsing the
0
0
6
@iScienceLuvr
Maybe optimising for edginess isn’t the path to maximal intelligence? Glad someone ran that experiment. Now we know. ;)
1
0
6
I knew they should've gone with
⚠️ "Scientists SHOCKED: Large Language Models Now Fit in Your Pocket!" or
⚠️ "Memory Companies HATE Them: Researchers Discover One Weird Trick to Shrink LLMs" or
⚠️ "You Won't BELIEVE What These AI Researchers Did with Limited Memory!" instead.
2
0
7
Here's a brief excerpt where I remind everyone what Gaussians look like. ;)
1
0
6
Academic texts can be exhausting for opposite reasons:
(a) Each paper needs to repeat a lot of blah boilerplate.
(b) Papers take things for granted that you don't know.
Imagine an AI that remembers what you know, and that curates and helps you understand what you don't yet know.
2
0
6
@random_walker
2022: AGI will be a deity that shall conquer the galaxy.
2023: AGI will replace all humans at everything.
2024: AGI is a program that's useful for many things.
1
0
6
AGI may be near but PDF parsing is still beyond humanity's technological capabilities. Here's how Google's
#NotebookLM
parses a two-column paper. 🥲
#Bard
#Gemini
#GoogleGemini
#AI
1
1
6
Marigold has such a pretty colourmap for its depth maps. I much prefer the red-to-blue gradient over the more commonly used white-to-black gradient for depth.
0
0
6
I implemented image deformation using moving least squares. Obviously this was the only correct image to test it with.
0
0
7
It's not just my face. Does anybody know the significance of these distinct spots in Stable Diffusion's VAE latents?
#StableDiffusion
#Diffusion
#VAE
2
0
5
Hidden state in Jupyter notebooks is terrible. It's crazy that we work like this. I wish reactive Pluto notebooks were the norm. I want to be able to run any cell an arbitrary number of times, in any order, and know exactly what result I'll get.
2
0
6
When vision people do graphics, they call it "image synthesis." When graphics people do vision, they call it "inverse rendering". ;)
0
0
6
@cocktailpeanut
@_akhaliq
Spread the word! ❤️
Every student with only a MacBook to work on will love you for adding an MPS check to your PyTorch device assignment. 🙃
0
4
31
2
0
5
@m_schuetz
If I became supreme dictator of the world, I would mandate a single coordinate system convention and then resign.
2
0
6
@blazer_adam
We'll see.
@KBingxin
,
@AntonObukhov1
et al. just showed how to get high-fidelity depth maps out of SD. For relighting we need surface normals and it's still unclear whether SD learns those. suggests that SD does encode "same plane" relationships, so maybe.
0
0
5
I hate everything about this. 😭
in many sectors within like six months fully human writing will be a novelty
53
582
8K
1
0
6
US politics is so utterly confused. I’m not a fan of TikTok but this is such embarrassing protectionism, lobbied for by Meta. Pass a universal data privacy law that affects US social media companies equally, or get off your high horse.
2
3
6
@jon_barron
Yeah, control is the big one here. Waiting (or working) many hours for seconds of final footage is standard procedure even in live action films, not just Pixar animation. People have no idea how long it takes to shoot a scene that ends up being 60 seconds in the final film/show.
1
0
6
Per-frame camera extrinsics self-calibration works like a charm! 🫠🫠🫠
0
0
6
One nice thing about studying at ETH is when physicists who also happen to be world-class triathletes casually tell you that “a non-productive day is not the end of the world.” 🫠
1
0
6
@docmilanfar
@mmbronstein
"Müller" is the most common German surname. "Thomas Müller" is to Germans what "John Smith" is to Brits.
1
0
4
@CSProfKGD
This was part of my initial exploration for our deep learning course project this semester. I’ll have a project report by the end of the semester. Just thought I’d share this because I found it cool. I’m new to DL (and research projects), so don’t know if it had been done before.
0
1
5
Fantastic TED talk by
@profgalloway
. The median age in the US is ~38.5 years. I wish someone would give this talk in Germany where the median age is 44.9 years.
1
1
5
I wonder if universities could create a custom GPT for each course to provide students with a tutor. Supply the GPT with all course materials, related readings, problem sets, and instructions, and let students use it as a 24/7 available TA.
#education
#chatGPT
#GPTs
#openAI
3
0
5
If Twitter could just allow me to auto-block any user (bot) profile that has a link to a camgirl site in its bio, that would go a long way. I just purged my follower list of ~40 obvious bot accounts and I'm sure I've missed many more.
2
1
5
@AntonObukhov1
Wow, those depth maps look amazing. Great work! There goes my course project for Deep Learning. 😅
Playing with self-attention in latent diffusion models. This animation illustrates that the model learns to represent 3d scene properties like depth and object semantics. The red dot shows which pixel's self-attention map we're seeing.
#Diffusion
#DeepLearning
#StableDiffusion
13
26
283
0
0
5
"The proton is a quantum mechanical object that exists as a haze of probabilities until an experiment forces it to take a concrete form. And its forms differ drastically depending on how researchers set up their experiment."
Sophon lock confirmed.
0
3
5
@yongyuanxi
@ZGojcic
The more time I spend among academic researchers, the more I understand why the German word for “curiosity” is “Neugier”, as in “greed for novelty” (neu = new, Gier = greed). I also notice it in myself.
I like that you point out the tension between self-serving and
0
0
4
Does Stable Diffusion's VAE encoder think something is wrong with the corner of my eye? 🥺
1
0
4
I created this graphic to give myself an easily glanceable overview of the U-Net in the Stable Diffusion architecture. Maybe it can be useful to others as well.
#StableDiffusion
#diffusion
#LDM
0
0
5
@andrewgwils
Industry gives greater rewards for doing things well. Academia gives greater rewards for doing things first.
1
0
5
@janusch_patas
When you first install it, you're shocked how terrible it is.
Give it a couple of days of active use and you'll be shocked by how well it manages to keep you hooked.
I had to uninstall it after a few days for that reason.
TikTok is scary good. It's digital crack. First time I feel attacked by AI in the brain.
611
2K
26K
1
0
5
@JustinMSolomon
@sp_monte_carlo
I believe it's just a remnant of the standard DL introduction where you go from a Perceptron to an MLP, and these computational graph diagrams then justify the term neural "network." I also really don't think that narrative is worth it though.
0
0
5
@nathanbenaich
@RikeFranke
@ylecun
The saying "He has forgotten more about X than I'll ever know." means that a person is such an expert that even the volume of X that he has forgotten exceed the speaker's current knowledge of X. It's not diminishing LeCun's expertise, it's complimenting it.
0
0
5
Cool example of neural rendering using a model trained specifically for this game. Inputs are ball, paddle, and light positions (7 floats), output is the per-object texture (256x256). Training data created with Blender cycles.
Ray Traced Pong starting to looking pretty good on integrated graphics (neural rendering using
@unity
#Sentis
)
#MachineLearning
#unity
#madewithunity
0
1
12
1
0
5
@YiMaTweets
@young_opsimath
I agree in principle but in practice unfortunately not all lines of inquiry lend themselves to rigorous experiments. And logical deduction reaches its limits pretty quickly as the complexity and stochasticity of the system under observation increases.
1
0
5
Rotating the covariance matrix of a 3D Gaussian and sampling points from it each frame.
1
0
5
0
0
5
@CSProfKGD
@david_picard
For me it's a pretty even split between social media and Scholar Inbox, followed by in-paper citations and
@ConnectedPapers
.
0
1
4
@jenwiderberg
@thealexbanks
Making sure you can never talk to a human being for customer service again.
0
0
4
It doesn't help that the main business pitch for AI/ML is that it can/will automate away much of what people currently earn their living with. Maybe once enough people flee into ML, the AI crowd will learn what it means to have their market destroyed by cheap and abundant labour.
Most people nowadays are interested in AI/ML because of the job prospective, or because it may lead to the growth of capital.
These are people who either hope to learn about ML so that ...
(2/10)
1
0
5
0
0
4