Excited to share our latest work on bringing the concept of layers to 3D painting in VR! #SIGGRAPH2024

I also gather some related toughts in this appendix of the #LearnWebGPU programming guide: "Keep in mind lower-end devices"

The fact is that research papers are mostly tested on the very top tier of GPUs available the year they are published (and publication takes time, so they're actually even more ahead).

Is it because researchers only work with recent high end #GPU that everybody has to renew their hardware so fast or is the other way around? Causality is hard to prove, but the correlation is a fact! And we have plenty more figures to show at our #SIGGRAPH2025 talk next summer!

Apply now to be part of the 2025 cohort of rising stars in computer graphics 🌟 This is a mentoring program with workshops co-located with Siggraph, for students and post-docs of under-represented genders in CG research Deadline for submissions: Apr 18 https://t.co/MfJsRN66o1

Hi all, I’m on the job market for industry research scientist or TT faculty positions starting Summer 2025. Interested in roles related to HCI, XR, Eye Tracking, Adaptive Interfaces, and Human-AI Interaction. Please reach out if hiring or aware of any positions! RT appreciated!

Work done with @fanny_uoft @karansher and Adrien Bousseau. This wouldn't have been possible without precious insights and time invested by our study participants! The @QuillSmoothstep community is lovely, thank you so much!

For more details, please check out our paper or come see our talk at Siggraph in Denver! >> https://t.co/868rmEbeyt We also open-source the code

We invited a few VR artists to try the tool and I also painted some things myself! So I can say first-hand, I think it's pretty fun :)

By letting artists work on a stack of apperance layers that define colors on top of a substrate layer that defines geometry, we can get many cool things! ✔️ non-destructive editing ✔️ color effects (blend modes, opacity gradients)

That issue stems from the fact that brush strokes in Quill define both the 3D geometry and the color to be rendered. Our key idea is to decouple geometry and color, such that these two components can be edited independently with stroke-based interactions.

... or add new strokes slightly in front of the previous ones -- hard to make it work from all viewpoints in 3D.

A specific pain point we identified was on how to edit colors of 3D strokes. In Quill, you have to either apply new colors as vertex colors -- a bit blurry and hard to control...

VR painting tools like Quill are great -- love that software! -- but they're still in the early days of defining what a painting experience in 3D could be.

We got the chance to chat with some brilliant Quill artists to understand VR painting workflows better. Turns out, in VR painting you can essentially paint all light and shadow effects, and it looks great. Here's a beautiful example by @NickTheLadd

Hope some people find it useful and have as much fun fiddling with is as I did 😊

We could not release the full pipeline to convert your own video clips to video+cameras+depth, but we do describe pretty extensively our internal format. We also provide all preprocessed videos from our paper's results to try out the system!

So we finally managed to release the code

Time to share our #SIGGRAPH2024 paper "N-Dimensional Gaussians for Fitting of High Dimensional Functions"! We show that N-Dimensional Gaussian mixtures can be optimized to handle high dimensional inputs like MLPs with a fraction of the training times. https://t.co/4edn0ZFwPr

Nous avons pu présenter notre démo "Video Doodles" à Paris pour #IHM2024 @afihm Merci à tous et toutes d'être passés dessiner à ma démo ! Ci-dessous quelques créations 🎨 Et merci aux organisateur·ices d'avoir créé ce lieu d'échanges