🌟New from
#NVIDIAResearch
, VILA is a vision language model that can reason among multiple images, learn in context, and even understand videos.
🤔Read our technical deep dive ➡️ .
In the past, vision language models have struggled with in-context…
From interactive hair simulation to an
#AI
system that can auto-generate realistic 3D character motion by watching 2D videos, check out the 19 papers from
#NVIDIAResearch
accepted into
#SIGGRAPH2023
.
Read the blog with links to each paper:
✨Introducing Neuralangelo✨ A new
#AI
model to turn 2D video from any device -- cell phone to drone capture -- into 3D structures with intricate details.
New from
#NVIDIAResearch
#CVPR2023
Read more:
Let us introduce you to the next evolution of
#GauGAN
:
#GauGAN360
turns your simple sketch into a 360 degree HDR environment. Try it now on our interactive
#AI
Playground.
If this works, it’s just nuts. Nvidia has come up with a video compression algorithm that lets you do Zoom calls with a tiny fraction of the bandwidth usually required. Could be a game-changer for people with poor internet connections. (Via
@chrismessina
!)
To generate a seemingly infinite number of portraits in a variety of painting styles,
@NVIDIA
researchers developed StyleGAN2. The new model, trained on NVIDIA V100 GPUs with
@TensorFlow
, will be presented at
#CVPR2020
. Learn more here:
Unveiled at
#NeurIPS2018
, NVIDIA trained a conditional generative neural network on existing video to create the first ever interactive neural network render.
#AI
rendering virtual worlds in real-time. Learn more:
Is your game avatar just not understanding you?
With the new
#AI
framework, PADL, you can more easily command your 3D characters with natural language commands. Learn more about this state-of-the-art paper here:
We're calling it Image Inpainting. See how
@NVIDIA
researchers introduced a state-of-the-art
#deeplearning
method that uses
#GPUs
to edit images or reconstruct a corrupted image in real-time.
Announcing NVIDIA
#TITANRTX
: the world’s most powerful desktop GPU. Adds massive performance for AI research, data science and creative applications - on display this week at
#NeurIPS2018
. Learn more:
Take a ride with NVIDIA research in the first ever interactive neural network renderer displayed at
#NeurIPS2018
. Read to learn more about this incredible work:
Deep learning-based 3D shape reconstruction is an open problem in AI. “Deformable Tetrahedral Meshes” presented @
#NeurIPS2020
by NVIDIA, is the first approach to showcase high-quality 3D tetrahedral meshes using only a single image as input. Learn more:
🏗️ Build
#3D
scenes from a single input view based on the latest
#NVIDIAResearch
paper accepted at
#ICCV2023
.
👀 This 3D-aware
#generativeAI
model can build diverse and plausible views.
research paper:
project page:
Amazing! Researchers from
@UCSF
used
#AI
+
@NVIDIA
GPUs to give a paralyzed man the ability to communicate by translating his brain signals into computer generated writing. Read more:
NVIDIA breaks 8
#AI
training performance records, delivering up to 1.8x faster-time-to-train in new round of
#MLPerf
. Get these
#DL
software optimizations and models from NGC.
Today, NVIDIA and
@huggingface
announced that
#NVIDIADGX
Cloud will integrate into the Hugging Face platform, empowering millions of developers with
#generativeAI
supercomputing for large language models and advanced
#AI
applications.
#SIGGRAPH2023
➡️
Create a personalized chatbot with the Chat with RTX tech demo.
#AIonRTX
Quickly get tailored info from your own files and content by connecting your data to an
#LLM
on RTX-Powered PCs.
📥 GeForce RTX 30 and 40 series owners can download now:
Announcing NVIDIA T4 Tensor Core GPU, the world’s most advanced
#AI
inference accelerator designed to deliver state-of-the-art
#inference
in real-time.
#GTC18
No need for expensive motion-capture hardware.
#AI
researchers from
@NVIDIA
developed a new
#physics
-based method to estimate and synthesize human motion models from 2D videos. Learn more:
Is your 3D character phasing, glitching, or clipping through objects?
This
#NVIDIAResearch
#AI
approach takes physics-based character motion generation and teaches the character how to realistically interact with objects & the environment.
#SIGGRAPH2023
.
@NVIDIA
’s viral real-time AI art sensation
#GauGan
just won a 2019
@PopSci
Magazine “Best of What’s New Award” in the engineering category.
Developed by NVIDIA researchers in 2019, GauGAN is the first AI model that can produce complex images with only a few brushstrokes.
🎉Just released: Eureka!, a new AI agent that uses LLMs to automatically generate algorithms to train robots to accomplish complex tasks.
👀 The
#NVIDIAResearch
paper includes the AI algorithms and how to experiment with Eureka using NVIDIA Isaac Gym.
👇
Director of Research,
@AnimaAnandkumar
, takes us behind the scenes of NVIDIA's new core
#AI
& machine learning research lab to share some challenges in algorithmic research her team hopes to tackle. Stop by to meet her in person next week at
#NeurIPS2018
.
At
#NeurIPS2018
,
@datametrician
shares how the new NVIDIA
#TITANRTX
provides a great entry point for developers and data scientists and the flexibility to experiment on larger datasets. Learn more about how to leverage TITAN RTX with
@rapidsai
:
The new NVIDIA Ampere architecture delivers the unmatched acceleration at every scale with faster performance for HPC, AI and data analytics workloads. Get an in-depth look on the NVIDIA Ampere Architecture:
#GTC20
With NVIDIA AI playground, you can now experience NeVA, a multi-modal vision language model, directly from your browser.
Just upload an image to NeVA model and ask questions related to the image.
#generativeai
.
@NVIDIA
researchers just developed a
#GPU
-accelerated reinforcement learning simulator that can teach a virtual robot human-like tasks in record time.
#Corl18
New York City-based startup
@TheTake_AI
, a member of
@NVIDIA
’s Inception program, recently unveiled a new
#deeplearning
algorithm that can automatically decode what a celebrity, athlete, or other public figure is wearing in a video in near real time.
A new
@NVIDIA
Jetson-based autonomous robot by
@doxel_ai
captures 3D scans of construction sites to inspect the quality of the work and tracks the progress of the project.
Trained on 50,000 episodes of PAC-MAN with
@NVIDIA
V100 GPUs, this new GAN model developed by NVIDIA Researchers from our Toronto lab, generates a fully functional version of the dot-munching classic without an underlying game engine, just
#AI
#pacman40th
NeMo Guardrails, the new toolkit for easily developing trustworthy LLM-based conversational applications.
It works with all
#LLMs
and natively supports
@LangChainAI
, adding a layer of safety, security, and topical guardrails to existing applications. ➡️
This year at
#NeurIPS2018
, NVIDIA and
@aivatechnology
collaborated on a brand new
#AI
-composed song honoring legendary rock band Queen by training a deep learning-based system on hundreds of rock songs.
A new
#GenerativeAI
method by NVIDIA researchers uses off-the-shelf, pre-trained latent diffusion models (LDMs) to turn image generators into high-resolution video generators.
Project Site:
Paper:
Amazing!
@UWaterloo
researchers are using
#AI
+ an
@NVIDIA
GPU to develop autonomous exoskeleton legs to help users walk, climb stairs, and avoid obstacles. Read how:
Explore one of the most critical components making “the world’s largest GPU” a reality - learn how NVSwitch integrates 16 GPUs to deliver NVIDIA
#DGX
-2: the world’s first 2 petaFLOPS
#AI
system.
Capture, Render, Win
Announcing the
#InstantNeRFVR
Contest 🎉
Read more about how to create an immersive scene with our new
#InstantNeRF
VR software for a chance to win an NVIDIA GeForce RTX 3090 Ti graphics card.
➡️
For the first time,
@UCSF
researchers trained and implemented a deep learning model on
@NVIDIA
#GPUs
that can convert brain signals into speech. The work has the potential to one day help people who can't talk communicate.
📣 Introducing FoundationPose, a unified foundation model for 6D object pose estimation and tracking for novel objects from
#NVIDIAResearch
.
See the details below.
🧵 👇
🎉 Congrats to our
#NVIDIAResearch
team for winning 🏆 1st Place and the 🏆 Innovation Award for the
#CVPR2023
#3D
Occupancy Challenge.
Their 3D object detection method substantially improved performance in comparison to prior approaches.
Read the paper:
Watch how
@UCBerkeley
researchers used
@NVIDIA
#GPUs
and reinforcement learning to train simulated characters to perform acrobatic moves by watching humans.
ICYMI: 👀📸 How NeRFs will help to re-imagine the world, an insightful blog by our community member
@franclucent
.
"The amount of applications are truly limitless, and I see it long term being the evolution of modern photography."
#InstantNeRF
➡️
Microsoft today announced a breakthrough in conversational AI, training the largest transformer-based language generation model, based on over 17 billion parameters, using
@NVIDIA
DGX-2 systems.
Discover the power of NVIDIA
#GPUCloud
for research in
#AI
and high-performance computing. NGC eliminates the complexity of deploying
#deeplearning
and
#HPC
software, freeing you to change the world. Sign up for free:
The human brain contains around 86 billion neurons and imaging a single cubic millimeter can generate more than 1000 terabytes of data. To parse through it
@GoogleAI
and
@mpiNeuro
researchers are using
#deeplearning
and
@NVIDIA
#GPUs
to help map the brain.
Just in time for the World Cup! Watch how researchers from Google, Facebook, and
@UW
are using
@NVIDIA
#GPUs
to transform a standard YouTube video of a soccer game into a moving 3D hologram.
#CVPR2018
At the
#NeurIPS2018
Expo, participants heard sessions on mixed-precision training, the CUDA ecosystem, NVIDIA hardware, the latest NVIDIA software development kits at the NVIDIA AI Tech Workshop. Get the full recap here:
To help the visually impaired as a service dog or to assist medical professionals with medical diagnostic monitoring,
@FloridaAtlantic
researchers recently built Astro, a GPU-accelerated AI robodog trained on
@NVIDIA
RTX
#GPUs
, running on two Jetson TX2 Modules.
Tell us about a time when
#AI
saved the day. 🦸🦸♀️
Reply with your answer and use
#AIonRTX
for a chance to win
@MSIGaming
Vector GP68 GeForce RTX 4080 Laptop! 👇
This AI-powered piano was trained on
@NVIDIA
#GPUs
with
@TensorFlow
to allow non-musicians to compose music by simply pressing a few buttons. See how they did it.
1/6 Excited to share our
#CVPR2023
work FEGR from
@zianwang97
We combine neural fields with explicit meshes to enable neural reconstruction of urban scenes that support controllable relighting and object insertion.
Project:
Video:
Go from imagination to reality quicker than ever before with the new NVIDIA AI Workbench. ⚡
👉 Which NVIDIA pre-trained
#AI
models you are using the most?
Comment below with your answer and use
#AIonRTX
for a chance to win a
@Razer
Blade 16 GeForce RTX 4080 Laptop. 🙌
.
@SkydioHQ
, a member of NVIDIA’s startup incubator Inception released Skydio 2, an AI-based drone that uses an
@NVIDIA
Jetson TX2 for processing, capable of performing 1.3 trillion operations per second. The drone can pilot itself while capturing cinematic footage in 4K.
Israeli-based startup
@saillog_ltd
is using
#GPUs
for their
#deeplearning
-based mobile app that instantly identifies over 500 diseases and pest infestations affecting farmer's crops.
In what ways are you using
#AI
on your RTX GPU in your personal or professional life? 🤔
Reply with your answer and use
#AIonRTX
for a chance to win a
@MSIGaming
GeForce RTX 4080 GAMING X TRIO GPU. 👇
To remaster archived content from SD to 4K with
#AI
, VideoGorillas trains and runs their algorithms on
@NVIDIA
#GPUs
to predict missing pixels, so the original content almost appears as it was filmed in 4K. Watch below.
.
@aivatechnology
, the company behind the world’s first non-human AI music composition, just released a brand new AI-generated rock song trained and generated on
@NVIDIA
#GPUs
.
📣
#NVIDIAResearch
paper, XCube, generates highly-detailed
#3D
scenes with resolutions of up to 1024³ in under 30 seconds.
👀 Capable of leveraging voxel attributes such as normals, semantics, & TSDF, this model is pushing the boundary of 3D generation.
To help hospitals screen patients and prioritize those likely to have the coronavirus virus, Beijing-based startup
@InferVISION
, a member of
@NVIDIA
’s AI incubator Inception, developed a GPU-accelerated AI application to automatically detect signs of the virus.
Don't miss the insights from all 8 authors of the groundbreaking paper "Attention is All You Need" that introduced transformers to the world.
👀 Hear from the experts on the technology that helped build every major
#AI
model.
#GTC24
Join us
@NVIDIAGTC
:
Debuting at
#ICML2018
: See how
@NVIDIA
researchers are using
#deeplearning
and
#GPUs
to help restore grainy or noisy images by simply looking at examples of corrupted photos only.
San Francisco-based startup
@Mirror_AI
is using
#GPUs
for their
#deeplearning
-based mobile app that instantly turns your selfie into a collection of custom emojis that look like you.
Check out NVIDIA’s newest generative model for complex open-world 3D scenes.
It will generate novel scenes, which you can then edit and style for a wide range of uses, including potential use cases in VR & robotics.
View each of the full sessions from the NVIDIA AI Tech Workshop and learn about the
#AI
technology platforms and tools that were covered from our leading engineers and researchers.
#NeurIPS2018
NVIDIA Research developed a
#GAN
training breakthrough. A new technique called ADA that only needs less than a few thousand training images to generate high-resolution images. Learn how:
#NeurIPS2020
Just released:
@NVIDIA
researchers teamed up with
@MayoClinic
and
@MassGeneralNews
to generate synthetic MRIs using GANs and Tesla V100 GPUs to advance medical research.
Now available for commercial use on NGC, pix2pixHD developed by
@NVIDIA
researchers generates high-resolution photorealistic images from high-level labels.
#CVPR2019
We’re honored
@TIME
recognized NVIDIA
#InstantNeRF
as one of the 🏆 Best Inventions of 2022.
Learn more:
Thank you to our NeRF community for exploring this new technology to create 3D scenes instantly from 2D photos. Share your favorite
#InstantNeRF
.
To enable the next generation of robots, NVIDIA is opening a new
#AI
robotics research lab in Seattle led by Dieter Fox. See how they are designing a robotic kitchen assistant:
Looking for lightning-fast
#ASR
? Check out NVIDIA NeMo Parakeet-TDT.
The open-source model is
#1
on the
@HuggingFace
Open ASR Leaderboard and is 64% faster than the previous best model.
#SpeechRecognition
#AI
⚡
Announcing new Turing optimized SDKs and resources for content creators, deep learning and HPC – NGX, Video Codec 9.0, Optical Flow available for early access. Also unveiled is new NVIDIA Open-Source Portal, now live.
#NeurIPS2018
#TITANRTX
Learn more:
We’re kicking off a contest to celebrate the records NVIDIA set in
#MLPerf
, the world’s first industry-wide
#AI
benchmark. Power up your AI project with the same record-setting software from NGC for a chance to win an NVIDIA
#TITANRTX
. Enter now:
By running their existing code on the new
@NVIDIA
#TITANRTX
GPU, researchers from
@dartmouth
achieved an 80% performance increase when training a
#deeplearning
system to detect osteoporosis.
NVIDIA's new
#AI
& ML research lab aims to push the boundaries of machine learning. Hear Director of Research,
@AnimaAnandkumar
, describe the challenges team hopes to tackle. Stop by
#NeurIPS2018
to meet her in person and learn more.
Dive into the
#code
to leverage
#neuralnetworks
and kernel-based methods to enhance real-world objects'
#3D
reconstruction process with
#NVIDIAResearch
Neural Kernel Surface Reconstruction.
And maybe win an RTX 3090Ti ...🧵 👇 New weekend plans?
Researchers will showcase
#AI
techniques to rapidly create and edit materials, accelerating 3D workflows.
Check out the capabilities debuting in NVIDIA Picasso in the future and ✨vote at Real-Time Live.✨
#SIGGRAPH2023
👀
This AI can play it by ear! Hear how Facebook researchers used
#deeplearning
and
@NVIDIA
#GPUs
to translate Elvis and Rihanna's music to sound like to Mozart