Returning to VR. With a Vengeance.
Introducing Vi “virtual eye”.
@ViHeadset
and gloves designed specifically for fitness.
Joining me are
@mentarus
who built a VR glove company "Plexus", and
@marcusckane
our "Jony Ive" of VR.
LET'S GO ᯅ! Thread on how we gonna do it 🔽
Important VR PSA: 👉 Deactivating your Facebook profile disables your Oculus Profile.
👉 Deleting your Facebook account takes away all your games, purchases, and progress.
Source: Eli Schwartz
Zuck somehow trolled everyone.
This demo used a million dollar camera array for the scans. Then was cleaned up and rigged (takes days to weeks).
A PC was tethered to render the scene.
It's not coming to your Quest 3. It doesn't even have face tracking! Stop it.
1/ Important VR PSA
#3
: 👉
@oculus
@FBRealityLabs
blocks, breaks, and kills successful VR companies.
The story of
@yur_fit
:
- Blocked from the
@oculus
store
- Broke by firmware updates 4x
- Attempted to poach CTO 4x
- Copied by "Oculus Move"
- More stories soon 👇
#antitrust
Hey AR/VR peeps.
We need to drop the term “Metaverse” entirely.
Our Web3 “friends” (and others) have butchered the term and we need to run away from it. Now.
I suggest we call the AR/VR space:
“The Oculus”
Today I announce my newest thing!
@VENDOR_GG
!
"Sell items in seconds using AI"
Here showing a concept with VisionOS (Apple Vision Pro).
Launching on iOS + Discord Bot later this month for SF!
Super excited to be founding with
@mentarus
a
@ycombinator
founder and good friend.
1/ It’s my birthday, it’s time to announce a new company. Check out this teaser!
, sports of the metaverse
@rekverse
Joining me on this journey is
@BartronPolygon
an ex-Apple AR engineer.
Let’s discuss the why, and how we're gonna make this big. ⬇️
What if you could punch a hole in your wall to go from AR to VR?
WELCOME TO REK! 😀
@REKfitness
Alpha coming end of March.
Tech showcased:
- Hand Tracking 2.1 👍
- Presence Platform
- Passthrough/Mixed Reality
Important VR PSA
#2
: 👉 Oculus headsets being used simultaneously on the same Facebook account will get it banned.
“not be able to use two headsets” “lead to one or both Facebook accounts being disabled or permanently banned”
Comms:
@FBRealityLabs
Source: Reddit - kommanderk33n
People saying XR hardware don't matter are out of their minds.
GPU power:
Quest 2: 1.2 TFlops
PS5: 10.3 TFlops
4090: 83 TFlops
Latest PC GPU is 70 TIMES faster than the Quest 2.
20-40% of the Quest 2 compute used by hand tracking etc
Greatly limits what devs can do, period.
Today we announce
@REKverse
going a *slightly* different direction (with the same end goal)!
Mixed Reality Fitness!
Imagine Superhot meets Supernatural in Mixed Reality.
@oivanmotta
did some amazing work here!
Joining us next is
@RJdoesVR
, and of course
@BartronPolygon
!
🧵1/
Someone needs to make a game engine specially for XR.
Unreal treats XR devs as second class citizens.
Unity is like duct taping together a bunch of barely fitting car parts and then debugging it by turning it on and guessing why it set itself on fire.
Niantic announced their outdoor headset yesterday!
SO AMPED for how this moves forward virtual sports.
@NianticLabs
is using XR to connect people in real life, and outside. A similar vision we have at REK.
More info 👇
The person who does branding at Meta needs to be fired.
The Quest headset
made by Meta
running HorizonOS
with Facebook accounts
playing Horizon Worlds
developed by "Oculus" devs and publishing
What in the hell guys.
So, Meta Connect is tomorrow. Let me make some hypotheses of the future of XR in the next few years.
Not making friends with this thread...
Let's start with
@Apple
:
The "puck" is not an accident. They are preparing us for a headset that will connect to our phone by 2026.
👇
REK Update: We shut down
@REKfitness
. We refunded 80%+ of all invested capital.
TLDR: It was too early, the timing was off.
Let me tell the story of why 👇
It started exciting! Semi viral on our first video!
People wanted it! We had a bunch of locations asking for it!
Apple is thinking they are too cool for controllers. This won’t last.
Games suck on the Vision Pro without them.
If I were a betting man: they will get the Sony PSVR2 controllers to work with the headset.
They fit the aesthetic and Sony <> Apple have a great relationship.
The Quest 2 is the most updated consumer hardware I have ever seen since it’s launch.
This thing has had more software updates than any device I have ever seen in 2.5 years.
Gotta respect that.
I want to speak about the "Open" nature of the Quest. I would call this framing dishonest at best and doublespeak at worst. Zuck, Boz, and Yann are factually incorrect.
Let me break down the reality:
1) Connectivity: No other VR controller is allowed on the Quest, in fact the…
Early in
@LIV
we had ideas that someday, avatars would replace real people in game content.
It would take full body tracking and proper avatars.
We aren't quite there yet, but this example of
@RitualNeo
pushing that future w/ dynamic virtual cameras.
This is a real person.
I hate to say this.
But AR WILL be bigger than VR.
Why?
Social dynamics, safety, and mobility.
I can travel while using AR, see friends, see threats, I can multitask.
VR will always be stuck at home.
BUT! They will eventually be the same device so it won't matter.
The BOM (Bill of Materials) for the Apple Headset leaked online in Chinese. I translated it for the english people below. It's a long post:👇
"Recently, Apple announced that it will hold the WWDC from June 6th to 10th, and may release the first-generation MR headset. We held an…
The exact same thing he is complaining about in regards to Apple and Google is exactly (if not worse) what he is doing in VR.
Corporate double-speak is so weird.
When a “tech journalist” says they think “AR is going to be big, but VR is dead”.
What they really mean is:
“I want a sunglass form factor that is impossible to make and I am incapable of understanding that modern headsets do both AR and VR.”
Just to be clear "Spatial Reality" or "Spatial Computing" is just another made up term.
The Vision Pro using conventional lingo is a VR headset with passthrough.
Using "Spatial" terminology instead of AR/VR/MR/XR allows Apple to win SEO + re-invent semantics... again.
“World is on fire. On the verge of world war. Millions are dying of a pandemic. What are you solving?”
Silicon Valley:
“We selling jpegs for millions, using energy of a country to make a virtual currency, and covering our eyes with a VR headset.”
“But… that doe…”
“Metaverse”
Everyone is thinking this is the new console wars with Apple vs Meta.
I disagree, it’s bigger than that.
AR/VR devices will replace everything. Consoles, TVs, monitors, desktops (final boss is phones).
This will make the console wars look like a pre game. Strap in.
OK I have never posted any AI generated art yet. But
@midjourney
v4 is insanely good.
This was first prompt for simply "augmented reality sport headsets".
My god these are truly amazing.
"I’m Finally Excited About VR Again!" -
@LinusTech
I've said it over and over again. VR is magical, but a hardware problem.
A time will come when the right hardware comes, and all us crazy people XR will be right.
Very excited to get my
@BigscreenVR
. CC
@DShankar
"Apple Tester Claims to Be 'Blown Away' by AR/VR Headset"
"the last few months, the tester has gone from "lamenting its 'underwhelming' capabilities" to being "blown away" by the experience and the hardware."
WILL IT ACTUALLY HAPPEN!?
Source:
@MacRumors
Concept:
@marcusckane
Goldman Sachs (Apple Card) just called me to verify my card wasn’t stolen.
“We have several very large charges on your card. Was your card stolen?”
“I bought a few of the Apple headset it came out today”.
“The vision thingie?”
“Yea, blame Tim Cook.”
It’s 2030.
Tinder is full of AI pictures that look like real people.
Text chat is done by AI chat bots.
90% of the people on social platforms aren’t real.
In order to verify people are real, a solution is discovered:
Going outside to meet people in….
*gasp*
Real life.
The Vision Pro is a dev kit.
I bought one, but Apple hasn’t done a good job communicating what it’s for. “Spatial computing” is parroted as if that’s a clear value prop.
Working in a virtual Apple environment?
OK, but it’s heavy and it costs 4-6K after taxes.
It’s a dev kit.
Just to rub in what you missing today at the
@ARHouseLA
:D
The spectating of
@REKverse
is getting 🔥!
Now we have:
- Pickups!
- Movement increases energy!
- And real-time spectating!
Here is
@BartronPolygon
and I dueling to the death :D
Interactions by boppity boopity 🤌
Holy shit. Just got my Vision Pro demo.
The UX and passthrough is so much better than anything on the market full stop.
Probably can’t wear it all day though.
Let’s goooo!
Not hearing incredible things about the Vision Pro…
- Hard to build for (issues with compiling Unity apps)
- Only works for sitting.
- Virtual keyboard ain’t great.
- extremely expensive
- no object occlusion
Very happy that Apple is launching, but V1 won’t be a home run.
1/ Meta continues to screw 3rd party devs in the VR space.
This time, it's to a dear friend of mine.
Meta gave a multi-million dollar contract, then pulled it destroying an entire studio after the Supernatural deal with the
@FTC
was approved.
This is the tip of the iceberg 👇
Will people making AR concept videos that aren’t actually possible.
Please for the love of god have a disclaimer that it’s conceptual?
This type of videos really hurt devs.
Look at what happened with Magic Leap.
Post stuff that works, or say it’s conceptual, please.
If only Meta Connect looked more like this the stock price wouldn't be in the floor.
Maybe the US Meta marketing team needs to talk to the Japanese team?
Games are basically all the 7 artistic mediums together, no?
Film = Cinematics
Music = Songs
Painting = 2D Art
Literature = Story
Architecture = Environment design
Sculpture = Character design
Performing = Voice/Animations
How could this not be the ultimate art form?
Stop trying to make 360 videos happen.
They won’t, and it’s not VR.
Making a 360 video is a production nightmare, your eyes can only see in 180, 360 videos don’t work for VR content due to motion sickness.
It only works for a type of video I won’t name.
Do something else.
The best part of this XR war. Is when Samsung/Google comes with a headset that integrates Android. And “Meta” with a 10 year head start and 100 billion loss, still loses.
Why? Simply because they treated devs like absolute trash and ran a predatory store with zero transparency.
People saying “hand tracking will solve everything”.
Are the same people who thought Kinect interactions will solve everything.
AVP hand tracking updates at 30hz, Controllers can update at 1000hz.
CV only works when the camera can see your hands.
These takes won’t age well.
I’m making a bet.
Fitness will become the top recurring use of Virtual Reality.
VR headsets will become analogous with fitness, the same way headphones are today.
Headsets are the visual equivalent of what headphones did to your ears.
Look into the past to see the future.
If Meta loses XR it won't be because of their hardware.
The Quest 3 is objectively the BEST headset.
It will be because how they ran their store. How closed off it is, how they treated devs.
The death of Quest won't be because of tech limits, it will be because of "policy".
Team... I'm tweeting from a Vision Pro non-ironically.
It just works. (with a Mac). I am actually working in this thing. Not sure if I could all day though (it's heavy).
Make this thing half the weight and much lower cost, and well... Monitors may just go extinct.
This has made normies more excited than anything Meta has ever done in XR.
On one hand this is great marketing. On the other hand people clearly don’t realize how this is not close to being in their current headset.
People are going to love critiquing the Vision Pro.
But I have to say, thank you to the teams at Apple who worked on this.
Thank you for shipping.
Thank you for not waiting forever for it to be perfect.
Thank you for all your hard work.
You have helped our space a lot.
Why I believe the
#1
use-case for AR/VR is active movement:
For the first time in human history our body is the controller. We are IN the game.
Now why does that matter?
Almost all video games are EMULATING physical activity.
Hold up and let me explain. 👇
Excited to announce I will be joining Meta's Horizon team!
About 6 months ago. Boz reached out to get my perspective on the latest Horizon Worlds.
I recommended they put Horizon in the OS layer. It increased adoption by 100,000%!
Let's build the future of ads, I mean social!
I promise you this is one of the biggest news in tech history.
The age of the monopolized, nepotism hell hole of the "App Store" model is coming to an end.
A business model designed to copy, extract users, and destroy startups.
Meta and Apple are next.
Building games for AR/VR is completely different than other platforms. What wins isn’t the “story” but the mechanics.
Beat Saber, Gorilla Tag, Pistol Whip, Blade and Sorcery, no real story, it just *feels fun*.
How *it feels* is more important than the story.
Meta please make your headsets more comfortable.
Stop making a bunch of hypothetical use-cases if it hurts to keep it on.
I would use my headset 2-3x longer (even with current content) if it wasn't so uncomfortable.
The best thing about VR.
Is when you give it to someone who gets stuck in the menus for 15 minutes and gives up before they even start a game.
Or when they start a game and get stuck in the complicated game menus and take the headset off.
Awesome UX guys! /s
The current VR space is a sick representation of Stockholm Syndrome. Any VR content creator who won’t sign a non disparagement agreement with Meta isn’t invited to connect.
Any 3rd party dev who critiques Meta gets their funding cut.
I despise Meta and what they have done to VR
Holy crap
Pico is shutting down.
“According to the latest news on October 20, according to relevant people to EuqalOcean, the person in charge of PICO recently went to Singapore to report to Zhang Yiming's work. The feedback was that ByteDance will gradually give up the PICO…
Quick initial thoughts on Vision Pro before I dive deeper.
- not really sharable, it requires eye and hand calibration to one user and has custom strap + face gasket.
- passthrough is amazing, no distortion seems close to retina level, notably darker than your actual vision…
As much as I hate Meta. The Quest 3 is my recommendation for anyone getting into VR.
And Supernatural is the best Fitness VR app.
It pains me to say this, but it’s true.
Now if only they didn’t treat 3rd party devs like literal dirt we might have an industry.
My favorite line is “While I do completely understand your concerns, we do need to have you comply with the Facebook TOS” like
@FBRealityLabs
@Facebook
thinks they are some authoritarian government.
What’s holding back AR/VR is the hardware, and user experience, period.
Price at $299 is fine. Content is actually pretty good.
Headsets are heavy, fragmented from other ecosystems, and hard for new people to figure out.
AAA games will not save VR. Hardware developments will.
The average VR user uses their headset in a MONTH.
What they use their phone in a DAY.
Keep these numbers in mind when building for VR.
What gets people to put on the headset, at all?
I know people been enjoying bagging on Humane all day.
And I generally agree that it probably won’t go mainstream.
But if you had any idea how hard it was to ship unique hardware, you should give them huge respect for even shipping it.
I am truly terrified by the addictive nature of modern video platforms.
I catch myself casually watching a short video to relax and 2 hours go by unintentionally. The length of an entire movie.
Do not underestimate this brain drain and what it will do to us, and our youth.
Well this is awesome. Valve released an app to stream your Steam games to the Quest 2/3.
Don’t expect a new Valve headset for a while though. They focusing on the Steam Deck.
Tell me anything in XR that could get a random group of adults this amped.
This was not planned at all, the guy shout-casting his friends just wanted to do it.
This is just the beginning with only
@BartronPolygon
and I can do.
Augmented Sports is going to be huge!
Guys, even someone with limited understanding of hardware knows that the
@VisorXR
is BS.
The concept video has no battery.
No projection in the displays.
2x 4K Displays at $399? lol
MR footage is from a Quest 3.
This co is going to take all your money with their SPAC.
The Quest "mixed reality room" setup is a nonstarter. Have to manually draw a 3D ruler around your entire room.
95% of consumers simply won't do this.
Mixed reality apps that use the room mesh are DOA unless they automate this.
May not be possible without a depth camera.
Even Zuck seems to think that AR sports is going to be the biggest use-case of upcoming headsets.
First shown demo of the upcoming "Cambria" headset is an AR sport. (Fencing)
Anyone who doesn’t see the problem with AR glasses recording everything should watch the Black Mirror episode “The entire history of you”.
Being able to relive past relationships and memories is going to be dangerous for our mental state.
We are not designed to relive the past.
My only comment on the Quest 3 ($499) headset just announced.
Guys I’m a nerd, but this looks ridiculous. It looks like they are about to shoot lasers out of their face.
Just the front casing being black would have made the 3 camera slots and back not look so bad.