RiftSketch: Live coding in VR with the Oculus Rift, Firefox WebVR, JavaScript and Three.js

273K views · 12 years ago · demo · intermediate · dated

Brian Peiris demonstrates RiftSketch, a live-coding environment inside an Oculus Rift built with JavaScript and Three.js and running in Firefox WebVR. He edits code while wearing the headset, and the 3D scene around him changes as he types.

HN credits it with convincing people to buy into VR and WebVR, as the clearest picture of programming the environment you are standing in.

“This video is what convinced me to buy in to VR”

18 comments from Hacker News

m
@moron4hire2020 · in “Holographic optics for thin and lightweight virtual reality”
Part 2: That was right about when Google Cardboard hit. That was 2014? I saw it during a Google I/O livestream and just so happened to have a few lenses left over from some still-photography experiments involving lasers and... never mind, another thing that went nowhere, I just had some lenses around. I quit watching the Google I/O stream and immediately hacked together a new cardboard box viewer with the lenses. Saw Versailles, which I have never been to, but I have been to Linderhof Palace in Bavaria, which is modelled after Versailles. Saw the Galapagos, where my wife and I had just spent our honeymoon about a year or so before. I immediately saw the experience was closer on the spectrum to really being somewhere than it was to seeing it on TV. So I'm sitting there, this cardboard box in my hand, this powerful smartphone in my hand, thinking to myself "I have to do this, I have to make these things". But all I knew was C# and JavaScript. Unity was garbage at the time. It's still garbage, but also back then. I had tried my hand at native app development and just didn't have the patience for Xcode or Android Studio. So I started hacking with Three.js and JavaScript. I ended up making the first JavaScript API for VR, releasing the first version about a month before the first announcements of WebVR. Then I saw RiftSketch (▶ this video). It blew my mind. Started chatting with people. Brian Pieris talked about wishing he could get syntax highlighting into the app, and complained about how he had to use CSS 3D transforms to position the box on top of his WebGL view. At the time, I recognized how early everything was and how primitive the tools were. So I thought, if I could make developer-oriented tools that made making VR easier, I could make something out of that. I thought Brian could be my first user. So I made a RiftSketch clone, added it into my WebVR framework, and that became what was eventually called Primrose. I got a small amount of internet fame out of Primrose. People started recognizing me at conferences. A "startup" hired me to be their head of VR. That turned out to be a different kind of hell. It crashed and burned after about a year. We had a kid and another one due any day, and we were completely out of money. I thought he VR dream was finally over. Started applying to jobs back in web and DB work. In the mean time, I had just started working in Unity at the startup, I had all this time on my hands, and Unity was offering full-access to their learning materials for the first month for new customers. It was clearly designed to go through in 3 months, but I churned through all of it in a month. Then one of the folks that I had hired on at the startup to work on VR stuff made a connection for me at a gigantic, multinational consultancy, for their Unity dev team. He thought I was pretty good even before I learned Unity properly, so I breezed through the interview. It was also the most money I'd ever been paid. Seemed like a huge win! Then the reality of giganto-consultingware companies set in. You've not seen office politics until you've worked in an organization that runs under a partnership model. It wasn't exactly the worst job experience I've ever had, but it definitely ranks up there. But it basically got me a ton of Unity development experience. They mismanaged the hell out of the team and eventually had to layoff half of everyone. I also ended up meeting a few folks along the way who got me an interview at my current place. I'm now the head of VR at a foreign language instruction company. Our main client is the military's foreign language school, the very same place where my parents met and then shortly thereafter had me. Things are going well. The company is stable. It's on its second owner, who brought it back from bankruptcy in the early 2000s. I report directly to the president of the company. He thinks the world of me and lets me do whatever I think is best. We have
Strongly recommendsView on HN
m
@mmanfrin2018 · in “Relativ – A VR headset that you can build yourself for $100”
I think the less cynical answer is that HTC often has good ideas for physical devices but then often fails to follow through and iterate well. They're also just struggling as a company in general. But damn, so I 1000% agree with being bummed about it not being the hackers headset. I preordered the Vive because of a VR video of a guy programming the environment he was in at the moment: ▶ this video I would love to use a VR IDE some day.
Strongly recommendsView on HN
m
@mmanfrin2017 · in “Introducing Oculus Go, Plus Santa Cruz Updates”
This video is what convinced me to buy in to VR: ▶ this video
Strongly recommendsView on HN
a
@adamnemecek2017 · in “Firefox 55: WebVR and more”
I've posted this some three years ago and it still blows my gourd ▶ this video
Strongly recommendsView on HN
r
@robin_reala2021 · in “RiftSketch: Live coding in VR with Firefox WebVR, JavaScript and Three.js (2014)”
Submitted the video to Hacker News.
RecommendsView on HN
t
@timthelion2017 · in “RiftSketch: Live Coding in VR with the Oculus Rift”
Submitted the video to Hacker News.
RecommendsView on HN
k
@kibwen2017 · in “RiftSketch: Live Coding in VR with Oculus Rift, Firefox WebVR, and Three.js (2014)”
Submitted the video to Hacker News.
RecommendsView on HN
m
@mmanfrin2016 · in “Wind Waker Graphics Analysis”
Does anyone know of any other threejs talk/walkthrough posts? I love watching the development of things with it, like this video: ▶ this video
RecommendsView on HN
c
@colinmcd2015 · in “RiftSketch: live coding in virtual reality”
Submitted the video to Hacker News.
RecommendsView on HN
j
@jfoster2015 · in “Oculus Rift”
It doesn't (yet) seem particularly comfortable, but this was an impressive demo of someone coding their environment in the Rift. ▶ this video
RecommendsView on HN
e
@et13372015 · in “Myself – v1.0.3”
There's also my favorite: live-editing a VR environment. ▶ this video
RecommendsView on HN
c
@corysama2015 · in “Show HN: Primrose – a text editor that runs in a WebGL texture”
Yep. To glimpse the potential for this, people should check out Peiris's demo vid: ▶ this video If anyone is interested in working on something like this, there's a very small community germinating in link
RecommendsView on HN