"Voice Driven Development: Who needs a keyboard anyway?" by Emily Shea

Strange Loop Conference
11 HN recommenders · recommended in 10 months, 2019–2023
YouTube
35K views · 7 years ago · talk · intermediate · evergreen

Emily Shea explains how she writes code by voice using Talon after developing RSI, and demonstrates it live, including driving vim in Ruby. The talk covers the setup, the tweaking it took and the state of voice coding.

HN points to it as proof that voice coding is much better than people expect, and as the talk to watch for anyone interested in hands-free input.

“Here's a good talk from a senior (now staff) engineer at Fastly who uses Talon daily”
Input devices & novel interfacesAccessibility
#voicecoding#talon#rsi#hands-freeinput#accessibility

15 comments from Hacker News

c
@cube22222023 · in “Numen: Voice Control for Handsfree Computing”
It's worth mentioning Talon[0] here, which is a system for offline voice control as well, with great python-based scripting (and also supports eye tracking, though I haven't used it myself). Using your computer or programming with it works like a charm, with some interesting and impressive projects based on it coming out as well, like Cursorless[1]. There's a great strangeloop talk[2] demonstrating talon and the actual state of voice coding, which is how I discovered it (hint: it's much better than you'd expect, and straightforward to learn at that). [0]: link [1]: link [2]: ▶ this video Disclaimer: not affiliated, just a happy occasional user
RecommendsView on HN
J
@JoachimS2023 · in “Voice Driven Development: Who needs a keyboard anyway? (YouTube)”
Submitted the video to Hacker News.
RecommendsView on HN
g
@glenjamin2022 · in “Hey, GitHub – Waiting list signup”
There was an excellent talk at Strange Loop a few years ago by Emily Shea about how she'd learnt to code vim using her voice to combat RSI. ▶ this video The demos are in Ruby, but I could imagine that languages with strong type-aware auto-completion could be easier to do.
RecommendsView on HN
k
@kbenson2022 · in “Ask HN: Why is there no high quality method for voice control of a PC?”
For anyone interested in this topic, you might be interested in this tech talk[1] from Emily Shea. In it she demos a tech stack similar to what's mentioned here, to fairly good effect. It does appear that required a lot of tweaking on her part and is optimized for the writing of code, and I'm not sure how well it functions for more general contexts. 1: ▶ this video
RecommendsView on HN
5
@58x142021 · in “Spatial Keyboard Navigation”
I think you'll find this presentation by Emily Shea on voice driven development to be intriguing. ▶ this video aside, novel HIDs are IMO a huge market gap that I'd really like to invest time in if anyone wants to chat.
RecommendsView on HN
C
@Centigonal2021 · in “Voice Assistant for VSCode”
Here's a good talk from a senior (now staff) engineer at Fastly who uses Talon daily: ▶ this video
RecommendsView on HN
c
@cube22222021 · in “Squeezebox Keyboard”
Check out voice programming with Talon[0], I've recently been playing around with it (to be less reliant on my hands), and it actually takes little work to get started and fairly productive. The state of voice programming is much better than most people would imagine. Here's a nice talk on strangeloop by a person who switched to it permanently: ▶ this video [0]: link
RecommendsView on HN
l
@lunixbochs2021 · in “Typing, RSI, and what I do differently”
My project, Talon, is free and cross platform. It might have some options that can help you: link Some blog posts: - link - link - link Some talks: - link - ▶ this video - link
RecommendsView on HN
d
@dmortin2021 · in “Voice Driven Development: Who needs a keyboard anyway?”
Submitted the video to Hacker News.
RecommendsView on HN
t
@tbabej2020 · in “Ask HN: Is there any work being done in speech-to-code with deep learning?”
While (likely) not using directly deep learning, I found the following talk [1] by Emily Shea on her code dictation setup (based on Talon Voice) both insightful and impressive. EDIT: Actual demo with coding starts at 18.00: ▶ this video [1] ▶ this video
RecommendsView on HN
t
@tambourine_man2020 · in ““Voice Driven Development: Who Needs a Keyboard Anyway?” By Emily Shea”
Submitted the video to Hacker News.
RecommendsView on HN
c
@cumwolf2019 · in “Voice Driven Development (Presentation 41min)”
Submitted the video to Hacker News.
RecommendsView on HN