Making thought-controlled music with a hacked arm prosthesis
Making thought-controlled music with a hacked arm prosthesis
5:02

Making thought-controlled music with a hacked arm prosthesis

Science
For me, this feels like I'm filled with my thoughts [SOUND] I recently came across a video on YouTube by bear told Meyer A musician and DJ who hacked his prosthetic arm to create a new way of turning his muscle signals into musical manipulations. I'm wearing this prosthetic hand right and it's a pretty neat device and it's controlled very easily with electrodes that sits on the surface of the skin and as you can see, you can rotate the hand and the full 360 And it's kind of okay and easy to work a record player with that to DJ with records and so forth. But a while ago, I started into music production and I'm using modular synthesizers to do music and devices that look Like this And these devices, you know they have so many knobs and buttons. It's really difficult to operate them with a hand prosthesis like this. But as you can see, there is a little jack next to each button. Button. That way you can plug in a cable to remote control every button and I always thought it's kind of stupid that my arm picks up electricity from my body, which is then transformed into a movement here and then I turn a knob there which is transformed back into electricity. It's kind of a stupid detour. So why not take the more direct way [MUSIC] And find a way to plug a cable like this into my arm and send the signals directly into the synthesizer. Thanks to some 3D printing, soldering, and parts from an older, non-functioning prosthesis, [UNKNOWN] and friends were able to make that dream into a real prototype device called Synlimb. I can pop this off. I know it looks weird, like don't be afraid you have to spin it a couple times and then it'll just pop off like this. And then we've developed this device here, right? And you can pop it on here like this. Switch it on. Right, that's what it looks like. And now you can plug a cable in here and take the other end of the cable and plug it somewhere like in here, right and then you can transform the signals from the prosthesis into the synthesizer. So that's how it works. If you don't think about a melody and it comes out of these cables, that's not how this works. You can really use these two cables to modify different parameters and it really depends on where you plug them in. So the way what I normally do is I program a little melody and then I change the parameters of that melody with the signals coming from here. So you change the pitch for example, or you change the groove Or you change the length, and then you plug it into something else. And then you can use it to cut the bass and then you can plug it into something else. And then the same signal that just a second ago would cut the bass now opens and closes the filter. That's the great thing about these modular synthesizers. They're so versatile. You can, basically control any parameter that's musical with a plug like this. [MUSIC] Offset undelivered, they ID unit. So the pitch will go off so I can now open the filter. Change the pitch. So everything we need for [UNKNOWN]. [MUSIC] It's difficult to describe how it feels. How do you move your finger, right? You just think about it and then it happens. And so I think the things that I would normally think to move the prosthesis. It's something that I've learned to do For the past 20 years, it's second nature for me to produce these signals. So you just think about them and it happens and to to experience that this thing that you do with your head does something completely different than you're normally used to, like normally you're used to like your hand is moving, and then suddenly something musical happens and it's still A mixture of surprise and joy. I've spent the past 20 years to learn to train my body to produce a specific muscle signal. So I've kind of learned to use my body as an interface to produce specific signals that technology will understand. For everybody else, it would be an extremely steep learning curve. And that's why this kind of interface I think it's not that suitable for the mass market. We need something that interfaces more dialect directly with the brain without the detour of brain to muscle to signal right. But that will still need a lot of reasons. You can find Bertolt's full video on the [UNKNOWN] prototype over on his YouTube channel. I'm still very, very much overwhelmed by the kind of attention it has generated. I mean, just the fact that we're talking right now. Now, it's kinda weird. So but yeah, have a look at the YouTube channel, check out my SoundCloud. It'll be great [MUSIC]

Up Next

See Inside Rivian's Electric Vehicle Test Labs
rivian-cnet

Up Next

See Inside Rivian's Electric Vehicle Test Labs

Apple's AI at WWDC Will Take a Different Twist
omt-wwdc-custom-ai-emojis-v2-clean

Apple's AI at WWDC Will Take a Different Twist

Travel Advice from AI? The Points Guy Schools ChatGPT
exvsai-the-points-guy-clean

Travel Advice from AI? The Points Guy Schools ChatGPT

Apple TV Just Leveled Up with the RetroArch App
240523-site-i-turned-my-apple-tv-into-a-sega-genesis

Apple TV Just Leveled Up with the RetroArch App

I Tried Three Fitness Apps to Help My Postpartum Recovery
cs-ai-coaching-seq-00-07-22-19-still001

I Tried Three Fitness Apps to Help My Postpartum Recovery

Samsung Galaxy S24 Ultra: Ultimate Good Lock Tips and Tricks
240509-yt-galaxy-s24-ultra-good-lock-app-v04

Samsung Galaxy S24 Ultra: Ultimate Good Lock Tips and Tricks

Did a Week With the Apple Watch Make Me Use My iPhone Less?
240419-site-does-having-an-apple-watch-make-me-use-my-iphone-less-4

Did a Week With the Apple Watch Make Me Use My iPhone Less?

How Google Tests the Cameras in Its Pixel Phones
240417-site-google-pixel-lab-exclusive-1

How Google Tests the Cameras in Its Pixel Phones

Boston Dynamics Retires Its HD Atlas Robot
p1022506-00-00-01-20-still001

Boston Dynamics Retires Its HD Atlas Robot

What's the Future of Phones? Expert vs. AI
240412-site-what-is-the-future-of-phones-expert-vs-ai-v1

What's the Future of Phones? Expert vs. AI

Tech Shows

The Apple Core
apple-core.png

The Apple Core

Alphabet City
alphabet-city.png

Alphabet City

CNET Top 5
top-5.png

CNET Top 5

The Daily Charge
the-daily-charge.png

The Daily Charge

What the Future
what-the-future.png

What the Future

Tech Today
tech-today.png

Tech Today

Cooley On Cars
on-cars.png

Cooley On Cars

Carfection
carfection.png

Carfection

Latest News

Home Security Cams Like My Nest Doorbell Are Getting Smarter With AI
must-use-subject-ring-doorbell-device

Home Security Cams Like My Nest Doorbell Are Getting Smarter With AI

Apple Watch: New Features Coming in WatchOS 11
cnet

Apple Watch: New Features Coming in WatchOS 11

Apple's MacOS Sequoia: The New Features You'll Want to Try
240610-yt-macos-ai-mac-vs-ai-pc-v06

Apple's MacOS Sequoia: The New Features You'll Want to Try

Apple Intelligence: What to Know About Apple's Gen AI
cnet

Apple Intelligence: What to Know About Apple's Gen AI

Apple Introduces Private Cloud Compute for AI Processing
ipados-00-09-14-29-still003

Apple Introduces Private Cloud Compute for AI Processing

Apple Reveals InSight for TVOS
screenshot-2024-06-10-at-12-20-29pm.png

Apple Reveals InSight for TVOS

OpenAI's ChatGPT Is Coming to Apple Apps
screenshot-2024-06-10-at-20-01-28.png

OpenAI's ChatGPT Is Coming to Apple Apps

Apple Redesigns Siri With AI and Glowing Borders
siripic

Apple Redesigns Siri With AI and Glowing Borders

Apple Updates Health Features With New Watch OS 11
240612-wwdc-watch-os-11

Apple Updates Health Features With New Watch OS 11

iPhone Mirroring Comes to Macs with MacOS Sequoia
screenshot-2024-06-10-at-11-45-50am.png

iPhone Mirroring Comes to Macs with MacOS Sequoia