
In 2022, a rehabilitation device that, when fitted to the arm of a person suffering loss of hand function due to stroke, moves the fingers as the patient performs the action in their mind became a reality. It was developed by an innovative startup that produces such medical devices as well as avatar robots using the biosignals emitted by human muscles to reproduce their function. Masahiro KASUYA started the business with his friends in 2013, while in graduate school. He says his aim is to use cyborg technology to enable people to do what they want to do. We look at a vision for the future of humanity from a genius entrepreneur on the cutting-edge of Japanese technology.
-
0m 23s
Something new is on the horizon in the field of rehabilitation.
-
0m 31s
This patient suffered a stroke, and as a result, can barely move her right hand.
-
0m 40s
To aid in her rehabilitation, the facility has set up a robot hand.
-
0m 45s
Move.
-
0m 50s
Release.
-
0m 54s
In the instant when she visualizes moving her hand in her mind,
-
0m 58s
the robot uses bio-electric signals to move the paralyzed hand as envisioned.
-
1m 07s
In general, the first three months after a stroke are the most effective period for recovery of function.
-
1m 17s
But the hand is a challenge.
-
1m 19s
Only 30 to 40% of patients recover enough function to eat normally.
-
1m 29s
On her fourth day of rehabilitation using the device, a change occurred.
-
1m 38s
My index finger suddenly moved upward.
-
1m 42s
It was such a surprise. I didn't expect that.
-
1m 47s
I said, "look everybody, it moved!"
-
1m 51s
It's like the part of my brain
that was gone came back to life. -
1m 57s
It feels like my brain and
my finger are reconnected. -
2m 05s
Like the connection was restored.
I guess that's how it feels. -
2m 12s
First available in 2022, this rehabilitation system uses cyborg technology that's recently gotten global attention.
-
2m 26s
It was developed by a startup entrepreneur and innovator in robotics, Masahiro Kasuya.
-
2m 36s
He's developed a number of robots using cyborg technology,
-
2m 40s
like reading biosignals from human muscles to mimic their function.
-
2m 51s
People are at the heart of it;
their desires, things they want to do. -
2m 57s
Using cyborg technology to enable this
is what we would like to do. -
3m 03s
This time, we look at how the fusion of human and machine, will shape our future.
-
3m 12s
A hospital specializing in neurosurgery located in Muroran, Hokkaido.
-
3m 19s
A region with an aging population, the facility here treats over 800 stroke patients a year.
-
3m 28s
Strokes, in which the brain is damaged by blocked or ruptured blood vessels, often result in partial paralysis.
-
3m 40s
So, rehabilitation to recover function is vital.
-
3m 46s
Okay, make a fist once again.
-
3m 50s
This patient suffered a stroke more the 20 days ago and has partial paralysis on the left side.
-
3m 57s
Her left hand is almost entirely immobile.
-
4m 02s
Ordinarily when you move your hand, nerve signals from the brain
-
4m 07s
travel down the spinal cord and through the peripheral nerves to the muscles.
-
4m 12s
A contracting muscle produces a myoelectric signal, a current, in response to this stimulus.
-
4m 22s
When nerve cells in the brain are damaged by a stroke,
-
4m 26s
the signals they generate become weak, and aren't properly transmitted.
-
4m 32s
Paralysis is the result.
-
4m 39s
This finger training rehabilitation system detects faint biosignals and interprets them.
-
4m 47s
To accomplish this, three electrodes are positioned on the forearm.
-
5m 03s
Okay, squeeze. That's it, good.
-
5m 08s
A completely immobile hand can now move slightly.
-
5m 14s
The robot assists movement by reading the electrical signals from the brain.
-
5m 22s
When attempting to move the hand,
-
5m 24s
a weak signal is sent to the arm through nerve pathways, causing a myoelectric discharge.
-
5m 32s
This is detected by the electrodes and analyzed.
-
5m 36s
When the desired movement is determined...
-
5m 40s
The robot hand moves within a few tenths of a second.
-
5m 45s
Seeing and feeling this movement, is believed to be a form of biofeedback that promotes re-learning in the brain.
-
5m 53s
With repeated stimulation, the brain adapts.
-
5m 57s
Nerve cells surrounding the damaged area acquire new function, creating a sort of "detour," or new neural pathway.
-
6m 06s
It's thought that, as a result, patients will be able to re-learn to move their hands.
-
6m 17s
With a therapist's help, patients do exercises like coordinated breathing while moving the paralyzed hand.
-
6m 25s
Here we go... Okay, okay, okay.
-
6m 31s
However, since they can't observe patient biosignals themselves, getting the timing right is difficult.
-
6m 42s
With the device, patients can observe the movement of the hand on the screen.
-
6m 50s
The detected myoelectrical waveform and its type are displayed.
-
6m 58s
Open.
-
6m 59s
In the case of a healthy individual, moving the hand according to the device...
-
7m 06s
The myoelectric signal for opening the hand is green,
-
7m 10s
when relaxed it's colorless, and for gripping it's blue.
-
7m 15s
The signal appears as a continuous line during myoelectric activity.
-
7m 22s
Open.
-
7m 27s
Relax.
-
7m 29s
In the case of a patient with paralysis, even though they are unable to move,
-
7m 35s
myoelectric signals are still present.
-
7m 37s
Although the waveforms are small and may be abnormal.
-
7m 41s
The device interprets the patient's command and strengthens the signal.
-
7m 48s
Open.
-
7m 52s
Relax.
-
7m 55s
The robot hand then moves according to the patient's command.
-
8m 03s
It gives them the sensation of controlling the hand via the onscreen display and corresponding movement.
-
8m 12s
This patient is now capable of slight movement.
-
8m 19s
Open. Okay, open.
-
8m 26s
It took some time, but the signal was generated.
-
8m 30s
It's possible for the system to display subtle changes in these biosignals.
-
8m 40s
It's thought that repeating this type of rehabilitation
-
8m 44s
in which image and movement are linked helps the brain to re-learn how to move the body.
-
8m 55s
After rehabilitation, the therapist checks the condition of the hand.
-
9m 00s
Yes! That's it!
-
9m 09s
It is moving, just a little.
-
9m 13s
The hand indeed shows signs of recovery.
-
9m 20s
Improvement seemed hopeless,
so I guess this is progress. -
9m 27s
Many who've had strokes can't
remember how it felt to move, -
9m 34s
or they have trouble imagining it.
-
9m 37s
Being able to visualize if biosignals
are actually being read or not, -
9m 43s
having it on the screen is a big plus.
-
9m 50s
But how is the device able to read these biosignals in such detail?
-
9m 56s
The answer is AI technology; a field which has been evolving rapidly in recent years.
-
10m 05s
System developer, Masahiro Kasuya.
-
10m 09s
With PhDs in robotics and AI engineering,
-
10m 13s
he's been involved in every step of the process, from design to software development.
-
10m 22s
The rehabilitation system is the first product from his company to see practical use.
-
10m 28s
Real-world usability is key.
-
10m 33s
It won't be used by AI specialists,
but by doctors and therapists. -
10m 38s
Making it easy for them to use
was something we focused on. -
10m 46s
With conventional biosignal processing it had been difficult to identify the type of signal,
-
10m 52s
even though it was possible to determine the strength by the size of the waveform.
-
10m 59s
Kasuya examined myoelectric data from thousands of people.
-
11m 03s
Depending on the action, such as making a fist or bending the wrist, frequency and amplitude changes.
-
11m 11s
This type of data was then processed by machine-learning.
-
11m 21s
A unique algorithm was developed that, by capturing the myoelectric currents in the arm,
-
11m 27s
was able to identify the desired movement of the hand based on subtle differences in the waveform.
-
11m 35s
Open.
-
11m 36s
What movement is the human trying to make?
-
11m 39s
The AI system they developed boasts high-accuracy real-time analysis,
-
11m 45s
making it possible to easily distinguish the desired myoelectric signal from unwanted noise.
-
11m 53s
In general, electrodes must be placed accurately to detect the myoelectric signals...
-
12m 00s
Basically, anywhere is okay.
-
12m 02s
Ordinarily it's quite difficult,
but with the rough outline defined -
12m 08s
the AI can fine tune it later.
-
12m 14s
Using biosignals, you can move it
in the way you move your own body. -
12m 20s
So, instead of being an object,
it becomes like a part of you. -
12m 23s
This concept is what interests me.
-
12m 29s
Around 2 months ago, Kinue Kayama suffered a stroke, becoming unable to grasp or pinch with her right hand.
-
12m 42s
26 days after onset, she began rehabilitation with the device for one hour every day.
-
12m 52s
And on the fourth day, she was able to move her fingers.
-
12m 59s
One month after using the device.
-
13m 01s
Kayama is now transitioning to rehabilitation, picking up and releasing objects, unassisted by the robot.
-
13m 11s
She'll soon be leaving the hospital.
-
13m 17s
It's the first time I've been able
to do such delicate work. -
13m 28s
It's important.
-
13m 30s
And when I go home, I'll keep at it
to get back even more function. -
13m 36s
I'll do my best for another 10 years
at least, and try to make the most of it. -
13m 45s
Recently, this type of so-called "neurorehabilitation" has seen real-world implementation and has attracted much interest.
-
13m 55s
The feeling that they're doing it
themselves is very important. -
14m 01s
I guess it's biofeedback.
-
14m 03s
Do this and it moves, do that it opens.
They develop an internal sense for it. -
14m 12s
This kind of neurorehabilitation,
as we call it, is extremely important. -
14m 19s
The treatment may also be effective for patients whose muscles have stiffened over time after the onset of a stroke.
-
14m 26s
This patient suffered a stroke 6 months earlier.
-
14m 34s
She began rehabilitation after receiving a botulinum treatment to loosen the muscles.
-
14m 43s
Doing so, movement returned to the immobile fingers, allowing her to wring out this dish cloth.
-
14m 53s
It was previously believed that loss of function caused by damage to the brain from a stroke was irreversible.
-
15m 00s
But recent studies have shown that the brain can adapt, making it possible to restore lost function.
-
15m 09s
In addition to biosignal interpretation, the system developed by Kasuya has another technological advantage:
-
15m 17s
a robotic control mechanism capable of sophisticated movements.
-
15m 24s
How best to move a robotic arm?
-
15m 27s
Kasuya focused on the human body.
-
15m 29s
Closely studying the physiology of muscles and tendons.
-
15m 37s
The hand moves here, but the muscles that
move it are actually here. -
15m 44s
We began with the physiology
of how the hand actually moves. -
15m 49s
And this is the first version of
the prosthetic hand we developed. -
15m 55s
His design imitates the human hand, reproducing its movements using wires in place of muscles and tendons.
-
16m 13s
Being wire driven, means no large
motors are needed in the hand. -
16m 21s
This would make it too heavy.
-
16m 24s
Wire drive lets you move while gripping,
and is significantly lighter. -
16m 33s
But existing technology made it difficult to accurately reproduce the hand's delicate movements using wires.
-
16m 44s
So Kasuya evaluated the material properties of the wire, devising pathways for it to move in.
-
16m 53s
The control software was also built from scratch.
-
17m 00s
Repeated testing was performed with the hand worn by a disabled person.
-
17m 15s
With the same size and weight as the human hand,
-
17m 18s
it is now capable of performing both powerful and delicate movements, unimaginable with a conventional prosthetic hand.
-
17m 31s
Using the prototype hand, they entered a competition.
-
17m 35s
The Cybathlon is an international competition in which people with disabilities compete wearing state-of-the-art prosthetic arms.
-
17m 44s
Their experience competing against the best in the world at the competition
-
17m 49s
made Kasuya feel that his company's technology could find global acceptance.
-
18m 03s
Kasuya is also working on research and development in areas outside of medicine.
-
18m 11s
This is his "avatar robot."
-
18m 13s
When it was unveiled in 2018, it attracted worldwide attention.
-
18m 21s
The avatar robot remotely reproduces the movements of a human operator with high precision.
-
18m 29s
Even bending and twisting all five fingers, Kasuya's actions are reproduced.
-
18m 35s
Full freedom of movement.
-
18m 40s
This robot too is wire driven.
-
18m 46s
The smooth human-like movements of the hands in particular stunned researchers around the world.
-
18m 52s
With five fingers, it can use tools designed for humans to perform a variety of tasks.
-
19m 03s
And even when in a remote location from the operator, movements are reproduced with minimal latency.
-
19m 12s
Use in the difficult-to-reach environment of space is one anticipated application.
-
19m 19s
For example, on a space station or the surface of the moon,
-
19m 23s
work once done by astronauts could be done from the ground.
-
19m 27s
We could be here on earth while working in space.
-
19m 34s
To make this happen, Kasuya worked with JAXA, the Japanese space agency,
-
19m 40s
to simulate work done by astronauts on the space station.
-
19m 45s
These developments also led to the further evolution of a hand-only avatar robot.
-
19m 56s
The accuracy of fine movements has also been improved.
-
19m 59s
Allowing the robot to scoop up these fine grains with a spoon.
-
20m 11s
It can even lay individual portions out for wrapping.
-
20m 21s
It can pinch these soft cotton balls without crushing them.
-
20m 26s
And subtle power adjustments are handled easily.
-
20m 34s
But it's also capable of heavy lifting, like this 5-kilogram weight.
-
20m 42s
The operator's motions are reproduced with incredible accuracy.
-
20m 50s
Avatar robots capable of complex tasks may someday be found at construction sites and other places unsafe for humans.
-
21m 01s
Being controllable from anywhere on earth, they could fundamentally change the way we work.
-
21m 10s
Such commercial applications are very close to being a reality.
-
21m 17s
Doctors have used it for patients,
and gotten feedback. -
21m 23s
Yes. And they specifically mentioned
the system in their questions. -
21m 31s
Is that so? The questioners?
-
21m 34s
That's real brand recognition. Fantastic!
-
21m 40s
Cyborg technology could bring revolutionary changes to our daily lives.
-
21m 45s
But where did Kasuya find the inspiration for his endeavors?
-
21m 51s
Loving both robots and making things from an early age, he won prizes for his inventions.
-
22m 01s
This was the title of his elementary school graduation essay at age 12:
-
22m 08s
"My Dream Is to Be a Medical Inventor."
-
22m 12s
I wanted to do medicine and engineering.
I didn't know the word, "cyborg," yet. -
22m 19s
A doctor who's also an inventor
is really what I imagined I'd be. -
22m 26s
I had a feeling for what I wanted to do
but I had trouble putting it into words. -
22m 35s
He decided to pursue cyborg engineering at age 14.
-
22m 40s
Transfer the data.
-
22m 42s
He fell in love with an anime depicting the fusion of humans and machines.
-
22m 54s
He even drew a sketch of a drive system for a powered suit to strengthen human capabilities.
-
23m 04s
This part labeled AM is
the artificial muscle unit. -
23m 08s
And the basic circuit that drives it.
-
23m 13s
So where the power comes from and
how it's controlled are also included. -
23m 21s
I used to think about things like this
all the time back then. -
23m 28s
As an undergraduate he attended the Waseda University school of science and engineering.
-
23m 34s
Working part-time to save money, he incredibly was able to make the power suit he'd imagined a reality;
-
23m 41s
a device that assists the elbow, making it easier to lift heavy objects.
-
23m 48s
In 2013 as a graduate student at The University of Electro-Communications,
-
23m 53s
he started a business with fellow research students.
-
23m 57s
Maybe reroute these wire pathways...
-
24m 00s
His dream of a practical application for cyborg technology became a reality.
-
24m 08s
Having stunned the world with his rehabilitation system and robot avatar,
-
24m 13s
he's now moving on to the next phase of his efforts.
-
24m 21s
In 2020, Kasuya established a new base for development in Minamisoma, Fukushima.
-
24m 31s
Here, he and his team are developing state-of-the-art avatar robots.
-
24m 39s
The base was set up as an environment in which repeatable testing and experimentation could be conducted,
-
24m 44s
allowing the development of avatar robots to proceed at a rapid pace.
-
24m 55s
A one-of-a-kind facility for robot performance evaluation and operator training is also located nearby.
-
25m 06s
A national project to establish the foundation for a new industry,
-
25m 10s
the vast grounds include bridges and tunnels, flooded townscapes and a variety of other testing environments.
-
25m 21s
They're currently testing a caterpillar track system to allow an avatar robot to travel over rough terrain.
-
25m 28s
Here, they check the function of the prototypes and conduct demonstration trials.
-
25m 35s
The local area was hard hit by the 2011 Great East Japan Earthquake.
-
25m 44s
This famously caused the accident at the Fukushima Daiichi Nuclear Plant.
-
25m 48s
Its decommissioning has become a long and difficult task.
-
25m 55s
Kasuya is also participating in the development of a robot to aid in this ongoing process.
-
26m 01s
The plan is to use remotely controlled robots for analysis of radioactive materials.
-
26m 10s
Our robot hand doesn't just do one thing.
-
26m 16s
Like a human hand, it can do multiple tasks.
This means it can work quite efficiently. -
26m 20s
For example, it could allow workers
to work without exposure to radiation. -
26m 25s
We're very close to achieving this.
-
26m 29s
We're at the stage of development
where such things will be possible. -
26m 35s
Avatar robots working in place of humans.
-
26m 41s
Through cyborg technology, the fusion of humans and machines, a new world of possibilities is on the horizon.
-
26m 49s
Our ultimate vision is that anyone,
regardless of mobility, or physical condition -
26m 55s
can live in the way that they want to.
-
26m 57s
In addition to prosthetic hands,
we want to develop other parts, -
27m 03s
essentially for the whole body.
-
27m 07s
Those are our current plans.
-
27m 10s
This massive diagram lays out various perspectives on cyborg technology,
-
27m 15s
including areas such as religion and culture.
-
27m 19s
Life is changing rapidly, so how can we
make that experience consistent -
27m 22s
with what we've known up to now?
-
27m 27s
I don't think cyborg technology
should be forced on people, -
27m 33s
but an option; some use it, some don't.
-
27m 36s
How humans deal with this technology,
and how we should make use of it, -
27m 39s
this needs to be clearly defined
as we move forward. -
27m 44s
What will a future shaped by cyborg technology look like?
-
27m 48s
The real-world efforts of Kasuya and others will likely provide the answer.