Getting Smart with Road Repair

[SPECIAL EDITION]
This series includes selected stories from BIZ STREAM's signature "On-Site" reports. With a large portion of Japan's extensive infrastructure in use for nearly 60 years, experts must now constantly work to repair and maintain the nation's roads and highways. This report features companies that are using smartphones to identify and log damaged roads and manholes.

*Subtitles and transcripts are available for video segments when viewed on our website.

Getting Smart with Road Repair

A city road inspection vehicle uses a dash-mounted smartphone equipped with AI software to identify and report road damage, which is then sent to a cloud-based assessment and mapping system

The labor-intensive task of checking manhole conditions across Japan is now being turned into local events where members of the public help complete the task by using a game-like smartphone application

Transcript

00:30

Searching for road damage, while on the move.

00:34

And hundreds of volunteers happily hunting for...

00:37

manholes?

00:40

Both of these activities are using smartphones to inspect Japan's aging roads.

00:46

Today's On-Site Report shows how advances in technology

00:49

have made smartphones a key tool in keeping Japan's aging infrastructure safe and secure.

02:20

The only tool this road inspection vehicle is equipped with, as it patrols some of Tokyo's busiest streets,

02:26

is a single smartphone, mounted on the dash.

02:30

It's using a proprietary application called "Road Manager."

02:38

This software allows for detailed road inspections to be done without stopping.

02:46

The green boxes you see on the screen highlight areas where road damage has been found.

02:53

When the smart phone's AI-driven software detects cracks in the road,

02:56

it sends an image, along with other information, to a cloud-based data management system.

03:02

Even while in motion, the AI is able to detect cracks and fissures, as small as 5 millimeters in width.

03:09

The system can also detect fading or damage to white or yellow lines and other road markings.

03:15

Until now, road inspections were usually carried out in one of two ways.

03:20

The first method involved relying on the trained eyes of an inspection team.

03:24

However, because they need to stop to examine and log any damage manually,

03:28

this method can only cover about 15 kilometers of road per day.

03:32

The other method, using a specialized inspection vehicle, though highly accurate, is extremely expensive.

03:38

With usage fees costing over $75,000 per multi-day inspection, the city of Shinagawa would only agree to using it once every five years.

03:47

The "Road Manager" system, however, can be used in almost any vehicle,

03:50

and includes hardware, software, and analytic services for an annual fee of around $7,500.

03:57

Not only is it accurate and budget friendly, because the vehicle doesn't have to stop,

04:01

the system can inspect up to 40 kilometers of road per day.

04:07

Maeda Hiroya's company developed the "Road Manager" system.

04:11

While in university, he focused his studies on infrastructure inspection software.

04:17

With over a million kilometers of road, there's no way we can keep track of it the old-fashioned way.

04:24

Including his time in university, Maeda has collected over five million images of road damage, while working with local governments across Japan.

04:34

Using deep-learning to analyze the massive catalogue of images, he created a highly accurate damage recognition system.

04:40

The wave-form displays visual representation of road damage, while the numerical classification indicates the severity.

04:47

In addition, the system can take the images gathered by the front-facing smartphone camera,

04:51

and convert them into a bird's eye view image,

04:54

that allows them to accurately determine the size, scale, and orientation of any road damage detected.

05:01

After finishing an inspection route, team members head back to headquarters to go over the results.

05:09

The stretches of road, that were checked today, are shown with a thick blue line.

05:16

The number displayed indicates the total number of damaged sections detected.

05:20

Today's inspection resulted in the discovery and logging of 4,100 cases of road damage.

05:26

The system's AI, then classifies these cases into one of seven different types of damage;

05:31

such as "potholes," which can be hazardous to drivers, and "fatigue cracks," which can deteriorate further, leading to large-scale damage.

05:40

The AI system uses a scale ranging from 0 to 1, to indicate the level of damage discovered, with 1 being the most severe.

05:47

According to Shinagawa city regulations, potholes at or above 0.6,

05:52

and fatigue cracks at or above 0.7 in severity should be designated for repair.

05:57

Of the 4,100 instances of damage detected, nine reached or surpassed this threshold.

06:05

By clicking on a damage icon, the exact location is displayed, along with a still image of it, that was taken during inspection.

06:14

A team is then sent out to conduct a more detailed inspection of areas designated for repair.

06:20

In most instances the roadwork is completed within two weeks of initial detection.

06:26

Our predecessors built these roads for us one or two generations ago, so now it's our job to make sure we maintain them.

07:47

This man isn't lost, he's taking photos of manhole covers.

07:53

And he's not alone, a large group of people are combing the streets in search of them!

08:00

"Excuse me, what are you doing?"

08:03

This is a local event, where we take photos of as many manholes as we can.

08:09

Today's event is being held in Okazaki City.

08:11

Participants have been asked to take photos of manholes across a section of the city,

08:15

that runs approximately 10 kilometers north to south, and 4 kilometers east to west.

08:21

A specially-made "manhole hunting application" shows users locations that have to be checked.

08:27

In the area being covered today, 20,000 manholes have yet to be logged.

08:35

When a user uploads a photo to the app, its color changes to show it has been recorded.

08:42

With over 560 participants, event organizers hope that all 20,000 manholes can be photo-logged in just two days.

08:50

I'm on a diet, and trying to get out as much as I can.

08:55

It's fun to go around to different cities and regions, and see the various designs they have on their manhole covers.

09:03

I really want to come in first place, so I'm hoping to get over 1,000 photos.

09:09

Attracted by the fun, competitive style of the event, some participants came from as far away as Tokyo.

09:15

The top photo takers are ranked, and many participants are rewarded with gift certificates and other prizes.

09:22

The event was organized by Hayashi Satoru.

09:25

He works for a manhole manufacturer, and came up with idea of creating a smartphone game to help keep track of aging manholes.

09:33

There are so many them out there, there's no way we could check them all in a reasonable amount of time.

09:38

So I thought, maybe there's a way we could get members of the public to lend us a hand in getting the job done as quickly as possible.

09:47

In addition to the game, Hayashi is also working on developing an AI-based damage assessment program.

09:57

It can take a photo of any manhole, and instantly determine which of 21 different conditions apply to it.

10:10

Being able to handle the whole process on a single device really smooths everything out.

10:14

I also think it will help to increase our accuracy.

10:18

Hayashi hopes that by using this system, in conjunction with the manhole hunting events,

10:22

his company will be able to carry out necessary repairs faster than ever before.

10:28

Naturally, since we make manhole covers, we're always going to want to find and meet demand, wherever we can.

10:37

Back in Okazaki, the hunt is just coming to an end.

10:45

"How many did you get today?"

10:47

Let's see... in total, 832!

10:51

While I didn't quite reach my goal, I'm really happy that I could come down here and do something positive for this community.

10:59

In just two days, the participants succeeded in photographing all 20,000 manholes.

11:08

I think there are still quite a few manhole covers here that need replacing,

11:12

so these photos will help us to make sure that we can get the job done.