The Dream of Generative AI Engineering - Koji Nishiguchi, Nagoya University

Research is ongoing to apply 3D generative AI to structural design. Koji Nishiguchi of Nagoya University is on the frontline, with a simulation method which used to be thought of as impractical.

Supercomputer "Fugaku"
Eulerian finite volume method
Compressing a structure in a virtual space, and collecting mechanical data
The generative AI learns structures with mechanical parameters

Transcript

00:24

In November 2022, an American company published an AI chatbot, "ChatGPT."

00:31

Since then, many people have become familiar with generative artificial intelligence.

00:40

Generative AI creates not only text, but also images which are amazingly minute and realistic.

00:47

So much so that fake images sometimes confuse our society in a bad way.

00:57

And now, generative AI is broadening its field into 3D.

01:09

Koji Nishiguchi, Associate Professor at Nagoya University.

01:20

Nishiguchi is working on a 3D generative model incorporating structural mechanics.

01:26

A dream application.

01:37

We can easily use 3D generative AI with natural languages.

01:41

Non-experts in mechanics, such as artists and marketers,
can design structures.

01:51

That is my final goal.

01:56

If his idea is realized, our industrial scenes might undergo a revolution.

02:06

How is Nishiguchi approaching his structural design application with generative AI?

02:18

Today, we will focus on his study.

02:52

Koji Nishiguchi, Associate Professor at the Nagoya University, Graduate School of Engineering.

02:59

He is 38 years old, born in Hiroshima.

03:03

Three and half years ago, he came to Nagoya University and got his first laboratory in his life.

03:09

Computational mechanics is his area of study.

03:13

He researches the mechanics of various structures, analyzing them with computer simulations.

03:20

I think it should have generated a bit better results.

03:26

Yes, the outputs are too fat in shape, unfortunately.

03:32

Real shapes with a strain energy of 7.0 x 10^9
are a bit thinner.

03:40

Discussions with his grad and undergrad students are a source of many fresh ideas for him.

03:50

There is one thing that Nishiguchi has never given up in his academic life.

03:56

That is the "Eulerian finite volume method."

04:00

There are very few researchers who study this technique in the world.

04:08

For example, when we analyze the structural mechanics of automobile bodies,

04:13

we use a minute mesh for discretization, which means making many calculations for each cell.

04:21

The de facto standard is the "Lagrangian description."

04:25

A mesh is drawn along with the body shape.

04:29

On the other hand, Nishiguchi's "Eulerian description" uses an orthogonal mesh all over the space.

04:42

The Lagrangian method calculates only the necessary parts effectively.

04:47

However, because the mesh is drawn exquisitely along the body,

04:52

we have to draw a new mesh if the design is changed.

05:04

On the other hand, the Eulerian method requires a huge amount of calculations

05:09

because it also draws a mesh on the empty space.

05:13

However, the mesh is simply orthogonal lines and is easy to redraw for different shapes.

05:21

Until recent years, Lagrangian has been used in most cases, due to the limits of computers.

05:38

And most people thought Eulerian was not applicable to complicated structures such as automobiles,

05:44

and so there were very few experts.

05:52

My seniors and colleagues often said,

05:56

"Nishiguchi, you should not stick to Eulerian,

05:59

but change your theme of research."

06:03

And even in international conferences,
when I made a presentation on the Eulerian method,

06:08

I got many negative reactions,

06:11

"This is difficult to use on complicated structures,
like metal materials or automobiles."

06:18

I did not agree, perhaps a bit defiant...

06:30

I believe in the potential of the Eulerian method.
So, I haven't given up, and continue to pursue it.

06:44

Nishiguchi met the Eulerian method in 2007,

06:47

when he was a senior student at Hiroshima University and joined the Laboratory of Structural Systems.

07:00

These are his Eulerian simulations in 2010.

07:04

Only such simpler and limited simulations were possible with the computers in those days.

07:18

However, Nishiguchi believed he would be able to conduct more complicated

07:24

and realistic simulations of automobile structures and their collisions in the future,

07:30

when computers got more powerful.

07:37

I was a kid who pursued only one thing.
Maybe that's why I stick to Eulerian.

07:45

Also, the number of Eulerian researchers was very few.
I know of only a few groups around the world.

07:57

So, I once thought,

08:02

"Eulerian structural analysis could disappear
if I give it up."

08:11

When he searched for a job after earning his masters degree,

08:15

he chose a materials manufacturing company where he could continue his study of the Eulerian method.

08:24

However, he felt a certain limit in his research within the company.

08:29

He kept studying there and got a PhD degree,

08:32

but he wanted a place where he could concentrate on his research.

08:40

One day, he got a great chance.

08:44

In 2016, he met Professor Makoto Tsubokura,

08:48

a team leader at the Riken Center for Computational Science.

08:53

He scouted Nishiguchi, a new PhD working at a materials manufacturer, to work at Riken.

09:01

When I first met him, he was still at the company.
I knew the theme of his PhD dissertation.

09:11

I really wanted him to join my team.

09:14

Soon after Nishiguchi joined Riken, the institute started operating the fastest supercomputer at that time.

09:24

Fugaku.

09:27

And, Nishiguchi was astounded with its amazing computational capacity.

09:41

In 2020, the pandemic spread all over the world.

09:45

The cases and deaths of COVID-19 continued increasing.

09:49

People were overwhelmed with a huge fear.

09:52

Is COVID transmitted through the air? Is wearing masks effective?

09:59

About the unknown virus, there was a huge amount of unreliable, sometimes rootless, rumors in our society.

10:12

Team Tsubokura, including Nishiguchi, decided to make full use of Fugaku to answer these questions.

10:18

That is, "Viral Droplet and Aerosol Dispersion Simulation."

10:23

They wanted to provide the public with correct information based on scientific data.

10:33

After only a month from launch, their simulations clearly showed

10:37

that masks and desktop partitions are quite effective to prevent droplet dispersion.

10:54

And at the end of August, just before school resumed,

10:59

it showed how to open doors and windows for the most effective ventilation.

11:10

Over two years, team Tsubokura ran about 1,500 simulations,

11:16

and continued publishing critical information for our society.

11:24

These Riken simulations by supercomputer Fugaku were highly evaluated among the world.

11:36

In the Viral Droplet and Aerosol Dispersion Simulation,

11:40

the Eulerian method played a big part.

11:52

The Eulerian method is faster than the Lagrangian.

11:58

The Eulerian contributed a lot to make simulations quicker.

12:07

The advantage of the Eulerian method was fully realized by the amazing calculation power of Supercomputer Fugaku,

12:15

and Riken was able to publish many exhausting simulations in a very short term, almost every month.

12:23

Nishiguchi had confirmed the potential of the Eulerian method.

12:30

It happened in very recent years,
due to the progress of supercomputers.

12:37

Our team has developed a way
to make the most of Fugaku.

12:43

Also, we have been conducting fundamental studies
of the Eulerian method.

12:48

All these things combined made simulations
more realistic, in a manner.

12:57

It was quite an unexpected collaboration that has further convinced Nishiguchi of the potential of the Eulerian method.

13:06

In aging societies like Japan,

13:08

there are many cases where elder people fall and break their bones.

13:12

And not a small number of such people are forced to be confined to bed for the rest of their lives.

13:19

Is there any way to prevent such accidents?

13:23

A venture company in Hamamatsu has developed a magical sheet,

13:27

which is firm in normal use but gets soft when a strong impact falls on it.

13:34

A wheel chair can smoothly move on the sheet, without sinking at all.

13:46

However, when someone falls down on it, it collapses and absorbs the shock.

13:55

The sheet is made of an elastic resin, and its secret lies in its structure.

14:05

It has space so that it can absorb shocks at strong impacts.

14:09

And it is supported with many pillars so that it stays firm with daily activity.

14:22

Hiroshi Shimomura invented this sheet.

14:25

His grandmother fell down and broke her thigh bone,

14:28

and stayed in the bed until she passed away.

14:31

Then Shimomura started developing devices to prevent such tragic injuries, and founded his company in 2019.

14:44

He has reached the current product after he made a number of prototypes

14:48

and fell on it by himself countless times.

14:52

But he realized that he needed scientific proof of its function.

15:04

Shimomura asked many dynamics researchers for simulations,

15:08

but all of them said it was impossible, except for Nishiguchi.

15:16

Prof. Nishiguchi said,
"It is not possible with conventional ways."

15:22

But he knew of a method that makes it possible.
So we started a collaboration for simulations.

15:34

Of course, Nishiguchi used the Eulerian method for his computer simulations.

15:42

The Eulerian method draws a mesh not on the surface but in the space.

15:47

It can calculate both deformed structures and air at the same time.

15:52

It made it possible to simulate this magical sheet with a complicated shape.

16:00

When a Japanese male falls down, his thigh bone receives an impact of about 3,200 Newtons.

16:07

This sheet reduces the shock by half, to 1,600 Newtons.

16:11

And Nishiguchi's Eulerian simulation showed the mechanism quite vividly.

16:17

Prof. Nishiguchi's simulations presented the effects of
deformation and air in actual situations.

16:26

I was very surprised.

16:28

The Eulerian method can calculate
both structures and fluids

16:35

and can deal with large deformations.

16:39

And now, we can use supercomputers.

16:45

The simulation results are very consistent with reality.

16:54

The Eulerian method is not a new one.

16:58

It was used in the 1950s by the U.S. military, in order to analyze the detonation of bombs.

17:06

A large part of this usage was classified until the 1990s.

17:10

And so, the papers and articles available to civilian researchers were quite limited.

17:18

This history would be one of the reasons why the researchers of the Eulerian method are not so many.

17:27

Computers are getting more and more powerful at an amazing pace.

17:31

ASCI White in the United States, the best supercomputer in the world in 2001,

17:37

is said to have had capacity equivalent to the iPhone in 2020.

17:47

Looking at the computational capacities of the fastest supercomputers,

17:52

they started growing rapidly in around 2019.

17:56

That capacity has become eight times in four years.

18:07

What is called "parallel computing" makes this improvement possible.

18:11

State-of-the-art supercomputers have hundreds of thousands of CPUs and millions of GPUs,

18:18

and carry out tremendous numbers of calculations at the same time.

18:30

And this parallel computing fits very well with the Eulerian method.

18:35

With current supercomputers, the amount of calculations with the Eulerian method is not an issue any more.

18:47

As global warming is becoming a serious issue,

18:50

the automobile manufacturers of the world are shifting to electric vehicles.

18:56

A motor show in Guangzhou, China, in November 2023.

19:01

About 40% of the displayed cars were new energy vehicles, such as electric vehicles and plug-in hybrids.

19:10

Japanese motor companies are also speeding up their new-car developments.

19:15

In this situation, they are attracted to the Eulerian method, which could make structural calculations faster.

19:27

Nishiguchi is conducting a joint study with Toyota Motor Corporation on structural design with the Eulerian method.

19:37

I think Nishiguchi's Eulerian method
has great potential.

19:45

We need to make larger calculations with faster speed.

19:54

I hope this collaboration bears a good result.

20:02

Now 3D printing and giga-casting have emerged,

20:09

and geometrical freedom in car development
is getting greater.

20:14

Of course, this improves the quality of cars,

20:21

but the designs are getting
more complicated and difficult.

20:30

If we could design various structures more easily,

20:35

it could help us find totally new things.

20:40

For example, structures with lighter weights
which absorb shocks more effectively.

20:53

As the capacity of supercomputers rapidly grows, artificial intelligence is undergoing evolution at a tremendous pace.

21:06

The scale of large language models is explosively getting gigantic.

21:11

Number of parameters used to be 50 million in 2017,

21:16

but it grew 30 thousand times in four years into 1.6 trillion in 2021.

21:25

AI's ability to understand our language and generate text and images

21:30

responding to our requests keeps growing rapidly.

21:42

This is supercomputer "Fugaku."
This system has about 160 thousand CPUs.

21:50

With this supercomputer and the Eulerian method, isn't it possible to build a 3D generative model,

21:56

incorporating mechanical information like shock-absorbing capabilities?

22:08

As the first step, Nishiguchi chose the "crash box," which is located at the front of the automobile frame.

22:20

Crash boxes are installed right behind the bumper.

22:23

In the case of a collision, they are crushed in order to absorb the shock.

22:27

Generative AI needs to learn a huge amount of data.

22:31

In the case of text and images, there are a limitless number of materials.

22:35

However, there are few data on crash boxes.

22:39

So Nishiguchi simulated many crash boxes in a virtual space.

22:44

Such simulations are possible only with the Eulerian method, which uses simple orthogonal meshes.

22:53

Nishiguchi prepared a data set with about 1,000 samples, and let the AI learn them.

22:59

What kind of things will the AI generate?

23:03

The results were - the output shapes were very good,

23:07

but the mechanical parameters were far from being accurate.

23:11

But Nishiguchi kept making the data set larger.

23:14

Other areas of generative AI - text, images, music,

23:19

its ability improves as the data set gets larger.

23:24

So, I think the same thing will happen
with 3D generative AI.

23:33

In January, 2024, an international conference on high performance computing was held in Nagoya.

23:41

I would like to construct a 3D generative model incorporating structural dynamics.

23:48

Nishiguchi reported on the newest results of his research on 3D generative AI.

23:54

As you can see from this distribution,

23:57

the error is almost the same between the trained data and unseen data.

24:04

So this is an example of an unseen shape.

24:07

And this one is the generated shape.

24:09

As you can see, we successfully generate a 3D shape by using our trained 3D AI.

24:20

This time, he did the same trial with 6,000 crash box samples, six times more than before.

24:27

The mechanical parameters of the output had surprisingly improved, up to 90% accuracy.

24:38

The results seem to reach a level where we could expect to use them for actual designs.

24:54

We were also surprised at the performance of the AI.

25:01

From now on, we will keep building up the data set
to 10,000 and 100,000.

25:09

Then I expect the results will get better and better.

25:14

In the fields of text and images, what is called "emergent abilities" are reported.

25:19

When the amount of learning surpasses a certain level, generative AI's abilities suddenly improve.

25:27

Nishiguchi expects the same thing with his 3D generative AI.

25:33

Human beings can accept linear improvements,
but exponential changes are counterintuitive.

25:43

That would be the reason why most of us feel
this tremendous AI emerged out of the blue.

25:58

Nishiguchi is now on the front line of AI research.

26:14

He thinks that is because he didn't give up the Eulerian method that he met in college,

26:19

and kept chasing after his dream.

26:30

As you know, "Moore's Law" says
the capacity of computers doubles every two years.

26:36

This is an exponential change,
at a counterintuitive speed.

26:43

I think we need to backcast from the future
10 years, 20 years from now.

26:50

We need to imagine
what seems impossible even as of today.

27:04

His journey to 3D generative AI has just begun.

27:13

There used to be very few researchers in this field, but it has started attracting attention.

27:19

Now, Nishiguchi is actively conducting joint research.

27:27

He believes that the goal of engineering

27:30

is to provide people with solutions to their troubles and complaints.

27:39

To be one of the researchers tackling a big issue in our society.

27:47

That is Nishiguchi's wish.