I see, Brain Tech Part 4 - "Fusion of Brain Tech x Digital Twin x Metaverse" - How will the future vision of business using brain waves change? ~ Lecture report

 

On​ ​Wednesday, October​ ​18, 2023, I see Brain Tech 4thFusion of Brain Tech x Digital Twin x Metaverse- How will the future concept of business using brain waves change? We held a webinar on ~.

This time, we will welcome Mr. Imoto from Beam Me up (hereinafter referred to as BMU), a company specializing in brain technology, as a guest, and we will discuss ``Actual uses of Metaverse and digital twins'' in the form of a conversation with our employees in charge of NVIDIA 's Omniverse ™ product. He talked about "Case" and "Possibilities of Digital Twin x Brain Tech."



From the left: [Panelists] Okubo, NVIDIA​ ​Omniverse ™ representative Macnica Inc., [Guest] Imoto, BMU, Inc., [Facilitator] Murata, BRAIL consultant Macnica Inc.


This article summarizes the contents of the webinar held on the day in a report. Please take a look at the video below.

Introduction of BMU company

First of all, our guest, Mr. Imoto, introduced us to BMU.

BMU was founded from the challenges and thoughts of game development.

Mr. Imoto: BMU is a Montreal (Canada) company founded in 2013.

Originally, the company was involved in game translation and bug checking, but we wanted to ``reduce the cost and time required for focus groups * that occur during game development,'' and we wanted to ``reduce the real emotions of game testers.'' We launched this service with the desire to reflect this in games by ``measuring brain waves.''

(* Marketing research in product development)

Understand users' real emotions

Mr. Imoto: the Company product called "NEO", which we will be introducing in this seminar, is a tool that can "measuring emotions" and "recording" using brain waves. The system uses a special headset to "measure brain waves," and based on that information, "AI measures emotions."

A feature of NEO is that it can measure emotions not only during gameplay, but also when watching content such as movies and commercials, to determine which parts are interesting and which parts are boring. One example is the ability to understand the user's real emotions, such as whether or not they are feeling well.

Another feature of this product is that it can measure emotions in real time and record the results, saving you the trouble of recalling your impressions later and allowing for more objective performance evaluations. It is a product that can be expected to be used for "content evaluation in various genres".

Introducing “NEO” usage examples

How is “electroencephalogram measurement” used in the military?

Next, he introduced an example of training in the Canadian Armed Forces as an example of the actual use of NEO.

In this case, the team members wear HoloLens and use brainwave measurements to read their emotions while training in virtual space.

At this time, the commander also wears a HoloLens, which allows him to understand where the members are feeling danger or fear, which can be used to "shorten instruction time" and provide "mental care." They say it can be done.

Furthermore, as a topic for the future, he also introduced SDK (Software Development Kit).

Dementia countermeasures using “brain wave measurement” combined with VR

Mr. Imoto: This is a brain-machine interface, and it is software that allows you to change game scenes and sounds, as well as button operations, depending on the emotions that can be read from the user's brain waves.

By using this software in combination with "VR," they aim to provide a platform for "dementia countermeasures for the elderly." Once the product is actually completed, this technology is expected to help solve the global problem of the declining birthrate and aging population.

What can we do by building a digital twin space?

From here, I would like to introduce "Digital Twin" and NVIDIA 's "Omniverse ™".

“Digital twin” is a technology that reproduces things that normally exist in real space, such as factories and buildings, in virtual space, performs analysis and simulations within that space, and uses the results to optimize the real space. This is how it works.

The biggest advantage of digital twins is that they allow you to try new things while reducing costs such as preparing physical space and equipment, as well as labor and material costs associated with transporting them. In order to build such a digital twin space, we introduced a platform called "Omniverse™" provided by NVIDIA (USA).

This product is a software platform that can be combined with NVIDIA 's "autonomous driving" and "environmental analysis" applications to create an environment.

In addition to NVIDIA products, it can be used in conjunction with about 220 various tools at present, so by incorporating physical laws and inference models, it can be used in various environments such as "factory simulation". It seems that it can be used as output for verification.

Introducing “Omniverse™” usage examples

-BMW company case-

"Omniverse™ As a company that utilizes "" in its actual operations, first of all, BMW A case study of the company was introduced.

BMW has decided to build a new EV (electric vehicle) factory in 2025, and will utilize Omniverse™ for this new construction.

By creating a building in virtual space that does not yet exist in reality, optimizing the line, simulating personnel, and preparing for robot training in advance, the factory can be operated in an optimized state. can do.

Normally, it would take 1 to 2 years from completion to operation of a factory, but being able to shorten this period and start operations immediately is a major advantage.

 

-Amazon case study-

The next example introduced by Amazon uses "Omniverse™" for "robot training at logistics bases."

At Amazon 's logistics bases (Amazon Robotics), automated container transport robots are in operation. In order to "improve the transportation accuracy" of this robot, we are using the "Omniverse™" replicator function to generate data for image AI learning.

Normally, it is necessary to take a video from the robot's perspective and create the data, but since that video can be easily created in virtual space, it is possible to "reduce development time and costs." The results show that the accuracy of the AI itself has improved to approximately 98%.

Possibilities of Metaverse, Digital Twin x Braintech

Finally, by combining BMU 's Brain Tech technology and NVIDIA 's Digital Twin technology that I have introduced so far, we can ask, ``What can we do in the future?'' ” We had a discussion.

(Murata)
I have the impression that digital twin technology alone is sufficiently advanced and likely to spread, but I would like to know the benefits of incorporating Brain Tech.

(Okubo)
We believe that if we can create a photorealistic space and measure the user's brain waves in a nearly realistic environment, it could be used in a variety of industries.
For example, in the real estate industry, before having customers come to actually see a building at a condominium plaza, etc., it is possible to verify what kind of functional equipment is needed to move customers' emotions.
I also think that the biggest advantage of Braintech x Digital Twin is that it allows us to analyze user emotions while realizing things that don't currently exist, such as preliminary verification of advertising effectiveness.

(Mr. Imoto)
After all, it is a huge advantage for content creators to know the emotions of users so that they can understand the evaluation of the product they are developing in advance and make improvements.
I believe that in the future, the range of applications will be wide-ranging, such as creating content for people who are unable to travel for some reason, such as virtual travel.

(Murata)
In particular, the ``utilization of virtual space'' in ``condominium and housing design'' is thought to become a technology that is needed right away, so ``incorporating sentiment analysis into that'' is very interesting. hey.

(Okubo)
In the real estate industry, there is a problem of not being able to understand the customer's feelings during previews, so I think this would be the perfect way to utilize it.

In this way, we had a lively discussion about how the use of digital twins and brain tech can be widely adopted, from solving current problems to creating content in the future.

Summary

Well, in this 4th seminar, we will talk about the current hot topic, ``What can be done by combining Metaverse/Digital Twin technology and Brain Tech?'' ” He introduced examples of actual use as well as stories about the future.

By maximizing the benefits of both, we believe that a lot of ``more practical content that incorporates users' feelings'' will be created in the future.

Some of the concerns of those reading this article may be able to be solved using the technology provided by Macnica. Why not take a moment to tell us about the issues you are facing and let's work together to come up with the best solution?

free demonstration

Guidance of the demonstration

Would you like to actually measure brain waves?
What is the "skill transfer of experts" based on brain waves? What is AI that learns human consciousness and judgment?

I think there are a lot of unknown things, so why not try measuring your brain waves first and experience what it's like?
After the actual measurement, we will provide support from proposals to implementation and operation so that we can use AI using EEG at the customer's site while including examples of AI utilization in our activities so far. increase.

Learnmore

Document download

Document download

If you want to know the details, please download the materials from here.

Learn more

Inquiry

If you have any questions regarding this article, please contact us below.

Back to BRAIL Top page