Bringing NVIDIA Omniverse™ closer to you! Purpose of video production

NVIDIA Omniverse™ is a software platform provided by NVIDIA that supports the development of metaverse applications such as industrial digital twins. For those who are actually interested in Omniverse, we would like to give you an idea of Omniverse's strengths in photorealistic virtual space expression and digital twin simulation using NVIDIA Isaac Sim™. For this purpose, we created a digital twin of Macnica 's distribution warehouse and compiled it into a video. In this article, we will focus on the points you should pay attention to in the video.

Filming and editing process

On-site shooting in the actual logistics warehouse before starting the production of the virtual space

When shooting the site, we measured the size and spacing of each shelf and asset, aiming to create a more realistic virtual space.

↓

Create realistic 3D models of each asset, such as shelves, casters, cardboard, floor materials, etc.

　I was conscious of making the position and number of the lights installed on the ceiling the same as in the real space.

In addition, in order to reproduce the material of each asset, textures are created for each asset, and even small scratches on the floor are realistically expressed.

↓

Install each asset in Omniverse in the same arrangement as the actual distribution warehouse

*In video creation, rendering is performed by path tracing.

The strength of Omniverse, the advantage of being photoreal

Enables highly accurate simulations

It can be used for simulation before operating equipment in an actual warehouse or factory.

Ability to immerse yourself in space and create visual and intuitive images

You can experience the pre-construction warehouse and factory in advance.

Can generate data used for AI learning in virtual space

Data that is difficult to obtain in real space can be generated in virtual space.

Featured point 1: Realistic reproduction of complex light reflections

Similar to the actual distribution warehouse, multiple lights are installed on the ceiling of the created virtual space. Thanks to Omniverse 's advanced rendering capabilities, complex reflections from multiple lights and shadows between racks are realistically reproduced.

Attention point 2: Robot running simulation

By using the Omniverse-based Isaac Sim extension that enables ROS 2 bridging, it is possible to control a robot placed in a virtual space from a ROS 2 application running on a host PC. This time, a robot equipped with the NVIDIA® Jetson AGX Orin™ developer kit is used as a real machine, and a model that can be imagined by Jetson is also installed in the virtual space robot.

Point of interest 3: Robot automatically travels to a designated point

Nvblox is one of the packages provided as NVIDIA® Isaac ROS GEMs. The environment around the robot can be constructed as a 3D image from real-time sensor information such as stereo cameras. In addition, the path planner can generate a collision-free path and allow the robot to self-propelled to the specified goal point. In this video, in addition to Nvblox, Visual SLAM and Stereo Disparity are simulated. As for Isaac ROS GEMs, there are many other ROS 2-based packages that utilize GPUs, such as object recognition and pose estimation.

There are still many points that cannot be explained! Please contact us

In this article, we introduced an overview of Omniverse and an actual simulation, along with a video. We are also accepting requests for seminars and training when introducing Omniverse and NVIDIA Isaac™, so please feel free to contact us if you are interested.