In recent years, with the dramatic advances being made in AI technology, a variety of industries and companies have reported examples of edge computing applications that implement advanced AI in IoT devices. At Macnica, we receive many inquiries from customers who are trying to conduct demonstration experiments of AI edge computing using Jetson, an AI development platform provided by NVIDIA that boasts overwhelming ease of use, asking, "Is there a way to manage the devices during operation and update their software after they are installed in the actual field?"

 

In this article, I would like to introduce the problems and solutions that I would like to know in advance for those who are collecting the following information.

・Those who want to build an AI IoT operation system using NVIDIA ® Jetson

・ Those who want to implement PoC in a remote location

Operational Issues Accompanying the Spread of High-Performance AI Edge Computing

High-performance edge devices such as Jetson can create image analysis applications that utilize deep learning technology, but various software is embedded there, resulting in a complex system. As systems become more complex, software updates and modifications are frequently implemented, but dealing with edge devices installed in remote or inaccessible locations is time consuming and time consuming. need. In addition, AI applications are rapidly advancing in technology, and there is a need for a software-defined update mechanism for long-term operation of the system, such as updating models and introducing new technologies. Against this background, the importance of management and operation systems in high-performance edge computing is increasing.

Pioneer of Smart City, Challenges in AI Traffic Monitoring in Taiwan

One example of a smart city is traffic surveys and dangerous behavior detection on roads. Jetson, a high-performance edge device, operates advanced AI applications such as vehicle classification, license plate detection, and intrusion detection into prohibited areas through image information such as surveillance cameras. One concrete example is an intelligent traffic monitoring system in operation in Taiwan. Jetson's built-in edge AI devices installed near highways and traffic lights in Taiwan collect information on vehicle types and flight routes, and are used to find recommended routes by grasping traffic volume in real time.

On the other hand, with the spread of AI edge devices, operational issues have come to the fore.

When a problem occurs with many devices installed on roads, etc., it becomes necessary to visit the site for troubleshooting and maintenance of system operation. On-site technical support can cost more than 100,000 yen for just one visit. In spite of this, most maintenance support may recover with only a reboot. To prepare for these issues, highways in Taiwan utilize Allxon's remote device management service, which also works with Jetson products.

Solution 1: A remote device management service that supports Jetson for peace of mind

Remote management and operation systems for edge devices are provided by various companies and cloud vendors, and there are many mechanisms that can be linked with Jetson. However, each service has its pros and cons. Macnica can propose various implementation methods according to customer requests, but this time we would like to introduce Allxon's SaaS solution that does not require system construction or maintenance.

The biggest advantage is that edge devices including Jetson can be remotely managed and operated, and the differences in device interface and OS can be absorbed to simplify management even when introducing a large number of devices. In addition, the remote monitoring system can be used from even one unit in the demonstration experiment, and the price per unit is set at a low cost of several thousand yen per year, so anyone can easily install it. Although it is low cost, it meets the strict system requirements of the Taiwanese government and is a service that guarantees the highest level of security by contracting with a specialized information security company.

Jetson remote device management system implementation method
Jetson remote device management system implementation method

Solution 2: Ready-to-use Jetson AI Box products are also available

Advantech, the largest industrial PC company, has partnered with Allxon to start selling AI BOX, which realizes large-scale edge AI remote management in various environments. Powered by NVIDIA Jetson Xavier NX, AI BOX features industrial design and versatile interfaces. In addition, there is a product lineup that ships with Allxon's agent pre-installed, and if the customer implements an AI application as an industrial AI BOX, Allxon's service can be used immediately. Supported devices are as follows. We also plan to expand our product lineup. (As of September 2020)

Advantech AIBOX products
Advantech AIBOX products

Try remote device management with Jetson

An example configuration for remote device management is shown below.

Remote device management configuration example
Remote device management configuration example

Edge device connection is only 2STEP

The method of connecting the management server side and the edge device is completed in 2 steps.

 

STEP1 Install Allxon's agent software on the edge AI device (Jetson) (advantech products are already installed)

STEP2 Register information such as the serial number of the edge device on the management server side

 

You are now ready for remote device management.

Dashboard screen (allows to grasp the status of all connected devices)
Dashboard screen (allows to grasp the status of all connected devices)
Registered device information
Registered device information

Try remote update with Jetson

By utilizing Allxon's remote management system, it is possible to batch update firmware for registered devices, specify the update time, and check the update status.

Only 2 steps to update

Implementation of the update is completed in 2 STEP.

 

STEP1 Register the file you want to update to Allxon Portal

Application registration screen for update
Application registration screen for update

STEP2 Select the update date and target group, and execute distribution

run the distribution
run the distribution

Interested? Contact us now

In this article, how was Jetson's remote operation management method introduced? To summarize.

・Remote management system is essential for actual operation of Jetson built-in edge AI devices

・By using SaaS, it is possible to use a remote management system without building a system on the management server side.

・Advantech's AI BOX products have built-in remote management system software and can be used immediately.

 

At Macnica, we offer a one-stop, one-stop solution for customers considering the introduction of edge computing, including device management and maintenance after operation, based on Jetson's many years of support experience and advanced technological capabilities related to hardware and software. Offers. If you would like more information, please contact us below.