Site Search

Generative AI solutions to solve network operation challenges [Part 2] ~ Case studies of using "Network Copilot™" ~

In this article, we will introduce Network Copilot™ as a generative AI solution that solves network operation challenges, using practical examples.

In part 1 of this article, we provide a detailed explanation of the learning methods used in LLM and RAG, so please read that as well.

Introducing Network Copilot™

Network Copilot ™ is a solution from Aviz Networks, which is represented by Macnica. Although Aviz Networks is a young company founded in 2019, it has a proven track record in Japan for its Network OS SONiC-related tools and support.

Aviz has provided solutions such as the network switch test and verification service "FTAS", the network monitoring and configuration software "ONES", and the network packet broker software "OBP". Leveraging their experience, know-how and knowledge of generative AI, Aviz released Network Copilot ™ in February​ ​2024.

Aviz believes that the key points to consider when using generative AI in network operations are listed below, and Network Copilot ™ meets all of them.

Network Copilot™ Use Cases

There are many possible use cases for Network Copilot™, but the main ones include:

① Network Update
It is possible to suggest the appropriate timing for updates based on traffic increase trends and easily generate performance reports after updates.

② Security Audit
You can load your company's security requirements in advance, inquire via chat whether those requirements are met, and even integrate it into your company's automation tools.

③ Performance check
You can request the creation of the dashboard you want via chat, and grasp the status of your network devices in real time.

④ Operational standards check
You can also keep up to date with the latest operational standards, chat with us to ensure you're aligned with them, and integrate Network Copilot™ capabilities with your existing NetOps tools.

⑤ Troubleshooting
Even beginners can contact the system via chat and receive real data retrieved from the network and suggestions for resolving similar problems that have occurred in the past.

Network Copilot™ System Architecture

Next, we will introduce the system architecture of Network Copilot ™.

The green blocks utilize the latest open LLMs and libraries. The current LLM uses a 7B (7 billion) parameter model from Mistral, a French company.

The blue blocks are parts that Aviz is developing for Network Copilot ™.

We collect data from your network and store it in our database. We also collect your operational standards and knowledge base, and can provide answers based on the information referenced in the RAG method.

When a user makes an inquiry in Japanese regarding network operations, Network Copilot ™'s LLM queries the database and returns a response based on the results.

To better understand the operational flow of Network Copilot ™, let us take a look at the following example to see how it works.

As an example, consider the case of enquiring whether a network meets operational standards.

The operational standard is that a network device's CPU load is considered normal if it is below 80%.

First, as a preliminary step, constantly import CPU load data from network devices into a database. Also import a file that lists your company's operational standard of a CPU load of 80% or less.

In a real world query, a user asks, "Is my network meeting operational standards?" The LLM understands that query and generates a SQL query to query the database, which in turn retrieves CPU load data from the database. Let's assume that the load is 50 %.

At the same time, the RAG method is used to reference information that states that a CPU load of 80% or less is normal according to the company's operational standards, and the system asks the LLM, "Currently, the CPU load is 50 %, and the operational standard is that a load of 80% or less is normal. Does this meet the operational standard?" The LLM then replies to the user, "Based on the acquired data and the operational standard, the standard is met."

Summary

The following points are important for Network Copilot ™ to function as expected:

LLM so that the user can understand the prompt. LLM Learn, fine-tune, and prompt engineer
② Import data from the network so that the necessary data can be stored in the database.
LLM is correct SQL You can generate queries to interrogate the database.
④ Operational standards and knowledge base RAG Use the correct embedding model or vector store to reference the method
⑤Acquired data and RAG Based on what you referenced in LLM Tuning to ensure correct answers

Generated based on the above important points AI In order to promote the use of this technology, Macnica provides customer support at the time of implementation.

When using Network Copilot ™, we listen to our customers' use cases, prepare LLMs specifically for them, and work together with them to tune and verify the solution, ultimately creating something that can be used in actual operations.

If you would like more detailed product information, would like to know the cost, or would like to see a demo of your own use case, please feel free to contact us.

Click here for list of materials

Document list

In addition to introducing products handled by Macnica,
We publish materials related to open networking, such as BGP cross network automatic construction files and network operation test evaluation reports.

Click here for details

Product Page Top

Aviz Networks

We are pioneers of SONiC, an open source network operating system, providing observability, configuration automation tools and support from a team of SONiC experts.

Edgecore Networks

We continue to be a pioneer in open networking by developing and selling products related to OpenNetworking/white Box switches.

IP Infusion

As a market leader among open networking providers, we provide reliable network solutions to over 600 customers, including carriers, service providers, and data centers.