"Using RAG is a good way for you to experiment with LLMs and experiment with AI," Kathail said. "You can get a lot of output and solve a lot of use cases to begin with, and then you can start realizing which use cases are going to give you a real ROI."

With so many promised use cases, AI hype might overshadow actual performance. But, when administrators evaluate AI's use cases, they can understand the practical applications of AI in the NOC. During the panel discussion, members of the AI-Driven NOC/SOC Automation Project team identified the following AI capabilities:

AI chatbots are a top use case of NOC automation, Haugh said. An approximate 13% of survey respondents said AI chatbots were a use case that justified investment in GenAI. A typical organization has dozens of IT professionals who must understand the multiple devices that are part of the network. This introduces complexity in network management. A chatbot enables organizations to integrate documentation into a single tool that network professionals can use to access information quickly.

Organizations can train chatbots on information about the network, Haugh said. For example, if an administrator asks a chatbot about the network's load balancers -- a topic on which the AI has been trained -- it can provide an answer to the query.

"When you've supplemented [an LLM] with your data, information, frequently asked questions and configuration guides, it's going to leverage that information first and give you an accurate response," Haugh said.

NOC professionals can also train AI models on syslog information. Network devices generate syslog messages -- based on rules written by network administrators to configure and manage notifications -- which monitor and alert teams on issues. But, if a device has an unprecedented error, the message doesn't appear in the syslog because the error isn't in the rule base.

Network administrators can train AI to understand the syslog, however, said Parantap Lahiri, vice president of network and data center engineering at eBay. An AI tool that has knowledge of syslog errors can identify when a new one occurs and help administrators troubleshoot issues in the network. Lahiri said he recommends organizations make the notification an actionable alert that administrators can review.

"It doesn't even have to be a critical syslog," he said. "It could be a warning or info, but it's uncommon because people don't see it as much. So, [AI can] help us to identify issues before they become big."

Syslog reports are also an important aspect of incident response, which pretrained AI tools can help organizations enable. When an issue occurs in the network, administrators work to fix the problem, but this often highlights the gap in skill sets, Kathail said.

When network users request assistance with an issue in the network, it falls on the experienced administrators to fix the issues for them. This takes away time they could spend on more critical parts of the network, network architecture, design or implementation of new services, Kathail said. But, if network administrators use AI to detect issues in the network, it enables them to fix problems quicker and dedicate more time to appropriate activities.

"If you design your virtual assistant or chatbot the right way and provide a little bit of navigation through the chatbot into your product, a lot of Level Zero, Level One support becomes easier," he said. "The skill gap becomes much smaller for people to adopt [AI]."

Xiaobo Long, head of backbone network services at Citi, said an AI copilot is especially useful to help network administrators accomplish their tasks.

"A lot of our employees don't have extensive programming skills, but they have some skills, and they want to do a lot of development work," she said. "Based on my team's feedback, [a copilot] really improves productivity."