Emerging AI Workloads Require New Approaches to Enhance Security, Availability and Low Latency

SAN JOSE, Calif. – Nov. 26, 2024 – Artificial intelligence (AI) adoption is creating new architectures in data centers and hybrid cloud infrastructures. It is also creating the need for new security solutions given the increased attack surface. According to a survey by KPMG, over 76 percent of respondents think they will be exposed to data privacy and security risks as a result of using Generative AI (GenAI). With this risk, security teams must develop new methods to secure AI applications in production. The top concerns include the safety of large language models (LLMs) including open source (e.g., LLAMA 3.1).

To help address these concerns, A10 Networks (NYSE: ATEN) is expanding it’s high-performance infrastructure and security solutions to now include an AI firewall and LLM safety tooling.

Developing New Approaches to Secure New Applications

Organizations that are putting LLMs into production will require new insights and easy-to-integrate solutions to deliver security and availability of inference workloads. These include tools that discover vulnerabilities such as responding to prompts that cause the model to hallucinate or divulge information that is proprietary or personally identifiable in nature. Additional tools would be required to, in some instances, break a secured model to help identify ways to make the model stronger.

New solutions like an AI firewall can be used to secure production LLMs. An AI firewall is a new approach to securing a new set of applications. It is a solution that can inspect the request and response path of traffic to an AI Inference application. An AI firewall can be applied to enforce specific policies, for example, to drop prompts that can be harmful to the untested and tested LLM. An AI firewall operates at a high speed to minimize latency and to work in conjunction with a proxy, or it may have a proxy function built in to terminate encrypted traffic and process traffic directly. Ultimately, an AI firewall can take actions to increase the security of AI applications, while also helping to provide availability and low latency.

“AI adoption is rapidly evolving as organizations forecast the benefits of AI in bringing new services and capabilities for their customers. But security remains a chief concern. Building on our expertise in helping secure service providers and hybrid cloud infrastructures, we are driving our AI strategy forward to develop new approaches. An AI firewall can help secure these new and evolving applications, while minimizing latency and maximizing availability so AI applications perform as they are intended,” said Dhrupad Trivedi, president and CEO, A10 Networks.

Additional Resource
Follow us on Social Media
About A10 Networks

A10 Networks provides security and infrastructure solutions for on-premises, hybrid cloud, and edge-cloud environments. Our 7000+ customers span global large enterprises and communications, cloud and web service providers who must provide business-critical applications and networks that are secure, available, and efficient. Founded in 2004, A10 Networks is based in San Jose, Calif. and serves customers globally. For more information, visit A10networks.com and follow us at A10Networks.

###

The A10 logo and A10 Networks are trademarks or registered trademarks of A10 Networks, Inc. in the United States and other countries. All other trademarks are the property of their respective owners.

Media Contact:

Karin Gilles
[email protected]
+1-408-240-5176

Categories:
Cloud & Networking Cyber Security