Enhanced Security and Streamlined Deployment of AI Agents with NVIDIA AI Enterprise

Summary:

NVIDIA AI Enterprise has introduced new features to enhance the security and deployment of AI agents. These agents are designed to increase efficiency, improve productivity, and accelerate innovation by autonomously reasoning through tasks and incorporating enterprise data and employee knowledge. The latest release includes simplified management of AI agent pipelines, security and API stability for AI models, and support for highly regulated industries.

Simplifying AI Agent Deployment with NVIDIA AI Enterprise

AI agents are becoming a crucial tool for organizations looking to streamline operations and improve efficiency. These agents are more advanced than previous AI applications, capable of autonomously reasoning through tasks and incorporating both enterprise data and employee knowledge to produce valuable business outcomes.

Simplified Management of AI Agent Pipelines

The NVIDIA NIM Operator simplifies the deployment and management of NIM microservices used to deploy AI pipelines on Kubernetes. This operator automates the deployment of AI pipelines and enhances performance with capabilities such as intelligent model pre-caching for lower initial inference latency and faster autoscaling.

Security and API Stability for AI Models

NVIDIA AI Enterprise includes monthly feature branch releases for AI and data science software, which contain top-of-tree software updates and are ideal for AI developers who want the latest features. However, these releases may not guarantee API stability, which can make it challenging to build enterprise solutions that need to be both secure and reliable over time.

To address this need, NVIDIA AI Enterprise also includes production branches of AI software. Production branches ensure API stability and regular security updates and are meant for deploying AI in production when stability is required. These branches are released every 6 months and have a 9-month lifecycle.

Support for Highly Regulated Industries

For customers in highly regulated industries, NVIDIA AI Enterprise offers long-term support branches (LTSB), which are supported with stable APIs for 3 years. LTSB 1 includes foundational AI components such as PyTorch, TensorFlow, RAPIDS, TensorRT, and Triton Inference Server. LTSB 2 adds Holoscan, which includes Holoscan SDK and Holoscan Deployment Stack.

More Ways to Deploy NIM Microservices

NVIDIA AI Enterprise is supported on both on-premises and public cloud services. You can deploy NIM microservices and other software containers into self-managed Kubernetes running on cloud instances, or use Kubernetes managed by the cloud provider. Google Cloud has integrated NVIDIA NIM into Google Kubernetes Engine to provide enterprise customers with a simplified path for deploying optimized models directly from the Google Cloud Marketplace.

Enhanced Security Features

NVIDIA AI Enterprise includes several enhanced security features to ensure the security and stability of AI agents. These features include:

• Monthly Security Patches: NVIDIA continuously monitors critical and high common vulnerabilities and exposures (CVEs) and releases monthly security patches to ensure the security of AI frameworks, libraries, models, and tools.
• API Stability: Production branches ensure API stability, which is crucial for deploying AI in production when stability is required.
• Long-Term Support: LTSB provides stable APIs for 3 years, which is ideal for highly regulated industries.

AI for Healthcare

The addition of Holoscan to LTSB is particularly beneficial for medical devices, which have strict requirements for long-term supportability. The Holoscan platform with LTSB enables device manufacturers to build the next generation of intelligent AI-enabled medical devices, with faster time to market and lower cost of maintenance.

Conclusion:

NVIDIA AI Enterprise has made significant strides in enhancing the security and deployment of AI agents. With simplified management of AI agent pipelines, security and API stability for AI models, and support for highly regulated industries, organizations can now deploy AI agents with confidence. The addition of Holoscan to LTSB is a significant step forward for medical devices and other industries that require long-term supportability.

Table: NVIDIA AI Enterprise Release Branches

Table: NVIDIA AI Enterprise Software Components