CFOtech Australia - Technology news for CFOs & financial decision-makers
Story image

New Relic unveils AI monitoring for DeepSeek applications

Today

New Relic has announced its observability solution for monitoring DeepSeek, aimed at assisting customers in reducing the complexity and expenses associated with the development, deployment, and monitoring of generative AI applications.

The company is now supporting DeepSeek and DeepSeek on Microsoft Azure AI Foundry, which allows customers to utilise New Relic AI monitoring to gain comprehensive visibility across the AI stack for applications built with DeepSeek.

This enhancement aims to provide a simplified setup with improved data security, complementing the cost efficiency and advanced reasoning capabilities of DeepSeek's open-source models.

According to Gartner's predictions, more than 80% of enterprises will be using generative AI or deploying generative AI applications by 2026. Organisations face the challenge of choosing the optimal AI models for diverse use cases amidst an expanding array of available models. New Relic aims to offer a broad, real-time view of the AI application stack to ensure efficient and reliable operations.

"There are a steady release of new models like DeepSeek, Alibaba's Qwen2.5-Max, and more, and organisations cannot afford to make the wrong AI implementation decisions in today's hyper-competitive market," said New Relic CEO Ashan Willy. "Observability solves this challenge by providing visibility across the AI stack. We are pioneering AI observability and extending our platform to include AI apps built with DeepSeek so enterprises can make the right decisions on which AI models to deploy and where to use them. Combining DeepSeek's cost-effective AI models with our expertise in observability and APM gives enterprises a competitive edge in the AI race."

AI applications often complicate technology stacks, elevate security concerns, and pose cost challenges. New Relic's AI monitoring services are designed to offer an expansive view of the AI stack and provide key metrics on throughput, latency, and costs, while also supporting customer data privacy requirements. The platform traces request flows across services and models to gain insights into the inner workings of AI applications.

The integration empowers businesses by providing reliability assurance and quality, allowing full visibility into performance with quick issue resolution.

The solution also enables cost optimisation through insights into token usage, facilitates confident model switching by showcasing the effects on performance and token usage, and accelerates AI innovation and deployment.

New Relic recently expanded its ecosystem, which already includes over 60 AI integrations such as OpenAI, Claude, Langchain, and Pinecone, reinforcing its position in the market with the addition of DeepSeek. The solution is part of New Relic's comprehensive observability platform, offered via its usage-based pricing model, and includes recent integrations with Nvidia NIM and Amazon Bedrock.

New Relic AI monitoring provides comprehensive monitoring for DeepSeek models, enabling enterprises of varying sizes to adopt and optimise AI technologies confidently.

This strategic approach is aimed at driving growth and maintaining a competitive position in the evolving AI market.

Follow us on:
Follow us on LinkedIn Follow us on X
Share on:
Share on LinkedIn Share on X