Skip to main content

Archive2

Understanding AI Agent Security

Understanding AI Agent Security

In an earlier blog post, we discussed the use-cases for RAG architecture and its secure design principles.

What are the Security Risks of Deploying DeepSeek-R1?

What are the Security Risks of Deploying DeepSeek-R1?

Promptfoo's initial red teaming scans against DeepSeek-R1 revealed significant vulnerabilities, particularly in its handling of harmful and toxic content..

1,156 Questions Censored by DeepSeek

1,156 Questions Censored by DeepSeek

DeepSeek-R1 is a blockbuster open-source model that is now at the top of the U.S.

How to Red Team a LangChain Application

How to Red Team a LangChain Application

Want to test your LangChain application for vulnerabilities? This guide shows you how to use Promptfoo to systematically probe for security issues through adversarial testing (red teaming) of your LangChain chains and agents..

Defending Against Data Poisoning Attacks on LLMs: A Comprehensive Guide

Defending Against Data Poisoning Attacks on LLMs: A Comprehensive Guide

Data poisoning remains a top concern on the OWASP Top 10 for 2025.

Jailbreaking LLMs: A Comprehensive Guide (With Examples)

Jailbreaking LLMs: A Comprehensive Guide (With Examples)

Let's face it - LLMs are gullible.

Beyond DoS: How Unbounded Consumption is Reshaping LLM Security

Beyond DoS: How Unbounded Consumption is Reshaping LLM Security

The recent release of the 2025 OWASP Top 10 for LLMs brought a number of changes in the top risks for LLM applications.

Red Team Your LLM with BeaverTails

Red Team Your LLM with BeaverTails

Ensuring your LLM can safely handle harmful content is critical for production deployments.

How to run CyberSecEval

How to run CyberSecEval

Your LLM's security is only as strong as its weakest prompt.

Leveraging Promptfoo for EU AI Act Compliance

Leveraging Promptfoo for EU AI Act Compliance

Beginning on February 2, 2025, the first prohibitions against certain AI systems will go into force in the European Union through the EU AI Act..