StruQ: Defending against prompt injection with structured queries
Recent advances in Large Language Models (LLMs) enable exciting LLM-integrated
applications, which perform text-based tasks by utilizing their advanced language …
applications, which perform text-based tasks by utilizing their advanced language …
When llms meet cybersecurity: A systematic literature review
The rapid advancements in large language models (LLMs) have opened new avenues
across various fields, including cybersecurity, which faces an ever-evolving threat landscape …
across various fields, including cybersecurity, which faces an ever-evolving threat landscape …
Injecagent: Benchmarking indirect prompt injections in tool-integrated large language model agents
Recent work has embodied LLMs as agents, allowing them to access tools, perform actions,
and interact with external content (eg, emails or websites). However, external content …
and interact with external content (eg, emails or websites). However, external content …
Prioritizing safeguarding over autonomy: Risks of llm agents for science
Intelligent agents powered by large language models (LLMs) have demonstrated substantial
promise in autonomously conducting experiments and facilitating scientific discoveries …
promise in autonomously conducting experiments and facilitating scientific discoveries …
On the duality between sharpness-aware minimization and adversarial training
Adversarial Training (AT), which adversarially perturb the input samples during training, has
been acknowledged as one of the most effective defenses against adversarial attacks, yet …
been acknowledged as one of the most effective defenses against adversarial attacks, yet …
A comprehensive study of jailbreak attack versus defense for large language models
Abstract Large Language Models (LLMs) have increasingly become central to generating
content with potential societal impacts. Notably, these models have demonstrated …
content with potential societal impacts. Notably, these models have demonstrated …
Jailbreakzoo: Survey, landscapes, and horizons in jailbreaking large language and vision-language models
The rapid evolution of artificial intelligence (AI) through developments in Large Language
Models (LLMs) and Vision-Language Models (VLMs) has brought significant advancements …
Models (LLMs) and Vision-Language Models (VLMs) has brought significant advancements …
LLM Jailbreak Attack versus Defense Techniques--A Comprehensive Study
Large Language Models (LLMS) have increasingly become central to generating content
with potential societal impacts. Notably, these models have demonstrated capabilities for …
with potential societal impacts. Notably, these models have demonstrated capabilities for …
Whispers in the Machine: Confidentiality in LLM-integrated Systems
Large Language Models (LLMs) are increasingly integrated with external tools. While these
integrations can significantly improve the functionality of LLMs, they also create a new attack …
integrations can significantly improve the functionality of LLMs, they also create a new attack …