Rule set sha256:bd65ec208a53

PROMPT_SECURITY_TOOL_CALL_HIJACK_001

One rule of the rule set with digest bd65ec208a532545cac038041e8bb3c2f62a09305837af00fa0917875f49eb75. An audit record that names this digest and this rule was decided by the rule as shown here. Every rule in this set.

RulePROMPT_SECURITY_TOOL_CALL_HIJACK_001
Rule version98e41dfdf9751b0907c63f730417dacd6a5dc64e148852174b6f21404bfa3917
ProvisionRegulation (EU) 2024/1689, Article 15(5)
ELI: http://data.europa.eu/eli/reg/2024/1689/art_15/par_5/oj
ApprovalNot approved

rules/regulations/universal/prompt_security/tool_call_hijack.yaml

Citation
Regulation (EU) 2024/1689, Article 15(5): High-risk AI systems shall be resilient against attempts by unauthorised third parties to alter their use, outputs or performance by exploiting system vulnerabilities. The technical solutions aiming to ensure the cybersecurity of high-risk AI systems shall be appropriate to the relevant circumstances and the risks. The technical solutions to address AI specific vulnerabilities shall include, where appropriate, measures to prevent, detect, respond to, resolve and control for attacks trying to manipulate the training data set (data poisoning), or pre-trained components used in training (model poisoning), inputs designed to cause the AI model to make a mistake (adversarial examples or model evasion), confidentiality attacks or model flaws.
Condition
Detects tool/function-call hijacking: injected instructions that direct an agent to invoke tools for the attacker (forward secrets, send data to an external address, run commands). EU AI Act Article 15. OWASP LLM01 / LLM07.
Condition type
regex
Status in the file
review