garak

What's Changed

New features

• feature: support JSON config as well as YAML by @patriciapampanelli in https://github.com/NVIDIA/garak/pull/1490
• feature: remove --generate_autodan CLI option by @sinhaabhiraj0 in https://github.com/NVIDIA/garak/pull/1521
• expand items in report entry_type:eval by @leondz in https://github.com/NVIDIA/garak/pull/1547
• reporting: tier biased securi...

What's Changed

New plugins

• probe: Api key probe + detector by @martinebl in https://github.com/NVIDIA/garak/pull/1406
• probe: zero width bad char injection by @Har1sh-k in https://github.com/NVIDIA/garak/pull/1489
• generator: AWS bedrock generator by @fabriziorocco in https://github.com/NVIDIA/garak/pull/1462

New features

• enable consistent PRNG access in generators by @j...

What's Changed

New plugins

• probe: Base class for iterative probes and FITD as an example by @aishwaryap in https://github.com/NVIDIA/garak/pull/1414
• detectors: any by @leondz in https://github.com/NVIDIA/garak/pull/1427

Improved plugins

• detectors: Fix incorrect target class for MustRefuteClaimModel by @RobGeada in https://github.com/NVIDIA/garak/pull/1419
• probes: Win11...

What's Changed

New plugins

• probe: Atbash Encoding by @Nakul-Rajpal in https://github.com/NVIDIA/garak/pull/1343
• probe: ansi escape codes in tokenizer by @leondz in https://github.com/NVIDIA/garak/pull/1351
• dropbox repeated token attack by @dchiitmalla in https://github.com/NVIDIA/garak/pull/1244
• probe: DRA (Disguise and Reconstruction Attack) by @patriciapampanelli in https:/...

What's Changed

New plugins

• Doctor attack + encoding/Leet by @leondz in https://github.com/NVIDIA/garak/pull/1180
• Simple Assistive Task Linkage Probe by @erickgalinkin in https://github.com/NVIDIA/garak/pull/1319
• Ascii Smuggling by @erickgalinkin in https://github.com/NVIDIA/garak/pull/1299
• Added more generalized version of Markdown exfil probe by @aishwaryap in https://github...