New
v0.13.1
What's Changed
New plugins
- probe: Atbash Encoding by @Nakul-Rajpal in https://github.com/NVIDIA/garak/pull/1343
- probe: ansi escape codes in tokenizer by @leondz in https://github.com/NVIDIA/garak/pull/1351
- dropbox repeated token attack by @dchiitmalla in https://github.com/NVIDIA/garak/pull/1244
- probe: DRA (Disguise and Reconstruction Attack) by @patriciapampanelli in https://github.com/NVIDIA/garak/pull/1345
- probes: package hallucination support for dart, perl, & raku by @dchiitmalla in https://github.com/NVIDIA/garak/pull/1243
- probe: Added token smuggling probe module by @mrowebot in https://github.com/NVIDIA/garak/pull/1192
New features
- feature: support detectors including
Nonein output values by @leondz in https://github.com/NVIDIA/garak/pull/1280 - config:
model_*totarget_*by @leondz in https://github.com/NVIDIA/garak/pull/1383 - cli: add filtering support for --list_* options by @JosephDavisC in https://github.com/NVIDIA/garak/pull/1367
Improved plugins
- bugfix: future probes now use future phrasing by @leondz in https://github.com/NVIDIA/garak/pull/1388
- rename and extend Web injection probes by @erickgalinkin in https://github.com/NVIDIA/garak/pull/1335
Documentation
- fixing probable typo in cliref.rst by @cassiasamp in https://github.com/NVIDIA/garak/pull/1353
- docs(chore): Fix most build warnings by @mikemckiernan in https://github.com/NVIDIA/garak/pull/1359
- docs: reorganize table of concepts and getting started page by @mikemckiernan in https://github.com/NVIDIA/garak/pull/1360
- docs: theme recolor by @leondz in https://github.com/NVIDIA/garak/pull/1385
- docs: auto-include ASR in probe doc page if current calibration exists by @leondz in https://github.com/NVIDIA/garak/pull/1387
- bugfix: ASR figures in probe docs are now actual ASRs by @leondz in https://github.com/NVIDIA/garak/pull/1392
Tuning & fixes
- Specify
flitbuild-system withinpyproject.tomlby @06kellyjac in https://github.com/NVIDIA/garak/pull/1317 - Update how license is defined in pyproject.toml by @06kellyjac in https://github.com/NVIDIA/garak/pull/1315
- reporting: add basic docs to scripts in analyze pkg by @leondz in https://github.com/NVIDIA/garak/pull/1369
- update: tektronix typo fix by @leondz in https://github.com/NVIDIA/garak/pull/1372
- cli: standardise reporting tool invocation patterns by @SubGlitch1 in https://github.com/NVIDIA/garak/pull/1370
- adding local fixture to setup wordnet environment by @dhruvmalik007 in https://github.com/NVIDIA/garak/pull/1342
- reporting: add aggregation of report jsonl digest objects, and tests for aggregation by @leondz in https://github.com/NVIDIA/garak/pull/1336
- update: rename
data/misp_descriptions.tsvtodata/tags.misp.tsvby @leondz in https://github.com/NVIDIA/garak/pull/1381
New Contributors
- @cassiasamp made their first contribution in https://github.com/NVIDIA/garak/pull/1353
- @Nakul-Rajpal made their first contribution in https://github.com/NVIDIA/garak/pull/1343
- @SubGlitch1 made their first contribution in https://github.com/NVIDIA/garak/pull/1370
- @dhruvmalik007 made their first contribution in https://github.com/NVIDIA/garak/pull/1342
- @patriciapampanelli made their first contribution in https://github.com/NVIDIA/garak/pull/1345
- @JosephDavisC made their first contribution in https://github.com/NVIDIA/garak/pull/1367
Full Changelog: https://github.com/NVIDIA/garak/compare/v0.13.0...v0.13.1