1.5.0 (2025-10-21)

Finally max_sample_size is here to alleviate a variety of woes resulting from gathering too many samples! Also finally, Benchee lets you exclude outliers!

Features (User Facing)

• Introduce max_sample_size which guides how many samples will be gathered at most for a given scenario. This avoids a variety of issues when scenarios gather too many samples (memory consumption, statistics taking long to calculate, formatters hanging/not working). Defaults to 1_000_000, setting it to nil gathers unlimited samples again (behavior before this version).
• Introduce exclude_outliers option which when set to true will automatically exclude outliers from the samples gathered. Especially important for run time, you can remove samples caused by garbage collection or external factors. Defaults to false. Shout out to @NickNeck who implemented this long wished for feature over in .