New
v0.20.0
Major Changes
- January 2025 Update by @m0nsky, @Lyrcaxis, @SignalRT & @martindevans in https://github.com/SciSharp/LLamaSharp/pull/1036
- Removed .NET6 by @martindevans in https://github.com/SciSharp/LLamaSharp/pull/982
- Implemented
LogitBiasforDefaultSamplingPipelineby @martindevans in https://github.com/SciSharp/LLamaSharp/pull/986
Bug Fixes
- Fixed
LLamaTokenDataArrayNative.Create's size initialization by @Lyrcaxis in https://github.com/SciSharp/LLamaSharp/pull/981 - Fixed
ChatSession.LoadSessionby @martindevans in https://github.com/SciSharp/LLamaSharp/pull/976 - Non-deterministic default seed by @Lyrcaxis in https://github.com/SciSharp/LLamaSharp/pull/993
- Fixed log levels (issue #995) by @LoicDagnas in https://github.com/SciSharp/LLamaSharp/pull/997
- Fix Batching shared token issues by @martindevans in https://github.com/SciSharp/LLamaSharp/pull/1045
Other Changes
- Adding simple batch example by @phil-scott-78 in https://github.com/SciSharp/LLamaSharp/pull/1038
- Add an option to apply the chat template to prompts when using StateslessExecutor by @phil-scott-78 in https://github.com/SciSharp/LLamaSharp/pull/1025
- Adds an exception for missing templates. by @phil-scott-78 in https://github.com/SciSharp/LLamaSharp/pull/1034
- Updated tests model to "LLama 3.2 1B Instruct" by @Lyrcaxis in https://github.com/SciSharp/LLamaSharp/pull/983
- Update M.E.AI.Abstractions by @stephentoub in https://github.com/SciSharp/LLamaSharp/pull/979, https://github.com/SciSharp/LLamaSharp/pull/992 and https://github.com/SciSharp/LLamaSharp/pull/1044
- Added sampling tests by @Lyrcaxis in https://github.com/SciSharp/LLamaSharp/pull/984
- Updated Nuget Dependencies by @martindevans in https://github.com/SciSharp/LLamaSharp/pull/987
- Helper method for sampling
ConversationwithSafeLLamaSamplerChainHandleby @martindevans in https://github.com/SciSharp/LLamaSharp/pull/994
New Contributors
- @LoicDagnas made their first contribution in https://github.com/SciSharp/LLamaSharp/pull/997
- @AcoranGonzalezMoray made their first contribution in https://github.com/SciSharp/LLamaSharp/pull/1015
- @phil-scott-78 made their first contribution in https://github.com/SciSharp/LLamaSharp/pull/1025
Full Changelog: https://github.com/SciSharp/LLamaSharp/compare/v0.19.0...v0.20.0