CoreNLP

Remove Patterns

• Older versions of Lucene have a security issue: https://github.com/advisories/GHSA-g643-xq6w-r67c Unfortunately, Lucene V9.12 is not compatible with Java 8. We therefore want to remove Lucene from this release
• The one project using it in CoreNLP is the patterns directory. We remove this, perhaps temporarily. If you are making use of the patterns project, please file...

Security updates

• Removed the ability to specify an external library for deserialization of annotations in the server. We believe this should not be necessary given the complete nature of the protobuf format, and this was reported as a potential security vulnerability: https://github.com/stanfordnlp/CoreNLP/security/advisories/GHSA-wv35-hv9v-526p If it turns out someone has a use case fo...

• Update German UD POS tagger to UD 2.14 data

• Add Austrian German month names to the German tokenizer: https://github.com/stanfordnlp/CoreNLP/pull/1454 Thank you @j3ernhard

• Improve the constituency to dependency converter to remove quite a few validation errors. This includes adding the PTB Corrector as an earlier step when operating specifically on PTB data https://github.com/stanford...

UD converter upgrades

Inspired by https://github.com/UniversalDependencies/docs/issues/717, although the work is not finished

• Add an option to use the PTBCorrector, which fixes many (although not all) incorrect POS tags https://github.com/stanfordnlp/CoreNLP/commit/5e57eaba40897ee93b69ed3f11bda511f6b427d8
• Treat sort of the same as kind of https://github.com/stanfordnlp/CoreNLP/c...

English Lemmatizer upgrades

• enroll, appall as American spellings, instead of enrol & appal. de- as a verb prefix, blog and xfer as double letter exceptions https://github.com/stanfordnlp/CoreNLP/commit/8adcbfe67fc47f952b773f2eb2afe3a0af73889e
• cowritten https://github.com/stanfordnlp/CoreNLP/commit/2dd08da9de9de381d241c228f15723123a438600
• elder / eldest https://github.com/stanfordnl...