spark-xml

What's Changed

• Use defined timezone on write for formats that need TZ info by @srowen in https://github.com/databricks/spark-xml/pull/665
• Add notes about file extensions and _corrupt_record to documentation by @dolfinus in https://github.com/databricks/spark-xml/pull/674
• Fix for xml expression to not parse arbitrary strings by @xanderbailey in https://github.com/databricks/spark-xml/pu...

• Improve handling of XSD complex type, decimal (https://github.com/databricks/spark-xml/pull/631, https://github.com/databricks/spark-xml/pull/638)
• Restore behavior of ignoreSurroundingSpaces (https://github.com/databricks/spark-xml/pull/637)
• Improve schema inference performance (https://github.com/databricks/spark-xml/pull/660)
• Fix corner case of double/float type inference (https://git...

• Minor bug fixes
• Custom timestamp formats now use session timezone when not specified in the format/input (#621)
• Some "ref" elements work in XSD schemas now ((#619)
• 'arrayElementName' can be used to control the schema name used for array elements when writing (#603)

See https://github.com/databricks/spark-xml/milestone/13?closed=1

This is a minor bug fix release, primarily for:

• #582 Fix a Hadoop conf bug that interferes with running multiple separate spark-xml reads/write jobs concurrently

See also:

https://github.com/databricks/spark-xml/milestone/12

This release is primarily to support Spark 3.2.0 and Scala 2.13. Support for Scala 2.11, previously deprecated, is removed. Spark 2 is not officially supported now, but should continue to work with Scala 2.12 builds.

It includes one new feature, otherwise:

• Control XML declaration in XML output (#560)

See https://github.com/databricks/spark-xml/issues?q=is%3Aclosed+milestone%3A0.14.0