New
Scalding 0.17.0 with 2.12 support!
This is the first Scalding release that publishes artifacts for Scala 2.12! Here are some of the changes that are part of this release:
- 2.12 releated updates: https://github.com/twitter/scalding/pull/1663, https://github.com/twitter/scalding/pull/1646
- Use reflection over Jobs to find serialized classes: https://github.com/twitter/scalding/pull/1654, https://github.com/twitter/scalding/pull/1662
- Simplify match statement and use collection.breakOut: https://github.com/twitter/scalding/pull/1661
- Add explicit types to implicit methods and values: https://github.com/twitter/scalding/pull/1660
- Reducer estimation size fixes: https://github.com/twitter/scalding/pull/1652, https://github.com/twitter/scalding/pull/1650, https://github.com/twitter/scalding/pull/1645, https://github.com/twitter/scalding/pull/1644
- Use Combined*SequenceFile for VKVS, WritableSequenceFileScheme, SequenceFileScheme: https://github.com/twitter/scalding/pull/1647
- Improve Vertica support in scalding-db: https://github.com/twitter/scalding/pull/1655
- Add andThen to Mappable: https://github.com/twitter/scalding/pull/1656
- Expand libjars globs in ScaldingShell to match the behavior of Tool: https://github.com/twitter/scalding/pull/1651
- Use Batched in Sketch production: https://github.com/twitter/scalding/pull/1648
- Pick up Algebird 0.13.0: https://github.com/twitter/scalding/pull/1640
- Added API for Execution/Config to work with DistributedCache: https://github.com/twitter/scalding/pull/1635
- Bump chill version to 0.8.3: https://github.com/twitter/scalding/pull/1634
- Fixes a bug in how we use this stack: https://github.com/twitter/scalding/pull/1632
- Upgrade build to sbt 0.13.13: https://github.com/twitter/scalding/pull/1629
- Generate Scalding microsite via sbt-microsites: https://github.com/twitter/scalding/pull/1623
- FileSource support for empty directories: https://github.com/twitter/scalding/pull/1622, https://github.com/twitter/scalding/pull/1618, https://github.com/twitter/scalding/pull/1613, https://github.com/twitter/scalding/pull/1611, https://github.com/twitter/scalding/pull/1591
- Clean up temporary files created by forceToDiskExecution: https://github.com/twitter/scalding/pull/1621
- Moving the repl in wonderland to a dedicated md file: https://github.com/twitter/scalding/pull/1614
- Update Scala and sbt version: https://github.com/twitter/scalding/pull/1610
- REFACTOR: Fixed some compilation warnings: https://github.com/twitter/scalding/pull/1604
- REFACTOR: Rename parameter to reflect expectation: https://github.com/twitter/scalding/pull/1601
- Add partitioned sources for Parquet thrift / scrooge: https://github.com/twitter/scalding/pull/1590
- Add a test for sortBy: https://github.com/twitter/scalding/pull/1594
- Create COMMITTERS.md: https://github.com/twitter/scalding/pull/1589
- Use ExecutionContext in Execution.from/fromTry: https://github.com/twitter/scalding/pull/1587
- Support custom parquet field name strategies: https://github.com/twitter/scalding/pull/1580
- Deprecate reflection-based JobTest apply method: https://github.com/twitter/scalding/pull/1578
- Use Caching for FlowDefExecution: https://github.com/twitter/scalding/pull/1581 [parquet tuple macros] listType was deprecated in favor of listOfElements: https://github.com/twitter/scalding/pull/1579
- Use Batched to speed up CMS summing on mappers: https://github.com/twitter/scalding/pull/1575
- Remove a TypedPipeFactory wrapper which seems unneeded: https://github.com/twitter/scalding/pull/1576
- Make Writeable sources Mappable to get toIterator: https://github.com/twitter/scalding/pull/1573
- case class implicit children: https://github.com/twitter/scalding/pull/1569