Version 1.8.1

Koalas 1.8.1 is a maintenance release. Koalas will be officially included in PySpark in the upcoming Apache Spark 3.2. In Apache Spark 3.2+, please use Apache Spark directly.

Improvements and bug fixes

  • Remove the upperbound for numpy. (#2166)

  • Allow Python 3.9 when the underlying PySpark is 3.1 and above. (#2167)

Along with the following fixes: - Support x and y properly in plots (both matplotlib and plotly). (#2172) - Fix Index.different to work properly. (#2173) - Fix backward compatibility for Python version 3.5.*. (#2174)