The Dask community is highly distributed with different teams working independently. This is powerful but sometimes makes it hard for people within the community to see everything that is going on. The Dask Heartbeat by Coiled is a bi-weekly publication intended to centralize and broadcast Dask news over the previous two weeks.
Stability Release 2021.01.1
Dask and Distributed 2021.01.1 were released last week. This release fixes critical issues and we strongly recommend any users on 2020.12.0 or 2021.01.0 upgrade.
The Dask community is hosting a virtual summit later this spring. More details will be released soon.
master –> main
Much like GitHub and other PyData projects like Bokeh and Scikit-learn, the Dask community is moving the default branches for repositories from
main. You can track progress at https://github.com/dask/community/issues/68.
There are many Dask-related libraries that aren’t quite ready to live in the main Dask organization on GitHub. Jacob Tomlinson (NVIDIA) recently started one of these (see Dask-CTL below) and thought that maybe we should have an incubation Github organization for these projects. See the community discussion at https://github.com/dask/community/issues/115 and resulting Dask-Contrib GitHub organization.
More here: https://github.com/dask-contrib
Experimental tools to control the lifecycle of Dask clusters with a standard API.
More here: https://github.com/dask-contrib/dask-ctl
As part of the ongoing scheduler performance work, we’ve started profiling the scheduler during heavy workloads. The conversation in this issue may be fun for those with an interest in low-level Python performance.
You’re All Caught Up On Dask
That’s it. Thanks for reading all.
If you’re interested in taking Coiled Cloud for a spin, which provides hosted Dask clusters, docker-less managed software, and zero-click deployments, you can do so for free today when you click below.