Dask Heartbeat

Matt Rocklin January 27, 2021

Dask Heartbeat by Coiled

, , , , ,


Introduction

The Dask community is highly distributed with different teams working independently. This is powerful but sometimes makes it hard for people within the community to see everything that is going on. The Dask Heartbeat by Coiled is a bi-weekly publication intended to centralize and broadcast Dask news over the previous two weeks.  

If you want something added to this list either send an e-mail at info@coiled.io, or tweet and tag @dask_dev and we’ll try to include it. Keep reading for the latest updates.

Dask Heartbeat

Stability Release 2021.01.1

Dask and Distributed 2021.01.1 were released last week. This release fixes critical issues and we strongly recommend any users on 2020.12.0 or 2021.01.0 upgrade.

Dask Summit

The Dask community is hosting a virtual summit later this spring. More details will be released soon.

master –> main

Much like GitHub and other PyData projects like Bokeh and Scikit-learn, the Dask community is moving the default branches for repositories from master to main. You can track progress at https://github.com/dask/community/issues/68

Dask-Contrib

There are many Dask-related libraries that aren’t quite ready to live in the main Dask organization on GitHub. Jacob Tomlinson (NVIDIA) recently started one of these (see Dask-CTL below) and thought that maybe we should have an incubation Github organization for these projects. See the community discussion at https://github.com/dask/community/issues/115 and resulting Dask-Contrib GitHub organization.

More here: https://github.com/dask-contrib

Dask-CTL

Experimental tools to control the lifecycle of Dask clusters with a standard API.

More here: https://github.com/dask-contrib/dask-ctl

Performance Tracing

As part of the ongoing scheduler performance work, we’ve started profiling the scheduler during heavy workloads. The conversation in this issue may be fun for those with an interest in low-level Python performance. 

More here: https://github.com/dask/distributed/issues/4443

You’re All Caught Up On Dask

That’s it. Thanks for reading all.

If you’re interested in taking Coiled Cloud for a spin, which provides hosted Dask clusters, docker-less managed software, and zero-click deployments, you can do so for free today when you click below.