Dask Heartbeat by Coiled: 2021-05-07

James Bourbeau May 7, 2021

, ,


Dask Heartbeat

Introduction

The Dask community is highly distributed with different teams working independently. This is powerful but sometimes makes it hard for people within the community to see everything that is going on. The Dask Heartbeat by Coiled is a monthly publication intended to centralize and broadcast Dask news over the previous four weeks.  

If you want something added to this list either send an e-mail at info@coiled.io, or tweet and tag @dask_dev and we’ll try to include it. Keep reading for the latest updates.

Dask Distributed Summit 

The Dask Distributed Summit is fast approaching and the schedule for the conference was recently announced. If you would like to attend you can register for the summit here

Releases

Over the last month both Dask and Distributed versions 2021.04.0 and 2021.04.1 were released

Dask monthly community meeting 

During the May Dask community meeting, there was a lively discussion around what questions we should include in this year’s Dask User Survey. See the meeting notes for what was brought up during this discussion. If there are any questions you’d like to see included in the survey, feel free to let us know on this issue.

Planetary Computer

Microsoft announced their Planetary Computer platform to accelerate environmental sustainability and Earth science. The platform uses Dask-Gateway to scale computations.

Concurrent.futures executor support

John Kirkham (NVIDIA) added support for `concurrent.futures` executors to Dask’s single-machine schedulers. 

Improved worker memory tracking

Guido Imperiale (Coiled) improved Dask’s worker memory tracking by including memory not managed directly by Dask. This will enable common memory-related issues (e.g. memory leaks) to be more easily diagnosed.

Dask-Image 0.6.0 release

Dask-Image 0.6.0 was recently released and includes, among other things, GPU support for binary morphological functions, and improvements to the performance of `imread`. See the Dask-Image changelog for full details. 

Monitoring Dask + RAPIDS with Prometheus + Grafana

Jacob Tomlinson wrote a blog post about how to monitor Dask and GPU metrics with Grafana.

You’re All Caught Up On Dask

That’s it. Thanks for reading all.

If you’re interested in taking Coiled Cloud for a spin, which provides hosted Dask clusters, docker-less managed software, and zero-click deployments, you can do so for free today when you click below.