The Dask community is highly distributed with different teams working independently. This is powerful but sometimes makes it hard for people within the community to see everything that is going on. The Dask Heartbeat by Coiled is a monthly publication intended to centralize and broadcast Dask news over the previous four weeks.
Dask Distributed Summit
Thanks to everyone who submitted talk, tutorial, and workshop proposals for the Dask Distributed Summit. Stay tuned for an announcement about the conference schedule and don’t forget to register for the summit.
Over the last month there have been several releases in the Dask ecosystem. In particular:
- Dask and Distributed versions 2021.03.0 and 2021.03 (2021.04.0 is scheduled to be released on April 2, 2021)
- Dask-Cloudprovider versions 2021.03.0 and 2021.03
- Dask-Kubernetes versions 2021.03.0 and 2021.03
- LightGBM version 3.2.0 was released, which includes native support for integrating with Dask.
Dask monthly community meeting
Some highlights from the April Dask community meeting:
- The Dask community will start having regular social virtual meetings to promote more social bonds in the community. See this issue for more information.
- The Dask community is considering adopting a Dask Enhancement Proposal (DEP) process to help plan larger development projects.
- Updating Dask’s visual identity. See this issue for more information.
Full meeting notes are available here.
Dask with PyTorch for large scale image analysis
Dropped Python 3.6 support
Dask adds more dependencies
Dask recently added cloudpickle, partd, fsspec, and toolz as required dependencies. Previously these packages were required to use certain functionality in Dask (e.g. Dask delayed), but were upgraded to required dependencies to reduce project maintenance.
The Dask development team maintains commit rights on all of these projects.
Main branch migration
The Dask community continues migrating the default branch name for its repositories to “main”. Recently the Dask and Distributed repositories were migrated. You can track progress here.
Measuring Dask memory usage with dask-memusage
Google Summer of Code
Dask is joining this year’s Google Summer of Code under the NumFOCUS umbrella. If you’re interested in project ideas, see this Dask wiki page.
Image segmentation with Dask
Distributed computing on GPUs with Dask
You’re All Caught Up On Dask
That’s it. Thanks for reading all.
If you’re interested in taking Coiled Cloud for a spin, which provides hosted Dask clusters, docker-less managed software, and zero-click deployments, you can do so for free today when you click below.