Lightweight compute platform for Python people
Built for data engineers and scientists. Obsessively crafted for developer experience.
import coiled
cluster = coiled.Cluster(
n_workers=2000,
region="us-east-2"
) ā
ā
# Process a shitload of data
data = load(...)
process(data)
Call up cloud machines by Calling a function.
No Kubernetes or Docker, just scalability from Python in three steps
Spin up machines
You can spin up any number of machines, in any region, with any specs, in about a minute.
All from your Python script.
import coiled
cluster = coiled.Cluster(
n_workers=2000, # Any number
region="us-west-1", # Any Region
vm_types=["c5n.18xlarge"] # Any Hardware
) ā
ā
ā
# Machines up!
Replicate your local environment
Coiled moves your packages, files, and credentials to your machines.
No Docker required.
Need to install a new package or edit a file?
Just edit your local environment and re-run.
$ pip install torch --upgrade
Installing [+++++++++++++++++++++++++++++++++++++++++]
ā
torch installed āClean up and Maintain with ease
Coiled cleans up your machines when you're done. Zero infrastructure at rest.
Setup takes two minutes. No cloud expertise required.
Zero effort to maintain your infrastructure.
>>> results.save() ā
>>> exit() ā
š ā
ā
# Ephemeral infrastructure.
# Zero maintenance.Your developer experience stays the same.
Now with a ton of machines.
- Runs in your cloud
- Drive from VSCode (or anywhere)
- Use your existing tools
One platform, many tools
Batch Jobs run any code on cloud VMs
- Run anything, even Fortran
- Specify hardware in script comments
- Parametrize with environment variables
#!/bin/bash
#COILED memory 32GB
#COILED container ubuntu:latest
#COILED ntasks 10
echo "Hello from $COILED_BATCH_TASK_ID"
#!/bin/bash
#COILED memory 32GB
#COILED container ubuntu:latest
#COILED ntasks 10
echo "Hello from $COILED_BATCH_TASK_ID"
A platform that's fun for the whole team
Your team deserves better than the AWS cloud console
Empower your team with a suite of accessible and safe tools
- Use Coiled API directly from Python
- Use Web UI to debug and analyze jobs
- Easily control access and costs
Delightful to use
These people said nice things about us, and we didn't even have to pay them.
"The speed is nice, sure, but the real benefit is taking a multi-day effort and finishing it in an afternoon. Coiled changed the character of our work."
Matt Plough
Software Engineer, KoBold Metals
"Quite literally burst to the cloud from your laptop, everything I've been dreaming of since grad school."
Eric Ma
Data Scientist, Moderna
"Coiled is a game changer for us. It's great to be able to run the same process on your laptop and on the cloud."
Basile Goussar
Co-founder, Netcarbon
"I've been incredibly impressed with Coiled; it's quite literally the only piece of our entire ETL architecture that I never have to worry about."
Bobby George
Co-founder, Kestrel
"Dask is simple. Coiled made it simpler. Set up is half the battle with the cloud and Coiled made this easy."
Kenneth Nguyen
CTO, Tasq
"Coiled is the Heroku of Data. Setup was a piece of cake."
Tim Cull
Leadership Swiss Army Knife, Urban Footprint
"My team has started using Coiled this week. Got us up and running with clusters for ad hoc distributed workloads in no time."
Mike Bell
Data Scientist, Titan
"Coiled support is amazing. I'll run into an issue and before I have a chance to mention it I have an email in my inbox. You don't get this kind of support with large companies."
Katya Potapov
Software Engineer, Floodbase
"On my computer this takes days. Now it takes an hour. I had no experience with distributed systems."
Mohamed Akbarally
Data Scientist, With Marmalade
"We've been using Coiled in our backend for months and never think about it. It just works."
Luiz Augusto Alvim
Acoustic Engineer, RPG Acoustical
"Coiled is natural and fun to use. It's Pythonic."
Lucas Gabriel Balista
Data Science Lead, Online Applications
FAQ
Coiled runs in your cloud account (AWS, GCP, or Azure).
Coiled sets up and manages the infrastructure, but the compute resources run in your own cloud environment, giving you full control over your data and costs, and a more private and secure experience.
If you're just starting out, you can run in our cloud account for free, just run
pip install coiled
coiled quickstart
pip install coiled
coiled quickstart
and you're good to go. There's no risk.
Coiled is free for most users.
We make most of our money from teams and enterprises who use our more advanced features.
The free tier includes:
- 200 CPU hours per month if you run in our account (typically used just to get started)
- 10,000 CPU-hours per month if you run in your own account (most people do this)
For more information, see the Pricing page.
Yeah, probably.
Coiled turns VMs on and off, and then runs your code in that cloud. That code can be any code; it doesn't even have to be Python.
Coiled is really easy to get started.
- The free tier is genreous (enough for most users)
- You can start running on our cloud account (and using your own cloud is also really easy)
- You can run everything with the Python API
You don't need to know anything about cloud infrastructure to start. Just run
pip install coiled
coiled quickstart
pip install coiled
coiled quickstart
and you're good to go. There's no risk.
Get started
Know Python? Come use the cloud. Your first 10,000 CPU-hours per month are on us.
$ pip install coiled
$ coiled quickstart
Grant cloud access? (Y/n): Y
... Configuring ...
You're ready to go. š$ pip install coiled
$ coiled quickstart
Grant cloud access? (Y/n): Y
... Configuring ...
You're ready to go. š