File: cloud.rst

package info (click to toggle)
dask 1.0.0%2Bdfsg-2
  • links: PTS, VCS
  • area: main
  • in suites: buster
  • size: 6,856 kB
  • sloc: python: 51,266; sh: 178; makefile: 142
file content (29 lines) | stat: -rw-r--r-- 1,108 bytes parent folder | download
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
Cloud Deployments
=================

To get started running Dask on common Cloud providers like Amazon, 
Google, or Microsoft, we currently recommend deploying
:doc:`Dask with Kubernetes and Helm <kubernetes-helm>`.

All three major cloud vendors now provide managed Kubernetes services.
This allows us to reliably provide the same experience across all clouds,
and ensures that solutions for any one provider remain up-to-date.

Data Access
-----------

You may want to install additional libraries in your Jupyter and worker images
to access the object stores of each cloud:

-  `s3fs <https://s3fs.readthedocs.io/>`_ for Amazon's S3
-  `gcsfs <https://gcsfs.readthedocs.io/>`_ for Google's GCS
-  `adlfs <http://azure-datalake-store.readthedocs.io/>`_ for Microsoft's ADL

Historical Libraries
--------------------

Dask previously maintained libraries for deploying Dask on Amazon's EC2.
Due to sporadic interest, and churn both within the Dask library and EC2 itself,
these were not well maintained.
They have since been deprecated in favor of the
:doc:`Kubernetes and Helm <kubernetes-helm>` solution.