GitHub repository: shachi01/dask_in_python_ml
Created: 2020-07-27T11:10:15Z
Description: Dask is an open-source python library with the features of parallelism and scalability in Python. It reuses the existing Python libraries such as pandas or numpy and enhances them by incurring scalability. Also, sklearn related ML algorithms are implemented. Thus, dask APIs are familiar to the existing Python APIs such as pandas, numpy, scikit-learn etc. It is able to handle huge in GBs and live-streaming data just like Spark and follows lazy computation mechanism where computations will only be performed when explicitly requested.