Kedro-Datasets is where you can find all of Kedro's data connectors.
Welcome to kedro_datasets
, the home of Kedro's data connectors. Here you will find AbstractDataset
implementations powering Kedro's DataCatalog created by QuantumBlack and external contributors.
kedro-datasets
is a Python plugin. To install it:
pip install kedro-datasets
AbstractDataset
implementations are supported?We support a range of data connectors, including CSV, Excel, Parquet, Feather, HDF5, JSON, Pickle, SQL Tables, SQL Queries, Spark DataFrames and more. We even allow support for working with images.
These data connectors are supported with the APIs of pandas
, spark
, networkx
, matplotlib
, yaml
and more.
The Data Catalog allows you to work with a range of file formats on local file systems, network file systems, cloud object stores, and Hadoop.
Here is a full list of supported data connectors and APIs.
AbstractDataset
implementation?Take a look at our instructions on how to create your own AbstractDataset
implementation.
Yes! Want to help build Kedro-Datasets? Check out our guide to contributing.
Kedro-Datasets is licensed under the Apache 2.0 License.