Supported connections
YData SDK can read and write data from a variety of data sources.
Connectors
Here is the list of the available connectors in YData SDK.
| Connector Name | Type | Supported file types | Notes |
|---|---|---|---|
| AWS S3 | Object Storage | Parquet CSV |
|
| Azure Blog Storage | Object Storage | Parquet CSV |
|
| Azure Data Lake | Object Storage | Parquet CSV |
|
| Google Cloud storage | Object Storage | Parquet CSV |
|
| Upload file | File | Parquet CSV |
Maximum file size is 700MB. Bigger files should be uploaded and read from remote object storages |
| Google BigQuery | Big Table | Not applicable |
|
| MySQL | RDBMS | Not applicable |
Supports reading whole schemas or specifying a query |
| Azure SQL Server | RDBMS | Not applicable |
Supports reading whole schemas or specifying a query |
| PostGreSQL | RDBMS | Not applicable |
Supports reading whole schemas or specifying a query |
| Snowflake | RDBMS | Not applicable |
Supports reading whole schemas or specifying a query |
| Oracle DB | RDBMS | Not applicable |
Supports reading whole schemas or specifying a query |
| SAP HANA / S/4HANA | RDBMS | Not applicable |
Supports reading tables, views or a query. Schema reflection needs an explicit table list on large (ABAP) schemas |
| Databricks Unity Catalog | Catalog | Not applicable |
Supports reading a table |
| Databricks Delta Lake | Lakehouse | Not applicable |
Supports reading a table |
Installing a connector
Connector drivers are installed per connector with a pip extra (flavour). See Installation for details.
| Connector | Flavour |
|---|---|
| AWS S3 | pip install "ydata-sdk[s3]" |
| Azure Blob Storage / Azure Data Lake | pip install "ydata-sdk[azure]" |
| Azure SQL Server | pip install "ydata-sdk[azuresql]" |
| Google Cloud Storage / BigQuery | pip install "ydata-sdk[google]" |
| MySQL | pip install "ydata-sdk[mysql]" |
| PostgreSQL | pip install "ydata-sdk[postgresql]" |
| Snowflake | pip install "ydata-sdk[snowflake]" |
| Databricks Unity Catalog / Delta Lake | pip install "ydata-sdk[databricks]" |
| SAP HANA / SAP S/4HANA | pip install "ydata-sdk[saphana]" |
| Upload file / local files | included in the base install |
| All of the above | pip install "ydata-sdk[all-connectors]" |
Haven't found your storage?
To understand our development roadmap or to request prioritization of new data connector, reach out to us.