Skip to content

Connectors

Connectors play an important role in the landscape of data-driven projects, acting as essential components that facilitate the movement and integration of data across different systems, platforms, and applications. YData´s Connectors where designed to offer a seamless and easy connectivity for data exchange between data sources (such as databases, cloud storage systems, lakehouses and more).

Benefits

  • Data Integration: YData's Connectors are primarily used to consume and integrate data a variety of different sources in a single project, ensuring that data can be easily combined, transformed, and made ready for analysis or operational use.
  • Automation of data flows: They automate the process of data extraction, transformation and loading (ETL), which is crucial for maintaining up-to-date and accurate the data that is being used for a certain project.
  • Simplification of data access: YData's connectors experience simplify the process of accessing and using data from specialized or complex systems, making it easier for users without deep technical expertise to leverage data for insights.
  • Enhancement of Data Security: Designed to manage in a secure way the credentials and access to your different storage.

The YData SDK provides a comprehensive set of connectors to access various data sources. This section covers the supported connectors and their usage.

Installation

Connectors are installed per data source, as flavours of ydata-sdk. The base install only includes the local file connector; add the flavours for the sources you use:

pip install "ydata-sdk[google,snowflake]"

Available flavours: s3, azure, azuresql, google, mysql, postgresql, snowflake, databricks, saphana and all-connectors. The supported connections page maps each connector to its flavour.

If a connector is created without its flavour, it raises MissingConnectorDependency with the command to run:

from ydata.connectors import SnowflakeConnector

SnowflakeConnector(conn_string=conn_str)
# MissingConnectorDependency: SnowflakeConnector requires the optional 'snowflake' dependencies
# (missing: snowflake.connector, snowflake.sqlalchemy). Install them with:
#
#     pip install "ydata-sdk[snowflake]"

Getting Started Examples

For practical examples of using these connectors, check out our Getting Started guides: