Destinations

The Destination section contains all the connections to data sources that you can use in your project. Recurves provides a wide range of connectors to data sources for the flexible needs and objectives for your businesses.

Each data source / provider can require specific authentication method and parameters.

Below is the list of available data sources.

Data warehouses

  • Azure Synapse

  • Big Query

  • Hive

  • Impala

Databases

  • ClickHouse

  • Apache Doris

  • ElasticSearch

  • MongoDB

  • Microsoft SQL Server

  • MySQL

  • Phoenix

  • PostgreSQL

  • Redshift

  • Spark

  • StarRocks

  • TiDB

Data storages

  • Azure Blob

  • FTP

  • Google Cloud Storage

  • Aliyun OSS

  • ownCloud

  • Amazon S3

  • SFTP

  • Tencent COS

How the connections work

In Recurve architecture, Recurve agent is the component that receives instructions from the Control Plane and executes the corresponding tasks in the Data Plane. This also involves registering and maintaining the connections to data sources.

When you set up connections within your organization, you direct the agent to establish secure links to your data sources. Therefore, all data transformations and persistence occur directly between the agent and your data sources.

Database permissions

When setting up a database connection in Recurve, you must configure it with user credentials that have sufficient permissions. Each data provider may have a different approach to granting permissions, but generally, the database user must have:

  • Read permissions (SELECT): To access and query source data tables.

  • Write permissions (CREATE, INSERT, UPDATE): To save transformed data and model results.

Ensure these permissions are granted specifically for the target schema where you plan to query and transform data.

Last updated