Getting started

This guide shows you how to get started with ReOrc

This guide covers the capabilities currently available in the beta release, allowing you to connect to a database, create data models using sources and SQL models, build pipelines incorporating these models, and schedule job runs directly from the pipeline.

Prerequisites:

• You have a Recurve account. If not, you can sign up here: ReOrc

• You have been invited to an organization, with environments and workers running. For instructions, see: Set up and deployment.

Step-by-step workflow

Follow these steps to get started with Recurve:

1. Set up a connection

   • Connect ReOrc to your data sources (relational database, data warehouse).

   • Authenticate and configure the connection details.

2. Create a project

   • Set up a project as a collaborative space for your team.

   • Configure an analytics database to store and process the transformed data of the project.

3. Create data models

   • Reference your raw data as sources.

   • Define your transformation logic using models.

   • Add tests to validate that your models are working properly.

4. Build the models in console

   • Execute model builds in console and run associated data tests to verify transformations.

   • Debug failed tests, optimize performance, and iterate models based on validation results.

5. Set up a pipeline

   • Automate the workflow in a pipeline by chaining together your data models.

   • Configure the pipeline execution and schedule in a job.

   • Monitor the pipeline through the Health Tracking dashboard.

Throughout these guides, we'll introduce you to the key components of Recurve and provide necessary links for more detailed information on each step. Let's get started!