Broker Guide

Stores

Stores

What is a store?

A store is a location where your data is stored. This could be a database, or a file bucket service. This is where we will read the raw data from, and write the output data to. You can have multiple stores of multiple types configured each with their own permissions.

Access control

We recommend that you define connections as read-only for sources that the Broker reads from, and that sources the Broker can write to be tightly controlled. While we will not remove any data on purpose, you have a lot of control with these tools.

Examples

Read-only sources --> write to a bucket

Tokenize (optional) S3 (Read-only) Broker workflow/workbook PostgreSQL (Read-only) MySQL

This example flow uses three sources in combination with workflows or workbooks to combine data from an AWS S3 bucket and a PostgreSQL database. The result is then written to a MySQL database.

On this page