Database Sync

The core of your Customer Data is likely to be in the database(s) that backend your customer facing platforms. Typically this will be a relational database. Some examples are PostgreSQL, MySQL, SQL Server. You may also using a NoSQL variety system, such as MongoDB or Cassandra. 

You may also have a business intelligence capability or an analytical data-warehouse from which to draw data. Here database platforms like Amazon Redshift, Azure Data Warehouse, Snowflake are used.

Databases are valuable repositories of raw Customer data. But they also contain a lot of related information that is specific to your business. This means they can be a valuable source of insight data. You may wish to pull up into your Customer Data Layer as part of this integration work.

This section describes how you can bring data from these systems into We have also included some best practices for you to follow.

Database Task List

Unlike the Public APIs using to connect to third-party systems, databases don’t often provide publicly accessable end-points. Therefore it is likely some engineering / IT resource will be required.

Equally the structure of your data is likely to be bespoke to your Organisation. The method for extracting data out of most databases is SQL. And so we’re going to need an engineer to help us with that bit.

If you feel you would like some assistance with either of these two resource our Supported Onboarding service can provide help.  

There are three stages to bringing in your customer data from a database:

  1. Setting up Database Access. The first thing we’re going to need to do is setup your database to allow to Connect. Database Security & Authentication describes this task.
  2. Creating Data Views. The structure of data in your Database will be unique to your business. The next task requires the creation of a set of database Views. Stored SQL statements structure data in a way that can understand.

    For more information about creating compatible scripted Views see creating Database Database View Scripts.
  3. Database Sync Best Practice. Databases are a mission critical part of the operational infrastructure. We have developed the database sync to be as gentle on your database as possible. This section details how this Sync process works as well as things you can put in place within your infrastructure to ensure smooth syncing.

    For more information see the Database Optimisation section.