Integrations, Migrations, Data Quality, Data Prep
- An extensible ETL platform with exceptional speed of 'Flow' development and user-friendliness
- We offer the Ziggy product and a range of services
- Easy deployment to AWS, Azure, Google Cloud or on-premise servers.
- Completely control over security, data persistence and performance.
- Custom Blocks for HubSpot, SalesForce and and many other platforms
- Extensive data mapping and validation support. Javascript and Python Blocks for all edge cases
- Product and Services
Docs
Contact Us
Services
We provide a full range of services for migrations, integrations and general data processing. We are used to handling highly complex projects, but we also take on smaller ones.
Because we have built our own technology, we do things fast. And, Ziggy runs on (your) dedicated infrastructure, so there are zero operational costs and performance is guaranteed.
Services
- Migrations - we have run some huge migrations running into many millions of records between multiple systems and objects
- Integrations - we can set up real-time or scheduled integrations between any data sources, platforms, databases and APIs.
- Data Cleansing - whether one-off or ongoing, we can set up processes that cleanse your data using automatic and manual flows.
- BI and Reporting Prep - create homogenous data views from one or multiple data sources for any reporting platform.
- Custom Blocks - we can build custom blocks to make accessing any platform incredibly easy and slot into a Flow. Take a look at the Hubspot Blocks section below to see how Custom Blocks work.
What is Ziggy?
The Ziggy product is for systems integrators who want to build their own Ziggy Flows. Basic Javascript knowledge is not essential, but can be useful for handling edge cases. If you are working with the Ziggy source code, then Typescript knowledge is required.
Ziggy Overview
See Ziggy being used in some common use-cases
Integrations
Migrations
Validation, Transformation, Mapping
- Product and Services
HubSpot, SalesForce and other platform blocks
Platform Blocks are built with ease-of-use and speed of Flow development in mind. They automatically take care of API batching and rate limits. We support a wide range of platforms, systems and databases. The Hubspot examples below give you an idea of what Blocks can do.
- Product and Services
Read
Read from any standard or custom object
Read batches or by matching data on an edge
Specify batch size and number of batch iterations for the testing phase
Fetch data from HubSpot based on a HubSpot search
Choose HubSpot properties to pass down the Flow
Write
Upsert and update
Validation of data before write
Writes all edge data in one batch operation
Set Associations
Create Association between objects
Includes custom objects and activities
Automatically uses Batch API regardless of data volume being sent
Get Associated Object
Retrieve associations between any objects
Specify the Association to use
Includes custom objects and activities
Great for reporting data prep
Get Owners
Retrieve all platform users
Includes Owner IDs and email addresses
Owner Translate
Translates email addresses into Owner IDs
Intended for integrations and migrations from a 3rd party system
Translates a batch of records with an email field into an Owner ID
Get File Attachments
Retrieve file attachments
Match against list of unique ID properties
Download or URL reference
Set File Attachments
Add file attachments
Attachment information taken from input edge data
Need another one?
Inquire if you need a Custom Block for Hubspot, SalesForce or other systems
We can address just about anything in HubSpot
Connect to other systems
You need to connect your HubSpot data to other systems. We are adding new Blocks all the time so shout if you need one. You can even code your own Custom Blocks.
REST
Make REST API calls
Supports batch operations
Javascript/Python
Simple, inline Javascript processing
Great for edge cases, special transformations and mappings
SalesForce Collection
Connect to all SalesForce objects
Same collection of Blocks as Hubspot
SQL
Read and write data to SQL databases
Full support for Batch operations
Use edge data within queries
AWS S3
Read and write to S3
CSV, JSON, Excel, Text
Azure Blob Storage
Read and write
CSV, JSON, Excel, Text
File
Write to and read from up- and downloadable files
Automatic conversion to CSV, JSON, Excel, Text etc.
Airtable
Write to and read from Airtable
Data Store
A Ziggy internal key/value data store
Fast batch operation support
Ideal for importing to, interim storage etc.
Helper Blocks
Helper Blocks are for quick and easy data manipulation
Maniulate data on one or more incoming/outgoing edge
Merge, split, map etc.
Request a Block
We can add Blocks that connect with any other system
New Blocks are released regularly
Contact us if you’d like a custom block built
Validation, Transformations and Mapping
Ziggy provides three ways to map and transform data. In fact, there is no data transformation you can’t do.
- "Edge" mapping (see video below)
- Google Sheets managed mapping
- Javascript or Python for hand-crafting all edge cases
Validations, transformations and mapping
Execution History
The status of all Flow executions are recorded in the Execution History.
- Store data and error messages for failed Flows
- Security settings to not store data
- Open History item to see reason for failure
Always an escape hatch
If there isn't an off-the-shelf Block, or you need special validations or transformations, or address any other edge-case - then you reach for the Javascript or Python Blocks.
- In-Block or full screen editor
- Reference NPM modules, executables
- Batching
- Branching
- Product and Services
Deploy to your own infrastructure
Ziggy Solo is a private instance of Ziggy than you fully own, control and manage.
- Simple Docker deployment
- You control performance, scaling and availability
- Full control over all security aspects
- Fixed pricing regardless of transaction volume
- Contact us for custom setup on your behalf
Add Custom Blocks. Extend Ziggy.
Custom Blocks can be added to work with any platform, API, database etc. Quick to build, they cut out the need for Javascript.
In fact, Ziggy can be customized or extended in any way you want.
- Product and Services
Supporting features
Ziggy provides a lot of supporting functionality for your Flows.
- Execution History
- Data Store
- Memory Store
- Flow Scheduler
- Queue Management
- Alert
- Secrets Management
- Structure Management
- Connection Objects
- Tests
See supporting features
Use Cases
There is an infinite number of use-cases for Ziggy - any time data needs to move between two or more systems.
Integrations
A change in one system should update one or more other systems, validating and transforming data in the process.
Migrations
Move any volume of data from System A to System B, applying mapping and validation rules along the way.
Reporting Data Prep
Take data from one or more platforms and recombine in the format required by your reporting
Data Quality, Cleaning
Ziggy provides several ways to check the quality of your data and even clean it.
Flow features
Ziggy comes with everything you are likely to need to perform any integration and migration - at scale and at speed.
Here a few of the core Flow features.
Contact us
Utility Blocks
Complex system and platform specific functionality wrapped in one or more friendly Blocks
Core product values - Ziggy Solo
There are some things that are non-negotiable in a quality systems integration product.
No Glass Ceilings
No-code and low-code cloud platforms are great until they don't do what you need. Ziggy is fully extensible, so the sky's the limit.
- Source Code option for those who want ultimate control
- Javascript Block lets you deal with any edge case
- Where you're building lots of integrations talking to one specific system, we, or you, can build super-friendly Custom Blocks that encapsulate any functionality you need in a single Block.
Security
You should be able to control all aspects of security.
- Specify what, if any, data is stored in the Execution History
- Fully encrypted secrets, API keys etc.
- No sensitive data written to logs
- Choose where your integrations are deployed
Deployment Location
Companies with strict security requirements need to control exactly which server their integrations run on.
- Deploy to any server/VPC
- Dockerized, so easy to deploy
- Control access at the DevOps level
Speed
You expect your integrations to run at speed. Ziggy is fast but there are other key considerations that Ziggy helps you manage.
- API rate limit protection for third party APIs
- Batching ensures that you can work with the largest datasets without overloading the system
- Queuing ensures that Webhooks get a fast response and the system isn't overwhelmed
- Each Block shows the time taken to execute, so you can fine-tune where you need to
Contact Us
Supporting Features
Ziggy comes with many features that support your Flows. These provide a complete framework to support the most complex use-cases.
- Product and Services
Execution History
View executed Flows. Load failed executions into the Flow editor with error info.
Structure Management
Define data structures from your data for mapping, with optional Zod validation