Manage Collections

Before reading further, make sure you are familiar with a collection.

If you are time-pressed, a collection is a database. We have set up some preconfigured database structures that make it easy to handle large volumes of semi-structured data that you might want to query in different ways, over and over again.

All collections are presented in the Collections Table.

Collections Table

Clicking on this icon will display the collection information page. This page contains all you need to know about what is in the collection and which variables map to which collection fields.

Collection Information View

General Info.

When the collection was created, who created it and the name of the pipeline that created it.

Default Fields

Which variables in the pipeline are associated with the stand collection fields.

Files

What are the files that have been used to create this collection.

Create An Extract

Clicking on this icon creates a new extract from the collection. This action displays the create extract forms. An extract is way of telling the application what data you want to see and what format you want to see it in. There are two different types of extracts, raw and aggregated.

Raw extracts are just that, a raw data dump of the request. Aggregated extracts summarize the data by different user-defined groups in the data. For example you can aggregated by date, country, currency, item etc. Aggregated extracts are very good for producing charts and reports.