Batch Exports
How to export your data in batches large or small
Last updated
How to export your data in batches large or small
Last updated
Aquarium allows you to export your data out of the tool in a variety of formats. The format of the data will look like depends on what view and workflow you are currently working with when initiating the export.
There are two main places you can batch export data from within Aquarium:
Grid View
Analysis View
Embedding View
Model Metrics View
The types of data included in each batch export range from just including frame IDs to fully encompassing exports that include almost all of the data initially ingested by Aquarium.
All segments except those of type Collection Campaign have the ability to batch export their data in a CSV or JSON format. Currently, Collection Campaigns can only be exported as JSON.
We recommend grouping your data into segments and exporting your data from there. For all segment types, there is a standard batch export available.
Segments of type Collection Campaign have an additional feature where you can search for new data within an unlabeled dataset. This feature also allows for an additional export of your data which we will cover separately.
For all types of segments, if you click into the segments view, then click the "Elements" tab, you will find an "Actions" button in the top right corner of the screen. Click this button to expand the dropdown. You will see the option to download a batch export file for just the data contained in the segment in either JSON or CSV format.
If you would like to enable the option "Export To Labeling" and send your data directly to a labeling provider via webhook, you can view the docs for that here.
Before you can export data under this tab, you have to kick off a search through the unlabeled dataset. To learn how to run a Collection Campaign follow this guide.
For a segment of type Collection Campaign, there is one additional place that you can batch export your data. Segments of type Collection Campaign will have another tab that says "Collected". Click the arrow button to expand the drop down in order to access the download button to export your data.
When exporting Segment data, you'll notice far more data included than in the main view exports. The data will vary depending on the ML Task type of the project, and if it is a crop or frame based segment, and if the crop are inference or ground truth crops.
For an example of what this export will look like, here is a link that will start a download to show an example of a JSON file for a frame-level segment export using the open source RarePlanes dataset (only has one element in export).
Export Data Format
In this context the main views are:
Grid View
Analysis View
Embedding View
Model Metrics View
In each one of these views, you will see a button toward the top right corner that has the download symbol and the number of elements that will be downloaded.
Click the button highlighted in the above image to export your data in a JSON format. Remember any queries applied to the window will reflect in which data is exported.
For this kind of batch export, the data format is basic: a list of all of the frame IDs currently queried in that view.
The data will be exported as JSON file and will look like this:
If your workflow requires additional data to be exported, reach out to the team and we can see what other solutions could be possible.
