Batch Exports

How to export your data in batches large or small

Overview

Aquarium allows you to export your data out of the tool in a variety of formats. The format of the data will look like depends on what view and workflow you are currently working with when initiating the export.

There are two main places you can batch export data from within Aquarium:

• Segments

• Main Views

  • Grid View

  • Analysis View

  • Embedding View

  • Model Metrics View

The types of data included in each batch export range from just including frame IDs to fully encompassing exports that include almost all of the data initially ingested by Aquarium.

Querying Your Data To Be Exported

Your exported data will reflect the current query in the view. For example, if I wanted to export data from any main view, without a query you will be exporting the entirety of the specific dataset.

If we apply a query to the view, you'll see that the number reflects just the data that fits the criteria of the query.

Exporting Data from a Segment

All segments except those of type Collection Campaign have the ability to batch export their data in a CSV or JSON format. Currently, Collection Campaigns can only be exported as JSON.

We recommend grouping your data into segments and exporting your data from there. For all segment types, there is a standard batch export available.

Segments of type Collection Campaign have an additional feature where you can search for new data within an unlabeled dataset. This feature also allows for an additional export of your data which we will cover separately.

How To Export Segment Data

For all types of segments, if you click into the segments view, then click the "Elements" tab, you will find an "Actions" button in the top right corner of the screen. Click this button to expand the dropdown. You will see the option to download a batch export file for just the data contained in the segment in either JSON or CSV format.

The expandable menu to export data into a JSON or CSV file

If you would like to enable the option "Export To Labeling" and send your data directly to a labeling provider via webhook, you can view the docs for that here.

How To Export Collection Campaign Segments

Before you can export data under this tab, you have to kick off a search through the unlabeled dataset. To learn how to run a Collection Campaign follow this guide.

For a segment of type Collection Campaign, there is one additional place that you can batch export your data. Segments of type Collection Campaign will have another tab that says "Collected". Click the arrow button to expand the drop down in order to access the download button to export your data.

Exporting the collection of new data sampled form an Unlabeled Dataset

Segment Export Data Format

When exporting Segment data, you'll notice far more data included than in the main view exports. The data will vary depending on the ML Task type of the project, and if it is a crop or frame based segment, and if the crop are inference or ground truth crops.

Frame Level JSON

For an example of what this export will look like, here is a link that will start a download to show an example of a JSON file for a frame-level segment export using the open source RarePlanes dataset (only has one element in export).

Export Data Format

[
   {
      "element_id":"", # unique id in segment
      "element_type":"frame", #frame or crop segment
      "dataset":"", # name of dataset
      "inference_set": "", # name of inference set
      "frame_id":"", # unique frame id
      "frame_data":{
         "_idx": , # int value
         "coordinate_frames":[ # details of coordinate frame
            {
               "coordinate_frame_id":"DEFAULT",
               "coordinate_frame_metadata":null,
               "coordinate_frame_type":"IMAGE"
            }
         ],
         "custom_metrics":null, # if any custom metrics were added in
         "date_captured":"2022-06-15T15:36:45.365725+00:00", 
         "deleted":null, 
         "device_id":"default_device", # if custom device id was specificed
         "frame_id":"", # unique frame id
         "frame_window": , # window id, unix timestamp of when data was uploaded
         "geo_data":"{}", 
         "inference_metadata":null, # will be null if frame level segment
         "label_data":[], # will be empty if frame level segment
         "reuse_latest_embedding":false,
         "sensor_data":[ # details of the sensor data
            {
               "coordinate_frame":"DEFAULT",
               "data_urls":"{\"image_url\": \"https://storage.googleapis.com/aquarium-public/datasets/rareplanes/train/PS-RGB_tiled/100_1040010029990A00_tile_319.png\"}",
               "date_captured":"2022-06-15T15:36:45.365729+00:00",
               "mirror_asset":false,
               "sensor_id":"DEFAULT",
               "sensor_metadata":"{}",
               "sensor_type":"IMAGE_V0"
            }
         ],
         "table":"", # reference to table in bigquery
         "task_id":"", # reference to frame id
         "window": , #unix timestamp for when data was uploaded
      },
      "issue_name":"", # name of the segment
      "label_metadata":{ # any metadata at the label level
         "confidenceThreshold":0.1,
         "iouThreshold":0.5
      },
      "aq_link":"", # link to the element in aquarium
      "issue_id":"" # segment id
   }
]

Frame Level CSV

For an example of what this export will look like, here is a link that will start a download to show an example of a frame-level segment export using the open source RarePlanes dataset (only has one element in export).

Here is a list of the columns you'll see in the csv file:

• element_id

• element_type

• dataset

• inference_set

• frame_id

• issue_name

• aq_link

• template_type

• confidenceThreshold

• iouThreshold

Crop Level JSON

For an example of what this export will look like, here is a link that will start a download to show an example of a JSON file for a crop-level segment export using the open source RarePlanes dataset (only has one element in export).

Export Data Format

[
  {
    "element_id": "", # unique id in the segment
    "element_type": "crop", # if it's a frame or crop segment
    "dataset": "", # name of the dataset formatted like Projectname.datasetname
    "inference_set": "", # name of inference set formatted like Projectname.inferencesetname
    "frame_id": "", # unique frame_id
    "frame_data": {
      "_idx": 0, # int value of frame id
      "coordinate_frames": [ # coordinate frame details if specified 
        {
          "coordinate_frame_id": "DEFAULT",
          "coordinate_frame_metadata": null,
          "coordinate_frame_type": "IMAGE"
        }
      ],
      "custom_metrics": null, # for any custom metrics added
      "date_captured": "2022-06-15T15:36:45.365725+00:00", # ISO formatted date
      "deleted": null, 
      "device_id": "default_device", # if specified string to represent specific device id
      "frame_id": "", # unique frame_id
      "frame_window": 1655325500563, # int value representing unix time stamp for when data was uploaded
      "geo_data": "{}", # if any geo data was added
      "inference_label_data": [], # if any inferences were present
      "inference_metadata": { # inference metadata
        "user_metadata": "{}",
        "visualization_assets": "{}"
      },
      "label_data": [ # specifics all the labels related to the frame that the added label is related to
        {
          "_idx": 1, 
          "attributes": "{\"top\": 130.2578795682639, \"left\": 429.42371606081724, \"width\": 82.57628393918276, \"height\": 98.95325811393559, \"user__area\": 647.8223796376661, \"user__is_plane\": 1.0, \"user__faa_wingspan_class\": 3.0, \"user__length\": 36.97375932148518, \"user__loc_id\": 100.0, \"user__location\": \"Terminal Circle, Billings, Yellowstone County, Montana, 59105, USA\", \"user__num_engines\": 2.0, \"user__num_tail_fins\": 1.0, \"user__propulsion\": \"jet\", \"user__role\": \"Medium Civil Transport/Utility\", \"user__role_id\": 2.0, \"user__wing_position\": \"mid/low mounted\", \"user__wing_type\": \"swept\", \"user__wingspan\": 35.04291690550339, \"user__category\": 1}",
          "deleted": null,
          "frame_window": 1655325500563,
          "label": "swept",
          "label_coordinate_frame": "DEFAULT",
          "label_type": "BBOX_2D",
          "linked_labels": [],
          "reuse_latest_embedding": false,
          "table": "aquarium-266018:Rareplanes_Wingtype_Project.initial_train_labels_crop",
          "task_id": "100_1040010029990A00_tile_319",
          "uuid": "100_1040010029990A00_tile_319_gt_1",
          "window": 1655325500563
        },
        {
          "_idx": 0,
          "attributes": "{\"top\": 126.75882516428828, \"left\": 271.2198036387563, \"width\": 111.92308640107512, \"height\": 89.66910047270358, \"user__area\": 489.7654989877302, \"user__is_plane\": 1.0, \"user__faa_wingspan_class\": 3.0, \"user__length\": 33.50365596986768, \"user__loc_id\": 100.0, \"user__location\": \"Terminal Circle, Billings, Yellowstone County, Montana, 59105, USA\", \"user__num_engines\": 2.0, \"user__num_tail_fins\": 1.0, \"user__propulsion\": \"jet\", \"user__role\": \"Medium Civil Transport/Utility\", \"user__role_id\": 2.0, \"user__wing_position\": \"mid/low mounted\", \"user__wing_type\": \"swept\", \"user__wingspan\": 29.26395384664032, \"user__category\": 1}",
          "deleted": null,
          "frame_window": 1655325500563,
          "label": "swept",
          "label_coordinate_frame": "DEFAULT",
          "label_type": "BBOX_2D",
          "linked_labels": [],
          "reuse_latest_embedding": false,
          "table": "aquarium-266018:Rareplanes_Wingtype_Project.initial_train_labels_crop",
          "task_id": "100_1040010029990A00_tile_319",
          "uuid": "100_1040010029990A00_tile_319_gt_0",
          "window": 1655325500563
        }
      ],
      "reuse_latest_embedding": false,
      "sensor_data": [
        {
          "coordinate_frame": "DEFAULT",
          "data_urls": "{\"image_url\": \"https://storage.googleapis.com/aquarium-public/datasets/rareplanes/train/PS-RGB_tiled/100_1040010029990A00_tile_319.png\"}",
          "date_captured": "2022-06-15T15:36:45.365729+00:00",
          "mirror_asset": false,
          "sensor_id": "DEFAULT",
          "sensor_metadata": "{}",
          "sensor_type": "IMAGE_V0"
        }
      ],
      "table": "aquarium-266018:Rareplanes_Wingtype_Project.initial_train_labels_frame",
      "task_id": "100_1040010029990A00_tile_319", # task id is another name for frame id
      "window": 1655325500563
    },
    "crop_data": { # information solely about the crop added to the issue
      "_idx": 0,
      "attributes": "{\"top\": 126.75882516428828, \"left\": 271.2198036387563, \"width\": 111.92308640107512, \"height\": 89.66910047270358, \"user__area\": 489.7654989877302, \"user__is_plane\": 1.0, \"user__faa_wingspan_class\": 3.0, \"user__length\": 33.50365596986768, \"user__loc_id\": 100.0, \"user__location\": \"Terminal Circle, Billings, Yellowstone County, Montana, 59105, USA\", \"user__num_engines\": 2.0, \"user__num_tail_fins\": 1.0, \"user__propulsion\": \"jet\", \"user__role\": \"Medium Civil Transport/Utility\", \"user__role_id\": 2.0, \"user__wing_position\": \"mid/low mounted\", \"user__wing_type\": \"swept\", \"user__wingspan\": 29.26395384664032, \"user__category\": 1}",
      "deleted": null,
      "frame_window": 1655325500563,
      "label": "swept",
      "label_coordinate_frame": "DEFAULT",
      "label_type": "BBOX_2D",
      "linked_labels": [],
      "reuse_latest_embedding": false,
      "table": "aquarium-266018:Rareplanes_Wingtype_Project.initial_train_labels_crop",
      "task_id": "100_1040010029990A00_tile_319",
      "uuid": "100_1040010029990A00_tile_319_gt_0",
      "window": 1655325500563
    },
    "issue_name": "crop_export_test", # name of the issue the crop was added to
    "label_metadata": { # metadata regarding the added crop if it was a label
      "confidence": -1,
      "confidenceThreshold": 0.1,
      "gtLabelClassification": "swept",
      "gtLabelId": "100_1040010029990A00_tile_319_gt_0",
      "infLabelClassId": -1,
      "infLabelClassification": "background",
      "infLabelId": "",
      "iou": 0,
      "iouThreshold": 0.5
    },
    "aq_link": "https://illume.aquariumlearning.com/projects/Rareplanes_Wingtype_Project/issues/bb2cd3ba-379f-4b7d-9020-5e77ffa01e24?issueElementId=2dabb997-ee6e-4352-8577-685038ae732b&tab=elements",
    "issue_id": "bb2cd3ba-379f-4b7d-9020-5e77ffa01e24" # issue id
  }
]

Crop Level CSV

For an example of what this export will look like, here is a link that will start a download to show an example of a crop-level segment export using the open source RarePlanes dataset (only has one element in export).

Here is a list of the columns you'll see in the csv file:

• element_id

• element_type

• dataset

• inference_set

• frame_id

• issue_name

• aq_link

• template_type

• confidence

• confidenceThreshold

• gtLabelClassification

• gtLabelId

• infLabelClassId

• infLabelClassification

• infLabelId

• iou

• iouThreshold

Exporting Data From a Main View

In this context the main views are:

• Grid View

• Analysis View

• Embedding View

• Model Metrics View

In each one of these views, you will see a button toward the top right corner that has the download symbol and the number of elements that will be downloaded.

Example of where to find the Batch Export button

Click the button highlighted in the above image to export your data in a JSON format. Remember any queries applied to the window will reflect in which data is exported.

Batch Export Data Format

For this kind of batch export, the data format is basic: a list of all of the frame IDs currently queried in that view.

The data will be exported as JSON file and will look like this:

[
  {
    "frameId": "100_1040010046CD1500_tile_187"
  },
  {
    "frameId": "100_1040010046CD1500_tile_476"
  }
]

If your workflow requires additional data to be exported, reach out to the team and we can see what other solutions could be possible.