# Uploading Data

## Overview

**There are three kinds of datasets you can upload into Aquarium.**&#x20;

* [<mark style="color:blue;">**Labeled Data**</mark>](https://legacy-docs.aquariumlearning.com/aquarium/getting-started/key-concepts#labeled-datasets)
  * Labeled datasets include all of your ground truth labels for your dataset
* **Model Inference Data**
  * Inference sets include all of the related data from your model's predictions/results for your dataset
* [<mark style="color:blue;">**Unlabeled Data**</mark>](https://legacy-docs.aquariumlearning.com/aquarium/getting-started/key-concepts#unlabeled-datasets)
  * Unlabeled datasets consists of unlabeled datapoints with or without model results/predictions

**To upload data into Aquarium, there are a few main steps to get going.**

* Create a [**project**](https://legacy-docs.aquariumlearning.com/aquarium/integrating-with-aquarium/creating-projects-in-aquarium) in Aquarium for the specific ML task you're working on
* Format your labels, metadata, and inference/predictions into [**frames**](https://legacy-docs.aquariumlearning.com/aquarium/integrating-with-aquarium/broken-reference)
* Add frames into a [dataset](https://legacy-docs.aquariumlearning.com/aquarium/getting-started/key-concepts#dataset)
* Upload the dataset into Aquarium

## How Do I Upload My Data?

### Prerequisites

* You'll need to [setup an account with Aquarium](https://legacy-docs.aquariumlearning.com/aquarium/getting-started/account-setup-and-team-onboarding) before you can upload your data
* Install the `aquariumlearning` package
* Ensure you have at least a version of Python >= 3.7

### **Python SDK**

**Data uploads are done through our** **Python SDK.**

Aquarium provides a python client library to simplify integration into your existing ML data workflows. In addition to wrapping API requests, it also handles common needs such as efficiently encoding uploaded data or using disk space to work with datasets larger than available system memory.

We have [<mark style="color:blue;">quickstart guides</mark>](https://legacy-docs.aquariumlearning.com/aquarium/getting-started/quickstart-guides) and detailed documentation available to demonstrate how you can upload data for a few demo datasets.

We also have step-by-step guides on how to upload different kinds of data into Aquarium:

* [Upload Labeled Datasets](https://legacy-docs.aquariumlearning.com/aquarium/integrating-with-aquarium/uploading-data/labeled-datasets)
* [Upload Model Inferences](https://legacy-docs.aquariumlearning.com/aquarium/integrating-with-aquarium/uploading-data/model-inferences)
* [Upload Unlabeled Datasets](https://legacy-docs.aquariumlearning.com/aquarium/integrating-with-aquarium/uploading-data/unlabeled-datasets)

## Monitoring Upload Status

After starting an upload, you'll be able to view the status of your uploads in the web app.

If you go to the **Project Details** page, you'll see a **Streaming Uploads** tab:

![](https://391596125-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MI6IGz_3V5m6p1UIhXm%2Fuploads%2FwSwIJ4YdNm9Dk5hGaEmA%2FScreen%20Shot%202022-07-29%20at%2012.12.21%20PM.png?alt=media\&token=7a8439cf-01c6-40e2-8616-22b0ccee70b6)

Each upload ID corresponds to a subset of your dataset/inference set (with the associated frame count + label count).

To view more details on which specific frames/labels are present in a given upload, you can click on the *Status* (e.g. DONE). A pop-up will appear with the following info:

![](https://391596125-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MI6IGz_3V5m6p1UIhXm%2Fuploads%2FObbOdTI45rtdnwMHQZoO%2FScreen%20Shot%202022-07-29%20at%2012.12.36%20PM.png?alt=media\&token=b44b7566-7932-4e01-bb5a-d51c741039bf)

In the case of a failed upload, you can debug via the **Errors** section (which exposes frame-specific debug logs), and download this info to determine which frames/crops may need to be re-uploaded.

To access the Errors section, click on the Status for each row:

![Where to click on the row in order to view the Errors section](https://391596125-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MI6IGz_3V5m6p1UIhXm%2Fuploads%2FGko81DxmpnCFsShTajjP%2FScreen%20Shot%202022-08-15%20at%209.02.32%20AM.png?alt=media\&token=41697fce-c487-49dc-afc9-5468f61a1ab9)

![Example of the Errors section](https://391596125-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MI6IGz_3V5m6p1UIhXm%2Fuploads%2FtbvTf0ILeaEhGfZeYCNc%2FScreen%20Shot%202022-07-29%20at%2012.12.47%20PM.png?alt=media\&token=2d020d78-9e0c-499a-83dd-7715dda3cf85)

If you are running into an error and the error logs are not sufficient to understand how to fix the issue, please reach out to the Aquarium team and we can help resolve your problem.
