This tutorial describes how to upload files to the Blackfynn platform using the Blackfynn Agent. It assumes that the user has a Blackfynn account and has setup his/her password. It also assumes the user has configured the agent using the method described in tutorial 1.
Creating a dataset
All files on the Blackfynn platform belong to a dataset. Therefore, we first need to create a dataset before we can upload files to the platform. You create a dataset using the
$ blackfynn_agent init newDataset 'This is a test dataset for tutorial 2.' Created dataset newDataset (N:dataset:xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx)
The dataset is now created. To verify, you can open the web application and see the dataset listed in your account. you can also list all datasets using the Agent with the
$ blackfynn_agent datasets +-----------------------------+----------------------+ | DATASET | NAME | +-----------------------------+----------------------+ | N:dataset:xxxxxxxx-xxxx-xx | newDataset |
Now, let’s upload some files to the dataset we just created. The
upload command has multiple options to specify exactly which files should be uploaded. Some examples are provided below, but be sure to check out the documentation on this command for a complete view of its capabilities.
Upload a single image file from the
~/Desktop/ folder to the
$ blackfynn_agent upload --dataset newDataset ~/Desktop/image.jpg
Multiple files using shell expansion
Shell-based file expansion (“globbing”) can be used to filter specific files to upload. For instance, we can specify that only DICOM files ending
.dcm should be uploaded:
$ blackfynn_agent upload --dataset newDataset ~/Desktop/*.dcm
Additionally, globbing can be used to specify multiple files across multiple directories to upload.
$ blackfynn_agent upload --dataset newDataset ~/Desktop/*.dcm ~/My-Data/*.json
This will upload all
.dcm files in
~/Desktop/ and all
.json files in
When multiple paths are supplied, all entries after glob expansion must specify files and not directories, otherwise an error will be issued.
$ blackfynn_agent upload --dataset newDataset ~/Desktop/*.dcm ~/My-Data/ upload error: When using multiple paths, all paths must be files. A directory was provided: ~/My-Data/ `` #### Uploading directory contents Upload all files in the `~/Desktop/` folder to the `newDataset` dataset. This command will not recurse into subdirectories, it will only upload files that reside in `~/Desktop/`. ```bash $ blackfynn_agent upload --dataset newDataset ~/Desktop/
Upload all files in the
~/Desktop/ folder and all files in all subfolders of
~/Desktop/ using the
--recursive flag. This flag will also preserve the folder structure in the Blackfynn platform.
$ blackfynn_agent upload --dataset newDataset --recursive ~/Desktop/
Note: multiple directories cannot be specified when attempting to upload the contents of a directory.