Guidelines for the Surveillance Team: Preparing and Uploading Datasets to the UQRDM

Introduction:

This document outlines the protocol for the Surveillance Team on how to correctly upload their datasets to the University of Queensland's Research Data Manager (UQRDM). It underscores the importance of adhering to the prescribed folder structure, ensuring the right number of images are placed within these folders, and delineates the methods for uploading data either through rclone or the UQRDM cloud web interface. The UQRDM is a specially designed platform that aids researchers in the organised management and secure storage of their research data. For a more comprehensive understanding of the UQRDM, further information can be accessed at https://guides.library.uq.edu.au/for-researchers/uq-research-data-manager.

Accessing Your UQRDM Storage:

This document provides a step-by-step guide on how to access your UQRDM folders.

You will receive an email notifying you that you have been invited to be a collaborator on the record for the project TERNSurveillance. Click on the ‘Join Record' button within the email, as shown in the screenshot below. If you have previously accepted the invitation to collaborate by clicking on the 'Join Record’ button, please enter cloud.rdm.uq.edu.au in your web browser, log in, and continue on with bullet point 3 below.

After clicking on the 'Join Record' button, you will be redirected to the UQRDM cloud login page at cloud.rdm.edu.au, as shown in the screenshot below. Use your credentials to log in. A variety of login options are available, including Australian Access Federation, eduGAIN, Tuakiri Federation (NZ), and LinkedIn. The LinkedIn link allows you to log in using your Google credentials (if you have used gmail as your username in LinkedIn).

Once you have logged in, you should be taken to the TERNSUR-Q6268 folder, as shown in the screenshot below. If you have not been taken automatically to this page, please enter cloud.rdm.edu.au in your web browser.

Within the TERNSUR-Q6286 folder, it is our standard practice to create distinct folders based on the type of image to be uploaded. The policy is to create an image-type folder and store all images related to that type in that folder. Subsequently, relevant subfolders for a particular data collection event can be established within the respective image-type folder. This organisational structure facilitates a more streamlined and coherent data management process, ensuring all related images are grouped together under a unified classification. For the remainder of this document, we will focus on discussing the folder structure and the uploading process specifically for Photopoint Panorama as an example.
The subfolder designated for uploading Panorama data has already been established at the following path: TERNSUR-Q6286/PhotopointPanorama. If you are tasked with uploading data for a specific data collection event, please navigate to this path to access the Panorama data upload subfolder. Ensure to adhere to the prescribed folder structure and naming conventions as outlined in the following sections of this document when organising and uploading your data.
Once you are within the PhotopointPanorama folder, you can click on the plus sign at the top of the screen (see screenshot below) to create new subfolders or upload files. For folders housing surveillance site visit data, the site name and site visit id (date) are typically incorporated into the folder name. For instance, the path to the site visit folder shown in the screenshot below is TERNSUR-Q6286/PhotopointPanorama/NSAAUA0001_PAN_20210328/ where NSAAUA0001 is the site name, PAN shows that this is panoramic data, and 20210328 is the site visit id. Uploading can also be accomplished by dragging files from your computer into the cloud web interface to upload, or by utilising Rclone. Rclone is often the preferred method for data upload due to its robustness and ability to handle large datasets efficiently. Its command-line interface allows for scripted or automated data transfers, making it a powerful tool for managing and uploading data to the UQRDM, especially in cases with a large volume of data or complex folder structures.

Preparing the Data:

1. Panorama Photopoint:

Folder Structure: Your main folder for each SiteVisitID should have 3 essential sub-folders named "1", "2", and "3" (as in the image below). If there are more than 3 folders due to steep slopes at the site, notify the data curators for verification.(Folder names SEQ_1, SEQ_2, and SEQ_3 are also acceptable)

Image Verification: Within each of these sub-folders, ensure that:
There are no more than 40 panoramic photographs.
Apart from the 40 panoramic photographs in each subfolder (“1”, “2”, “3”), there is one identifier photograph which shows the location and date of the site visit.
There are no other photographs in the subfolder, apart from the panoramic photographs (maximum of 40) and the identifier photograph.

Uploading the Data:

For uploading data to the UQRDM, please see the document entitled How to Upload Files into UQRDM using the cloud web interface and Rclone.