What are the file formats recommended by TERN

Welcome to TERN Knowledge Base

What are the file formats recommended by TERN

This page provides an overview of the file specification formats and standard data submission templates for TERN and ecological survey-related datasets.

Recommended File Formats

The following table contains file formats recommended by TERN for data preservation, publication and reuse. The list was developed based on the Library of Congress Recommended Formats Statement 2020-2021.

If you are unsure about the suitable data file format, don't hesitate to get in touch with us at esupport@tern.org.au for clarification.

Data types

Recommended Formats

Data types

Recommended Formats

Still images (e.g., bio-imaging)

Note: we accept camera raw image file, which then will be converted into the recommended format for publication).

  • JPEG

  • TIFF

  • PNG

Audio works (e.g., bioacoustics)

  • Free Lossless Audio Codec (FLAC)

  • Wav

Geospatial vector

  • ESRI Shapefile

  • GML

Geospatial raster (e.g., remote sensing gridded data products; soil and landscape grid)

  • Geo-referenced TIFF

  • Cloud Optimized GeoTIFF (COG)

  • NetCDF

  • Cloud Optimised Point Cloud (COPC)

  • NOTE: Make sure the Protocol for Data Services is specified and correct:

    • For data hosted on data.tern.org.au, the protocol is usually HTTP.

    • For data hosted on Geoserver (i.e., uses WMS, WCS, etc.) copy the title and layer name from the Geoserver.

Sensor time series (e.g., ecology plot-based survey and inventory data, flux)

  • Comma-separated values (CSV)

  • Tab-delimited file

  • NetCDF (for multidimensional array). Please refers to TERN NetCDF Users Manual

Textual works

  • PDF/UA, PDF/A or PDF

  • OpenDocument Text

  • Plain text (.txt).

  • NOTE: All Word documents (.docx) need to be converted to a pdf format before submitting

TERN Data Submission Template

Please use the attached example template to map your flora and/or fauna plot-based surveys :

It is to be noted that for all systematic ecological surveys, data submissions is via CSV, and we encourage you to follow the prescribed TERN Data Submission Template (see above for the sheet attached).

  • All on-ground ecological survey data should include a standard survey methodology and the data structure and submission format (.csv) should reflect this survey methodology. This structure should also adhere to the TERN specifications and ecological data model. At its core, the data should essentially capture:

    • ‘site information’ : siteID, plotID, plotLength, plotWidth, subplotID, latitude, longitude, etc.

    • ‘site visit information’: visitStartDate, visitEndDate, surveyDuration

    • ‘sampling information’: plantID, stemID, animalVoucherSpecimenID etc.

    • ‘feature of interest’ : featureOfInterest (e.g., plant individual, plant community, animal population, etc.), featurePositionX_coordinate, featurePositionY_coordinate

    • ‘observable properties/ also called as observable parameters’ : plantHeight, stemDiameter, animal sex, body mass, etc.

    • ‘additional information related to the survey’ : fieldNotes, comments, instrument, personnel, etc.

    • All the TERN Ecosystem Processes sites should map their data as per the standard data template below.

    • Some data columns are optional and some are mandatory (see below)

    • An Accompanying metadata Dictionary is mandatory - This can be in a CSV or xls format. But should contain detailed descriptions of each data field and any calculations for derived observations

    • Please write to the TERN DSA team (@esupport.tern.org) should you need to modify or customize your template if the protocols have changes to it.

  • Source Codes should be uploaded on GitHub and the URL attached under Method Documentation on SHaRED

An example template for data dictionary that should be submitted as part of the data submission (CSV preferred):

TERN Ontology Class (For Reference Only)

Data Column

Data Description

TERN Ontology Class (For Reference Only)

Data Column

Data Description

site information Class

siteID

Name/identifier of the site (e.g., Robson Creek Rainforest, Great Western Woodlands, etc.)

site information Class

plotID

Unique identifier for each plot (e.g., Robson Creek, core1ha; Great Western Woodlands, core1ha, etc.)

site information Class

plotWidth_meters

The plot width in meters (e.g., 100 m)

site information Class

plotLength_meters

The plot length in meters (e.g., 100 m)

site information Class

latitude

GPS latitude (please specify in metadata dictionary: SW, NW, NE, SE corner / Centroid)

site information Class

longitude

GPS longitude (please specify in metadata dictionary: SW, NW, NE, SE corner/ Centroid)

site information Class

subplotID

If there is a subPlot, the identifier for each subplot within a larger plot. This is usually a 20m x 20m subplot within a plot.

site information Class

subplotLength

The subplot length in meters (e.g., 20 m)

site information Class

subplotwidth

The subplot width in meters (e.g., 20 m)

site information Class

transectID

If there is a transect within the larger plot, instead of a subplot, use the transect identifier (e.g., T1, T2, etc.)

site information Class

transectLength

The total length of the transect in meters (e.g., 10 m)

site information Class

transectWidth

The total width of the transect in meters (e.g., 1 m)

site visit information

startVisitDate

Date when the survey began or the first observation was made.

site visit information

endVisitDate

Date when the survey concluded or the last observation was made.

feature of interest

The feature of interest on which observations were made. Examples include, ‘plant individual’, ‘plant occurrence’ and ‘plant community’. This is a data integration point for the TDSA, not an ecological concept.

feature of interest

plantID

Unique identifier for each individual plant (tree/liana, etc.). In some cases where plant ID is not Unique, the cells can be Concatenated using =”subPlotID_genus_positionX_positionY”

feature of interest

positionX_coordinate

Local coordinate within subplot (if mapped; if not use position X in meters from SW corner)

feature of interest

positionY_coordinate

Local coordinate within subplot (if mapped; if not use position_Y in meters from SW corner)

feature of interest

feature_latitude

Exact latitude coordinates, >4 or more decimal points where a stem/plant individual is located in the plot

feature of interest

feature_longitude

Exact longitude coordinates, >4 or more decimal points where a stem/plant individual is located in the plot

observable properties

stemDiameter_centimeters

Stem diameter in centimeters (measured at breast height, i.e., POM at 130 cm from ground; or in some cases 10 or 20 or 0 cm in mallee or mulga sites; see section 8.4.4 in the TERN vegetation protocols for details). Please note: Lianas/vines are measured 1.3 m along the stem after they leave the ground.; Palms, ferns and grass trees are included if the stem is ≥ 10 cm DBH (at 1.3 m) below the lowest living leaf base.

observable properties

measurementType_stemDiameter

A qualifier to indicate whether the stem diameter is an estimate or an exact measure. (Estimated; Measured)

observable properties

stemDiameterPointOfMeasurement_metres

Point of Measurement recorded from the ground or the lowest living leaf base in some cases

observable properties

diameterMeasurementInstrument

Tools used for measurement of stem diameter and or height (e.g., caliper, diameter tape, laser)

observable properties

stemHeight_meters

Total height measured (or estimated) from the ground to the uppermost vegetative component of each stem individual.; Please note the height of a liana/vine will be the estimated length of the stem and will generally be higher than the host stem. They are mapped where they are considered to originate.

additional information

surveyorName

Name of the person(s) conducting the measurement

additional information

taggingMethod

Tagging method (wire, nail, paint, none)

additional information

mappingMethod

Mapping method (GPS, sighting, post-reference)

additional information

comments

General comments additional to what was not recorded in the other columns.

TERN EP Supersites Vegetation Biomass Monitoring Data Submission

TERN Ecosystem Processes node community are encouraged to find the latest site specific templates documentation here: https://ternaus.atlassian.net/wiki/spaces/TDSAG/pages/3111518332

Provide your feedback about the experience with Knowledge base