Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Info

This work is part of the deliverables in Section 2 - Deliverables for phase 4 of the DAWE Data Standards Project.

Work scope

TERN Surveillance has informed TDSA that the deliverable has been broken into 19 separate modules and each module will be worked on one by one.

Milestone 1

Milestone 1 will focus on completing the Floristics module.

Task

Description

Status

Growth form controlled vocabulary

Set up a scheduled pipeline in Airflow to pull from the TERN Surveillance REST API the growth form list and transform it into a SKOS controlled vocabulary.

API endpoint to process: https://dev.core-api.paratoo.tern.org.au/documentation#/Lut-veg-growth-form/get_lut_veg_growth_forms

Status
colourBlue
titleongoing

APNI species list - full-text search

Shared scope with work in SHaRED (data submission tool), making available a full-text search of flora species names from APNI, backed by Elasticsearch.

Status
colourBlue
titleongoing

Milestone 2

Milestone 2 will focus on completing the Site Description module.

Task

Description

Status

Implementation

A preliminary read-only development version of the web API has been provided by TERN Surveillance to access the PostgreSQL database containing the lookup tables.

Info

https://dev.core-api.paratoo.tern.org.au/documentation

Flow

TERN Surveillance provides a REST API for accessing the PostgreSQL database. On a schedule, TDSA utilises Airflow to pull the lookup tables from TERN Surveillance and transforms the values into SKOS controlled vocabularies. The transformed values are validated before ingesting into GraphDB and made available in the AusPlots vocabularies viewer.

Drawio
zoom1
simple0
inComment0
pageId1834779431
custContentId1834779496
lbox1
diagramDisplayNametern-surveillance-vocabs-flow.drawio
contentVer3
revision3
baseUrlhttps://ternaus.atlassian.net/wiki
diagramNametern-surveillance-vocabs-flow.drawio
pCenter0
width2003
links
tbstyle
height464

Controlled vocabulary shapes

Concept

Generic concept shape, but API field examples are based on the landform elements endpoint: https://dev.core-api.paratoo.tern.org.au/lut-landform-elements.

Name

API field

Property

Required

preferred label

landform_element

skos:prefLabel

Status
colourRed
titleyes

code

code

skos:notation

Status
colourRed
titleyes

definition

description

skos:definition

Status
colourRed
titleyes

created

created_at

dcterms:created

Status
colourRed
titleyes

modified

updated_at

dcterms:modified

Status
colourRed
titleyes

identifier

id

dcterms:identifier

Status
colourRed
titleyes

source

dcterms:source

Status
colourRed
titleyes

alternate label

abbreviation

skos:altLabel

Status
titleoptional

Schemes

The new protocol’s controlled lists will be created as a standalone set of controlled vocabularies from the TDSA’s global set. This is to ensure that they function as intended within the scope of the DAWE’s Data Standards Project. If interoperability between datasets using the new protocol and controlled vocabularies from TDSA’s global set, then a linkset (mapping) may be used to assert the semantic relationships.

...