/
Fauna test

Fauna test

Owned by Habacuc FM (Unlicensed)
Last updated: 04 Oct 2022
7 min read

Overall:

Taxonomy needs to be added but this requires AFD to provide an API

Mapped parameters are missing, this could be related to the fact that the test databases is a small subset that may not have included the parameters missing

Empty values character has to be standardised, so far N\A,NULL and "" are used

There are multiple cases where a single observation id has multiple observations, this needs to be fixed. Create validation to check for single observation per observation type -foi combinations

The sensitivity analyses needs to be implemented in ETL

Metadata record has to be added

Amphibian individual

 

Check

Result

Notes

Check

Result

Notes

Accuracy of mapping (are all mapped variables present?)

PASSED

MIssing variables have been added to the mapping

Functionality in EcoPlots

PASSED

 

Completeness and functionality of download (API, cart)

PASSED

Cart download works

API download works

 

Functionality of data

PASSED

 

Transformation

FAILED

Multiple observations per parameter for unique foi id

e.g. http://linked.data.gov.au/dataset/bdbsa/amphibian_ind_id-23863841

 

Joining,Analysing

PASSED

 

Integrity of data

NA

test data is only a subset

Unique observation id

FAILED

see transformation row above, see example output below

 

Taxonomic information

FAILED

Missing taxon class. External dependency. Waiting for AFD to provide API endpoint

Scientific name present and no more than 5% of names missing a taxon class

FAILED

Missing scientific name. Added to mapping

Sensitive data

FAILED

Needs implementing. Cannot be implemented until AFD taxonomic matching is implemented

Check citation is correct

FAILED

Needs implementing. Metadata record has not been added. Add https://portal-test.tern.org.au/biological-databases-south-australia/24602

 

Amphibian occurrence

Check

Result

Notes

Check

Result

Notes

Accuracy of mapping (are all mapped variables present?)

PASSED

 

Functionality in EcoPlots

PASSED

 

Completeness and functionality of download (API, cart)

PASSED

 

 

Functionality of data

PASSED

 

Transformation

FAILED

Multiple observations per observation ID e.g. http://linked.data.gov.au/dataset/bdbsa/amphibian_occurr_id-2911584

 

Joining,Analysing

PASSED

 

Integrity of data

NA

test data is only a subset

Unique observation id

FAILED

Multiple observations per observation ID e.g. http://linked.data.gov.au/dataset/bdbsa/amphibian_occurr_id-2911584

Taxonomic information

FAILED

Missing taxon class. External dependency. Waiting for AFD to provide API endpoint

Scientific name present and no more than 5% of names missing a taxon class

FAILED

Missing scientific name row. Added to mapping

Sensitive data

FAILED

Needs implementing. Cannot be implemented until AFD taxonomic matching is implemented

Check citation is correct

FAILED

Needs implementing. Metadata record has not been added. Add https://portal-test.tern.org.au/biological-databases-south-australia/24602

 

 

Bird Occurrence

Check

Result

Notes

Check

Result

Notes

Accuracy of mapping (are all mapped variables present?)

PASSED

 

Functionality in EcoPlots

PASSED

 

Completeness and functionality of download (API, cart)

PASSED

 

 

Functionality of data

PASSED

 

Transformation

PASSED

 

Joining,Analysing

PASSED

 

Integrity of data

 

test data is only a subset

Unique observation id

PASSED

 

Taxonomic information

FAILED

Missing taxon class. External dependency. Waiting for AFD to provide API endpoint

Scientific name present and no more than 5% of names missing a taxon class

PASSED

 

Sensitive data

FAILED

Needs implementing. Cannot be implemented until AFD taxonomic matching is implemented

Check citation is correct

FAILED

Needs implementing. Metadata record has not been added. Add https://portal-test.tern.org.au/biological-databases-south-australia/24602

 

Fish individual

Check

Result

Notes

Check

Result

Notes

Accuracy of mapping (are all mapped variables present?)

PASSED

Missing variables (1 sex ,2 body mass ,3 animal activity ,4 disc length ,5 lower jaw fork length ,6 sampling duration ,7 number of fyke net) have been added to mapping

Functionality in EcoPlots

PASSED

 

Completeness and functionality of download (API, cart)

PASSED

 

 

Functionality of data

PASSED

 

Transformation

PASSED

 

Joining,Analysing

PASSED

 

Integrity of data

 

test data is only a subset

Unique observation id

PASSED

 

Taxonomic information

FAILED

Missing taxon class. External dependency. Waiting for AFD to provide API endpoint

Scientific name present and no more than 5% of names missing a taxon class

PASSED

 

Sensitive data

FAILED

Needs implementing. Cannot be implemented until AFD taxonomic matching is implemented

Check citation is correct

FAILED

Needs implementing. Metadata record has not been added. Add https://portal-test.tern.org.au/biological-databases-south-australia/24602

 

 

Fish occurrence

Check

Result

Notes

Check

Result

Notes

Accuracy of mapping (are all mapped variables present?)

PASSED

 

Functionality in EcoPlots

PASSED

 

Completeness and functionality of download (API, cart)

PASSED

 

 

Functionality of data

PASSED

 

Transformation

Multiple observations per observation ID e.g. http://linked.data.gov.au/dataset/bdbsa/fish_occurr_id-16000

 

Joining,Analysing

PASSED

 

Integrity of data

 

test data is only a subset

Unique observation id

FAILED

Multiple observations per observation ID e.g. http://linked.data.gov.au/dataset/bdbsa/fish_occurr_id-16000``

Taxonomic information

FAILED

Missing taxon class. External dependency. Waiting for AFD to provide API endpoint

Scientific name present and no more than 5% of names missing a taxon class

PASSED

Missing scientific name row. Added to mapping

Sensitive data

FAILED

Needs implementing. Cannot be implemented until AFD taxonomic matching is implemented

Check citation is correct

FAILED

Needs implementing. Metadata record has not been added. Add https://portal-test.tern.org.au/biological-databases-south-australia/24602

 

 

Invertebrate individuals

Check

Result

Notes

Check

Result

Notes

Accuracy of mapping (are all mapped variables present?)

PASSED

Missing variables (1 comment, 2 animal length, 3 invertebrate carapace length, 4 sampling duration, 5 number of fyke net) have been added to mapping

(Source data has only few rows of data)

Functionality in EcoPlots

PASSED

 

Completeness and functionality of download (API, cart)

PASSED

 

 

Functionality of data

PASSED

 

Transformation

PASSED

 

 

Joining,Analysing

PASSED

 

Integrity of data

 

test data is only a subset

Unique observation id

PASSED

 

Taxonomic information

FAILED

Missing taxon class. External dependency. Waiting for AFD to provide API endpoint

Scientific name present and no more than 5% of names missing a taxon class

FAILED

Missing scientific name row. Added to mapping

Sensitive data

FAILED

Needs implementing. Cannot be implemented until AFD taxonomic matching is implemented

Check citation is correct

FAILED

Needs implementing. Metadata record has not been added. Add https://portal-test.tern.org.au/biological-databases-south-australia/24602

 

 

Invertebrate occurrence

Check

Result

Notes

Check

Result

Notes

Accuracy of mapping (are all mapped variables present?)

PASSED

Subset has been updated

1 sampling duration
2 number of elliot traps
3 number of pitfall traps
4 number of cage traps
5 number of fyke net

(Javi: updated subset)

Functionality in EcoPlots

PASSED

 

Completeness and functionality of download (API, cart)

PASSED

 

 

Functionality of data

PASSED

 

Transformation

FAILED

Multiple observations per obs id http://linked.data.gov.au/dataset/bdbsa/invertebrate_occ_id-16000

 

Joining,Analysing

PASSED

 

Integrity of data

 

test data is only a subset

Unique observation id

PASSED

Multiple observations per obs id http://linked.data.gov.au/dataset/bdbsa/invertebrate_occ_id-16000

Taxonomic information

FAILED

Missing taxon class. External dependency. Waiting for AFD to provide API endpoint

Scientific name present and no more than 5% of names missing a taxon class

FAILED

Missing scientific name row. Added to mapping

Sensitive data

FAILED

Needs implementing. Cannot be implemented until AFD taxonomic matching is implemented

Check citation is correct

FAILED

Needs implementing. Metadata record has not been added. Add https://portal-test.tern.org.au/biological-databases-south-australia/24602

 

Mammal individual

Check

Result

Notes

Check

Result

Notes

Accuracy of mapping (are all mapped variables present?)

PASSED

Data were missing because subset was not big enough

1 lactating status (Javi: subset not big enough)
2 tail length (Javi: subset not big enough)
3 number of elliot traps (Javi: subset not big enough)
4 number of pitfall traps (Javi: subset not big enough)
5 number of cage traps (Javi: subset not big enough)
6 number of youngs in pouch (Javi: subset not big enough)
7 animal length (Javi: subset not big enough)
8 snout length (Javi: subset not big enough)
9 head length (Javi: subset not big enough)
10 animal activity (Javi: subset not big enough)

Functionality in EcoPlots

PASSED

 

Completeness and functionality of download (API, cart)

PASSED

 

 

Functionality of data

PASSED

 

Transformation

PASSSED

 

Joining,Analysing

PASSED

 

Integrity of data

 

test data is only a subset

Unique observation id

PASSED

 

Taxonomic information

FAILED

Missing taxon class. External dependency. Waiting for AFD to provide API endpoint

Scientific name present and no more than 5% of names missing a taxon class

PASSED

 

Sensitive data

FAILED

Needs implementing. Cannot be implemented until AFD taxonomic matching is implemented

Check citation is correct

FAILED

Needs implementing. Metadata record has not been added. Add https://portal-test.tern.org.au/biological-databases-south-australia/24602

 

Mammal occurrence

Check

Result

Notes

Check

Result

Notes

Accuracy of mapping (are all mapped variables present?)

PASSED

 

Functionality in EcoPlots

PASSED

 

Functionality of download (API, cart)

PASSED

 

 

Functionality of data

PASSED

 

Transformation

PASSED

 

Joining,Analysing

PASSED

 

Integrity of data

 

test data is only a subset

Unique observation id

FAILED

Multiple observations per observation ID see:

 

Taxonomic information

FAILED

Missing taxon class. External dependency. Waiting for AFD to provide API endpoint

Scientific name present and no more than 5% of names missing a taxon class

FAILED

Scientific name was missing in mapping. Missing name in mapping added.

Sensitive data

FAILED

Needs implementing. Cannot be implemented until AFD taxonomic matching is implemented

Check citation is correct

FAILED

Needs implementing. Metadata record has not been added. Add https://portal-test.tern.org.au/biological-databases-south-australia/24602

Reptile individual

Check

Result

Notes

Check

Result

Notes

Accuracy of mapping (are all mapped variables present?)

PASSED

This has been reviewed.

This FOI does not have: number of individual animals (Javi: *-individuals does not have this observation in the mapping) and animal presence (Javi: *-individuals does not have this observation in the mapping)

We have included : animal relative habitat position (Javi: FOI attribute) and animal activity (Javi: missing in the mapping)

The following are not in used, therfore not included in the mapping:
mist net used (Javi: missing in the mapping)
hair trap used (Javi: missing in the mapping)
bat detector used (Javi: missing in the mapping)

Functionality in EcoPlots

PASSED

 

Completeness and functionality of download (API, cart)

PASSED

 

 

Functionality of data

 

 

Transformation

PASSED

 

 

Joining,Analysing

PASSED

 

Integrity of data

 

test data is only a subset

Unique observation id

PASSED

 

Taxonomic information

FAILED

Missing taxon class. External dependency. Waiting for AFD to provide API endpoint

Scientific name present and no more than 5% of names missing a taxon class

FAILED

Missing scientific name row. Added to mapping

Sensitive data

FAILED

Needs implementing. Cannot be implemented until AFD taxonomic matching is implemented

Check citation is correct

FAILED

Needs implementing. Metadata record has not been added. Add https://portal-test.tern.org.au/biological-databases-south-australia/24602

Reptile occurrence

 

Check

Result

Notes

Check

Result

Notes

Accuracy of mapping (are all mapped variables present?)

PASSED

 

Functionality in EcoPlots

PASSED

 

Completeness and functionality of download (API, cart)

PASSED

 

 

Functionality of data

PASSED

 

Transformation

FAILED

Multiple observations per observation id http://linked.data.gov.au/dataset/bdbsa/reptile_occurr_id-2080052

Joining,Analysing

PASSED

 

Integrity of data

 

test data is only a subset

Unique observation id

FAILED

Multiple observations per observation id http://linked.data.gov.au/dataset/bdbsa/reptile_occurr_id-2080052

Taxonomic information

FAILED

Missing taxon class. External dependency. Waiting for AFD to provide API endpoint

Scientific name present and no more than 5% of names missing a taxon class

PASSED

 

Sensitive data

FAILED

Needs implementing. Cannot be implemented until AFD taxonomic matching is implemented

Check citation is correct

FAILED

Needs implementing. Metadata record has not been added. Add https://portal-test.tern.org.au/biological-databases-south-australia/24602

Related content

Overview of BDBSA data model
Overview of BDBSA data model
BDBSA Dataset Integration
Read with this
2022-08-18 Meeting notes
2022-08-18 Meeting notes
BDBSA Dataset Integration
More like this
2022-08-16 Meeting notes
2022-08-16 Meeting notes
BDBSA Dataset Integration
More like this
EMSA field survey data review - Floristics (Enhanced)
EMSA field survey data review - Floristics (Enhanced)
Project: PlotX
More like this