{"type":"doc","content":[{"type":"paragraph","content":[{"text":"Source: ","type":"text"},{"text":"CORVEG.TAXA","type":"text","marks":[{"type":"code"}]}]},{"type":"paragraph","content":[{"text":"Example row:","type":"text"}]},{"type":"table","attrs":{"layout":"full-width"},"content":[{"type":"tableRow","content":[{"type":"tableHeader","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"paragraph","content":[{"text":"LINNAEAN_ID","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"tableHeader","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"paragraph","content":[{"text":"TAXON","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"tableHeader","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"paragraph","content":[{"text":"FAMILY","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"tableHeader","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"paragraph","content":[{"text":"GENUS","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"tableHeader","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"paragraph","content":[{"text":"SPECIES","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"tableHeader","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"paragraph","content":[{"text":"INFRA_RANK","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"tableHeader","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"paragraph","content":[{"text":"INFRA","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"tableHeader","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"paragraph","content":[{"text":"BC_NUMBER","type":"text","marks":[{"type":"strong"}]}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"paragraph","content":[{"text":"4413","type":"text"}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"paragraph","content":[{"text":"Gynura drymophila var. drymophila","type":"text"}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"paragraph","content":[{"text":"Asteraceae","type":"text"}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"paragraph","content":[{"text":"Gynura","type":"text"}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"paragraph","content":[{"text":"drymophila","type":"text"}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"paragraph","content":[{"text":"var.","type":"text"}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"paragraph","content":[{"text":"drymophila","type":"text"}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"paragraph","content":[{"text":"3525","type":"text"}]}]}]}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"Interpretation in SKOS","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Create a ","type":"text"},{"text":"skos:ConceptScheme","type":"text","marks":[{"type":"code"}]},{"text":" for taxa ","type":"text"},{"text":"skos:Concept","type":"text","marks":[{"type":"code"}]},{"text":" in both the CORVEG and the Australian Plant Census (APC).","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Link between the mapped concepts in CORVEG and the APC by ","type":"text"},{"text":"skos:closeMatch","type":"text","marks":[{"type":"code"}]},{"text":".","type":"text"}]}]}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"Background","type":"text"}]},{"type":"paragraph","content":[{"text":"The Australian Plant Census (APC) is considered to be the authoritative source of data on vascular plants and mosses in Australia, provided by Biodiversity. They deliver the Australian Plant Name Index (APNI) as a dataset to tie in with the APC.","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"https://biodiversity.org.au/nsl/services/export/index","type":"text","marks":[{"type":"link","attrs":{"href":"https://biodiversity.org.au/nsl/services/export/index"}}]},{"text":" - APC and APNI for vascular plants","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"https://moss.biodiversity.org.au/nsl/services/export/index","type":"text","marks":[{"type":"link","attrs":{"href":"https://moss.biodiversity.org.au/nsl/services/export/index"}}]},{"text":" - APC and APNI for mosses","type":"text"}]}]}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"Outcome","type":"text"}]},{"type":"paragraph","content":[{"text":"The terms in APC and CORVEG have been modelled using SKOS and the Darwin Core terms, and a relationship has been created between the two ","type":"text"},{"text":"skos:ConceptScheme","type":"text","marks":[{"type":"code"}]},{"text":" using ","type":"text"},{"text":"skos:closeMatch","type":"text","marks":[{"type":"code"}]},{"text":".","type":"text"}]},{"type":"paragraph","content":[{"text":"The result of the ETL process for Taxa is three new controlled vocabularies:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"the set of terms from the CORVEG Taxa table","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"the set of terms name-matched from the CORVEG Taxa table to the APC terms","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"a set of taxon rank terms used in the APC and APNI","type":"text"}]}]}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"Further Information","type":"text"}]},{"type":"paragraph","content":[{"text":"The mappings for APNI and APC terms have been documented in ","type":"text"},{"text":"https://www.anbg.gov.au/ibis25/display/NSL/Data+Extracts+-+Darwin+Core","type":"text","marks":[{"type":"link","attrs":{"href":"https://www.anbg.gov.au/ibis25/display/NSL/Data+Extracts+-+Darwin+Core"}}]},{"text":" by Biodiversity. The mappings have been created in ","type":"text"},{"text":"taxa.py","type":"text","marks":[{"type":"code"}]},{"text":" for TERN's use since the Biodiversity's Linked Data APIs are currently down (as of March, 2019).","type":"text"}]},{"type":"paragraph","content":[{"text":"Due to CORVEG’s Taxa table's column ","type":"text"},{"text":"infra_rank","type":"text","marks":[{"type":"em"}]},{"text":" using the abbreviated form as its value, a controlled vocabulary had to be created to marry the terms up with APNI (as APNI uses the non-abbreviated form for its taxon rank value). For example, CORVEG’s value is ","type":"text"},{"text":"var.","type":"text","marks":[{"type":"em"}]},{"text":" while APNI's value is ","type":"text"},{"text":"Varietas","type":"text","marks":[{"type":"em"}]},{"text":", but they're the same term.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"RDF Example of the Taxon Rank Vocabulary","type":"text"}]},{"type":"codeBlock","attrs":{"language":"javascript"},"marks":[{"type":"breakout","attrs":{"mode":"wide"}}],"content":[{"text":"@prefix biod: .\n@prefix bioreg: .\n@prefix corveg: .\n@prefix corveg-cv: .\n@prefix corveg-def: .\n@prefix corveg-dist: .\n@prefix corveg-geol: .\n@prefix corveg-location: .\n@prefix corveg-rfstruct: .\n@prefix corveg-site: .\n@prefix corveg-site-strata: .\n@prefix corveg-site-tax-strata: .\n@prefix corveg-situation: .\n@prefix corveg-soil: .\n@prefix corveg-soil-text: .\n@prefix corveg-struct: .\n@prefix corveg-taxa: .\n@prefix corveg-v-comm: .\n@prefix data: .\n@prefix dct: .\n@prefix dwct: .\n@prefix epsg-crs: .\n@prefix geo: .\n@prefix geosparql: .\n@prefix locn: .\n@prefix owl: .\n@prefix plot: .\n@prefix plot-x: .\n@prefix prov: .\n@prefix rdf: .\n@prefix rdfs: .\n@prefix sdo: .\n@prefix skos: .\n@prefix sosa: .\n@prefix ssn-ext: .\n@prefix time: .\n@prefix unit: .\n@prefix xml: .\n@prefix xsd: .\n\nbiod:rank-classis a skos:Concept ;\n skos:altLabel \"cl.\" ;\n skos:inScheme biod:taxon-rank ;\n skos:notation 30 ;\n skos:prefLabel \"Classis\" .\n\nbiod:rank-division a skos:Concept ;\n skos:altLabel \"div.\" ;\n skos:inScheme biod:taxon-rank ;\n skos:notation 20 ;\n skos:prefLabel \"Division\" .\n\nbiod:rank-familia a skos:Concept ;\n skos:altLabel \"fam.\" ;\n skos:inScheme biod:taxon-rank ;\n skos:notation 80 ;\n skos:prefLabel \"Familia\" .\n\nbiod:rank-forma a skos:Concept ;\n dwct:specificEpithet \"clypearia\" ;\n skos:altLabel \"f.\" ;\n skos:inScheme biod:taxon-rank ;\n skos:notation 230 ;\n skos:prefLabel \"Forma\" .\n\nbiod:rank-genus a skos:Concept ;\n skos:altLabel \"gen.\" ;\n skos:inScheme biod:taxon-rank ;\n skos:notation 120 ;\n skos:prefLabel \"Genus\" .\n\nbiod:rank-infragenus a skos:Concept ;\n skos:altLabel \"infragenus\" ;\n skos:inScheme biod:taxon-rank ;\n skos:notation 500 ;\n skos:prefLabel \"infragenus\" .\n\nbiod:rank-infraspecies a skos:Concept ;\n dwct:specificEpithet \"calcitrapa\" ;\n skos:altLabel \"infrasp.\" ;\n skos:inScheme biod:taxon-rank ;\n skos:notation 500 ;\n skos:prefLabel \"infraspecies\" .\n\nbiod:rank-morphological-var a skos:Concept ;\n dwct:specificEpithet \"tasmanica\" ;\n skos:altLabel \"morph.\" ;\n skos:inScheme biod:taxon-rank ;\n skos:notation 260 ;\n skos:prefLabel \"morphological var.\" .\n\nbiod:rank-n-a a skos:Concept ;\n skos:altLabel \"n/a\" ;\n skos:inScheme biod:taxon-rank ;\n skos:notation 500 ;\n skos:prefLabel \"n/a\" .\n\nbiod:rank-nothovarietas a skos:Concept ;\n dwct:specificEpithet \"bontei\" ;\n skos:altLabel \"nothovar.\" ;\n skos:inScheme biod:taxon-rank ;\n skos:notation 210 ;\n skos:prefLabel \"Nothovarietas\" .\n\nbiod:rank-ordo a skos:Concept ;\n skos:altLabel \"ordo\" ;\n skos:inScheme biod:taxon-rank ;\n skos:notation 60 ;\n skos:prefLabel \"Ordo\" .\n\nbiod:rank-regio a skos:Concept ;\n skos:altLabel \"regio\" ;\n skos:inScheme biod:taxon-rank ;\n skos:notation 8 ;\n skos:prefLabel \"Regio\" .\n\nbiod:rank-regnum a skos:Concept ;\n skos:altLabel \"reg.\" ;\n skos:inScheme biod:taxon-rank ;\n skos:notation 10 ;\n skos:prefLabel \"Regnum\" .\n\nbiod:rank-sectio a skos:Concept ;\n skos:altLabel \"sect.\" ;\n skos:inScheme biod:taxon-rank ;\n skos:notation 140 ;\n skos:prefLabel \"Sectio\" .\n\nbiod:rank-series a skos:Concept ;\n skos:altLabel \"ser.\" ;\n skos:inScheme biod:taxon-rank ;\n skos:notation 160 ;\n skos:prefLabel \"Series\" .\n\nbiod:rank-species a skos:Concept ;\n dwct:specificEpithet \"aspera\" ;\n skos:altLabel \"sp.\" ;\n skos:inScheme biod:taxon-rank ;\n skos:notation 190 ;\n skos:prefLabel \"Species\" .\n\nbiod:rank-subclassis a skos:Concept ;\n skos:altLabel \"subcl.\" ;\n skos:inScheme biod:taxon-rank ;\n skos:notation 40 ;\n skos:prefLabel \"Subclassis\" .\n\nbiod:rank-subfamilia a skos:Concept ;\n skos:altLabel \"subfam.\" ;\n skos:inScheme biod:taxon-rank ;\n skos:notation 90 ;\n skos:prefLabel \"Subfamilia\" .\n\nbiod:rank-subforma a skos:Concept ;\n dwct:specificEpithet \"baccifera\" ;\n skos:altLabel \"subf.\" ;\n skos:inScheme biod:taxon-rank ;\n skos:notation 240 ;\n skos:prefLabel \"Subforma\" .\n\nbiod:rank-subgenus a skos:Concept ;\n skos:altLabel \"subg.\" ;\n skos:inScheme biod:taxon-rank ;\n skos:notation 130 ;\n skos:prefLabel \"Subgenus\" .\n\nbiod:rank-subordo a skos:Concept ;\n skos:altLabel \"subordo\" ;\n skos:inScheme biod:taxon-rank ;\n skos:notation 70 ;\n skos:prefLabel \"Subordo\" .\n\nbiod:rank-subsectio a skos:Concept ;\n skos:altLabel \"subsect.\" ;\n skos:inScheme biod:taxon-rank ;\n skos:notation 150 ;\n skos:prefLabel \"Subsectio\" .\n\nbiod:rank-subseries a skos:Concept ;\n skos:altLabel \"subser.\" ;\n skos:inScheme biod:taxon-rank ;\n skos:notation 170 ;\n skos:prefLabel \"Subseries\" .\n\nbiod:rank-subspecies a skos:Concept ;\n dwct:specificEpithet \"manihot\" ;\n skos:altLabel \"subsp.\" ;\n skos:inScheme biod:taxon-rank ;\n skos:notation 200 ;\n skos:prefLabel \"Subspecies\" .\n\nbiod:rank-subtribus a skos:Concept ;\n skos:altLabel \"subtrib.\" ;\n skos:inScheme biod:taxon-rank ;\n skos:notation 110 ;\n skos:prefLabel \"Subtribus\" .\n\nbiod:rank-subvarietas a skos:Concept ;\n dwct:specificEpithet \"longifolia\" ;\n skos:altLabel \"subvar.\" ;\n skos:inScheme biod:taxon-rank ;\n skos:notation 220 ;\n skos:prefLabel \"Subvarietas\" .\n\nbiod:rank-superordo a skos:Concept ;\n skos:altLabel \"superordo\" ;\n skos:inScheme biod:taxon-rank ;\n skos:notation 50 ;\n skos:prefLabel \"Superordo\" .\n\nbiod:rank-superspecies a skos:Concept ;\n skos:altLabel \"supersp.\" ;\n skos:inScheme biod:taxon-rank ;\n skos:notation 180 ;\n skos:prefLabel \"Superspecies\" .\n\nbiod:rank-tribus a skos:Concept ;\n skos:altLabel \"trib.\" ;\n skos:inScheme biod:taxon-rank ;\n skos:notation 100 ;\n skos:prefLabel \"Tribus\" .\n\nbiod:rank-unranked a skos:Concept ;\n dwct:specificEpithet \"matrella\" ;\n skos:altLabel \"unranked\" ;\n skos:inScheme biod:taxon-rank ;\n skos:notation 500 ;\n skos:prefLabel \"unranked\" .\n\nbiod:rank-varietas a skos:Concept ;\n dwct:specificEpithet \"rupestris\" ;\n skos:altLabel \"var.\" ;\n skos:inScheme biod:taxon-rank ;\n skos:notation 210 ;\n skos:prefLabel \"Varietas\" .\n\nbiod:taxon-rank a skos:ConceptScheme ;\n dct:description \"A vocabulary of taxonomic rank terms in the Australian Plant Name Index (APNI).\" ;\n dct:isPartOf ;\n skos:hasTopConcept biod:rank-classis,\n biod:rank-division,\n biod:rank-familia,\n biod:rank-forma,\n biod:rank-genus,\n biod:rank-infragenus,\n biod:rank-infraspecies,\n biod:rank-morphological-var,\n biod:rank-n-a,\n biod:rank-nothovarietas,\n biod:rank-ordo,\n biod:rank-regio,\n biod:rank-regnum,\n biod:rank-sectio,\n biod:rank-series,\n biod:rank-species,\n biod:rank-subclassis,\n biod:rank-subfamilia,\n biod:rank-subforma,\n biod:rank-subgenus,\n biod:rank-subordo,\n biod:rank-subsectio,\n biod:rank-subseries,\n biod:rank-subspecies,\n biod:rank-subtribus,\n biod:rank-subvarietas,\n biod:rank-superordo,\n biod:rank-superspecies,\n biod:rank-tribus,\n biod:rank-unranked,\n biod:rank-varietas ;\n skos:prefLabel \"Taxon Rank Concepts\" .","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"RDF Example","type":"text"}]},{"type":"paragraph","content":[{"text":"An example of what the output RDF in Turtle looks for a single taxon ","type":"text"},{"text":"Gynura drymophila var. drymophila","type":"text","marks":[{"type":"em"}]},{"text":" mapped to APC's ","type":"text"},{"text":"Gynura drymophila (F.Muell.) F.G.Davies var. drymophila","type":"text","marks":[{"type":"em"}]},{"text":". This ","type":"text"},{"text":"skos:closeMatch","type":"text","marks":[{"type":"code"}]},{"text":" mapping is done by mapping the Corveg's taxon name to the ","type":"text"},{"text":"canonicalName","type":"text","marks":[{"type":"code"}]},{"text":" in APC.","type":"text"}]},{"type":"codeBlock","attrs":{"language":"javascript"},"marks":[{"type":"breakout","attrs":{"mode":"wide"}}],"content":[{"text":"@prefix biod: .\n@prefix bioreg: .\n@prefix corveg: .\n@prefix corveg-cv: .\n@prefix corveg-def: .\n@prefix corveg-dist: .\n@prefix corveg-geol: .\n@prefix corveg-location: .\n@prefix corveg-rfstruct: .\n@prefix corveg-site: .\n@prefix corveg-site-strata: .\n@prefix corveg-site-tax-strata: .\n@prefix corveg-situation: .\n@prefix corveg-soil: .\n@prefix corveg-soil-text: .\n@prefix corveg-struct: .\n@prefix corveg-taxa: .\n@prefix corveg-v-comm: .\n@prefix data: .\n@prefix dct: .\n@prefix dwct: .\n@prefix epsg-crs: .\n@prefix geo: .\n@prefix geosparql: .\n@prefix locn: .\n@prefix owl: .\n@prefix plot: .\n@prefix plot-x: .\n@prefix prov: .\n@prefix rdf: .\n@prefix rdfs: .\n@prefix sdo: .\n@prefix skos: .\n@prefix sosa: .\n@prefix ssn-ext: .\n@prefix time: .\n@prefix unit: .\n@prefix xml: .\n@prefix xsd: .\n\nbiod:apc-taxa a skos:ConceptScheme ;\n dct:description \"A vocabulary of taxon terms from the Australian Plant Census (APC) dataset. This is a combined collection of Biodiversity's Vascular Plants and AusMoss APC taxonomic data.\" ;\n dct:isPartOf ;\n skos:hasTopConcept biod:gynura-drymophila-var-drymophila ;\n skos:prefLabel \"Australian Plant Census Taxa\" .\n\ncorveg-cv:corveg-taxa a skos:ConceptScheme ;\n dct:description \"A vocabulary of taxon terms from the CORVEG dataset.\" ;\n dct:isPartOf corveg: ;\n skos:hasTopConcept corveg-cv:gynura-drymophila-var-drymophila ;\n skos:prefLabel \"Corveg Taxa\" .\n\ncorveg-cv:gynura-drymophila-var-drymophila a dwct:Taxon,\n skos:Concept ;\n dwct:family \"Asteraceae\" ;\n dwct:genus \"Gynura\" ;\n dwct:species \"drymophila\" ;\n dwct:specificEpithet \"drymophila\" ;\n skos:closeMatch biod:gynura-drymophila-var-drymophila ;\n skos:inScheme corveg-cv:corveg-taxa ;\n skos:notation 4413 ;\n skos:prefLabel \"Gynura drymophila var. drymophila\" .\n\nbiod:gynura-drymophila-var-drymophila a dwct:Taxon,\n skos:Concept ;\n dct:created \"1997-07-16 13:01:13+10\"^^xsd:dateTime ;\n dct:modified \"1997-07-16 13:01:13+10\"^^xsd:dateTime ;\n dwct:acceptedNameUsage \"Gynura drymophila (F.Muell.) F.G.Davies var. drymophila\" ;\n dwct:acceptedNameUsageID ;\n dwct:class \"Equisetopsida\" ;\n dwct:family \"Asteraceae\" ;\n dwct:higherClassification \"Plantae|Charophyta|Equisetopsida|Magnoliidae|Asteranae|Asterales|Asteraceae|Gynura|drymophila|drymophila\" ;\n dwct:kingdom \"Plantae\" ;\n dwct:nameAccordingTo \"CHAH (2011), Australian Plant Census\" ;\n dwct:nameAccordingToID ;\n dwct:nomenclaturalCode \"ICN\" ;\n dwct:parentNameUsageID ;\n dwct:scientificName \"Gynura drymophila (F.Muell.) F.G.Davies var. drymophila\" ;\n dwct:scientificNameAuthorship \"\" ;\n dwct:scientificNameID ;\n dwct:taxonConceptID ;\n dwct:taxonID ;\n dwct:taxonRank \"Varietas\" ;\n dwct:taxonomicStatus \"accepted\" ;\n skos:altLabel \"Gynura drymophila var. drymophila\" ;\n skos:inScheme biod:apc-taxa ;\n skos:prefLabel \"Gynura drymophila (F.Muell.) F.G.Davies var. drymophila\" .","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"Algorithm","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Create the taxon rank controlled vocabulary (as it is a dependent of the taxa controlled vocabulary)","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Load APNI CSV","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Gather the unique taxon ranks","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Clean up some of the string literals (redundant square brackets)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Map to SKOS RDF","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Create the taxa controlled vocabulary, forming two ","type":"text"},{"text":"skos:ConceptScheme","type":"text","marks":[{"type":"code"}]},{"text":", one as concepts from CORVEG, the other from APC","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Create file-based indexes using Whoosh library for APC CSV","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Load the indexes","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Note: once indexes have been created, new CSVs won't be indexed unless the ","type":"text"},{"text":"force_taxa_index","type":"text","marks":[{"type":"code"}]},{"text":" attribute in the YAML file for Taxa table is true.","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"The indexes are created so that searching for the taxon terms is extremely fast compared (otherwise it'd be O(n","type":"text"},{"text":"2","type":"text","marks":[{"type":"subsup","attrs":{"type":"sup"}}]},{"text":") using two loops in time complexity)","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"For each taxon term in CORVEG, create it as a ","type":"text"},{"text":"skos:Concept","type":"text","marks":[{"type":"code"}]},{"text":", match its ","type":"text"},{"text":"infra_rank","type":"text","marks":[{"type":"code"}]},{"text":" to the ","type":"text"},{"text":"skos:altLabel","type":"text","marks":[{"type":"code"}]},{"text":" of the taxon rank controlled vocabulary","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Map it to terms in SKOS, DCT, and Darwin Core Terms","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Do a ","type":"text"},{"text":"skos:closeMatch","type":"text","marks":[{"type":"code"}]},{"text":" to the same term in APC, name-matching on its ","type":"text"},{"text":"canonicalName","type":"text","marks":[{"type":"code"}]},{"text":" (with slight fuzzy-matching capabilities of the Whoosh library)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Ensure that the ","type":"text"},{"text":"taxonRank","type":"text","marks":[{"type":"code"}]},{"text":" column in APC is also matched to the taxon rank controlled vocabulary, name-matching on the ","type":"text"},{"text":"skos:prefLabel","type":"text","marks":[{"type":"code"}]}]}]}]}]}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"Comments","type":"text"}]},{"type":"paragraph","content":[{"text":"Many of the columns' values in APC and APNI can/should be turned into a controlled vocabulary. Currently only the taxon rank values in APNI have been turned into a controlled vocabulary (for interoperability between CORVEG taxon rank values and APNI taxon rank values). Creating controlled vocabularies for the other columns should be a good enhancement in the future but for now, the values are just string literals.","type":"text"}]},{"type":"paragraph","content":[{"text":"Currently 2225 out of 103,108 CORVEG taxon terms are not mapped to external sources (like APC). It may be possible to map these 2225 terms to other Australian government agencies' datasets in the future, but currently having most of the taxon terms mapped to APC is good enough. A possible way to find out what sources have data on these terms can be done by searching the missing terms on Atlas of Living Australia (ALA), and checking where their source information is from. ","type":"text"},{"text":"taxa_terms_not_found.txt","type":"text","marks":[{"type":"link","attrs":{"href":"https://bitbucket.org/terndatateam/etl-corveg/src/60148848c4a6ec419bb697c6d2b9a153754f00b7/docs/taxa_terms_not_found.txt"}}]},{"text":" is a list of taxon terms that were not name-matched to external sources.","type":"text"}]},{"type":"paragraph","content":[{"text":"The Python library ","type":"text"},{"text":"Whoosh","type":"text","marks":[{"type":"link","attrs":{"href":"https://whoosh.readthedocs.io/en/latest/"}}]},{"text":" was used to create binary (pickle) file-based indexes so that full text search queries were made possible on the large APC and APNI CSV files.","type":"text"}]},{"type":"paragraph","content":[{"text":"ALA's sources are not updated often enough (some are two years out of date) and they mix and match data between different sources, which is controversial, therefore we are not using ALA as an external source for extra taxonomy information.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"Visual Diagram of a Single Taxon","type":"text"}]},{"type":"paragraph","content":[{"text":"A visual diagram showcasing the above RDF Turtle snippet.","type":"text"}]},{"type":"mediaSingle","attrs":{"layout":"full-width","width":100.0},"content":[{"type":"media","attrs":{"width":4936,"id":"9e3f3486-0288-4aa4-bcb3-665dd718ca61","collection":"contentId-693501968","type":"file","height":1020}}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"Action Items","type":"text"}]},{"type":"taskList","attrs":{"localId":""},"content":[{"type":"taskItem","attrs":{"state":"TODO","localId":"1"}}]}],"version":1}

Browser not supported