SPARK Workshop on Dynamic Data Ingestion

Programme Session 4 (26-05-2021)

“Introduction by Kaspar Gubler

Welcome to the fourth and final session of the SPARK Nodegoat Workshop. We are very happy about the participation and the numerous feedbacks on the workshop. I can only recommend that you organise such a workshop yourself. With a video conference this is no longer a problem. For example, several projects could get together and organise a workshop, perhaps on a specific topic related to Nodegoat.  A comment on Nodegoat as a research infrastructure in the humanities: Nodegoat is jointly funded by various projects and universities, a model that I believe is the solution for the long-term development of a digital infrastructure for the humanities. It is crucial that such an infrastructure can be used by different disciplines and not just by a single, specific project. If only one project can use software, it is not a true infrastructure. In contrast, as we have seen, Nodegoat can be used by different humanities disciplines. Another advantage of Nodegoat as a research infrastructure is that it does not require difficult software installations or programming skills. Thus, an infrastructure like Nodegoat allows users to focus on research. They don’t have to deal with technical things first. I think this is a big problem in the digital humanities: there is too much focus on the technical stuff and not enough on our core competence, which is to answer research questions with digital methods. In my opinion, too often we only talk about the possibilities of digital methods instead of delivering research results. It’s like constantly cleaning your glasses instead of just putting them on.”

14:00 Welcome and recap of last week’s session

14:15 Ingestion of publications from the Dutch Royal Library SPARQL endpoint

14:50 Break

15:00 Ingestion of SameAs references from lobid.org

15:15 Ingestion of Wikimedia Commons URLs from Wikidata

15:50 Break

16:00 Ingestion (TBD)

16:35 Q&A

Slides:

 

Linked Data Resources Suggestions

Linked Data Resources

Label Value
Name Query the KB SPARQL endpoint based on VIAF ID
Protocol SPARQL
URL http://data.bibliotheken.nl/sparql?default-graph-uri=&query=
URL Options &format=json&timeout=0&debug=on
Query SELECT DISTINCT ?pub ?name ?date (group_concat(?author_ids; separator=”, “) AS ?author_id)

WHERE {

?pub schema:author ?person.

[query=viaf]?person schema:sameAs <http://viaf.org/viaf/[variable=id]71399367[/variable]>.[/query]

?pub schema:name ?name.

?pub schema:author ?author_node.

?author_node schema:sameAs ?author_ids.

?pub schema:publication ?publication_node.

?publication_node schema:startDate ?date.

}

GROUP BY ?pub ?name ?date

Conversion INPUT

http://www.wikidata.org/entity/Q123034, http://viaf.org/viaf/71399367

Script:

const uris = INPUT;

const arr_viaf = uris.match(/viaf\/(\w+)/i);

const viaf_identifier = arr_viaf[1];

OUTPUT = {‘viaf_identifier’: viaf_identifier};

Original Query SELECT DISTINCT ?pub ?name ?date (group_concat(?author_ids; separator=”, “) AS ?author_id)

WHERE {

?pub schema:author ?person.

?person schema:sameAs <http://viaf.org/viaf/71399367>.

?pub schema:name ?name.

?pub schema:author ?author_node.

?author_node schema:sameAs ?author_ids.

?pub schema:publication ?publication_node.

?publication_node schema:startDate ?date.

}

GROUP BY ?pub ?name ?date

 

Label Value
Name Query the lobid.org API for ‘SameAs’
Protocol API
URL https://lobid.org/gnd/
URL Options .json
Query [query=id][variable]118637533[/variable][/query]

 

Label Value
Name Query Wikidata for Wiki Commons URLs based on Wikidata ID
Protocol SPARQL
URL https://query.wikidata.org/sparql?query=
URL Options &format=json
Query SELECT (CONCAT(“https://commons.wikimedia.org/wiki/Category:”,STR(?commons)) as ?commons_link)

WHERE {

<[query=id]http://www.wikidata.org/entity/[variable=id:uri-identifier]Q60866[/variable][/query]> wdt:P373 ?commons.

}

URI Template http://www.wikidata.org/entity/[[identifier]]
Link Click to open Query

 

Label Value
Name DiJeSt
Protocol SPARQL
URL http://tdk-jbs.cs.technion.ac.il:8890/sparql?default-graph-uri=&query=
URL Options &format=application%2Fsparql-results%2Bjson&timeout=0&debug=on&run=+Run+Query+
Query SELECT DISTINCT ?book ?title ?author_name

WHERE {

?book <http://purl.org/dc/terms/title> ?title .

[query=name]FILTER regex(?title,  “[variable]קודש[/variable]”, “i”)[/query]

?book <http://purl.org/dc/terms/creator> ?author_node .

?author_node <https://schema.org/name> ?author_name .

FILTER (lang(?author_name) = ‘und-hebr’)

}

OFFSET [[offset]] LIMIT [[limit]]

 

Label Value
Name The Getty Thesaurus of Geographic Names
Protocol SPARQL
URL http://vocab.getty.edu/sparql.json?query=
URL Options
Query SELECT DISTINCT ?place ?label ?parents (GROUP_CONCAT(?altlabel;SEPARATOR=”,”) AS ?altlabels) {

?place skos:inScheme tgn: .

?place luc:term “[query=name][variable]lemberg[/variable][/query]”.

?place gvp:prefLabelGVP [xl:literalForm ?label].

 

OPTIONAL { ?place xl:altLabel [ gvp:term ?altlabel ] }

OPTIONAL { ?place gvp:parentStringAbbrev ?parents }

}

GROUP BY ?place ?label ?parents

OFFSET [[offset]] LIMIT [[limit]]

 



Cite this blog post
kgubler (2021, June 5). SPARK Workshop on Dynamic Data Ingestion. HistData. Retrieved June 23, 2024, from https://doi.org/10.58079/ple0