Compact Memory entities: presence and Wikidata
http://data.judaicalink.org/datasets/cm-entities
Search this dataset In the catalogue · Query
Classes
| Corpus presence | 5,445 |
| foaf:Person | 3,504 |
| place | 1,253 |
Description
- rdf:type
- void:Dataset
- rdf:type
- dcat:Dataset
- dcterms:abstract
- What is known about the entities (mainly persons and places) that were linked in the Compact Memory full text by TagMe (cm-tagme): how often and when they are mentioned, and, for those that no other dataset names, their data from Wikidata.
- dcterms:description
What is known about the entities (mainly persons and places) that were linked in the Compact Memory full text by TagMe (cm-tagme): how often and when they are mentioned, and, for those that no other dataset names, their data from Wikidata. Presence: for every entity, a `jl:Corpu…
What is known about the entities (mainly persons and places) that were linked in the Compact Memory full text by TagMe (cm-tagme): how often and when they are mentioned, and, for those that no other dataset names, their data from Wikidata. Presence: for every entity, a `jl:CorpusPresence` that links it (`jl:entity`) with the corpus Compact Memory (`jl:corpus`, `http://data.judaicalink.org/data/compact-memory/corpus`) and states the number of mentions and pages, the first and last year of mention, the number of journals and the journal with the most mentions; years and journals come from the full-text index via the page. The node IRIs are `http://data.judaicalink.org/data/cm-entities/presence/<the entity IRI after data/>`. The counts are exact for the TagMe links, which are themselves automatic (cm-tagme). Wikidata: for the entities that no other dataset names, the Wikidata item, found through the German Wikipedia title in the entity IRI (following redirects); labels in German, English and Hebrew; the type (person, or place if the item has coordinates); coordinates; and GND, VIAF and GeoNames identifiers from Wikidata. The statements are about the entities (the records of cm-tagme), not about entity pages.- identifier
- cm-entities
- dcterms:license
- https://creativecommons.org/publicdomain/zero/1.0/
- dcterms:title
- Compact Memory entities: presence and Wikidata
- dcterms:type
- datasets/vocabulary/method/lookup
- dcterms:type
- datasets/vocabulary/kind/complement
- dcterms:type
- datasets/vocabulary/method/deterministic
- void:uriSpace
- http://data.judaicalink.org/data/cm-entities/
- dcat:hasVersion
- datasets/cm-entities/2026-10-12
- dcat:landingPage
- https://judaicalink.org/
- void:exampleResource
- A. E. Housman
datasets/cm-entities/2026-10-12
- rdf:type
- void:Dataset
- rdf:type
- dcat:Dataset
- rdf:type
- prov:Entity
- void:triples
- 89300
- dcterms:creator
- datasets/agents/persons/1
- dcterms:issued
- 2026-10-12
- void:classes
- 3
- void:distinctSubjects
- 10293
- void:properties
- 13
- dcat:distribution
- dumps/cm-entities/2026-10-12/cm-entities-meta.ttl.gz
- dcat:distribution
- dumps/cm-entities/2026-10-12/cm-entities-presence.ttl.gz
- dcat:distribution
- dumps/cm-entities/2026-10-12/cm-entities-wikidata.ttl.gz
- dcat:isVersionOf
- datasets/cm-entities
- dcat:version
- 2026-10-12
- prov:wasDerivedFrom
- datasets/cm-tagme/2021-01-18
- prov:wasDerivedFrom
- datasets/dbpedia-persons/2018-10-24
- prov:wasDerivedFrom
- datasets/interlinks/2018-07-18
- prov:wasGeneratedBy
- datasets/cm-entities/2026-10-12/generation
datasets/cm-entities/2026-10-12/generation
- rdf:type
- prov:Activity
- rdfs:comment
Input not published (inputs:compact-memory/fulltext-2026-10-05-v2, 43 files, 2,097,436,345 bytes; named by checksum in the run record): Compact Memory full text for the Solr core cm_meta (bundle v2). 846,500 pages of Compact Memory as documents for the Solr core cm_meta, one JSON…
Input not published (inputs:compact-memory/fulltext-2026-10-05-v2, 43 files, 2,097,436,345 bytes; named by checksum in the run record): Compact Memory full text for the Solr core cm_meta (bundle v2). 846,500 pages of Compact Memory as documents for the Solr core cm_meta, one JSON object per line in 35 gzipped parts (docs-NNNN.jsonl.gz): page VLID, journal, date of issue, page label, volume, OCR text. manifest.json lists the parts with their checksums, the pages left out (no OCR file, no metadata, no text) and the corrections (Hebrew calendar years converted to Gregorian, which can be one year off; '(null)' removed; volumes rebuilt from the MODS records). date_review.tsv lists 513 pages whose year is isolated from the rest of their journal (not changed). The bundle also holds its README.md, the scripts that made and corrected it (extract_cm_fulltext.py, fix_bundle.py with fix_bundle.log), the loader for Solr (load_cm_fulltext.py) and dropped.tsv.gz (the pages left out, with the reason). Origin: Made on 2026-10-05 by extract_cm_fulltext.py (cm_indexer in the repository of the FID portal, handed over to Frankfurt) from the OCR XML files of Compact Memory on the JudaicaLink labs server in Mannheim, the page table (compact-memory-supp) and the MODS records (inputs:compact-memory/mods-2020-06-15); a copy is on that server.- rdfs:comment
Input not published (inputs:web-caches/api-cache-2026-10-06, 1464 files, 387,042,272 bytes; named by checksum in the run record): Answers of the Wikipedia, Wikidata and DNB EntityFacts APIs (kg-complements, 2026-10-06). 1,464 JSON answers, one file per request, named by the sha1 …
Input not published (inputs:web-caches/api-cache-2026-10-06, 1464 files, 387,042,272 bytes; named by checksum in the run record): Answers of the Wikipedia, Wikidata and DNB EntityFacts APIs (kg-complements, 2026-10-06). 1,464 JSON answers, one file per request, named by the sha1 of the request (URL + '?' + its parameters as JSON with sorted keys) under a folder of the first two hex digits: <xx>/<sha1>.json. A file holds the answer as returned (null for no record); it does not repeat the request. 97 Wikidata answers with complete entities make 365 of the 372 MB. Origin: Queried by the kg-complements builders on 2026-10-06 (cm-entities-wikidata: https://de.wikipedia.org/w/api.php and https://www.wikidata.org/w/api.php; gnd-persons-entityfacts: https://hub.culturegraph.org/entityfacts/).- rdfs:comment
- Presence: 5,445 entities.
- rdfs:comment
- Wikidata: 4,859 entities not named by any dataset; {'no Wikidata item': 11, 'other': 91, 'person': 3504, 'place': 1253}; 195 cached API answers used.
- rdfs:seeAlso
- https://github.com/judaicalink/judaicalink-data/blob/main/generators/cm-entities/runs/2026-10-12.json
- prov:endedAtTime
- 2026-10-12T07:59:13Z
- prov:startedAtTime
- 2026-10-12T07:58:18Z
- prov:used
- dumps/cm-tagme/2021-01-18/cm_tagme_references.ttl.gz
- prov:used
- dumps/cm-tagme/2021-01-18/cm_tagme_resources.ttl.gz
- prov:used
- dumps/dbpedia-persons/2018-10-24/Entityfacts-dbpedia-sameas.ttl.gz
- prov:used
- dumps/dbpedia-persons/2018-10-24/generated_persons_DBPedia_enriched_02.ttl.gz
- prov:used
- dumps/dbpedia-persons/2018-10-24/persons-gndid.ttl.gz
- prov:used
- dumps/interlinks/2018-07-18/interlinks-04-enriched-09.ttl.gz
- prov:used
- dumps/interlinks/2018-07-18/interlinks.n3.gz
- prov:used
- https://github.com/judaicalink/judaicalink-data/blob/b8e227c3dc120eeabdda242096eca3683fbc2683/generators/cm-entities/generate.py
- prov:wasAssociatedWith
- datasets/agents/persons/1
- prov:wasAssociatedWith
- datasets/agents/software/judaicalink-data
datasets/cm-entities/2026-10-12/metadata
- rdf:type
- prov:Activity
- rdfs:comment
- Rendered by the framework from the catalogue entry, the run record of the version and statistics measured on its files (decision 0018).
- prov:endedAtTime
- 2026-10-12T07:59:32Z
- prov:used
- https://github.com/judaicalink/judaicalink-data/tree/b8e227c3dc120eeabdda242096eca3683fbc2683
- prov:wasAssociatedWith
- datasets/agents/software/judaicalink-data
dumps/cm-entities/2026-10-12/cm-entities-meta.ttl.gz
- rdf:type
- dcat:Distribution
- dcterms:description
- Metadata of this version (this file).
- dcat:accessURL
- https://web.judaicalink.org/dataindex/?file=cm-entities/2026-10-12/cm-entities-meta.ttl.gz
- dcat:compressFormat
- http://www.iana.org/assignments/media-types/application/gzip
- dcat:mediaType
- http://www.iana.org/assignments/media-types/text/turtle
- prov:wasGeneratedBy
- datasets/cm-entities/2026-10-12/metadata
dumps/cm-entities/2026-10-12/cm-entities-presence.ttl.gz
- rdf:type
- dcat:Distribution
- dcterms:description
- For every entity linked in Compact Memory, its presence in the corpus (jl:CorpusPresence): mentions, pages, first and last year, journals, the journal with the most mentions.
- void:triples
- 48997
- dcat:accessURL
- https://web.judaicalink.org/dataindex/?file=cm-entities/2026-10-12/cm-entities-presence.ttl.gz
- dcat:compressFormat
- http://www.iana.org/assignments/media-types/application/gzip
- dcat:mediaType
- http://www.iana.org/assignments/media-types/text/turtle
- http://spdx.org/rdf/terms#checksum
- dumps/cm-entities/2026-10-12/cm-entities-presence.ttl.gz#sha256
- dcat:byteSize
- 151858
dumps/cm-entities/2026-10-12/cm-entities-presence.ttl.gz#sha256
- rdf:type
- http://spdx.org/rdf/terms#Checksum
- http://spdx.org/rdf/terms#algorithm
- http://spdx.org/rdf/terms#checksumAlgorithm_sha256
- http://spdx.org/rdf/terms#checksumValue
- cd0544b62161b4ecc6a84a9e9918562328587106f60585db81472fde3a9d5967
dumps/cm-entities/2026-10-12/cm-entities-wikidata.ttl.gz
- rdf:type
- dcat:Distribution
- dcterms:description
- For the entities that no other dataset names: Wikidata item, labels (de, en, he), type, coordinates, GND, VIAF and GeoNames IDs.
- void:triples
- 40303
- dcat:accessURL
- https://web.judaicalink.org/dataindex/?file=cm-entities/2026-10-12/cm-entities-wikidata.ttl.gz
- dcat:compressFormat
- http://www.iana.org/assignments/media-types/application/gzip
- dcat:mediaType
- http://www.iana.org/assignments/media-types/text/turtle
- http://spdx.org/rdf/terms#checksum
- dumps/cm-entities/2026-10-12/cm-entities-wikidata.ttl.gz#sha256
- dcat:byteSize
- 273155
dumps/cm-entities/2026-10-12/cm-entities-wikidata.ttl.gz#sha256
- rdf:type
- http://spdx.org/rdf/terms#Checksum
- http://spdx.org/rdf/terms#algorithm
- http://spdx.org/rdf/terms#checksumAlgorithm_sha256
- http://spdx.org/rdf/terms#checksumValue
- 8e0d443a9eaa07fe89e68e51c6d35e642e0c034328058d930ada90a0fea20c5c