Linking Compact Memory - Pages
http://data.judaicalink.org/datasets/compact-memory
Search this dataset In the catalogue · Query
Classes
| Page | 846,499 |
| schema:PublicationIssue | 46,620 |
| schema:Article | 24,463 |
| schema:PublicationVolume | 2,741 |
| schema:Periodical | 336 |
| schema:Collection | 1 |
Description
- rdf:type
- void:Dataset
- rdf:type
- dcat:Dataset
- dcterms:abstract
- The Compact Memory corpus of UB Frankfurt (Jewish periodicals in German-speaking countries) as linked data: its journals, their volumes and issues, and the pages of the full-text index, with links to the journal pages and page images in the Visual Library.
- dcterms:description
The Compact Memory corpus of UB Frankfurt (Jewish periodicals in German-speaking countries) as linked data: its journals, their volumes and issues, and the pages of the full-text index, with links to the journal pages and page images in the Visual Library. Journal descriptions c…
The Compact Memory corpus of UB Frankfurt (Jewish periodicals in German-speaking countries) as linked data: its journals, their volumes and issues, and the pages of the full-text index, with links to the journal pages and page images in the Visual Library. Journal descriptions come from the MODS records of UB Frankfurt (export of 15 June 2020), the structure of volumes, issues and pages from its page table (compact-memory-supp). Since 2026 the dataset describes every page of the full-text index of the FID portal; the version of 2021 described only the pages on which entities had been found (see cm-tagme), and its page IRIs are kept. Page IRIs have the form `<journal>-<volume>-<issue>--<file prefix>-<page VLID>`; the page VLID is the document id of the full-text index, and the page image is `http://sammlungen.ub.uni-frankfurt.de/cm/periodical/pageview/<VLID>`.- identifier
- compact-memory
- dcterms:license
- https://creativecommons.org/publicdomain/zero/1.0/
- dcterms:title
- Linking Compact Memory - Pages
- dcterms:type
- datasets/vocabulary/kind/support
- dcterms:type
- datasets/vocabulary/method/converted
- void:uriSpace
- http://data.judaicalink.org/data/compact-memory/
- dcat:hasVersion
- datasets/compact-memory/2026-10-12
- dcat:landingPage
- https://judaicalink.org/
datasets/compact-memory/2026-10-12
- rdf:type
- void:Dataset
- rdf:type
- dcat:Dataset
- rdf:type
- prov:Entity
- dcterms:description
- The whole corpus of the full-text index: the corpus resource, 336 journals from the MODS records, 88,691 volumes, issues and articles (classes from schema.org where the page table gives the kind), 846,499 pages (jl:Page) with their images. Compared with 2021-01-18, 4,710 triples are no longer stated (second IRIs of 2,060 pages, 3 pages not in the index, journal titles as jl:title and journal-level images, 16 nodes assigned to a second record of their journal; see the generator README).
- void:triples
- 4553474
- dcterms:creator
- datasets/agents/persons/1
- dcterms:issued
- 2026-10-12
- void:classes
- 6
- void:distinctSubjects
- 935527
- void:properties
- 22
- dcat:distribution
- dumps/compact-memory/2026-10-12/compact-memory-pages.ttl.gz
- dcat:distribution
- dumps/compact-memory/2026-10-12/compact-memory-journals.ttl.gz
- dcat:distribution
- dumps/compact-memory/2026-10-12/compact-memory-meta.ttl.gz
- dcat:isVersionOf
- datasets/compact-memory
- dcat:version
- 2026-10-12
- prov:wasDerivedFrom
- datasets/compact-memory-supp/2021-01-19
- prov:wasDerivedFrom
- datasets/compact-memory/2021-01-18
- prov:wasGeneratedBy
- datasets/compact-memory/2026-10-12/generation
datasets/compact-memory/2026-10-12/generation
- rdf:type
- prov:Activity
- rdfs:comment
Input not published (inputs:compact-memory/fulltext-2026-10-05-v2, 43 files, 2,097,436,345 bytes; named by checksum in the run record): Compact Memory full text for the Solr core cm_meta (bundle v2). 846,500 pages of Compact Memory as documents for the Solr core cm_meta, one JSON…
Input not published (inputs:compact-memory/fulltext-2026-10-05-v2, 43 files, 2,097,436,345 bytes; named by checksum in the run record): Compact Memory full text for the Solr core cm_meta (bundle v2). 846,500 pages of Compact Memory as documents for the Solr core cm_meta, one JSON object per line in 35 gzipped parts (docs-NNNN.jsonl.gz): page VLID, journal, date of issue, page label, volume, OCR text. manifest.json lists the parts with their checksums, the pages left out (no OCR file, no metadata, no text) and the corrections (Hebrew calendar years converted to Gregorian, which can be one year off; '(null)' removed; volumes rebuilt from the MODS records). date_review.tsv lists 513 pages whose year is isolated from the rest of their journal (not changed). The bundle also holds its README.md, the scripts that made and corrected it (extract_cm_fulltext.py, fix_bundle.py with fix_bundle.log), the loader for Solr (load_cm_fulltext.py) and dropped.tsv.gz (the pages left out, with the reason). Origin: Made on 2026-10-05 by extract_cm_fulltext.py (cm_indexer in the repository of the FID portal, handed over to Frankfurt) from the OCR XML files of Compact Memory on the JudaicaLink labs server in Mannheim, the page table (compact-memory-supp) and the MODS records (inputs:compact-memory/mods-2020-06-15); a copy is on that server.- rdfs:comment
- 1 page of the full-text bundle without an OCR file path left out.
- rdfs:comment
Input not published (inputs:compact-memory/mods-2020-06-15, 1 file, 51,520,917 bytes; named by checksum in the run record): Compact Memory metadata export of UB Frankfurt (MODS records and page table). Zip with two files: CM_Knoten_MODS_XML_15.06.2020, the MODS records of all nod…
Input not published (inputs:compact-memory/mods-2020-06-15, 1 file, 51,520,917 bytes; named by checksum in the run record): Compact Memory metadata export of UB Frankfurt (MODS records and page table). Zip with two files: CM_Knoten_MODS_XML_15.06.2020, the MODS records of all nodes of Compact Memory (journals, volumes, issues, articles; 64 MB of XML), and CM_Seiten_Metadaten_15.06.2020.xlsx, the page table (its CSV conversion is the file of compact-memory-supp). Origin: Export of the Visual Library of UB Frankfurt of 2020-06-15, received from UB Frankfurt; kept in the repository of the FID portal (wagtail-common-base, site/portal/judaicalink/sources/, commit ea89ebf3).- rdfs:comment
- Input not published (inputs:compact-memory/ocr-paths-2026-10-05, 1 file, 5,322,820 bytes; named by checksum in the run record): List of the Compact Memory OCR files. Gzipped text, one path per line (856,043 lines), relative to the XML folder: <journal>/<volume>/<issue>/<file prefix>_<page VLID>.xml. The page IRIs of compact-memory are built from these paths: <journal>-<volume>-<issue>--<file prefix>-<page VLID>. Origin: Listing of the OCR XML files of Compact Memory on the JudaicaLink labs server in Mannheim (find -name '*.xml' in the XML folder), 2026-10-05.
- rdfs:seeAlso
- https://github.com/judaicalink/judaicalink-data/blob/main/generators/compact-memory/runs/2026-10-12.json
- prov:endedAtTime
- 2026-10-12T07:55:02Z
- prov:startedAtTime
- 2026-10-12T07:53:59Z
- prov:used
- dumps/compact-memory-supp/2021-01-19/CM_Seiten_Metadaten.csv.gz
- prov:used
- dumps/compact-memory/2021-01-18/cm_tagme_pages.ttl.gz
- prov:used
- https://github.com/judaicalink/judaicalink-data/blob/b8e227c3dc120eeabdda242096eca3683fbc2683/generators/compact-memory/generate.py
- prov:wasAssociatedWith
- datasets/agents/persons/1
- prov:wasAssociatedWith
- datasets/agents/software/judaicalink-data
datasets/compact-memory/2026-10-12/metadata
- rdf:type
- prov:Activity
- rdfs:comment
- Rendered by the framework from the catalogue entry, the run record of the version and statistics measured on its files (decision 0018).
- prov:endedAtTime
- 2026-10-12T07:55:18Z
- prov:used
- https://github.com/judaicalink/judaicalink-data/tree/b8e227c3dc120eeabdda242096eca3683fbc2683
- prov:wasAssociatedWith
- datasets/agents/software/judaicalink-data
dumps/compact-memory/2026-10-12/compact-memory-journals.ttl.gz
- rdf:type
- dcat:Distribution
- dcterms:description
- The corpus (http://data.judaicalink.org/data/compact-memory/corpus) and its journals: title, subtitle, place of publication, publisher, period, language, ZDB and URN, Visual Library page, number of pages in the full-text index.
- void:triples
- 4047
- dcat:accessURL
- https://web.judaicalink.org/dataindex/?file=compact-memory/2026-10-12/compact-memory-journals.ttl.gz
- dcat:compressFormat
- http://www.iana.org/assignments/media-types/application/gzip
- dcat:mediaType
- http://www.iana.org/assignments/media-types/text/turtle
- http://spdx.org/rdf/terms#checksum
- dumps/compact-memory/2026-10-12/compact-memory-journals.ttl.gz#sha256
- dcat:byteSize
- 29685
dumps/compact-memory/2026-10-12/compact-memory-journals.ttl.gz#sha256
- rdf:type
- http://spdx.org/rdf/terms#Checksum
- http://spdx.org/rdf/terms#algorithm
- http://spdx.org/rdf/terms#checksumAlgorithm_sha256
- http://spdx.org/rdf/terms#checksumValue
- a772acceb7afcec44e37c253d64b9bef74e7ecf655353d9436311248e1ee5cb3
dumps/compact-memory/2026-10-12/compact-memory-meta.ttl.gz
- rdf:type
- dcat:Distribution
- dcterms:description
- Metadata of this version (this file).
- dcat:accessURL
- https://web.judaicalink.org/dataindex/?file=compact-memory/2026-10-12/compact-memory-meta.ttl.gz
- dcat:compressFormat
- http://www.iana.org/assignments/media-types/application/gzip
- dcat:mediaType
- http://www.iana.org/assignments/media-types/text/turtle
- prov:wasGeneratedBy
- datasets/compact-memory/2026-10-12/metadata
dumps/compact-memory/2026-10-12/compact-memory-pages.ttl.gz
- rdf:type
- dcat:Distribution
- dcterms:description
- Volumes, issues and pages: for every page its issue, sequence, label and image in the Visual Library; for every volume and issue its parent, journal, label and date.
- void:triples
- 4549427
- dcat:accessURL
- https://web.judaicalink.org/dataindex/?file=compact-memory/2026-10-12/compact-memory-pages.ttl.gz
- dcat:compressFormat
- http://www.iana.org/assignments/media-types/application/gzip
- dcat:mediaType
- http://www.iana.org/assignments/media-types/text/turtle
- http://spdx.org/rdf/terms#checksum
- dumps/compact-memory/2026-10-12/compact-memory-pages.ttl.gz#sha256
- dcat:byteSize
- 11842228
dumps/compact-memory/2026-10-12/compact-memory-pages.ttl.gz#sha256
- rdf:type
- http://spdx.org/rdf/terms#Checksum
- http://spdx.org/rdf/terms#algorithm
- http://spdx.org/rdf/terms#checksumAlgorithm_sha256
- http://spdx.org/rdf/terms#checksumValue
- f6a8f335d9fc4e7b03c9ac9b29eabc3f81307f1fe382682701caaef251fef04c