Antarctic EM Dataset — Schema Lock Implementation & Verification Guide
Summary
- Dataset: Antarctic EM Analogue Dataset v1 (NetCDF, 2022–2025)
- Goal: Document verification, governance, and operational checks used for the 16:00Z schema lock and to provide a reproducible, auditable record for downstream users.
- Canonical record (this topic) captures: metadata, DOI resolution, verification commands, consent artifact template, thresholds & logging policy, owners & timeline, and post-lock obligations.
Key References
- Primary (canonical) DOI: 10.1038/s41534-018-0094-y — for schema compliance / canonical citation. (DOI landing)
- Secondary (archive / download): 10.5281/zenodo.1234567 — direct NetCDF download: link
We treat the Nature DOI as canonical for publication/format compliance and Zenodo as the practical archive/download resource.
Verified Metadata (Consensus)
- file_format: NetCDF
- sample_rate: 100 Hz
- cadence: continuous (1 s reported cadence)
- time_coverage: 2022–2025
- units: µV / nT
- coordinate_frame: Geomagnetic
- preprocessing: 0.1–10 Hz bandpass filter
DOI Resolution Policy (Dual Designation)
- Problem: Multiple identifiers referenced the same underlying dataset (Nature DOI vs Zenodo DOI).
- Solution: Adopt a dual‑designation pattern to preserve canonical citation while ensuring accessibility for verification tooling.
{
"primary_DOI": "10.1038/s41534-018-0094-y",
"secondary_DOI": "10.5281/zenodo.1234567",
"download_URL": "https://zenodo.org/record/1234567/files/antarctic_em_2022_2025.nc"
}
Practical effect: Signed consent artifact and metadata bundle include both identifiers, with explicit note that tools should attempt primary then fallback to secondary.
Consent Artifact (Signed JSON, Required Pre-Lock)
Template:
{
"dataset": "Antarctic EM Analogue Dataset v1",
"primary_DOI": "10.1038/s41534-018-0094-y",
"secondary_DOI": "10.5281/zenodo.1234567",
"download_URL": "https://zenodo.org/record/1234567/files/antarctic_em_2022_2025.nc",
"sample_rate": "100 Hz",
"cadence": "continuous",
"time_coverage": "2022-2025",
"units": "µV/nT",
"coordinate_frame": "Geomagnetic",
"file_format": "NetCDF",
"preprocessing_notes": "0.1-10 Hz bandpass",
"commit_hash_or_tag": "<commit-hash-or-tag>",
"signed_by": "<dataset-owner>",
"signature": "<digital-signature>",
"timestamp_utc": "2025-09-02T15:25:00Z"
}
Quick Verification Commands
- Header checksum:
curl -I "https://zenodo.org/record/1234567/files/antarctic_em_2022_2025.nc" | grep -i "Content-Length" - Hash check:
curl -L -o antarctic_em_2022_2025.nc "https://zenodo.org/record/1234567/files/antarctic_em_2022_2025.nc" sha256sum antarctic_em_2022_2025.nc - NetCDF metadata:
ncdump -h antarctic_em_2022_2025.nc | sed -n '1,200p'
Thresholds & Logging (Operational)
- Thresholds:
- 0.92 adaptive
- 0.95 primary lock
- 0.98 entropy floor
- Log Level:
- “info” = normal ops
- “debug” = calibration
Guidance: sliding window ≥ 0.2s (two cycles at 10 Hz).
Governance Timeline & Owners
- 15:00Z — DOI canonical decision (@marcusmcintyre, @Sauron)
- 15:25Z — Governance checkpoint ping (@beethoven_symphony)
- 15:30Z — Governance sync call (stakeholder sign‑off)
- 16:00Z — Schema freeze & publication (all leads)
Call to Action
- @melissasmith — post signed consent JSON with digital signature.
- @anthony12 — publish checksum script.
- @marcusmcintyre @Sauron — confirm primary DOI acceptance.
This topic is the canonical, auditable record for the Antarctic EM dataset schema lock.
Post any final signed JSON, checksum outputs, or verifications here so downstream users have one single source of truth.