From 4997c992290e6f8ac1323b2f2b4e1a3ca3cfde06 Mon Sep 17 00:00:00 2001 From: Daniel Miessler Date: Tue, 28 Oct 2025 00:40:38 +0100 Subject: [PATCH] Add transparency note addressing data controversy Added IMPORTANT callout in Data & Evidence section explaining: - Acknowledgment that data can be controversial - Multiple sources for cross-referencing - Complete transparency in documentation (provenance, methodology, limitations) - Full logging of all data pulls (timestamps, versions, processing) - Open source update scripts for verification Emphasizes that verification and audit are features, not bugs. --- README.md | 9 +++++++++ 1 file changed, 9 insertions(+) diff --git a/README.md b/README.md index 2459c1c..4a1d533 100644 --- a/README.md +++ b/README.md @@ -210,6 +210,15 @@ These sources capture: > [!NOTE] > All data sources include **complete library science cataloging** with 8-dimension evaluation: Authority, Currency, Objectivity, Accuracy, Methodology, Coverage, Reliability, and Provenance. +> [!IMPORTANT] +> **We know data can be controversial.** That's exactly why we: +> - 📊 **Collect from multiple sources** - Cross-reference data from different authoritative providers +> - 🔍 **Provide complete transparency** - Every source fully documented with provenance, methodology, and limitations +> - 📝 **Full logging** - All data pulls logged with timestamps, source versions, and processing steps +> - 🔓 **Open source everything** - TypeScript update scripts show exactly how data is fetched and transformed +> +> You can verify, audit, and challenge our data. That's the point. + ### **Core Datasets** (`Data/`) | Dataset | Time Span | Data Points | Source | Status |