FORENSIC VALIDATION OF A 30-YEAR CITIZEN SCIENCE MONITORING NETWORK

Situation

Oklahoma Conservation Commission's Blue Thumb Program has operated a statewide volunteer chloride monitoring network since 1992. 15,600+ measurements across 300+ sites — collected by trained volunteers using field titration kits — sat in the EPA Water Quality Portal with no formal statistical validation against professional reference sensors. Without proof of equivalence, the dataset could not be cited in peer-reviewed publications or used as evidence in grant applications. The program's own federal grant documentation values volunteer labor at $30/hour, with 7,000+ hours contributed annually — $210,000/year in in-kind labor that satisfies EPA Section 319 matching requirements. Over 30 years, the cumulative in-kind value of the network exceeds $6.3M. Replacing it with paid professional staff is not financially viable for the state. A second problem: the program's live dashboard had no automated data sync. New monitoring records were accumulating in the ArcGIS FeatureServer with no mechanism to pull them into the production database. Four new monitoring sites that began in 2025 had never been registered.

Finding

Phase 1 analysis (N=48, OLS) indicated preliminary correlation. OCC statistician Joseph Dyer identified a metadata overlap — professional-to-professional pairs contaminating the volunteer sample. The pipeline was rebuilt from scratch. Phase 2 applied a linear mixed-effects model to 25 confirmed volunteer-to-professional matched pairs, identified via Virtual Triangulation (≤125m spatial, ≤72h temporal, closest-record strategy). Volunteer CSV integrity verified at runtime via SHA-256 checksum. IsVolunteer β = -0.433 SE = 0.218 p = 0.047 Longitude β = -0.435 SE = 0.078 p < 0.001 Seasonal β = +0.110 SE = 0.023 p < 0.001 After controlling for geography and seasonal variation, volunteer measurements are statistically consistent with professional reference sensors at the landscape scale.

Infrastructure

The Blue Thumb Dashboard was blocked pending ArcServer credentials OCC did not have. Black Box identified the public REST FeatureServer endpoint powering OCC's own App Map, bypassing the ArcServer dependency entirely. The production pipeline was redeployed to GCP:

Cloud Functions   → daily FeatureServer fetch (QAQC_Complete = 'X')
Cloud Run         → dashboard serving refreshed database
Cloud Scheduler   → 06:00 CST automated trigger

Live since February 19, 2026. Zero manual updates required.

Impact

Three decades of citizen science data — previously uncitable — now carry a formal statistical validation. Oklahoma is the only state with the data infrastructure (distinct WQX Organization IDs in the federal portal) to enable this type of retrospective validation. Equivalent programs in Georgia and Missouri cannot replicate this analysis due to data management differences.

Remediation

Oral presentation: 2026 OCLWA Annual Conference, Stillwater, OK — April 15, 2026. Manuscript in preparation. OCC co-authors: Joseph Dyer, Kim Shaw.

Evidence