Building a dMRV Data Pipeline from Field to Registry
dMRV data pipeline guide: how to move field, satellite and model data into monitoring reports and registries with versioning, QA/QC and an audit trail.
A dMRV data pipeline takes raw field measurements, satellite data and project records, validates and processes them, calculates emission reductions or removals, and outputs the monitoring report tables and registry files, with every number traceable to its source. The point is not automation for its own sake: it is making each verification faster, cheaper and harder to dispute.
The pipeline in seven stages
- Capture. Field apps record trees, plots, farmers and events with location, time and photos. Satellite imagery and alerts are pulled on schedule. Management data (planting, fire, harvest) is logged at source. See mobile tree measurement.
- Ingest and store raw. Write raw data to storage that is never edited. Keep image IDs, file hashes and timestamps.
- Validate. Automated rules catch missing fields, impossible values (a five-year-old tree with 80 cm DBH), duplicates, points outside boundaries and photos missing.
- Clean with a log. Corrections are new records that reference the original, with reason and approver.
- Process. Apply allometric equations, remote sensing models, stratification and the methodology’s equations. Code and parameters are version-controlled.
- Calculate and check. Produce stocks, changes, baseline, leakage, uncertainty and buffer contributions. Run reasonableness checks against previous periods.
- Report and export. Generate tables for the monitoring report, geospatial files for registries and verifiers, and dashboards for buyers and communities.
Architecture choices
| Component | Simple option | Scaled option |
|---|---|---|
| Field capture | Form-based app with offline sync | Purpose-built app with species lists, validation and photo analysis |
| Storage | Cloud database plus object storage | Data warehouse with versioned tables |
| Geospatial | Desktop GIS, scripted exports | Cloud raster processing with scheduled jobs |
| Calculations | Version-controlled scripts | Workflow orchestration with tests |
| Reporting | Templates filled from queries | Automated report generation and dashboards |
Start simple and make it reproducible. A well-documented script in version control beats an untested platform.
Designing for two registry worlds
Indonesian projects may report to an international standard such as Verra or Gold Standard and also to the national system. Exchange-traded units in Indonesia must be recorded in SRUK, which replaces SRN-PPI, and IDXCarbon trades SPE-GRK offsets. Keep the data model registry-neutral, with clean exports to each. See SRUK and SPE-GRK.
Verra has also updated technical requirements for geolocation files; check the current version before you design export formats.
Linking carbon and EUDR
The same farmer, plot and tree data can support EUDR geolocation and deforestation-free evidence for commodities such as coffee, cocoa and rubber. Build plot polygons, ownership and consent records once, and use them for both. See one dataset for carbon and EUDR.
Who owns which step
Pipelines break at handovers. Name an owner for each stage: field coordinators own capture and first-line checks; a data manager owns validation rules and the correction log; an analyst owns calculation code; a technical lead signs off results before they go into the monitoring report. Keep a short RACI table in the data management plan, and train backups so the pipeline survives staff turnover between monitoring periods, which can be years apart.
Security and access
Carbon data is commercially sensitive and includes personal data. Use role-based access, log who changed what, encrypt data at rest and in transit, and agree data-sharing terms with landholders, buyers and verifiers. Indonesia’s personal data protection law applies to farmer records, so collect consent for data use and keep only what you need.
Common mistakes
- Spreadsheets as the system of record. Copies multiply and nobody knows which is final.
- Overwriting raw data during cleaning.
- Unversioned calculations, so last period’s numbers cannot be reproduced.
- Hard-coded parameters buried in formulas instead of a documented parameter table.
- No identity for entities: trees, plots and farmers without stable IDs cannot be tracked across periods.
- Ignoring data protection. Farmer names, IDs and locations are personal data; control access and get consent.
What good evidence looks like
A verifier should be able to pick any reported number and follow it back: report table → calculation script and version → processed dataset → validated records → raw records with photos and coordinates. Provide a data management plan, a parameter table with sources, QA/QC logs, code repositories or exported scripts, and change logs between monitoring periods. Access for the VVB to a read-only view of the data speeds verification.
A checklist before your first verification
- Data management plan written and followed.
- Raw data immutable and backed up.
- Validation rules documented with results.
- Calculation code versioned and tagged for the monitoring period.
- Parameter table matches the PDD and methodology version.
- Uncertainty calculated in the pipeline, not by hand. See uncertainty deductions.
- Exports tested against registry and VVB requirements.
Our dMRV implementation service builds pipelines like this, and akar dMRV covers field capture through reporting. See the dMRV hub for the wider picture.
Frequently asked questions
What is a dMRV pipeline?
It is the chain of systems and steps that take raw field, satellite and management data, check and process it, calculate carbon, and produce the reports and files a verifier and registry need, with every step traceable.
Do registries accept digital MRV data directly?
Registries mostly still receive documents and spreadsheets, though digital submission formats are growing. Design your pipeline so it can export to the formats each registry and verifier requires.
What makes a dMRV pipeline auditable?
Immutable raw data, version-controlled code and parameters, logged transformations, clear links from each reported number back to source records, and access controls.