Data Format Documentation Overview
This section contains documentation about data formats used in AMOCarray. The documentation is organized to follow the data processing workflow from native formats to standardized outputs.
Understanding the Documentation Structure
The data format documentation is organized around four key stages of data handling:
Document |
Purpose |
When to Use |
---|---|---|
Native formats from observing arrays |
Understanding original data structure from each array (RAPID, OSNAP, etc.) |
|
Standards compliance requirements |
Implementing OceanSITES-compliant data formats |
|
Conversion strategies from native to standard |
Planning how to transform native formats to standardized ones |
|
Final standardized format specification |
Using |
Workflow Overview
The typical data processing workflow follows this sequence:
Original Data → Each observing array provides data in its own native format
Analysis & Planning → Understand native formats and plan conversions
Standardization → Convert to OceanSITES-compliant intermediate format
Final Output → Produce AC1 standardized format for interoperability
Native Formats Conversion OceanSITES AC1 Format
(format_orig) → (format_conversion) → (format_oceanSITES) → (format_AC1)
RAPID.nc
OSNAP.nc → Analysis & → Standards → Standardized
MOVE.nc Planning Compliance Output
SAMBA.txt
Key Concepts
- Array Independence
Each observing array (RAPID, OSNAP, MOVE, SAMBA, etc.) provides data in different formats, units, and structures. The native format documentation captures these differences.
- Standards Compliance
OceanSITES provides community standards for oceanographic data. We follow these conventions while adapting them for AMOC array requirements.
- Unified Access
The AC1 format provides a consistent interface regardless of which array the data originally came from, enabling cross-array analysis and comparison.
- Metadata Preservation
Throughout the conversion process, we preserve attribution to original data providers and maintain full provenance tracking.
Getting Started
New to the project? Start with Array Format (Native / Original) to understand the data landscape
Implementing readers? Use Converting to OceanSITES format for conversion strategies
Need standards compliance? Refer to OceanSITES Format for AMOC Arrays for requirements
Using converted data? See AMOCarray Format AC1 for the final format specification
Questions and Contributions
If you have questions about data formats or want to contribute to format development:
Check our GitHub issues
See the Developer Guide for amocatlas for contribution guidelines
Review existing format documentation for similar arrays before proposing new formats