Skip to Main content Skip to Navigation
Journal articles

An Adaptable Seismic Data Format

Abstract : We present ASDF, the Adaptable Seismic Data Format, a modern and practical data format for all branches of seismology and beyond. The growing volume of freely available data coupled with ever expanding computational power opens avenues to tackle larger and more complex problems. Current bottlenecks include inefficient resource usage and insufficient data organization. Properly scaling a problem requires the resolution of both these challenges, and existing data formats are no longer up to the task. ASDF stores any number of synthetic, processed or unaltered waveforms in a single file. A key improvement compared to existing formats is the inclusion of comprehensive meta information, such as event or station information, in the same file. Additionally, it is also usable for any non-waveform data, for example, cross-correlations, adjoint sources or receiver functions. Last but not least, full provenance information can be stored alongside each item of data, thereby enhancing reproducibility and accountability. Any data set in our proposed format is self-describing and can be readily exchanged with others, facilitating collaboration. The utilization of the HDF5 container format grants efficient and parallel I/O operations, integrated compression algorithms and check sums to guard against data corruption. To not reinvent the wheel and to build upon past developments, we use existing standards like QuakeML, StationXML, W3C PROV and HDF5 wherever feasible. Usability and tool support are crucial for any new format to gain acceptance. We developed mature C/Fortran and Python based APIs coupling ASDF to the widely used SPECFEM3D_GLOBE and ObsPy toolkits.
Document type :
Journal articles
Complete list of metadata

https://hal.archives-ouvertes.fr/hal-01534788
Contributor : Publications Géoazur Connect in order to contact the contributor
Submitted on : Tuesday, October 12, 2021 - 5:18:11 PM
Last modification on : Wednesday, November 3, 2021 - 5:21:31 AM

File

ggw319.pdf
Publisher files allowed on an open archive

Licence


Distributed under a Creative Commons Attribution 4.0 International License

Identifiers

Collections

Citation

L. Krischer, J. Smith, W. Lei, M. Lefebvre, Y. Ruan, et al.. An Adaptable Seismic Data Format. Geophysical Journal International, Oxford University Press (OUP), 2016, 207 (2), pp.1003 - 1011. ⟨10.1093/gji/ggw319⟩. ⟨hal-01534788⟩

Share

Metrics

Record views

615

Files downloads

45