Vorsitzende der Sitzung
Big data storage, handling and access
- Andreas Döpp (LMU Munich)
-
Dr. Axel Huebl (LBNL)26.01.22, 16:15
The open standard for particle-mesh data (openPMD) is a community meta-data standard. openPMD adds scientific self-description in a machine-actionable format to data sets, which allows sharing data processing frameworks, chaining data through simulations and designing long analysis pipelines.
Go to contribution page
Developed in the open as a FAIR data standard, openPMD is based on portable and scalable file formats... -
Prof. Scott Feister26.01.22, 16:45
The smallest laboratories in our field often have the highest repetition-rate experiments and the opportunity for the fattest data pipelines. One shortcut to achieving high-repetition-rate data analysis and storage, while retaining high-fidelity of datasets for post-analysis, is to implement an automated global shot counter in the lab and stamp it on every bit of scientific data. Data can then...
Go to contribution page -
Derek Schaeffer (Princeton University)26.01.22, 17:20
Flexible data structures are critical when designing control systems and data storage for high-repetition-rate experiments, and they must take into account the full lifetime of the experiment from facility preparation to data analysis. We present lessons learned from our experience creating software to control high-rep-rate laser experiments at UCLA. We overview the main motivations and key...
Go to contribution page -
Dr. Archis S. Joglekar (Center for Ultrafast Optical Sciences, University of Michigan - Ann Arbor)26.01.22, 17:40
We show a cloud-based platform for experimental data storage, management, and sharing. The platform has a UI that runs on a containerized Pythonic web application hosted by a container service. It is fronted by a lightweight authentication portal for a username and password. The experimental data is stored on a database service and object storage service. The container server, database, object...
Go to contribution page -
Hans-Peter Schlenvoigt (HZDR)26.01.22, 18:00
Experiments have per definition an unknown outcome and need adaption and improvement during their runtime. Especially user experiments are frequently changed or even just temporarily set up. On the other hand, policies develop towards open science what is undeniably useful in our field since drive lasers/facilities and experiments are cutting-edge but always have their peculiarities, hence...
Go to contribution page