Data Labs

Data Labs
3TU.Datacentrum Symposium on Research Data Management
TU/e, June 11th, 2014
Maurice Vanderfeesten - [email protected]
Data planning: Before Research project
Data Lab
Data capture: During Research project
Data
Archive
Data archiving: After Research project
DMP
Data re-use: trust vs. transparancy
raw
data
scripts
under version control
http://static.nl.groupon-content.net/25/05/1333050000525.jpg
http://adaywithsfe.files.wordpress.com/2012/09/eazie5.jpg
tailored
data
How does a data lab work?
Online | Offline
Software dev &
roadmapping
3TU.datalab:
Hosting & Support
Instances
thedata.org
Dutch Data Verse Network
Studies
Studies
Studies
Open Earth
Package
Open Earth / GeoData Lab
Zandmotor
data.nl
Zandmotor
(Harvard)
(Deltares)
(simple upload, DIY)
(data orchestration, DIT)
tools & models
tools & models
Other
(eg. cryostate virtual machines )
www.dataverse.nl
Flavour
DUTCH DATAVERSE
NETWORK (DDN)
www.dataverse.nl
Dutch Dataverse Network (DDN)
Collection: TU/e
Study
i
Datafile
Datafile
Datafile
Study
Collection: UTwente
Collection: TU Delft
Datafile
Datafile
Datafile
Code
Datafile
Datafile
Doc
Datafile
Datafile
www.zandmotordata.nl
OpenEarth.nl
Flavour
GEODATA LAB
Case: Sand Engine project
•
•
•
•
•
•
Client: Rijkswaterstaat/EcoShape
Goal: coastal protection & research
https://zandmotordata.nl
Researchers: 66
Research domains: 5
Data volume: 5 - 10TB
Processing
Create Processing Environment
Virtual Machines
The exisiting standards fostered by OpenEarth
Open Earth Package
catalogue
of data
graphics
of data
Web based viewer in browser (thin client)
Desktop Viewer (QGIS, Google Earth, ArcGIS)
Vector data:
tailored
data
standard
data
Generic
Geonetwork / CKAN
Grid data:
CartoDB
THREDDS ncWMS
Geoserver
ADAGUC WMS
PostGIS (Oracle Spatial)
PostgreSQL (Oracle)
CF conventions
netCDF-CDF filer
Worker
Ansible
Python
MatLab
Authorization /
Authentication
LDAP
OAuth
UI/Admin
raw
data
SubVersion
GIT
Django
Creating new flavours
Setting-up Data Labs with 3TU.Datacentrum
• Adjusted to your needs
– (re-configure and start an instance of what we have on shelf)
• Tailored to your needs
– (change/add/remove components in what we have on shelf)
• Hosted to your needs
– (we host your data lab and deliver support,
you can focus on your research again)
Questions?
• Who would like more information
about Data Labs?
Maurice Vanderfeesten
Research Data Officer
3TU.Datacentrum
TU Delft | Research Data Services
T +31 (0)15 27 85 526
E [email protected]
@maurice_
T +31 (0)15 27 88 600
E [email protected]
W www.datacentrum.3tu.nl
@3TUDatacentrum