NCAR-UCAR Seminar July 10 2014 FL2

Geo-DAB: Making the GEOSS
Infrastructure Operational
STEFANO NATIVI
N AT I O N A L R E S E A R C H C O U N C I L O F I TA LY ( C N R - I I A ) :
E A RT H A N D S PA C E S C I E N C E I N F O R M AT I C S - L A B O R ATO R Y ( E S S I - L A B )
NCAR/UCAR seminar July 10 2014
[email protected]
NCAR-UCAR Seminar July 10 2014 FL2
[email protected]
Rationale
• Towards an operational “GCI 2.0”
– New challenges
• The DAB role
GEO (Group on Earth Observations)
• launched in response to calls for action by the 2002 World
Summit on Sustainable Development, Earth Observation
Summits, and by the G8 (Group of Eight) leading
industrialized countries
• voluntary partnership of 90 governments and 77
international organizations
• provides a framework within which these partners can
develop new projects and coordinate their strategies and
investments
• charged with developing GEOSS
Global Earth Observation
System of Systems (GEOSS)
NCAR-UCAR Seminar July 10 2014 FL2
[email protected]
GEOSS Architecture
GEOSS
User
Access
Register
(GCI)
GEOSS
Common
Infrastructure
Resource
Providers
Member and
PO
Resources
Agency Services and SW Applications:
Web services, Applications. Community Portals
Official Catalogs
[email protected]
NCAR-UCAR Seminar July 10 2014 FL2
GEOSS
Current Architecture
Access
GEOSS User
GEO Web
Portal
GCI
GEOSS Registries:
•Standards &
Interoperability
•User Requirements
•Best Practices Wiki
•Semantic
Discovery and Access
Broker* (DAB)
Clearinghouse
(Catalog)
Register
Component & Service
Registry (CSR)
Resource
Providers
harvest
Monitoring
Services
Centralized EO
Inventory Clients
GENESI*, CWIC*, FedEO*
metadata
links to
real-time
search
Member and
PO
Resources
Agency Services and SW Applications:
Web services, Applications. Community Portals
Official Catalogs
NCAR-UCAR Seminar July 10 2014 FL2
[email protected]
Current GCI (D&A) configuration
NCAR-UCAR Seminar July 10 2014 FL2
[email protected]
NCAR-UCAR Seminar July 10 2014 FL2
[email protected]
http://reporting.geodab.eu
Towards an operational GEOSS
Access
GEOSS User
GEO Web
Portal
GCI
send requests to
Discovery and
Access Broker
access
distribute
access
Register
GENESI*, CWIC*, FedEO*
(Users, collections, data)
real-time
search
search
Resource
Providers
Centralized EO
Inventory Clients
Member and PO Resources
Create and
manage
Metadata
data
Agency Assets
Official Catalogs
NCAR-UCAR Seminar July 10 2014 FL2
[email protected]
Towards operational GCI 2.0
GEO
Home
Page
GEOSS
Portal
GEO
Discovery &
Access
Broker
NCAR-UCAR Seminar July 10 2014 FL2
[email protected]
GEO DAB (GCI 2.0) on the Cloud
NCAR-UCAR Seminar July 10 2014 FL2
[email protected]
Towards a New Registration process for GCI 2.0
New Data
Provider
• Fill in the Web
Form available on
the GEO website
(i.e. Yellow page
service)
• May contact a
representative of
the GEO sec –if
necessary
GEO sec
• Check the new
Yellow Page entry
• May release press
news
• Virtually introduce
the Provider
Technical POC to
GEO DAB/ CNR
DAB Team
• Run tests and
contact the Provider
Technical Contact
Point –if necessary
• Recognize the most
effective Brokering
Agreement
• Update the DAB and
the monitoring
tools
Yellow page form fields: Responsible person information, Organization information, Technical POC, Service
Level Agreement, estimated number of Collections (optional), estimated number of DataCORE (optional),
estimated number of Granules (optional), principal thematic area (optional)
NCAR-UCAR Seminar July 10 2014 FL2
[email protected]
Using Federated Identity
e.g. OpenID Connect
Authentication and User statistics
NCAR-UCAR Seminar July 10 2014 FL2
[email protected]
Users’ Feedbacks
• Based on the pilot developed by GeoViQua
Challenge: Merging Metadata Records with User Feedbacks
Private Sector involvement:
Lessons Learnt
Analytics
functions
GEOSS
Communities
App
App
GEOSS
Portal
App
App
App
App
App
App
App
Cloud
Infrastr.
App
GEOSS Data
Providers
GCI Platform
Private
Infrastructure
public
Interfaces
/APIs
Public Data
DAB
• Interoperability agreement(s)
• . ..Share Data
• Share Apps
• Share functionalities (e.g. Analytics)
NCAR-UCAR Seminar July 10 2014 FL2
[email protected]
System of Systems ..
.. .
(Big)Data
GCI 2.0
Data
Infrastructure
GEOSS Catalog for
Long Tail Data
Data
Infrastructure
GEOSS Yellow Pages
Data
Infrastructure
GEOSS Feedback
Catalog
Crowdsourcing
data system
NCAR-UCAR Seminar July 10 2014 FL2
[email protected]
Towards an operational GCI 2.0
 (From a “Catalog of Catalogs” to) a multi-
disciplinary Brokering Platform
 (From discoverability to) accessibility and analytics
 (From data to) information and knowledge
 (From authoritative data to) crowdsourcing
 (From expert users to) User profiling
GCI & Big Data Challenge
• Volume
o Millions of discoverable
(small & medium) products
o Long EO time/space series
• Variety
extreme heterogeneity
characterizing different disciplines
o Diverse product types:
data, services, models, documents
o Different granularity levels
o Different semantics
GCI & Big Data Challenges
• Veracity
• Quality constraints
• Fit for purpose
• Essential (Community) Variables (EBVs, CEVs,
CCEVs, ..)
• Ranking metrics
• User Feedbacks
• Velocity
• Needs to reach Developing Countries
–with limited Web/Internet access
– GEONETcast
• Data Analytics (from data to knowledge)
NCAR-UCAR Seminar July 10 2014 FL2
[email protected]
Conclusions
• GCI 2.0 new challenges
–
–
–
–
Big Data (complex analytics)
Crowdsourcing, Social services and usage profiling
Linking Private sector platforms
From Data to Knowledge
• The Brokering framework plays a key enabling role
NCAR-UCAR Seminar July 10 2014 FL2
[email protected]