Big Data Space Fungus Martin Kersten

Big Data Space Fungus
Martin Kersten
© M Kersten 2015 CIDR
The Big Data problem
$$$$$$
volume
Scientific data warehouses grow exponentially
$$$$$
$$$
Business data warehouses grow linearly
$$
$
Storage
Time
© M Kersten 2015 CIDR
The non-solution
$$$$$$
Ride the hardware trend
- Disk storage $ decreases
cost
$$$$$
$$$
$$
$
Storage
Time
© M Kersten 2015 CIDR
The non-solution
$$$$$$
Ride the hardware trend
- Disk storage $ decreases
Cost
$$$$$
$$$
$$
$
Storage
Time
© M Kersten 2015 CIDR
volume
Fresh and overdue data
The fundamental law of nature is
to rot everything to return the
resources for new use
Time
© M Kersten 2015 CIDR
volume
Fresh and overdue data
The fundamental law of nature is
to rot everything to return the
resources for new use
Time
© M Kersten 2015 CIDR
Data fungi to the rescue
volume
Fungi have different growth rates,
appetites, and eco needs
Time
© M Kersten 2015 CIDR
Data fungi to the rescue
volume
Fungi have different growth rates,
appetites, and eco needs
E.G random deleting records
Time
© M Kersten 2015 CIDR
Data fungi to the rescue
volume
Fungi have different growth rates,
appetites, and eco needs
E.G queries eat data away
Time
© M Kersten 2015 CIDR
Medicines against fungi
volume
Medicinal queries expressing interest
may revive part of the data
Time
© M Kersten 2015 CIDR
Where to put our effort
•  Research to distinguish fresh from overdue data
•  Research the very broad field of data fungi
•  Built-in collection of fungi that are auto-magically activated
•  Users can buy medicines to delay the rotting process
•  Fungi are actually healthy (See Hannes Mühleisen)
© M Kersten 2015 CIDR

Download Report