View the presentation

Decoding Big Data:
Unlocking the Power of
Smart Analytics
Kevin Pool
CTO – TIBCO Asia
© Copyright 2000-2014 TIBCO Software Inc.
Is This Big Data?
Quoted from an online source
“The Complexity of Daily Trash
The Senseable City Lab of MIT conducted an experiment to see
what happens when someone takes out the trash. By attaching
transmitters to over 3,000 pieces of rubbish they were
able to track where that item went, whether they went to the
correct recycling facility or not, and how far they traveled. The
results were eye opening as you can imagine from the tracer map
It’s this kind of Big Data that can help cities manage
resources more effectively, reduce costs and carbon footprint. “
Is This Big Data?
Often the Big Data success stories
are not about Big Volume
But New Types of Data
That is used in new and unusual ways
To Obtain new Business Insights
or new types of Business Value
© Copyright 2000-2013 TIBCO Software Inc.
Is this True? … or even Relevant?
• Is this Big Data
Sizing True?
• Is it Relevant?
• If not, then what
is Relevant?
The Gartner Hype Cycle
Peak of Inflated
Expectations
Expectations (Hype)
Plateau of Productivity
Slope of
Enlightenment
Technology
Trigger
Trough of
Disillusionment
Time
Big Data Hype Cycle
Expectations (Hype)
Big Data
Time
Are you Ready To Jump into Big Data?
Are you Ready To Jump into Big Data?
What is Different?
The Data Warehouse
• Do (did) you have a DW project?
• Is it viewed as a Success?
• Why?
And now with Big Data …..
….. We want more?
Some Experienced This
• 80% of time spent extracting, cleaning, and
loading data
• Hidden problems in systems feeding the DW
• Needed data not being captured by existing
systems
• Poor Data Quality
• Low Business Value
• Unacceptable Performance
• Inability to Expand
• Not Cost Justified
• Over Budget / Behind Schedule
• Poor Quality Reports
• Not Responsive to Changing Business
Requirements
• Did not get the VALUE anticipated
A New Approach for BI?
“I know what I need”
“Capture only what is needed”
“Capture everything”
“I don’t know what I need!”
3V’s ???
Volume!
Velocity!
Variety!
3V’s describe only the data itself,
not critical business activities
required to obtain business value
The Good News is ……
Big Data
Master Data
Management
Expectations (Hype)
Visual
Analytics
Application
Integration
Cloud
Data
Cleansing
Predictive
Analytics
In-Memory
Data Grid
Time
High Value Objectives
Enterprise Analytics Capabilities
Enterprise-Class
Dimension-Free
Data
Exploration
Predictive &
Event Driven
•
Contextual
Collaboration
Data Mashup
•
Explore and
understand events
in the context of
historical data
•
•
•
•
Event Driven Analysis
Focused on Line of
Business, not IT heavy
Use Predictive Analytics
to Anticipate problems
and opportunities
Mashup Data at Rest with
Data in Motion
© Copyright 2000-2014 TIBCO Software Inc.
•
•
•
Operationalize
analytics
Automate
process
monitoring
and analysis
Alert users to
anomalies/problems/opportunities
Provide users the analytic context to
understand and evaluate events
Analytics to Action: Real-Time Opportunities
Source: Tower Group, 2012
REAL-TIME EVENT ANALYSIS and RESPONSE
UNDERSTAND
ANTICIPATE
Predict new issue,
defect or detect
sensor signal
requiring
intervention
Identify triggers
for defect ID or
sensor signal
SPOTFIRE
1
0
1
0
0
1
0
1
0
0
1
RULES /
MODELS
EVENT
SERVER
ANALYTICS
1
0
1
0
0
1
0
1
0
0
1
ACT
RESULTS
Intervene to
proactively address
process to prevent
defects, sensor
malfunction or
equipment issue
VISUALIZE
RESULTS
STATS
SERVER
Measure results,
validate
interventions
SPOTFIRE DASHBOARDS
1
0
1
1
0
1001001010010010101001010101010101010101001010010010101010100101010010101001010100100101100100100110010100101010101010101010110010101010101010101010010101010010
1
1
1
0
0
0
1
1
0
0
0
1
1
1
MACHINE DATA
HISTORICAL DATA
0
TIBCO ENTERPRISE SERVICE BUS AND IN MEMORY DATA GRID
101001010101010101010101010100101010101010101010110000
LOG FILE MANAGEMENT
10101010
11010101010101010101001010101010101010101100001010101
HADOOP / ASTER
REAL TIME APPLICATION EVENTS AND DATA
FIRST TO INSIGHT.
FIRST TO ACTION.
25
© Copyright 2000-2013 TIBCO Software Inc.
Analytics Based Decision Driven Meetings
© Copyright 2000-2014 TIBCO Software Inc.
Visual Analytics
“
…visualization-based data discovery tools have far-reaching implications for
how business information is consumed….end-user organizations should adopt as a
way to improve the success of their BI program.
- Gartner
“
ANALYTICS
& DATA
DISCOVERY
Visual, Intuitive, &
Interactive
REPORTING
STATS
Dynamic, Fast, &
Easy to Use
Useful, but Limited to
Static Information
Powerful, but Highly
Complex
Predetermined
Questions Only
Difficult to Customize
IT-dependent
For Advanced Users
Only
Ad-hoc Q&A,
Customizable
28
Empowers All User
Populations
Interactive Visual Analytics Video
© Copyright 2000-2014 TIBCO Software Inc.
Interactive Visual Analytics Video
© Copyright 2000-2014 TIBCO Software Inc.
Use Cases
Understanding Analytics Users in Your Enterprise
Traders
Risk
Management
• Analyze Price /
Volume
• Drill-down on
Individual Securities
• Analyze Economic
Indicators
• Incorporate
Statisctical methods
• Aggregated view
of multiple
positions
• Handle
Unexpected
market changes
• Rapid
Rebalancing
Marketing
• Analyze Customers
• Monitor Product
Uptake
• Identify patterns
across multiple
products
• Discover acceptance
thresholds across
customer groups
© Copyright 2000-2014 TIBCO Software Inc.
Product Line
VP / CFO
• Sales Scorecard
• Strategic Pricing
• Financial Data
Quality
• Capital Planning
• Product Marketing
• Asset & Risk
Management…
Consumer Insights
• Problem / Value
•
Grow revenue with cross-sell
up-sell
• Response
• Items purchased by members
in prior period
• Analysis
•
Identify associations between
products purchased by same
customer in given time window
•
Make recommendations for
companion / next purchase
Product Affinity
• Problem / Value
•
Grow revenue with cross-sell
up-sell
• Response
• Specific product purchase
(Y/N)
• Features
•
Other items purchased
• Analysis
•
Predict specific product
purchase
(training set)
•
Score cart: intervene when
Pr(specific product purchase)
> threshold (e.g. 0.8) and no
specific product in cart
Location Analytics
• Analysis Unit
• Stores / outlets
• Branch Offices
• ATMs
• Features
• Stores: lat, long,
population served
• Volume: products / value
• Costs
• Value
• Operations optimization
Trading Analytics
Traders need rapid and comprehensive view of risk and sensitivities
Equity Trading
►
Analyze price / volume across
holdings
►
Drill down into individual securities
►
Calculate statistical and technical
indicators, benchmark comparisons
►
Incorporate indicators and financial
data e.g. Bloomberg, Thomson,
FactSet
►
Collaborate across trading teams
Fixed Income Analysis
►
Identify unknowns: bond prices,
interest, durations, convexity and
yield
►
Compare fixed income
instruments with economic
indicators
►
Incorporate statistical methods
applied to new and existing
instruments
Risk Management
Risk managers need interactive and aggregate views on risk; and ability
to visualize complex risk analyses with management
Enterprise Risk Aggregation
►Aggregated view of multiple risk
positions by geography, product, …
►Assess loss given default for
products and counterparties
Credit and Counterparty Risk
►
►
►
Handle unexpected changes in
markets with rapid rebalancing
Incorporate predictive analytics
e.g. stress tests, economic
capital
Collaborate between traders
and managers
Market Risk
►
►
►
Mark to market, VaR, scenario
and sensitivity analysis
Interest rate and FX-risk
Collaborate across organization
for rapid response to market
conditions
Fraud and Compliance
Regulators expect banks to have powerful and robust
analytics for compliance and Anti Money Laundering (AML)
Anti-Money Laundering
►
►
►
Identify / trace unknown and
suspect transactions across
context eg business lines and
geographies
Set thresholds, define segments
and automate alert scoring
Comply with OCC guidelines
Credit Card Fraud
►
►
Identify fraudulent transactions
by vendor, location
Highlight patterns, context and
identify root cause
Trade Fraud and Compliance
►
►
Track desk in near real time
Identify violations, patterns, rulebrushing traders
Portfolio Management
Managers require multiple assets and funds in single view;
need to prove value and comply with new regulations
Portfolio Optimization
►Analyze risk-return sensitivities
►Efficient frontier statistics
►Drill to efficient portfolios of interest
►Incorporate predictive analytics
►Rebalance on –demand
Regulation Compliance
►
Comply with new regulations that
require thorough understanding
of trading across assets and
liabilities
Performance and Attribution
►
►
►
Dimension-free exploration of
assets across time
Real-time analysis and review of
fund strategies impact on
performance
Integrate with CRM data for
customer insight
FIRST TO INSIGHT.
FIRST TO ACTION.
Big Data
Visual
Analytics
Do you have the tools and technologies in place
to get BIG VALUE from your Big Data?
Kevin Pool
[email protected]
+65 6836 3880

Download Report