SlideShare a Scribd company logo
1 of 32
1© Cloudera, Inc. All rights reserved.
MiFiD II Best Execution
Compliance with
Cloudera and TickSmith
Francis Wenzel
CEO, TickSmith
@TickSmith
Richard Harmon
FS Director, Cloudera
@ClouderaUK
2© Cloudera, Inc. All rights reserved.
Our relationship with data is changing
3© Cloudera, Inc. All rights reserved.
Boardroom thinking
DRIVE CUSTOMER
INSIGHTS
IMPROVE PRODUCT &
SERVICES EFFICIENCY LOWER BUSINESS RISK
4© Cloudera, Inc. All rights reserved.
Boardroom thinking
DRIVE CUSTOMER
INSIGHTS
IMPROVE PRODUCT &
SERVICES EFFICIENCY LOWER BUSINESS RISK
MODERNIZE ARCHITECTURE
5© Cloudera, Inc. All rights reserved.
Areas Affecting Business Risks
CYBERSECURITY FRAUD COMPLIANCE
• Insider threat
• Advanced persistent
threats
• Account takeovers
• Anti Money
Laundering (AML)
• Payments fraud
• Insider threats
• Regulatory compliance
(PCI, HIPPA, Dodd-Frank)
• Internal compliance
• External & internal audits
6© Cloudera, Inc. All rights reserved.
Areas Affecting Business Risks
CYBERSECURITY FRAUD COMPLIANCE
• Insider threat
• Advanced persistent
threats
• Account takeovers
• Anti Money
Laundering (AML)
• Payments fraud
• Insider threats
• Regulatory compliance
(PCI, HIPPA, Dodd-Frank)
• Internal compliance
• External & internal audits
7© Cloudera, Inc. All rights reserved.
Our Customers Include
Over 180 financial companies (banking, capital markets, insurance)
19 of the top 30 global systematically important banks (G-SIBs)
5 of the top 6 asset management firms
2 of the top 3 multi-national payment processing firms
3 of the top 5 Fortune 500 insurance companies (p&c and life)
8© Cloudera, Inc. All rights reserved.
Regulatory Compliance & MiFID II
9© Cloudera, Inc. All rights reserved.
Comprehensive Regulatory Compliance-Key Drivers and Objectives
Drive
Efficiencies
Reduce Risk of
Non-Compliance
Reduce Time to
Compliance
• Unify data governance across
lines of business
• Scale data volume and
processing cost-effectively
• Improve data quality
• Use all available current and
historical data to improve
accuracy
• Apply machine learning
• Use advanced analytics for
better controls, including
proactive and predictive
• Break silos so that reporting can
be performed seamlessly, on one
data hub
• Flexible/adaptable platform
• Automate e-discovery
• Automate data lineage tracking
Unified Data Platform Supports a Comprehensive Compliance Framework
10© Cloudera, Inc. All rights reserved.
Cloudera: Managing Data for Comprehensive Regulatory Compliance
Handle real-time
data ingest from
diverse sources
Governance and
Security
Data
Streams
Deployment Flexibility
Machine Learning
Capabilities
Diverse Analytical
Options
Combine Data from Different Sources
Data Mgmt. Hub
Scale easily & cost
effectively
Batch or Real- time
Data Streams
Data Sources
A comprehensive data management platform to support more accurate and efficient compliance
Data Sources
Data Storage &
Processing
Reporting, Analytics &
Auditing
Data Ingest
Other
Data Governance (Data Lineage, Data Protection, Data Lifecycle Management)
MiFID II, FRTB, IFRS-9, BCBS-239, MAD/MAR, GDPR, ….
11© Cloudera, Inc. All rights reserved.
MiFID II – Markets in Financial Instruments Directive
Investor
Protection
Transparency
Transaction
Reporting
Micro-
Structural
Issues
Data
Publication
& Access
Commodity
Derivatives
Market
Infrastructure
Governance
Authorization,
Branches &
Passporting
MiFID II / MiFIR
Trading
&
Clearing
Four Objectives for MiFID II
1. To strengthen investor protection
2. To reduce the risks of a disorderly
market
3. To reduce systemic risks
4. To increase the efficiency of
financial markets and reduce
unnecessary costs for market
participants.
Active: January 3, 2018
12© Cloudera, Inc. All rights reserved.
MiFID II – Data Governance & IT Infrastructure Challenges
Best Execution Validation
13© Cloudera, Inc. All rights reserved.
MiFID II: New Requirements for Best Execution
Best Execution standards are being enhanced & expanded
⎻ These changes are designed to protect investor interests.
⎻ They require both buy-side and sell-side firms to document, monitor and demonstrate
best execution based on quantitative and qualitative metrics – such as price, cost,
speed, size, likelihood of execution, settlement, size and nature of the trade.
• Firms are required to explain their execution policies in sufficient detail to allow clients to
easily understand how orders will be executed;
• Firms are required to disclose the top five execution venues used on an annual basis;
• Firms are to disclose on at least an annual basis the quality of execution;
• ESMA has upgraded the obligation to achieve the best execution result from an obligation to
use "all reasonable steps" to a more stringent requirement to take “all sufficient steps”.
14© Cloudera, Inc. All rights reserved.
RTS-27: Best Execution Requirements For Execution Venues
RTS-27: Regulatory Technical Standards (Execution Venues)
⎻ Coverage: Applies to all trading venues, systematic internalisers, market
makers, or other liquidity providers.
⎻ Cost Disclosures: Requires full disclosure of all order execution charges
⎻ Execution Likelihood: Requires metrics to be created to assess the likelihood
of execution of a specific financial instrument on a specific venue.
⎻ Execution Comparison: Requires order execution comparisons to be sized
ranged based upon the type of financial instrument and its liquidity to ensure
an adequate sample of executions in a size that is typical in that instrument.
⎻ Public Data Access: Requires trading venues to enable public website
access for all provided data
15© Cloudera, Inc. All rights reserved.
RTS-28: Best Execution Requirements for Investment Firms
RTS-28: Regulatory Technical Standards (Investment Firms)
⎻ Data will need to be captured at each transaction/order level, such as the
percentage of passive/aggressive/directed orders; which will need to be stored
for future recall if necessary.
⎻ The data must then be mapped and attached to every order for reporting
purposes.
⎻ To maintain the data’s accuracy and reliability, consistent management and
control will also be required.
⎻ This controlled data can then be fed into various post-trade feeds for allocations,
confirmations, affirmations and surveillance or global order and risk monitoring.
16© Cloudera, Inc. All rights reserved.
MiFID II’s Best Execution Related Data & Technology Challenges
⎻ Extensive benchmark data across all relevant markets must be sourced,
stored and accessible.
⎻ Where benchmark data is not available, firms will need to devise proxy
methodologies to compute the required best execution metrics.
⎻ Many firms will need to modify & enhance their data feeds and coded “best
execution” logic in their trade capture systems and market data sources.
⎻ Agile Big Data solutions will be required to process, store and analyze the
vast amounts of benchmark and proxy data required for “best execution”.
© TickSmith Corp. All rights reserved.
Leveraging “big data”
To solve this big data problem: MiFID II RTS 27 & RTS 28
You need proven big data technology:
And an award winning solution:
© TickSmith Corp. All rights reserved.
TickVault
Big data problem
MiFID II
RTS 27
RTS 28
Proven big data
technology
Award winning
innovative solution
© TickSmith Corp. All rights reserved.
Introducing TickVault
TickVault: Hadoop-based big data management platform for capital markets
TickVault is a complete software application built on a modular architecture
Accumulate/transform/analyse/disseminate Terabytes and Petabytes of financial data
Used by trading and risk groups, regulators, exchanges and data vendors
Ideal for compliance and trading
Complete workflow from data centralization to delivery with entitlements and standard access
tools
Abstracts the complexities of big data technology into a ready to use platform
© TickSmith Corp. All rights reserved.
TickVault
Deployment
● In-house, on client hardware and Hadoop cluster
● On client’s cloud infrastructure
● Capacity driven by infrastructure and supports Terabytes to multi-Petabytes
TickVault is a Cloudera Certified Technology that supports CDH 4.7, 5.2, 5.3, 5.4, 5.7,
5.8
© TickSmith Corp. All rights reserved.
TickVault for data producing firms
Exchanges & data vendors
● Centralize & normalize
● All trade & quote data
● All asset classes and +
● Analyze & enrich
● Reconstruct & report
● Interact & distribute
https://nasdaq-cx.ticksmith.com
https://datamine.cmegroup.com
https://trdata.tickvault.com
© TickSmith Corp. All rights reserved.
TickVault for data consuming firms
Systematic trading groups, market
makers, regulators and compliance
● Accumulate & centralize
○ Data from quote feeds, trading systems,
event feeds, etc.
○ All asset classes, depths and data types
○ Up to nanosecond resolution
○ Supports multiple timestamps
● Normalize, combine, analyze, reconcile
● Rebuild point in time market depth
● Provide time series & reports
● Interact & integrate with in-house apps
National Bank of Canada case study at
https://aws.amazon.com/solutions/case-studies/national-bank-of-canada/
© TickSmith Corp. All rights reserved.
TickVault modules
3
4
5
6 7
21
Complete software platform
1. Load all exchange, trade and other data from exchange feeds,
network appliances, (Corvil, Solace, Exegy, etc.), aggregators,
OMS, order routers, FIX engines, trade venues, etc.
1. Connect directly to your data on local and cloud storage (SAN, NAS,
file servers, S3…).
1. Retain original data. Normalize through time and across sources.
1. Create combined and derived datasets. Turn data into time-series.
Run analytics, create reports and statistics. Reconstruct market
activity and market depth.
1. Entitle and control data and features access to users and systems.
Interface with existing billing system.
1. Provide data via easy to use web interfaces and Rest APIs.
1. Monitor and manage all tasks and processes.
© TickSmith Corp. All rights reserved.
Addressing MiFID requirements
TickVault is able to store, normalize, and run calculations on terabytes to multi-petabytes of
financial data as required for MiFID II compliance. Leveraging Hadoop, it provides a future-proof
to address:
RTS 27/28 best execution reports
Public portal for data queries
File inventory centralization (RTS1, 2, 6, 22, 23 & 24)
Timestamp validation of accumulated data
© TickSmith Corp. All rights reserved.
TickVault’s RTS-27 Solution
Takes book by order data from trading venues and automatically generates best execution tables for MiFID II RTS 27
data retention and publication.
Reports are organized by TickVault’s internal custom search and statistics engine. TickVault also provides
alerts on specific unfilled table fields that may require ad hoc descriptions to be inputted.
TickVault is able to automatically generate tables 1, 2, 3, 4, 6, 7, 8 and 9 given the following trading venue
data:
Financial instrument directory
System event information (halts, suspensions, outages, failed transactions)
Book by order for all price levels including number of market makers and specific types of orders
All timestamped execution information of every financial instrument
© TickSmith Corp. All rights reserved.
TickVault’s RTS-27 Solution
Custom Search displays Top of Book HITS or Rollups (one second/minute time intervals) for each queried
financial instrument which can be exported as a csv file. The export button can also produce RTS-27
tables.
Statistics page displays calculated information for each queried financial instrument including, but not
limited to:
● Daily VWAPs
● OHLC
● Trading Value
● Number of Passive/Aggressive Orders
● Mean time elapsed between order acceptance and execution
● Number of suspensions
● Average Spread at Best Bid and Offer
Statistics information can be exported as a csv file and RTS 27 tables.
© TickSmith Corp. All rights reserved.
TickVault’s RTS-27 Solution
Custom Search page
Top of Book interface and
charting available trading
venue data
Book by Order interface
from trading venue data
Statistics page
© TickSmith Corp. All rights reserved.
TickVault’s RTS-27 Solution
TickVault Generated machine-readable Table 6 for an
example trading venue and financial instrument
TickVault Generated machine-readable Table 7 for an example trading venue and financial instrument
© TickSmith Corp. All rights reserved.
TickVault’s RTS-28 Solution
Whenever a client investment firm executes an order, TickVault logs all relevant best execution
information for that order and organizes it for reporting requirements. Tables 1, 2, and 3 can be
automatically generated.
Investment firm can add notes and descriptions in trade analysis report in the case of irregular
executions.
TickVault contains an Access and Identity Management module which manages user
authentication and access to private data.
The investment firm’s execution statistics can be exported into a csv file.
© TickSmith Corp. All rights reserved.
TickVault’s RTS-28 Solution
Private data portal
TickVault Generated machine-readable Table 2
© TickSmith Corp. All rights reserved.
Beyond compliance
Usable data is valuable data. Using TickVault with Cloudera CDH allows your firm to leverage existing
Hadoop clusters and provides an ideal solution to organize and exploit trading and market data on
Hadoop.
Example of machine learning application using data from TickVault
In addition to its specialized tools and interfaces,
TickVault’s easy to use APIS provide in-house
developers and applications access to data and
analytics for:
● Back-testing
● Quantitative research
● RISK data management
● Compliance
● Financial econometrics
● Machine learning and algorithmic models.
32© Cloudera, Inc. All rights reserved.
Thank you
Francis Wenzel
CEO, TickSmith
@wenzelware
Richard Harmon
FS Director, Cloudera
@ClouderaUK

More Related Content

More from Cloudera, Inc.

More from Cloudera, Inc. (20)

Introducing Cloudera Data Science Workbench for HDP 2.12.19
Introducing Cloudera Data Science Workbench for HDP 2.12.19Introducing Cloudera Data Science Workbench for HDP 2.12.19
Introducing Cloudera Data Science Workbench for HDP 2.12.19
 
Shortening the Sales Cycle with a Modern Data Warehouse 1.30.19
Shortening the Sales Cycle with a Modern Data Warehouse 1.30.19Shortening the Sales Cycle with a Modern Data Warehouse 1.30.19
Shortening the Sales Cycle with a Modern Data Warehouse 1.30.19
 
Leveraging the cloud for analytics and machine learning 1.29.19
Leveraging the cloud for analytics and machine learning 1.29.19Leveraging the cloud for analytics and machine learning 1.29.19
Leveraging the cloud for analytics and machine learning 1.29.19
 
Modernizing the Legacy Data Warehouse – What, Why, and How 1.23.19
Modernizing the Legacy Data Warehouse – What, Why, and How 1.23.19Modernizing the Legacy Data Warehouse – What, Why, and How 1.23.19
Modernizing the Legacy Data Warehouse – What, Why, and How 1.23.19
 
Leveraging the Cloud for Big Data Analytics 12.11.18
Leveraging the Cloud for Big Data Analytics 12.11.18Leveraging the Cloud for Big Data Analytics 12.11.18
Leveraging the Cloud for Big Data Analytics 12.11.18
 
Modern Data Warehouse Fundamentals Part 3
Modern Data Warehouse Fundamentals Part 3Modern Data Warehouse Fundamentals Part 3
Modern Data Warehouse Fundamentals Part 3
 
Modern Data Warehouse Fundamentals Part 2
Modern Data Warehouse Fundamentals Part 2Modern Data Warehouse Fundamentals Part 2
Modern Data Warehouse Fundamentals Part 2
 
Modern Data Warehouse Fundamentals Part 1
Modern Data Warehouse Fundamentals Part 1Modern Data Warehouse Fundamentals Part 1
Modern Data Warehouse Fundamentals Part 1
 
Extending Cloudera SDX beyond the Platform
Extending Cloudera SDX beyond the PlatformExtending Cloudera SDX beyond the Platform
Extending Cloudera SDX beyond the Platform
 
Federated Learning: ML with Privacy on the Edge 11.15.18
Federated Learning: ML with Privacy on the Edge 11.15.18Federated Learning: ML with Privacy on the Edge 11.15.18
Federated Learning: ML with Privacy on the Edge 11.15.18
 
Analyst Webinar: Doing a 180 on Customer 360
Analyst Webinar: Doing a 180 on Customer 360Analyst Webinar: Doing a 180 on Customer 360
Analyst Webinar: Doing a 180 on Customer 360
 
Build a modern platform for anti-money laundering 9.19.18
Build a modern platform for anti-money laundering 9.19.18Build a modern platform for anti-money laundering 9.19.18
Build a modern platform for anti-money laundering 9.19.18
 
Introducing the data science sandbox as a service 8.30.18
Introducing the data science sandbox as a service 8.30.18Introducing the data science sandbox as a service 8.30.18
Introducing the data science sandbox as a service 8.30.18
 
Cloudera SDX
Cloudera SDXCloudera SDX
Cloudera SDX
 
Introducing Workload XM 8.7.18
Introducing Workload XM 8.7.18Introducing Workload XM 8.7.18
Introducing Workload XM 8.7.18
 
Get started with Cloudera's cyber solution
Get started with Cloudera's cyber solutionGet started with Cloudera's cyber solution
Get started with Cloudera's cyber solution
 
Spark and Deep Learning Frameworks at Scale 7.19.18
Spark and Deep Learning Frameworks at Scale 7.19.18Spark and Deep Learning Frameworks at Scale 7.19.18
Spark and Deep Learning Frameworks at Scale 7.19.18
 
Cloud Data Warehousing with Cloudera Altus 7.24.18
Cloud Data Warehousing with Cloudera Altus 7.24.18Cloud Data Warehousing with Cloudera Altus 7.24.18
Cloud Data Warehousing with Cloudera Altus 7.24.18
 
How Cloudera SDX can aid GDPR compliance
How Cloudera SDX can aid GDPR complianceHow Cloudera SDX can aid GDPR compliance
How Cloudera SDX can aid GDPR compliance
 
When SAP alone is not enough
When SAP alone is not enoughWhen SAP alone is not enough
When SAP alone is not enough
 

Recently uploaded

%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...
%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...
%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...
masabamasaba
 
%+27788225528 love spells in Atlanta Psychic Readings, Attraction spells,Brin...
%+27788225528 love spells in Atlanta Psychic Readings, Attraction spells,Brin...%+27788225528 love spells in Atlanta Psychic Readings, Attraction spells,Brin...
%+27788225528 love spells in Atlanta Psychic Readings, Attraction spells,Brin...
masabamasaba
 
AI Mastery 201: Elevating Your Workflow with Advanced LLM Techniques
AI Mastery 201: Elevating Your Workflow with Advanced LLM TechniquesAI Mastery 201: Elevating Your Workflow with Advanced LLM Techniques
AI Mastery 201: Elevating Your Workflow with Advanced LLM Techniques
VictorSzoltysek
 
The title is not connected to what is inside
The title is not connected to what is insideThe title is not connected to what is inside
The title is not connected to what is inside
shinachiaurasa2
 
TECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service providerTECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service provider
mohitmore19
 

Recently uploaded (20)

%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...
%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...
%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...
 
%+27788225528 love spells in Atlanta Psychic Readings, Attraction spells,Brin...
%+27788225528 love spells in Atlanta Psychic Readings, Attraction spells,Brin...%+27788225528 love spells in Atlanta Psychic Readings, Attraction spells,Brin...
%+27788225528 love spells in Atlanta Psychic Readings, Attraction spells,Brin...
 
AI Mastery 201: Elevating Your Workflow with Advanced LLM Techniques
AI Mastery 201: Elevating Your Workflow with Advanced LLM TechniquesAI Mastery 201: Elevating Your Workflow with Advanced LLM Techniques
AI Mastery 201: Elevating Your Workflow with Advanced LLM Techniques
 
%in Hazyview+277-882-255-28 abortion pills for sale in Hazyview
%in Hazyview+277-882-255-28 abortion pills for sale in Hazyview%in Hazyview+277-882-255-28 abortion pills for sale in Hazyview
%in Hazyview+277-882-255-28 abortion pills for sale in Hazyview
 
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdfThe Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
 
AI & Machine Learning Presentation Template
AI & Machine Learning Presentation TemplateAI & Machine Learning Presentation Template
AI & Machine Learning Presentation Template
 
8257 interfacing 2 in microprocessor for btech students
8257 interfacing 2 in microprocessor for btech students8257 interfacing 2 in microprocessor for btech students
8257 interfacing 2 in microprocessor for btech students
 
10 Trends Likely to Shape Enterprise Technology in 2024
10 Trends Likely to Shape Enterprise Technology in 202410 Trends Likely to Shape Enterprise Technology in 2024
10 Trends Likely to Shape Enterprise Technology in 2024
 
Right Money Management App For Your Financial Goals
Right Money Management App For Your Financial GoalsRight Money Management App For Your Financial Goals
Right Money Management App For Your Financial Goals
 
The title is not connected to what is inside
The title is not connected to what is insideThe title is not connected to what is inside
The title is not connected to what is inside
 
Microsoft AI Transformation Partner Playbook.pdf
Microsoft AI Transformation Partner Playbook.pdfMicrosoft AI Transformation Partner Playbook.pdf
Microsoft AI Transformation Partner Playbook.pdf
 
VTU technical seminar 8Th Sem on Scikit-learn
VTU technical seminar 8Th Sem on Scikit-learnVTU technical seminar 8Th Sem on Scikit-learn
VTU technical seminar 8Th Sem on Scikit-learn
 
%in Midrand+277-882-255-28 abortion pills for sale in midrand
%in Midrand+277-882-255-28 abortion pills for sale in midrand%in Midrand+277-882-255-28 abortion pills for sale in midrand
%in Midrand+277-882-255-28 abortion pills for sale in midrand
 
%in Harare+277-882-255-28 abortion pills for sale in Harare
%in Harare+277-882-255-28 abortion pills for sale in Harare%in Harare+277-882-255-28 abortion pills for sale in Harare
%in Harare+277-882-255-28 abortion pills for sale in Harare
 
Define the academic and professional writing..pdf
Define the academic and professional writing..pdfDefine the academic and professional writing..pdf
Define the academic and professional writing..pdf
 
%in kempton park+277-882-255-28 abortion pills for sale in kempton park
%in kempton park+277-882-255-28 abortion pills for sale in kempton park %in kempton park+277-882-255-28 abortion pills for sale in kempton park
%in kempton park+277-882-255-28 abortion pills for sale in kempton park
 
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
 
Crypto Cloud Review - How To Earn Up To $500 Per DAY Of Bitcoin 100% On AutoP...
Crypto Cloud Review - How To Earn Up To $500 Per DAY Of Bitcoin 100% On AutoP...Crypto Cloud Review - How To Earn Up To $500 Per DAY Of Bitcoin 100% On AutoP...
Crypto Cloud Review - How To Earn Up To $500 Per DAY Of Bitcoin 100% On AutoP...
 
TECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service providerTECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service provider
 
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
 

MiFiD II Best Execution Compliance with Cloudera and TickSmith

  • 1. 1© Cloudera, Inc. All rights reserved. MiFiD II Best Execution Compliance with Cloudera and TickSmith Francis Wenzel CEO, TickSmith @TickSmith Richard Harmon FS Director, Cloudera @ClouderaUK
  • 2. 2© Cloudera, Inc. All rights reserved. Our relationship with data is changing
  • 3. 3© Cloudera, Inc. All rights reserved. Boardroom thinking DRIVE CUSTOMER INSIGHTS IMPROVE PRODUCT & SERVICES EFFICIENCY LOWER BUSINESS RISK
  • 4. 4© Cloudera, Inc. All rights reserved. Boardroom thinking DRIVE CUSTOMER INSIGHTS IMPROVE PRODUCT & SERVICES EFFICIENCY LOWER BUSINESS RISK MODERNIZE ARCHITECTURE
  • 5. 5© Cloudera, Inc. All rights reserved. Areas Affecting Business Risks CYBERSECURITY FRAUD COMPLIANCE • Insider threat • Advanced persistent threats • Account takeovers • Anti Money Laundering (AML) • Payments fraud • Insider threats • Regulatory compliance (PCI, HIPPA, Dodd-Frank) • Internal compliance • External & internal audits
  • 6. 6© Cloudera, Inc. All rights reserved. Areas Affecting Business Risks CYBERSECURITY FRAUD COMPLIANCE • Insider threat • Advanced persistent threats • Account takeovers • Anti Money Laundering (AML) • Payments fraud • Insider threats • Regulatory compliance (PCI, HIPPA, Dodd-Frank) • Internal compliance • External & internal audits
  • 7. 7© Cloudera, Inc. All rights reserved. Our Customers Include Over 180 financial companies (banking, capital markets, insurance) 19 of the top 30 global systematically important banks (G-SIBs) 5 of the top 6 asset management firms 2 of the top 3 multi-national payment processing firms 3 of the top 5 Fortune 500 insurance companies (p&c and life)
  • 8. 8© Cloudera, Inc. All rights reserved. Regulatory Compliance & MiFID II
  • 9. 9© Cloudera, Inc. All rights reserved. Comprehensive Regulatory Compliance-Key Drivers and Objectives Drive Efficiencies Reduce Risk of Non-Compliance Reduce Time to Compliance • Unify data governance across lines of business • Scale data volume and processing cost-effectively • Improve data quality • Use all available current and historical data to improve accuracy • Apply machine learning • Use advanced analytics for better controls, including proactive and predictive • Break silos so that reporting can be performed seamlessly, on one data hub • Flexible/adaptable platform • Automate e-discovery • Automate data lineage tracking Unified Data Platform Supports a Comprehensive Compliance Framework
  • 10. 10© Cloudera, Inc. All rights reserved. Cloudera: Managing Data for Comprehensive Regulatory Compliance Handle real-time data ingest from diverse sources Governance and Security Data Streams Deployment Flexibility Machine Learning Capabilities Diverse Analytical Options Combine Data from Different Sources Data Mgmt. Hub Scale easily & cost effectively Batch or Real- time Data Streams Data Sources A comprehensive data management platform to support more accurate and efficient compliance Data Sources Data Storage & Processing Reporting, Analytics & Auditing Data Ingest Other Data Governance (Data Lineage, Data Protection, Data Lifecycle Management) MiFID II, FRTB, IFRS-9, BCBS-239, MAD/MAR, GDPR, ….
  • 11. 11© Cloudera, Inc. All rights reserved. MiFID II – Markets in Financial Instruments Directive Investor Protection Transparency Transaction Reporting Micro- Structural Issues Data Publication & Access Commodity Derivatives Market Infrastructure Governance Authorization, Branches & Passporting MiFID II / MiFIR Trading & Clearing Four Objectives for MiFID II 1. To strengthen investor protection 2. To reduce the risks of a disorderly market 3. To reduce systemic risks 4. To increase the efficiency of financial markets and reduce unnecessary costs for market participants. Active: January 3, 2018
  • 12. 12© Cloudera, Inc. All rights reserved. MiFID II – Data Governance & IT Infrastructure Challenges Best Execution Validation
  • 13. 13© Cloudera, Inc. All rights reserved. MiFID II: New Requirements for Best Execution Best Execution standards are being enhanced & expanded ⎻ These changes are designed to protect investor interests. ⎻ They require both buy-side and sell-side firms to document, monitor and demonstrate best execution based on quantitative and qualitative metrics – such as price, cost, speed, size, likelihood of execution, settlement, size and nature of the trade. • Firms are required to explain their execution policies in sufficient detail to allow clients to easily understand how orders will be executed; • Firms are required to disclose the top five execution venues used on an annual basis; • Firms are to disclose on at least an annual basis the quality of execution; • ESMA has upgraded the obligation to achieve the best execution result from an obligation to use "all reasonable steps" to a more stringent requirement to take “all sufficient steps”.
  • 14. 14© Cloudera, Inc. All rights reserved. RTS-27: Best Execution Requirements For Execution Venues RTS-27: Regulatory Technical Standards (Execution Venues) ⎻ Coverage: Applies to all trading venues, systematic internalisers, market makers, or other liquidity providers. ⎻ Cost Disclosures: Requires full disclosure of all order execution charges ⎻ Execution Likelihood: Requires metrics to be created to assess the likelihood of execution of a specific financial instrument on a specific venue. ⎻ Execution Comparison: Requires order execution comparisons to be sized ranged based upon the type of financial instrument and its liquidity to ensure an adequate sample of executions in a size that is typical in that instrument. ⎻ Public Data Access: Requires trading venues to enable public website access for all provided data
  • 15. 15© Cloudera, Inc. All rights reserved. RTS-28: Best Execution Requirements for Investment Firms RTS-28: Regulatory Technical Standards (Investment Firms) ⎻ Data will need to be captured at each transaction/order level, such as the percentage of passive/aggressive/directed orders; which will need to be stored for future recall if necessary. ⎻ The data must then be mapped and attached to every order for reporting purposes. ⎻ To maintain the data’s accuracy and reliability, consistent management and control will also be required. ⎻ This controlled data can then be fed into various post-trade feeds for allocations, confirmations, affirmations and surveillance or global order and risk monitoring.
  • 16. 16© Cloudera, Inc. All rights reserved. MiFID II’s Best Execution Related Data & Technology Challenges ⎻ Extensive benchmark data across all relevant markets must be sourced, stored and accessible. ⎻ Where benchmark data is not available, firms will need to devise proxy methodologies to compute the required best execution metrics. ⎻ Many firms will need to modify & enhance their data feeds and coded “best execution” logic in their trade capture systems and market data sources. ⎻ Agile Big Data solutions will be required to process, store and analyze the vast amounts of benchmark and proxy data required for “best execution”.
  • 17. © TickSmith Corp. All rights reserved. Leveraging “big data” To solve this big data problem: MiFID II RTS 27 & RTS 28 You need proven big data technology: And an award winning solution:
  • 18. © TickSmith Corp. All rights reserved. TickVault Big data problem MiFID II RTS 27 RTS 28 Proven big data technology Award winning innovative solution
  • 19. © TickSmith Corp. All rights reserved. Introducing TickVault TickVault: Hadoop-based big data management platform for capital markets TickVault is a complete software application built on a modular architecture Accumulate/transform/analyse/disseminate Terabytes and Petabytes of financial data Used by trading and risk groups, regulators, exchanges and data vendors Ideal for compliance and trading Complete workflow from data centralization to delivery with entitlements and standard access tools Abstracts the complexities of big data technology into a ready to use platform
  • 20. © TickSmith Corp. All rights reserved. TickVault Deployment ● In-house, on client hardware and Hadoop cluster ● On client’s cloud infrastructure ● Capacity driven by infrastructure and supports Terabytes to multi-Petabytes TickVault is a Cloudera Certified Technology that supports CDH 4.7, 5.2, 5.3, 5.4, 5.7, 5.8
  • 21. © TickSmith Corp. All rights reserved. TickVault for data producing firms Exchanges & data vendors ● Centralize & normalize ● All trade & quote data ● All asset classes and + ● Analyze & enrich ● Reconstruct & report ● Interact & distribute https://nasdaq-cx.ticksmith.com https://datamine.cmegroup.com https://trdata.tickvault.com
  • 22. © TickSmith Corp. All rights reserved. TickVault for data consuming firms Systematic trading groups, market makers, regulators and compliance ● Accumulate & centralize ○ Data from quote feeds, trading systems, event feeds, etc. ○ All asset classes, depths and data types ○ Up to nanosecond resolution ○ Supports multiple timestamps ● Normalize, combine, analyze, reconcile ● Rebuild point in time market depth ● Provide time series & reports ● Interact & integrate with in-house apps National Bank of Canada case study at https://aws.amazon.com/solutions/case-studies/national-bank-of-canada/
  • 23. © TickSmith Corp. All rights reserved. TickVault modules 3 4 5 6 7 21 Complete software platform 1. Load all exchange, trade and other data from exchange feeds, network appliances, (Corvil, Solace, Exegy, etc.), aggregators, OMS, order routers, FIX engines, trade venues, etc. 1. Connect directly to your data on local and cloud storage (SAN, NAS, file servers, S3…). 1. Retain original data. Normalize through time and across sources. 1. Create combined and derived datasets. Turn data into time-series. Run analytics, create reports and statistics. Reconstruct market activity and market depth. 1. Entitle and control data and features access to users and systems. Interface with existing billing system. 1. Provide data via easy to use web interfaces and Rest APIs. 1. Monitor and manage all tasks and processes.
  • 24. © TickSmith Corp. All rights reserved. Addressing MiFID requirements TickVault is able to store, normalize, and run calculations on terabytes to multi-petabytes of financial data as required for MiFID II compliance. Leveraging Hadoop, it provides a future-proof to address: RTS 27/28 best execution reports Public portal for data queries File inventory centralization (RTS1, 2, 6, 22, 23 & 24) Timestamp validation of accumulated data
  • 25. © TickSmith Corp. All rights reserved. TickVault’s RTS-27 Solution Takes book by order data from trading venues and automatically generates best execution tables for MiFID II RTS 27 data retention and publication. Reports are organized by TickVault’s internal custom search and statistics engine. TickVault also provides alerts on specific unfilled table fields that may require ad hoc descriptions to be inputted. TickVault is able to automatically generate tables 1, 2, 3, 4, 6, 7, 8 and 9 given the following trading venue data: Financial instrument directory System event information (halts, suspensions, outages, failed transactions) Book by order for all price levels including number of market makers and specific types of orders All timestamped execution information of every financial instrument
  • 26. © TickSmith Corp. All rights reserved. TickVault’s RTS-27 Solution Custom Search displays Top of Book HITS or Rollups (one second/minute time intervals) for each queried financial instrument which can be exported as a csv file. The export button can also produce RTS-27 tables. Statistics page displays calculated information for each queried financial instrument including, but not limited to: ● Daily VWAPs ● OHLC ● Trading Value ● Number of Passive/Aggressive Orders ● Mean time elapsed between order acceptance and execution ● Number of suspensions ● Average Spread at Best Bid and Offer Statistics information can be exported as a csv file and RTS 27 tables.
  • 27. © TickSmith Corp. All rights reserved. TickVault’s RTS-27 Solution Custom Search page Top of Book interface and charting available trading venue data Book by Order interface from trading venue data Statistics page
  • 28. © TickSmith Corp. All rights reserved. TickVault’s RTS-27 Solution TickVault Generated machine-readable Table 6 for an example trading venue and financial instrument TickVault Generated machine-readable Table 7 for an example trading venue and financial instrument
  • 29. © TickSmith Corp. All rights reserved. TickVault’s RTS-28 Solution Whenever a client investment firm executes an order, TickVault logs all relevant best execution information for that order and organizes it for reporting requirements. Tables 1, 2, and 3 can be automatically generated. Investment firm can add notes and descriptions in trade analysis report in the case of irregular executions. TickVault contains an Access and Identity Management module which manages user authentication and access to private data. The investment firm’s execution statistics can be exported into a csv file.
  • 30. © TickSmith Corp. All rights reserved. TickVault’s RTS-28 Solution Private data portal TickVault Generated machine-readable Table 2
  • 31. © TickSmith Corp. All rights reserved. Beyond compliance Usable data is valuable data. Using TickVault with Cloudera CDH allows your firm to leverage existing Hadoop clusters and provides an ideal solution to organize and exploit trading and market data on Hadoop. Example of machine learning application using data from TickVault In addition to its specialized tools and interfaces, TickVault’s easy to use APIS provide in-house developers and applications access to data and analytics for: ● Back-testing ● Quantitative research ● RISK data management ● Compliance ● Financial econometrics ● Machine learning and algorithmic models.
  • 32. 32© Cloudera, Inc. All rights reserved. Thank you Francis Wenzel CEO, TickSmith @wenzelware Richard Harmon FS Director, Cloudera @ClouderaUK

Editor's Notes

  1. What once was a cost to be managed is now a source of competitive advantage and new revenue streams. Organizations are actively working to gather more data by instrumenting applications, platforms, and physical devices to create more of it and storing it for a longer time horizon– in order to drive this advantage. Data is now a strategic asset, and you need a strategy for it.
  2. Translating it to a boardroom level, there are a number of initiatives that this wealth of data is very well suited to. Data drives business value in for these, tremendous value. The three areas of opportunities within businesses generally are: Customer and Channel – How do I build a 360 picture of my customer to deliver new revenue streams? Data-Driven Products – How can I build better data-driven products and services, at lower cost? Security, Risk, and Compliance – How do meet compliance regulations and preserve data security to minimize our corporate risk profile? So let’s look at each of these in turn
  3. All of these initiatives have one thing in common: they need a different approach to dealing with data. A different scale on which is must be consumed, stored, analysed. Beyond current systems. It needs a modern data architecture as well as strategy
  4. When we think of business risks, there are many areas that affect business risks. Some of the key areas are cybersecurity, fraud and compliance. Identifying cybersecurity risk, preventing fraud and meeting compliance requirements help mitigate risks within the organization.
  5. When we think of business risks, there are many areas that affect business risks. Some of the key areas are cybersecurity, fraud and compliance. Identifying cybersecurity risk, preventing fraud and meeting compliance requirements help mitigate risks within the organization.
  6. In insurance our customers include global multi-line insurers (offering p&c – personal & commercial lines, life, asset/wealth management coverage), general insurers (p&c – personal & commercial lines) and life insurers Why? Because we give business a single place for unlimited data and unified access through Apache Hadoop. We make Hadoop Fast for business Easy to manage and audit Secure without compromise Not just as Cloudera yet through our vast eco system of partners. We now have more than 2500 partners. Application partners. Platform partners. A safe pair of hands to deliver solutions and let you realise business value fast.
  7. We need a data platform in support of a comprehensive regulatory compliance framework