Hadoop's Impact on the Future of Data Management | Amr Awadallah
•
4 likes•4,793 views
Speaker: Amr Awadallah As Hadoop and the surrounding projects & vendors mature, their impact on the data management sector is growing. Amr will talk about his views on how that impact will change over the next five years. How central will Hadoop be to the data center of 2020? What industries will benefit most? Which technologies are at risk of displacement or encroachment?
Recommended
More Related Content
Viewers also liked
Viewers also liked (20)
Similar to Hadoop's Impact on the Future of Data Management | Amr Awadallah
Similar to Hadoop's Impact on the Future of Data Management | Amr Awadallah (20)
More from Cloudera, Inc.
More from Cloudera, Inc. (20)
Recently uploaded
Recently uploaded (20)
Hadoop's Impact on the Future of Data Management | Amr Awadallah
- 1. 1© Cloudera, Inc. All rights reserved. Hadoop's Impact on the Future of Data Management Strata+Hadoop World — San Jose 2015 Amr @Awadallah Chief Technology Officer, Cofounder
- 2. 2© Cloudera, Inc. All rights reserved.
- 3. 3© Cloudera, Inc. All rights reserved. Fact: Hadoop Isn’t Just Hadoop Anymore The stack is continually evolving and growing! 2006 2008 2009 2010 2011 2012 Present Core Hadoop (HDFS, MR) HBase ZooKeeper Core Hadoop Hive Pig Mahout HBase ZooKeeper Core Hadoop Sqoop Whirr Avro Hive Pig Mahout HBase ZooKeeper Core Hadoop Flume Bigtop Oozie MRUnit HCatalog Sqoop Whirr Avro Hive Pig Mahout HBase ZooKeeper Spark Impala Solr Kafka Flume Bigtop Oozie MRUnit HCatalog Sqoop Whirr Avro Hive Pig Mahout HBase ZooKeeper Parquet Sentry Spark Impala Solr Kafka Flume Bigtop Oozie MRUnit HCatalog Sqoop Whirr Avro Hive Pig Mahout HBase ZooKeeper Core Hadoop +YARN Core Hadoop +YARN Core Hadoop +YARN
- 4. 4© Cloudera, Inc. All rights reserved. Security and Administration Unlimited Storage Process Discover Model Serve Deployment Flexibility On-Premise Appliances Engineered Systems Public Cloud Private Cloud Hybrid Cloud The Enterprise Data Hub: • One place for unlimited multi-type data • Unified, multi-framework data access Going production requires: • Enterprise Security • Data Governance • Complete Management • And more…
- 5. 5© Cloudera, Inc. All rights reserved. WEB/MOBILE APPLICATION ENTERPRISE DATA WAREHOUSE ENTERPRISE REPORTINGBI / ANALYTICSDATA MODELINGDEVELOPER SDKs CLOUDERA MANAGER CLOUDERA NAVIGATOR ENTERPRISE DATA HUB Security Admins System Admins Engineers Data Scientists Analysts Business Users Customers & End Users SYS LOGS WEB LOGS FILES RDBMS The Modern Information Architecture
- 6. 6© Cloudera, Inc. All rights reserved.
- 7. 7© Cloudera, Inc. All rights reserved.
- 8. 8© Cloudera, Inc. All rights reserved. Many Thanks to the Apache Software Foundation
- 9. 9© Cloudera, Inc. All rights reserved. Thank you!
Editor's Notes
- Keynote flow Not just about Hadoop (Hadoop + ecosystem) Defining in the future is about picking best of breed Foundation Not just an add on feature of existing architecture, it’s a central part of it Community All about Apache & community driven innovation Donation to ASF
- Hadoop! Love that little yellow elephant
- But there’s a whole lot more than just core Hadoop these days Look at what we’ve accomplished – together Kafka support now
- Year 5: EDH Short EDH pitch From projects to platform This year: Platform to foundation.
- What does the architecture look like?
- As the architecture becomes the norm, it must constantly adapt. We must optimize the workloads that run in the platform, removing barriers to customer adoption.
- Cask. We must make it as easy as possible for developers to quickly and easily build robust big data applications on the data hub.
- I am pleased to share that this morning Cloudera made a $300,000 contribution to the Apache Software Foundation as a Platinum member. We believe that the core governing principles of ASF supporting true open source innovation across individual and corporate contributors is important to the success of Hadoop and its future. We were recently offered the opportunity to invest the same amount alongside a number of vendors with the intent of driving standards. We feel such vendor driven initiatives run counter to the goals of the Apache Software Foundation and its Community.
- San Jose Technology to foundation, maturity, broad adoption Grow in all directions Thanks for coming this far Next phase! Enjoy the week, and have a great conference!