How AI, OpenAI, and ChatGPT impact business and software.
Openshift 3.10 & Container solutions for Blockchain, IoT and Data Science
1. John Archer
Senior Openshift Solution Architect
joarcher@redhat.com
What’s New in Red Hat
OpenShift Container Platform 3.10
&
Emerging Container Solutions:
Blockchain, IoT, Data Science
2. Aug 2nd - RHUG Agenda
● Get a Beer - Try the Ranga - Excellent Red!
● Who’s new
● Looking for a gig?
● Meet the F5 and Red Hat Teams
● Automating F5 BIG-IP with Ansible
● Why yes I’ll have a beer - maybe the Box Kick IPA
● Openshift 3.10 - Update Highlights
○ Blockchain
○ IoT
○ Data Science
● Questions
3. ● 700+ attendees (100% YoY growth)
● 385+ OpenShift Commons Members (40%
YoY growth)
● BP Joined
● 21+ OpenShift Customer presentations and
Panel discussions:
● Amadeus, Barclays, Bank of Montreal
● Daimler, Paychex, Cisco
● Florida Blue, UPS, DHL
● Banking on OpenShift Panel
● What’s Next Panel
● Roadmap AMA Panel
OPENSHIFT COMMONS 2018 AT-A-GLANCE
OpenShift Commons Gathering (Videos) - https://www.youtube.com/playlist?list=PLaR6Rq6Z4IqcTSloODnFwdIn2XjNa72JJ
Join OpenShift Commons here - https://commons.openshift.org#join
4. OPENSHIFT + CoreOS UNIFIED PLATFORM
Developer Productivity
Build Automation, Image
Streams, CI/CD
Kubernetes
Red Hat Enterprise Linux or Red Hat CoreOS
Automated
Operations
Hybrid Cloud
App
Monitoring
Infra
Monitoring
Service Cat/Operators
etcd, Prometheus, Red
Hat Middleware, ISVs
Cluster Services
Metering/Chargeback,
Metrics, Logging, Registry
CaaS PaaSBest Operator Experience Best Developer Experience
Operator Lifecycle Manager
Ops & Dev Consoles
Install / Upgrade
Security / Auth
Network / CNI
Storage / CSI
5. ENHANCING OPENSHIFT WITH COREOS TECTONIC
& QUAY CONTAINER REGISTRY
CoreOS Tectonic
● Fully integrated and merged with OpenShift
● Adds automated operations and day 2 management
(install, upgrades, monitoring, metering and chargeback)
● Best-in-class support for CaaS/KaaS/PaaS use cases
CoreOS Container Linux
● Red Hat CoreOS inspired by Container Linux &
RHEL/Atomic
● Fully immutable, container optimized, automatically
updated Linux host foundation for OpenShift
CoreOS Quay Registry
● Enterprise container registry; self managed & as-a-service
● Premium offering usable standalone or with OpenShift
● Geo-replication, vulnerability scanning, build automation
ETCD PROMETHEUS
METERING &
CHARGEBACK
RED HAT QUAY REGISTRY
RED HAT COREOS
PLATFORM OPERATOR - AUTOMATED OPS
APPLICATION OPERATORS - SELF-DRIVING APPS
6. 6
- Minimal Linux distribution
- Optimized for running containers
- Decreased attack surface
- Over-the-air automated updates
- Ignition-based Metal and Cloud
host configuration
- Deployment option for OpenShift
DELIVERING IMMUTABLE INFRASTRUCTURE
WITH RED HAT CoreOS
Red Hat Summit Video
Red Hat CoreOS FAQ
7. 7
INTRODUCING THE OPERATOR FRAMEWORK
● Kubernetes-native Day1 and Day2
deployment and operations of Apps
● Simplify Kubernetes upgrades
● Deploy Apps as “Self-Driving”
● Consistent App Deploy/Ops on
Kubernetes on Any Cloud
● Fully Open Source
Operator Framework Deep Dive - OpenShift Commons Briefing - https://youtu.be/oLAfCKM7RbA
8. 8
AUTOMATING DAY 2 OPERATIONS
OF CONTAINER APPLICATIONS
CONTAINER OPERATORS
Encapsulate and automate operational
knowledge and actions with application
services.
OPERATOR FRAMEWORK
An open source toolkit to manage
application instances on Kubernetes in an
effective, automated and scalable way.
https://github.com/operator-framework
Operator SDK
Operator
Lifecycle
Management
Operator
Metering
9. 9
● ISTIO available on OpenShift Container Platform
● RHOAR Launcher will provision ISTIO code samples
○ Spring Boot, WildFly Swarm @Summit; Node.js, Eclipse Vert.x to follow
● Simplifies microservices development for enterprise developers
○ Infrastructure services embedded into container platform
○ More focus on business logic, less infrastructure code
○ Improved security, robustness, and observability with little to no coding
RELEASING AS DEVELOPER PREVIEW AT SUMMIT - GA EOY or early next year
INTRODUCING SERVICE MESH:
ISTIO in OpenShift
10. 10
INTRODUCING SERVERLESS:
OPENSHIFT CLOUD FUNCTIONS
● Industry’s first enterprise grade, Hybrid Serverless offering
● Runs on OpenShift - based on Apache OpenWhisk
● Mature, battle-tested technology - IBM and Adobe already running OpenWhisk at
scale
● Initial RHOAR supported runtimes:
○ Java, Python and Node.js
● Event Sources:
○ In-memory Data Grid, Storage (Gluster), Messaging (AMQ), HTTP, GitHub, etc.
● Dev tool support with Che / OpenShift.io
RELEASING AS DEVELOPER PREVIEW AT SUMMIT - WATCH THE VIDEO
11. 11
INTRODUCING
CONTAINER-NATIVE VIRTUALIZATION
Technology enabling OpenShift Container Platform as a unified platform for building,
modifying, and deploying applications residing in both containers and virtual machines in a
common, shared environment.
Use Kubernetes to orchestrate both application containers and VM containers on the same
container platform (OpenShift). CNV is based on RHEL (KVM) virtualization capabilities.
Keynote Demo: https://youtu.be/r8e4bT0-zhU?t=45m30s
Based on the KubeVirt project: http://www.kubevirt.io/
12. Feature: Podman is now available as a
technology preview.
Description: A daemon-less CLI/API for
running, managing, and debugging OCI
containers and pods
● Fast and lightweight
● Leverages runC
● Provides a “docker-like” syntax for
working with containers
● Remote management API via Varlink
● Provides systemd integration and
advanced namespace isolation
Podman Tech Preview
kernel
13. RED HAT SUMMIT 2018 - RESOURCES
Red Hat Summit Videos: Keynotes and Breakouts
Red Hat Summit Keynote Demos: Container-Native Virt, OpenShift on Azure, Serverless (OpenWhisk),
OpenShift Commons Gathering: All Videos
Must See Videos
● RHEL and Red Hat CoreOS (Roadmap) - https://www.youtube.com/watch?v=LJOm4JbF4eQ
● OpenShift Roadmap - https://www.youtube.com/watch?v=1AelNjx6BB4
● Kubernetes & the future platform - https://www.youtube.com/watch?v=YAFKlOB8vBw
● OpenShift & Service Mesh (Istio) - https://www.youtube.com/watch?v=iGLPk-Rm62E
● OpenShift & Serverless (OpenWhisk) - https://www.youtube.com/watch?v=C2u6wVRI-N0
● OpenShift for Operations - https://www.youtube.com/watch?v=nBXALsqs1RA
● Building Production-ready Containers - https://www.youtube.com/watch?v=nizud-1IK9c
● OpenShift & Tensorflow (Machine Learning) - https://www.youtube.com/watch?v=YJzp4iOqLEo
● Red Hat’s AI Strategy - https://www.youtube.com/watch?v=1hUA31uzUzg
14. OCP 3.10 - The Efficient Cluster
● Resource Management
● Descheduler (tech preview), CPU Manager, Ephemeral Storage,
HugePages
● Resilience
● Node Problem Detector, HA egress pods with DNS
● Workload Diversity
● Device Manager, Windows Containers (dev preview)
● Installation Automation
● TLS node bootstrapping, static pods
● Security
● Etcd cipher coverage, Shared PID namespace options, more secured
router
18. 18
● HyperLedger Fabric
● JPMC Quorum
● Ripple
● R3 Corda
● Lightning Network
● BlockApps Strato
● Red Hat Middleware
○ Fuse - Ethereum SDK adapter
○ Process Activity Management (PAM) - BPM Activity
○ Openshift Runtime - Vert.X
RHT Activity in the Blockchain Marketplace
19. 19
BLOCKCHAIN HELPFUL CONCEPTS
“ISN’T IT JUST A DATABASE?”
One can follow the following conceptual path:
1. Centralized database
2. Replicated database
3. Distributed database
(Up to now, all under the control of one entity.)
4. Distributed ledger / blockchains
(Under the control of multiple entities)
https://medium.com/@sbmeunier/blockchain-technology-a-very-special-kind-of-distributed-database-e63d00781118
20. 20
● A node application: code that runs on the nodes
● A client-facing application: GUI, CLI, RPC
● A peer-to-peer networking system: to connect the nodes into one network
● A data structure: to organise the data on the ledger/chain
● A messaging (gossiping) system: to send the updates to the network
● A storage system: to store transactions and/or blocks on the nodes
● A consensus system: to choose the node in the network in charge of creating the next block
● A virtual machine: to execute “smart” “contracts”
● A way to define the blockchain’s governance (built-in? external?)
WHAT’S IN A BLOCKCHAIN
Necessary bits
21. INSERT DESIGNATOR, IF NEEDED
THE ENTERPRISE IT STACK IN 2025?
21
HYBRID CLOUD
DATABASES
MIDDLEWARE
APPLICATIONS
SMART CONTRACTS
DISTRIBUTED LEDGER(S)
AI/ML
IT OPERATIONS
IDENTITY
ACCOUNTING
BLOCKCHAINS AND DLTs AS A DEFAULT COMPONENT
22. BlockApps – Confidential
Enterprise Blockchain Platform Key Differentiators
Data Containers
& Storage
(esp. cloud)
Blockchain
Application
Platform
Enterprise
Applications
Use Case /
Verticals
STRATO Blockchain Platform
Enterprise Resource
Planning (ERP)
Supply Chain
Management
Workflow
Management
Enterprise
Performance
Management
Banking Logistics Energy Government
Financial Services Transportation Insurance Agriculture
STRATO
VM
STRATO
Sync
STRATO
DB
STRATO
Transaction
API
STRATO
Query API
STRATO Key
and Smart
Contract API
REST API approach simplifies
enterprise application development
and hides complexity from
developers
Cloud agnostic for enterprise
flexibility, enabling our clients to
remain with their favorite cloud
provider
Enterprise-friendly licensing geared
to allow worry free use and
extensibility needed for enterprises
1
2
3
BlockApps Stack - STRATO
22
Red Hat OpenShift Container Platform
24. The cost of
Non-Productive Time pe
asset during drill to
completion is $500K -
$1M per day, and post
completion is
$40K-$300K per day on
average
Prioritizing Upstream Use Cases
25. Addressing End-to-End Enterprise IoT needs
Data Management & Analytics
● Enterprise Data Mgmt.
● Persistent Data Storage
● Big Data Processing & Analytics
● Real-Time Analytics
● Machine Learning
● Data Security & Compliance
Operational Technology (OT)
● Device Management
● Industrial protocols
● OT Middleware
● Intelligent gateways
● MQTT co-inventors
● OT security
Information Technology (IT)
● Messaging & Integration
● Business Rules & CEP
● Open Hybrid
Platform-as-a-Service
● Enterprise Linux Platform
● IT security
Enterprise IoT open source community
Operational Technology (OT) Information Technology (IT)
26. 26
Red Hat and Open Source for IoT
Our open source solutions
• Free you from proprietary lock-in and cost
escalation
• Capture community innovation
• Provide the enterprise-level security,
reliability, scalability and support required by
the IoT
• Bring the internet of things to life quickly,
cost-effectively, and with lower risk.
27. An End-to-End Open Source Architecture for IoT
• Application lifecycle
management
• Integration services
• Self-service provisioning
• Hybrid cloud portability via
containers
Sensors,
Actuators,
Data Sources
Edge Processing
& Analytics
Data Integration, Routing,
Device Command/Control
Telemetry
Data
Telemetry
Data
Application
Data
Advanced Analytics
& Machine Learning
Application Development,
Deployment, Integration
• Device management,
security, and access control
• Data aggregation
• Event processing
• Integration services
• Device connectivity
• Data transformation
• Intelligent routing
• Business logic
• Edge analytics & real-time
decisions
• Data ingest
• Stream / batch processing
• Persistent data storage
• Machine learning and
real-time analytics
CDH
IoT
GATEWAYS
IoT
INTEGRATION HUB
CONNECTED
“THINGS”
ENTERPRISE
APPLICATIONS
28. Wells
Remote Monitoring and Alerting
Dashboard
“Things” IoT Gateways
Refineries
Pipelines
Assets
OneStream Data Science
Asset Predictive Maintenance
Production Optimization
Safety Assurance
Reliability Monitoring
On Premise and/or Public Cloud
Human Aided AI
Storage
MQTT
Partners
Multiple
Protocols
EdgeML
30. ● Real time bead size analysis
● Maximize production line utilization
● EdgeML with precision imagery
● Correlate environmental factors
○ Ambient and material humidity
○ Ambient and material temperature
○ Manufacturing settings
Polyethylene Bead Manufacturing
31. Artificial Lift ESP (Electrical Submersible Pumps)
● Motor Temperature
● Vibration
● Voltage
● Frequency
● Intake and Discharge pressures
● Downhole Pressure
● Monitor Flow Rates
● Cavitation
● % of Water, Oil, Sand, Mud
Predictive Maintenance and Monitoring
32. ● GeoSteering/Borehole Planned/Actual
● HSE Gas Detection
● Unconventional Field Planning
○ Asset Management
○ Long Term Planning
○ NPT Solver
Unconventional Field Optimization Use Cases
33. Business Optimizer33
Business Value
-15% Driving Time (Fuel and Driver savings)
-3% Reduction in Non Productive Time
Determine optimal sand density lbs/ft
Rules:
Direct to pad when needed
Storage availability 40/70/100
Redirect due to well site issue, weather or traffic
Increase sand while production volumes increase
Sand Delivery and Proppant Optimization
Execute deliveries and changes with more efficiency and NPV maximized
42. Benefits of using OpenShift for Jupyter
● More accessible to developers and non technical users
● Easier to create custom solutions for deploying Jupyter
● Can use JupyterHub for collaborators or education
● Run workloads other than just Jupyter notebooks
● Users controlled through quotas and limits on resources
● Share infrastructure with other users in your organization
● Open Source platform, with option for support from Red Hat
43. Data Science/ML/AI Resources
● GitHub - Openshift Notebooks
○ Jupyter Notebook on OCP https://github.com/jupyter-on-openshift
○ JupyterHub and JupyterLab on OCP
https://github.com/jupyter-on-openshift/jupyterhub-quickstart
○ Jupyter on Openshift https://www.jupyteronopenshift.org
● Articles - Jupyter-related on OpenShift
○ https://blog.openshift.com/tag/jupyter/
● Briefings - Machine Learning-related on OpenShift
○ https://blog.openshift.com/tag/machine-learning/
● Check out Red Hat’s Radanalytics.io Developers Portal
○ Empowering intelligent application development on the OpenShift platform
○ https://radanalytics.io/
● Join the OpenShift Commons Machine Learning Special Interest Group!
○ http://commons.openshift.org/sig/OpenshiftMachineLearning.html