Apache Kafka in industrial environments – OPC and shopfloor connectivity in manufacturing, Thorsten Weiler and Jonathan Malessa of inray Industriesoftware GmbH
Meetup link: https://www.meetup.com/Hamburg-Kafka/events/274363847/
4. 4
−Software based communication platform
−Lots of available plug-ins / connections
−Connecting shop floor and top floor systems
−Mature Software
• 15 years on the market
• Successfully proven in thousands of projects
−Free demo at www.opc-router.com
What it is & what it doe s
OPC Router
5. 5
Original Idea 15 Years agoWhe re it come s from
OPC Router
Field Systems
OPC Server
OPC Router HMI/SCADA/MESERP
OPC as de facto communication standard in automation
www.opc-router.com/what-is-opc-ua/#OPC-Server
6. 6
−Currently not so much present on Automation level
−Widely used in IT-/Office-environment
−IoT / Industry 4.0: IT/Office needs data from Shopfloor
• Predictive Maintenance / Condition Based Monitoring
• Production Cost (energy, raw material, water, scrap, etc.)
• Increase of Quality and Effectiveness
• Reduction of Cost and Equipment Downtime
• Order Information
• Compliance / Governmental Reporting
Ope n S ource S oftwa re for Ma na geme nt of Data S tre a ms
Apache Kafka
7. 7
P l u g-ins , modula r de s ign, inte r fa ce s
OPC Router
OPC Router
Databases:
MS SQL, MySQL,
Oracle, SAP HANA,
InfluxDB, MongoDB, etc.
SAP / ERP
OPC-Server
Charm EZ
Field Systems
Mail
Barcode Readers
PrintersExcel
Euromap 63/77
Telegram
IIoT (MQTT, REST)
JSON, XML/Xpath, .NET
RFID-AutoID
Apache Kafka
8. 8
OPC Router
How it wor ks
Templates & Instances
Transfer
Objects
Connections
Templates & Instances
Plug-ins
Triggers
10. −Standarized protocol to exchange
data between different
communcation partners
• Back then only on shopfloor
• Today also for secure
communication from shopfloor to
topfloor
−Client/Server architecture
Ope n Platfor m Commu n ication s
What is OPC?
Shopfloor
Topfloor
MES Big Data Cloud ERP Database
PLC, Controllers, Databases, HMI/SCADA-Systems
11. ▪ Communication via Microsoft DCOM
▪ Only for Windows-OS
▪ Access only via Windows-Components
▪ No VPN-Access
▪ No direct communication through Firewalls
OPC S er ver : Classic (DA) an d Un ified Ar ch itectu r e (UA)
OPC Insight
OPC Classic OPC UA (Unified Architecture)
▪ Communication via TCP/IP
▪ Platform-independent
▪ Encryption/Access via Webstandard
(RSA, x509) and User Authentication
▪ Enables Communication across Domain-borders
(WAN, Internet)
12. Communication exchange not
only of data, but also of
complex information models
(metadata, instances) and
thus enables interoperability
on a semantic level
Laye r Mode l
OPC UA Insight
13. • Binary with UA-TCP:
• Optimized for Performance
• Thorughout Protocol
• Single TCP-Port used for Communication
• opc.tcp-Protocol
• Webservice (XML-SOAP):
• „Firewall friendly“
• XML-Structure through https-Protocol
• Easier for Java or dotnet-Environments
• By default single-port 443 needs to be unlocked
• Hybrid (UA-Binary via HTTPS)
• Advantages of both worlds (firewall friendly binary coded
implementation in https-frame)
• By default single-port 443
Tra ns port Protocols
OPC UA Insight
14. Apache Kafka® in Industrial Environments
Confluent Meetup
Jonathan Malessa & Thorsten Weiler
18th November 2020
15. "Dieses Foto" von Unbekannter Autor ist lizenziert
gemäß CC BY-SA
15
Kafka in Industrial Environments
Business logic processing
production data and
generating label