Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Apache Kafka® in Industrial Environments


Published on

Apache Kafka in industrial environments – OPC and shopfloor connectivity in manufacturing, Thorsten Weiler and Jonathan Malessa of inray Industriesoftware GmbH

Meetup link:

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Apache Kafka® in Industrial Environments

  1. 1. Apache Kafka® in Industrial Environments Confluent Meetup Jonathan Malessa & Thorsten Weiler 18th November 2020
  2. 2. − Industrial Automation Software Development − Since 1995 − 70 Employees − Based in northern Germany inray Industr ies oftware GmbH Who we are
  3. 3. OPC Router
  4. 4. 4 −Software based communication platform −Lots of available plug-ins / connections −Connecting shop floor and top floor systems −Mature Software • 15 years on the market • Successfully proven in thousands of projects −Free demo at What it is & what it doe s OPC Router
  5. 5. 5 Original Idea 15 Years agoWhe re it come s from OPC Router Field Systems OPC Server OPC Router HMI/SCADA/MESERP OPC as de facto communication standard in automation
  6. 6. 6 −Currently not so much present on Automation level −Widely used in IT-/Office-environment −IoT / Industry 4.0: IT/Office needs data from Shopfloor • Predictive Maintenance / Condition Based Monitoring • Production Cost (energy, raw material, water, scrap, etc.) • Increase of Quality and Effectiveness • Reduction of Cost and Equipment Downtime • Order Information • Compliance / Governmental Reporting Ope n S ource S oftwa re for Ma na geme nt of Data S tre a ms Apache Kafka
  7. 7. 7 P l u g-ins , modula r de s ign, inte r fa ce s OPC Router OPC Router Databases: MS SQL, MySQL, Oracle, SAP HANA, InfluxDB, MongoDB, etc. SAP / ERP OPC-Server Charm EZ Field Systems Mail Barcode Readers PrintersExcel Euromap 63/77 Telegram IIoT (MQTT, REST) JSON, XML/Xpath, .NET RFID-AutoID Apache Kafka
  8. 8. 8 OPC Router How it wor ks Templates & Instances Transfer Objects Connections Templates & Instances Plug-ins Triggers
  9. 9. What is OPC?
  10. 10. −Standarized protocol to exchange data between different communcation partners • Back then only on shopfloor • Today also for secure communication from shopfloor to topfloor −Client/Server architecture Ope n Platfor m Commu n ication s What is OPC? Shopfloor Topfloor MES Big Data Cloud ERP Database PLC, Controllers, Databases, HMI/SCADA-Systems
  11. 11. ▪ Communication via Microsoft DCOM ▪ Only for Windows-OS ▪ Access only via Windows-Components ▪ No VPN-Access ▪ No direct communication through Firewalls OPC S er ver : Classic (DA) an d Un ified Ar ch itectu r e (UA) OPC Insight OPC Classic OPC UA (Unified Architecture) ▪ Communication via TCP/IP ▪ Platform-independent ▪ Encryption/Access via Webstandard (RSA, x509) and User Authentication ▪ Enables Communication across Domain-borders (WAN, Internet)
  12. 12. Communication exchange not only of data, but also of complex information models (metadata, instances) and thus enables interoperability on a semantic level Laye r Mode l OPC UA Insight
  13. 13. • Binary with UA-TCP: • Optimized for Performance • Thorughout Protocol • Single TCP-Port used for Communication • opc.tcp-Protocol • Webservice (XML-SOAP): • „Firewall friendly“ • XML-Structure through https-Protocol • Easier for Java or dotnet-Environments • By default single-port 443 needs to be unlocked • Hybrid (UA-Binary via HTTPS) • Advantages of both worlds (firewall friendly binary coded implementation in https-frame) • By default single-port 443 Tra ns port Protocols OPC UA Insight
  14. 14. Apache Kafka® in Industrial Environments Confluent Meetup Jonathan Malessa & Thorsten Weiler 18th November 2020
  15. 15. "Dieses Foto" von Unbekannter Autor ist lizenziert gemäß CC BY-SA 15 Kafka in Industrial Environments Business logic processing production data and generating label
  16. 16. 16 Questions & Answers
  17. 17. AdobeStock_322104018
  18. 18. Thorsten Weiler +49 4892 - 89008-165