3. Siphon: Enterprise Data
Bus
Near real-time
Compliant
No data dead-ends
Hyper scale
Reliable
Network effects
8 million
EVENTS PER SECOND PEAK INGRESS
800 TB (10 GB per Sec)
INGRESS PER DAY
1,800
PRODUCTION KAFKA BROKERS
450
TOPICS
15 Sec
99th PERCENTILE LATENCY
5. Customer: Major Car Manufacturer
Scenario: Connected Car Telematics
Data producers
Millions of cars
Routed via cloud gateway to Siphon endpoint
Data consumers
Spark streaming applications
Siphon compute forwards data to blob storage
15. Compliance regions
North America
South America
Europe
Asia Pacific
Go Local
Australia
Canada
India
Japan
United Kingdom
Sovereign
Germany
China
Government
16. Self-service
Tenant creation & management
Topic creation & management
Topic health & data preview
Subscription creation & management
AuthN
Azure AD based for Self-service API & UI
Cert based for data producers and consumers
AuthZ
Siphon Metadata used to authorize provisioning & management (tenants, topics, etc.)
Kafka ACLs for topic level access control
Throttling
EventServer throttles based on quota limit
Monitoring
Operational metrics in a single system (MDM) for monitoring and alerting
Data quality
Audit Trail system for e2e latency and completeness monitoring
Editor's Notes
Customers
Users
Data producers
Data consumers
Service owners