Personal Information
Organization / Workplace
San Francisco Bay Area United States
Occupation
Senior Staff Software Engineer, Data infrastructure at LinkedIn
Industry
Technology / Software / Internet
About
Passionate about building large scale distributed systems!.
Data Infra Engineer at LinkedIn. Tech Lead/Architect for Pinot, a Real time Analytics Platform and ThirdEye (Anomaly Detection Framework to monitor Business Metrics).
Creator of Apache Helix (Generic Cluster management Framework) (http://helix.apache.org).
Founding member of the team that built Espresso (Document oriented NoSQL data store), Databus (Change Data Capture).
Prior to LinkedIn, I worked extensively on Ad systems at Yahoo. Built Apache S4, a real time stream processing framework.
Tags
cluster management
distributed data systems
cluster manager
helix
real-time
olap
analytics
apache helix
fault tolerance
apache
kafka
apache pinot
slice and dice
yarn
distributed systems
partition management
elasticity
testing
debugging
fault tolerance testing
socc 2012
See more
- Presentations
- Documents
- Infographics