Personal Information
Organization / Workplace
Taipei City, Taiwan, 0 Taiwan
Occupation
VP of Apache Bigtop, Big Data Engineer at Yahoo!
Industry
Technology / Software / Internet
About
I’m an Apache Bigtop Project Committer and PMC member. The feature I developed in virtualization and containerization helps the community reinforce its automation and continuous integration pipeline for Hadoop ecosystem which yields better software quality with faster release cycles.
At Trend Micro, we built our own Hadoop Distribution to serve our own needs. My responsibilities was to build up an in-house Hadoop distribution(TMH) based on Apache Bigtop and develop a system that deploys and manages Hadoop cluster across 100+ nodes in Production.
Another achievement I have at Trend Micro was to develop a high-throughput, fault-tolerant distributed data streaming system that scales. The ...
Tags
docker
apache bigtop
apache hadoop
hadoop deployment
career
open source
apache spark
apache
big data
devops
software
asf
software industry
apache software foundation
distributed deep learning
tensorflow
optimization
sql
apache calcite
packaging
cassandra
akka
vagrant
bigtop
impala
apache flume
apache thrift
apache hbase
puppet
hdfs
hadoop
quorum journal
ha
See more
- Presentations
- Documents
- Infographics