Stephen Scaffidi

40 Followers

3 SlideShares 40 Followers 42 Followings

An experienced DevOps engineer specializing in development of tools and applications for large-scale data processing and analysis. Has written flexible, high-performance distributed applications operating across multiple platforms and integrating both open and proprietary systems. Interested in working on ever-larger challenges in systems automation and management and big data. Specialties: Applications programming in Java, Perl, Python, Clojure, C, C++ and numerous other languages. Integration of data flows from related systems into enterprise aggregation points (Continuous ETL). Extensive experience with NetCool from v3 (CIC) to v7, NerveCenter from v3.5 to v4.2, TREND, and HP OpenVie...

perl mocking testing aws golang devops fpm hadoop java packaging perlbrew puppet s hive query tool hql apache hadoop hadoop summit tripadvisor hive hadoop kensho best practice

Activity
About

Apache Carbondata: An Indexed Columnar File Format for Interactive Query with Spark SQL: Spark Summit East talk by Jacky Li and Jihong Ma

Spark Summit • 7 years ago

Stephen Scaffidi

Presentations

The Essential Perl Hacker's Toolkit

In the desert, without a camel

Testing Against AWS APIs Go

Likes

How Netflix Tunes EC2 Instances for Performance

The Netflix Way to deal with Big Data Problems

Apache Carbondata: An Indexed Columnar File Format for Interactive Query with Spark SQL: Spark Summit East talk by Jacky Li and Jihong Ma

Cost-Based Optimizer Framework for Spark SQL: Spark Summit East talk by Ron Hu and Zhenhua Wang

Even Faster: When Presto meets Parquet @ Uber

Optimizing Apache Spark SQL Joins

Spark Autotuning: Spark Summit East talk by Lawrence Spracklen

Parquet and AVRO

Kudu: New Hadoop Storage for Fast Analytics on Fast Data

Next Gen Big Data Analytics with Apache Apex

The Columnar Era: Leveraging Parquet, Arrow and Kudu for High-Performance Analytics

Parquet performance tuning: the missing guide

Apache drill

Tuning Java for Big Data

Data Discovery on Hadoop - Realizing the Full Potential of your Data

Scaling Ceph at CERN - Ceph Day Frankfurt

Distributed Storage and Compute With Ceph's librados (Vault 2015)

Ceph Day SF 2015 - Building your own disaster? The safe way to make Ceph ready!

Ceph Day SF 2015 - SysAdmin's Toolbox: Tools for Running Ceph in Production

Ceph Day SF 2015 - Big Data Applications and Tuning in Ceph

Gc and-pagescan-attacks-by-linux

The Christmas Spider - The story of a new holiday tradition

Infrastructure Around Hadoop

Simplifying Use of Hive with the Hive Query Tool

The Essential Perl Hacker's Toolkit