Personal Information
Organization / Workplace
Bengaluru Area, India, 10 India
Occupation
Senior Software Developer at IBM Analytics
Industry
Technology / Software / Internet
About
I am working at IBM-ISL in Analytics group. I am involved in designing and development of solutions for the problems involving huge amount of data. Currently working on Spark and related technologies to build next generation analytic platform. I am a result-oriented engineer with 3 years of experience in building products using Java and Big Data technologies like Spark, Scala, Hadoop, PIG, Hive, HBase, Impala, Oozie and Apache Solr.
Software Skills
Big Data Technologies : Spark, Scala, Hadoop, Map-Reduce, YARN, HDFS, Solr, Hive, Impala, Pig, Shark, CDH, Oozie, HBase, Phoenix, Zookeeper
Programming Languages : C, C++, Core Java
Middleware Technologies : Java, Spring Framework, JAXB, hibe...
Tags
apache spark
spark
hadoop
data analytics
big data
big data analytics
scala
data science
mapreduce
data mining
machine learning
generating physical plan
catalyst optimizer
plan optimization & execution
rdd recap
comparison with pig and hive pipeline
dataframes operations
architecture of spark sql
extensions
data cleansing
dataframes
spark sql library
diagram for logical plan container
definition of a dataframes api
code generation
catalyst analyzer
dataframes features
big data university
streaming
streaming applications
twitter
opensource
spark streaming
fault tolerance
architecture
apache spark introduction
resilient distributed dataset
rdd basics
rdd deep dive
rdd
See more
- Presentations
- Documents
- Infographics
Migrating to Spark 2.0 - Part 2
datamantra
•
6 years ago
Migrating to spark 2.0
datamantra
•
6 years ago
Running Zeppelin in Enterprise
DataWorks Summit
•
6 years ago
Introduction to Kubernetes
rajdeep
•
9 years ago
Getting Started with Alluxio + Spark + S3
Alluxio, Inc.
•
7 years ago
Deep Dive : Spark Data Frames, SQL and Catalyst Optimizer
Sachin Aggarwal
•
7 years ago
Taking Spark Streaming to the Next Level with Datasets and DataFrames
Databricks
•
8 years ago
Comparison of various streaming technologies
Sachin Aggarwal
•
8 years ago
Interactive Analytics using Apache Spark
Sachin Aggarwal
•
8 years ago
Apache Spark Streaming: Architecture and Fault Tolerance
Sachin Aggarwal
•
8 years ago
Apache Spark Introduction and Resilient Distributed Dataset basics and deep dive
Sachin Aggarwal
•
8 years ago
kafka
Ariel Moskovich
•
8 years ago
Tuning and Debugging in Apache Spark
Patrick Wendell
•
9 years ago
Hive tuning
Michael Zhang
•
10 years ago