Submit Search
Upload
Keep me in the Loop: INotify in HDFS
•
10 likes
•
5,709 views
DataWorks Summit
Follow
Hadoop Summit 2015
Read less
Read more
Technology
Report
Share
Report
Share
1 of 29
Recommended
The Full MySQL and MariaDB Parallel Replication Tutorial
The Full MySQL and MariaDB Parallel Replication Tutorial
Jean-François Gagné
All about Zookeeper and ClickHouse Keeper.pdf
All about Zookeeper and ClickHouse Keeper.pdf
Altinity Ltd
Achieving compliance With MongoDB Security
Achieving compliance With MongoDB Security
Mydbops
ProxySQL High Availability (Clustering)
ProxySQL High Availability (Clustering)
Mydbops
MySQL/MariaDB Proxy Software Test
MySQL/MariaDB Proxy Software Test
I Goo Lee
RocksDB compaction
RocksDB compaction
MIJIN AN
Hoodie - DataEngConf 2017
Hoodie - DataEngConf 2017
Vinoth Chandar
The basics of fluentd
The basics of fluentd
Treasure Data, Inc.
Recommended
The Full MySQL and MariaDB Parallel Replication Tutorial
The Full MySQL and MariaDB Parallel Replication Tutorial
Jean-François Gagné
All about Zookeeper and ClickHouse Keeper.pdf
All about Zookeeper and ClickHouse Keeper.pdf
Altinity Ltd
Achieving compliance With MongoDB Security
Achieving compliance With MongoDB Security
Mydbops
ProxySQL High Availability (Clustering)
ProxySQL High Availability (Clustering)
Mydbops
MySQL/MariaDB Proxy Software Test
MySQL/MariaDB Proxy Software Test
I Goo Lee
RocksDB compaction
RocksDB compaction
MIJIN AN
Hoodie - DataEngConf 2017
Hoodie - DataEngConf 2017
Vinoth Chandar
The basics of fluentd
The basics of fluentd
Treasure Data, Inc.
My sql failover test using orchestrator
My sql failover test using orchestrator
YoungHeon (Roy) Kim
Hadoop Distributed File System
Hadoop Distributed File System
elliando dias
Sharding Methods for MongoDB
Sharding Methods for MongoDB
MongoDB
Redis cluster
Redis cluster
iammutex
Performance Tuning RocksDB for Kafka Streams’ State Stores
Performance Tuning RocksDB for Kafka Streams’ State Stores
confluent
Securing Hadoop with Apache Ranger
Securing Hadoop with Apache Ranger
DataWorks Summit
Improving fault tolerance and scaling out in Kafka Streams with Bill Bejeck |...
Improving fault tolerance and scaling out in Kafka Streams with Bill Bejeck |...
HostedbyConfluent
Building robust CDC pipeline with Apache Hudi and Debezium
Building robust CDC pipeline with Apache Hudi and Debezium
Tathastu.ai
Apache doris (incubating) introduction
Apache doris (incubating) introduction
leanderlee2
Log Structured Merge Tree
Log Structured Merge Tree
University of California, Santa Cruz
Large Scale Lakehouse Implementation Using Structured Streaming
Large Scale Lakehouse Implementation Using Structured Streaming
Databricks
Hadoop Architecture | HDFS Architecture | Hadoop Architecture Tutorial | HDFS...
Hadoop Architecture | HDFS Architecture | Hadoop Architecture Tutorial | HDFS...
Simplilearn
Ceph issue 해결 사례
Ceph issue 해결 사례
Open Source Consulting
Upgrading HDFS to 3.3.0 and deploying RBF in production #LINE_DM
Upgrading HDFS to 3.3.0 and deploying RBF in production #LINE_DM
Yahoo!デベロッパーネットワーク
Change Data Capture to Data Lakes Using Apache Pulsar and Apache Hudi - Pulsa...
Change Data Capture to Data Lakes Using Apache Pulsar and Apache Hudi - Pulsa...
StreamNative
Redis - Usability and Use Cases
Redis - Usability and Use Cases
Fabrizio Farinacci
Iceberg: a fast table format for S3
Iceberg: a fast table format for S3
DataWorks Summit
Data Engineer's Lunch #83: Strategies for Migration to Apache Iceberg
Data Engineer's Lunch #83: Strategies for Migration to Apache Iceberg
Anant Corporation
Introduction to memcached
Introduction to memcached
Jurriaan Persyn
Ozone and HDFS's Evolution
Ozone and HDFS's Evolution
DataWorks Summit
Craft CMS: Beyond the Small Business; Advanced tools and configurations
Craft CMS: Beyond the Small Business; Advanced tools and configurations
Nate Iler
Kapacitor Alert Topic handlers
Kapacitor Alert Topic handlers
InfluxData
More Related Content
What's hot
My sql failover test using orchestrator
My sql failover test using orchestrator
YoungHeon (Roy) Kim
Hadoop Distributed File System
Hadoop Distributed File System
elliando dias
Sharding Methods for MongoDB
Sharding Methods for MongoDB
MongoDB
Redis cluster
Redis cluster
iammutex
Performance Tuning RocksDB for Kafka Streams’ State Stores
Performance Tuning RocksDB for Kafka Streams’ State Stores
confluent
Securing Hadoop with Apache Ranger
Securing Hadoop with Apache Ranger
DataWorks Summit
Improving fault tolerance and scaling out in Kafka Streams with Bill Bejeck |...
Improving fault tolerance and scaling out in Kafka Streams with Bill Bejeck |...
HostedbyConfluent
Building robust CDC pipeline with Apache Hudi and Debezium
Building robust CDC pipeline with Apache Hudi and Debezium
Tathastu.ai
Apache doris (incubating) introduction
Apache doris (incubating) introduction
leanderlee2
Log Structured Merge Tree
Log Structured Merge Tree
University of California, Santa Cruz
Large Scale Lakehouse Implementation Using Structured Streaming
Large Scale Lakehouse Implementation Using Structured Streaming
Databricks
Hadoop Architecture | HDFS Architecture | Hadoop Architecture Tutorial | HDFS...
Hadoop Architecture | HDFS Architecture | Hadoop Architecture Tutorial | HDFS...
Simplilearn
Ceph issue 해결 사례
Ceph issue 해결 사례
Open Source Consulting
Upgrading HDFS to 3.3.0 and deploying RBF in production #LINE_DM
Upgrading HDFS to 3.3.0 and deploying RBF in production #LINE_DM
Yahoo!デベロッパーネットワーク
Change Data Capture to Data Lakes Using Apache Pulsar and Apache Hudi - Pulsa...
Change Data Capture to Data Lakes Using Apache Pulsar and Apache Hudi - Pulsa...
StreamNative
Redis - Usability and Use Cases
Redis - Usability and Use Cases
Fabrizio Farinacci
Iceberg: a fast table format for S3
Iceberg: a fast table format for S3
DataWorks Summit
Data Engineer's Lunch #83: Strategies for Migration to Apache Iceberg
Data Engineer's Lunch #83: Strategies for Migration to Apache Iceberg
Anant Corporation
Introduction to memcached
Introduction to memcached
Jurriaan Persyn
Ozone and HDFS's Evolution
Ozone and HDFS's Evolution
DataWorks Summit
What's hot
(20)
My sql failover test using orchestrator
My sql failover test using orchestrator
Hadoop Distributed File System
Hadoop Distributed File System
Sharding Methods for MongoDB
Sharding Methods for MongoDB
Redis cluster
Redis cluster
Performance Tuning RocksDB for Kafka Streams’ State Stores
Performance Tuning RocksDB for Kafka Streams’ State Stores
Securing Hadoop with Apache Ranger
Securing Hadoop with Apache Ranger
Improving fault tolerance and scaling out in Kafka Streams with Bill Bejeck |...
Improving fault tolerance and scaling out in Kafka Streams with Bill Bejeck |...
Building robust CDC pipeline with Apache Hudi and Debezium
Building robust CDC pipeline with Apache Hudi and Debezium
Apache doris (incubating) introduction
Apache doris (incubating) introduction
Log Structured Merge Tree
Log Structured Merge Tree
Large Scale Lakehouse Implementation Using Structured Streaming
Large Scale Lakehouse Implementation Using Structured Streaming
Hadoop Architecture | HDFS Architecture | Hadoop Architecture Tutorial | HDFS...
Hadoop Architecture | HDFS Architecture | Hadoop Architecture Tutorial | HDFS...
Ceph issue 해결 사례
Ceph issue 해결 사례
Upgrading HDFS to 3.3.0 and deploying RBF in production #LINE_DM
Upgrading HDFS to 3.3.0 and deploying RBF in production #LINE_DM
Change Data Capture to Data Lakes Using Apache Pulsar and Apache Hudi - Pulsa...
Change Data Capture to Data Lakes Using Apache Pulsar and Apache Hudi - Pulsa...
Redis - Usability and Use Cases
Redis - Usability and Use Cases
Iceberg: a fast table format for S3
Iceberg: a fast table format for S3
Data Engineer's Lunch #83: Strategies for Migration to Apache Iceberg
Data Engineer's Lunch #83: Strategies for Migration to Apache Iceberg
Introduction to memcached
Introduction to memcached
Ozone and HDFS's Evolution
Ozone and HDFS's Evolution
Similar to Keep me in the Loop: INotify in HDFS
Craft CMS: Beyond the Small Business; Advanced tools and configurations
Craft CMS: Beyond the Small Business; Advanced tools and configurations
Nate Iler
Kapacitor Alert Topic handlers
Kapacitor Alert Topic handlers
InfluxData
Designate Install and Operate Workshop
Designate Install and Operate Workshop
Graham Hayes
Introduction of unit test on android kernel
Introduction of unit test on android kernel
Johnson Chou
Matt Jarvis - Unravelling Logs: Log Processing with Logstash and Riemann
Matt Jarvis - Unravelling Logs: Log Processing with Logstash and Riemann
Danny Abukalam
Android - ADB
Android - ADB
Yossi Gruner
Linux Kernel Debugging
Linux Kernel Debugging
GlobalLogic Ukraine
Openstack 簡介
Openstack 簡介
kao kuo-tung
Gluster technical overview
Gluster technical overview
Gluster.org
MariaDB, MySQL and Ansible: automating database infrastructures
MariaDB, MySQL and Ansible: automating database infrastructures
Federico Razzoli
Attacking Big Data Land
Attacking Big Data Land
Jeremy Brown
MySQL/MariaDB Parallel Replication: inventory, use-case and limitations
MySQL/MariaDB Parallel Replication: inventory, use-case and limitations
Jean-François Gagné
SECON'2017, Цаль-Цалко Иван, Go на практике
SECON'2017, Цаль-Цалко Иван, Go на практике
SECON
Monitoring with Syslog and EventMachine (RailswayConf 2012)
Monitoring with Syslog and EventMachine (RailswayConf 2012)
Wooga
OpenStack Cinder
OpenStack Cinder
Deepti Ramakrishna
CI-CD WITH GITLAB WORKFLOW
CI-CD WITH GITLAB WORKFLOW
AddWeb Solution Pvt. Ltd.
Designate Installation Workshop
Designate Installation Workshop
Graham Hayes
Trouble shooting apachecloudstack
Trouble shooting apachecloudstack
Sailaja Sunil
OSBConf 2016: The Database Backup is done - what next? - by Jörg Brühe
OSBConf 2016: The Database Backup is done - what next? - by Jörg Brühe
NETWAYS
Dx11 performancereloaded
Dx11 performancereloaded
mistercteam
Similar to Keep me in the Loop: INotify in HDFS
(20)
Craft CMS: Beyond the Small Business; Advanced tools and configurations
Craft CMS: Beyond the Small Business; Advanced tools and configurations
Kapacitor Alert Topic handlers
Kapacitor Alert Topic handlers
Designate Install and Operate Workshop
Designate Install and Operate Workshop
Introduction of unit test on android kernel
Introduction of unit test on android kernel
Matt Jarvis - Unravelling Logs: Log Processing with Logstash and Riemann
Matt Jarvis - Unravelling Logs: Log Processing with Logstash and Riemann
Android - ADB
Android - ADB
Linux Kernel Debugging
Linux Kernel Debugging
Openstack 簡介
Openstack 簡介
Gluster technical overview
Gluster technical overview
MariaDB, MySQL and Ansible: automating database infrastructures
MariaDB, MySQL and Ansible: automating database infrastructures
Attacking Big Data Land
Attacking Big Data Land
MySQL/MariaDB Parallel Replication: inventory, use-case and limitations
MySQL/MariaDB Parallel Replication: inventory, use-case and limitations
SECON'2017, Цаль-Цалко Иван, Go на практике
SECON'2017, Цаль-Цалко Иван, Go на практике
Monitoring with Syslog and EventMachine (RailswayConf 2012)
Monitoring with Syslog and EventMachine (RailswayConf 2012)
OpenStack Cinder
OpenStack Cinder
CI-CD WITH GITLAB WORKFLOW
CI-CD WITH GITLAB WORKFLOW
Designate Installation Workshop
Designate Installation Workshop
Trouble shooting apachecloudstack
Trouble shooting apachecloudstack
OSBConf 2016: The Database Backup is done - what next? - by Jörg Brühe
OSBConf 2016: The Database Backup is done - what next? - by Jörg Brühe
Dx11 performancereloaded
Dx11 performancereloaded
More from DataWorks Summit
Data Science Crash Course
Data Science Crash Course
DataWorks Summit
Floating on a RAFT: HBase Durability with Apache Ratis
Floating on a RAFT: HBase Durability with Apache Ratis
DataWorks Summit
Tracking Crime as It Occurs with Apache Phoenix, Apache HBase and Apache NiFi
Tracking Crime as It Occurs with Apache Phoenix, Apache HBase and Apache NiFi
DataWorks Summit
HBase Tales From the Trenches - Short stories about most common HBase operati...
HBase Tales From the Trenches - Short stories about most common HBase operati...
DataWorks Summit
Optimizing Geospatial Operations with Server-side Programming in HBase and Ac...
Optimizing Geospatial Operations with Server-side Programming in HBase and Ac...
DataWorks Summit
Managing the Dewey Decimal System
Managing the Dewey Decimal System
DataWorks Summit
Practical NoSQL: Accumulo's dirlist Example
Practical NoSQL: Accumulo's dirlist Example
DataWorks Summit
HBase Global Indexing to support large-scale data ingestion at Uber
HBase Global Indexing to support large-scale data ingestion at Uber
DataWorks Summit
Scaling Cloud-Scale Translytics Workloads with Omid and Phoenix
Scaling Cloud-Scale Translytics Workloads with Omid and Phoenix
DataWorks Summit
Building the High Speed Cybersecurity Data Pipeline Using Apache NiFi
Building the High Speed Cybersecurity Data Pipeline Using Apache NiFi
DataWorks Summit
Supporting Apache HBase : Troubleshooting and Supportability Improvements
Supporting Apache HBase : Troubleshooting and Supportability Improvements
DataWorks Summit
Security Framework for Multitenant Architecture
Security Framework for Multitenant Architecture
DataWorks Summit
Presto: Optimizing Performance of SQL-on-Anything Engine
Presto: Optimizing Performance of SQL-on-Anything Engine
DataWorks Summit
Introducing MlFlow: An Open Source Platform for the Machine Learning Lifecycl...
Introducing MlFlow: An Open Source Platform for the Machine Learning Lifecycl...
DataWorks Summit
Extending Twitter's Data Platform to Google Cloud
Extending Twitter's Data Platform to Google Cloud
DataWorks Summit
Event-Driven Messaging and Actions using Apache Flink and Apache NiFi
Event-Driven Messaging and Actions using Apache Flink and Apache NiFi
DataWorks Summit
Securing Data in Hybrid on-premise and Cloud Environments using Apache Ranger
Securing Data in Hybrid on-premise and Cloud Environments using Apache Ranger
DataWorks Summit
Big Data Meets NVM: Accelerating Big Data Processing with Non-Volatile Memory...
Big Data Meets NVM: Accelerating Big Data Processing with Non-Volatile Memory...
DataWorks Summit
Computer Vision: Coming to a Store Near You
Computer Vision: Coming to a Store Near You
DataWorks Summit
Big Data Genomics: Clustering Billions of DNA Sequences with Apache Spark
Big Data Genomics: Clustering Billions of DNA Sequences with Apache Spark
DataWorks Summit
More from DataWorks Summit
(20)
Data Science Crash Course
Data Science Crash Course
Floating on a RAFT: HBase Durability with Apache Ratis
Floating on a RAFT: HBase Durability with Apache Ratis
Tracking Crime as It Occurs with Apache Phoenix, Apache HBase and Apache NiFi
Tracking Crime as It Occurs with Apache Phoenix, Apache HBase and Apache NiFi
HBase Tales From the Trenches - Short stories about most common HBase operati...
HBase Tales From the Trenches - Short stories about most common HBase operati...
Optimizing Geospatial Operations with Server-side Programming in HBase and Ac...
Optimizing Geospatial Operations with Server-side Programming in HBase and Ac...
Managing the Dewey Decimal System
Managing the Dewey Decimal System
Practical NoSQL: Accumulo's dirlist Example
Practical NoSQL: Accumulo's dirlist Example
HBase Global Indexing to support large-scale data ingestion at Uber
HBase Global Indexing to support large-scale data ingestion at Uber
Scaling Cloud-Scale Translytics Workloads with Omid and Phoenix
Scaling Cloud-Scale Translytics Workloads with Omid and Phoenix
Building the High Speed Cybersecurity Data Pipeline Using Apache NiFi
Building the High Speed Cybersecurity Data Pipeline Using Apache NiFi
Supporting Apache HBase : Troubleshooting and Supportability Improvements
Supporting Apache HBase : Troubleshooting and Supportability Improvements
Security Framework for Multitenant Architecture
Security Framework for Multitenant Architecture
Presto: Optimizing Performance of SQL-on-Anything Engine
Presto: Optimizing Performance of SQL-on-Anything Engine
Introducing MlFlow: An Open Source Platform for the Machine Learning Lifecycl...
Introducing MlFlow: An Open Source Platform for the Machine Learning Lifecycl...
Extending Twitter's Data Platform to Google Cloud
Extending Twitter's Data Platform to Google Cloud
Event-Driven Messaging and Actions using Apache Flink and Apache NiFi
Event-Driven Messaging and Actions using Apache Flink and Apache NiFi
Securing Data in Hybrid on-premise and Cloud Environments using Apache Ranger
Securing Data in Hybrid on-premise and Cloud Environments using Apache Ranger
Big Data Meets NVM: Accelerating Big Data Processing with Non-Volatile Memory...
Big Data Meets NVM: Accelerating Big Data Processing with Non-Volatile Memory...
Computer Vision: Coming to a Store Near You
Computer Vision: Coming to a Store Near You
Big Data Genomics: Clustering Billions of DNA Sequences with Apache Spark
Big Data Genomics: Clustering Billions of DNA Sequences with Apache Spark
Recently uploaded
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Orbitshub
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
Sandro Moreira
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
Rustici Software
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024
The Digital Insurer
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
Remote DBA Services
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
Zilliz
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Orbitshub
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
apidays
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
Dropbox
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
rafiqahmad00786416
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
Zilliz
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
Andrey Devyatkin
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
MadyBayot
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
Nanddeep Nachan
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
MIND CTI
Architecting Cloud Native Applications
Architecting Cloud Native Applications
WSO2
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Victor Rentea
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
apidays
Recently uploaded
(20)
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
Architecting Cloud Native Applications
Architecting Cloud Native Applications
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Keep me in the Loop: INotify in HDFS
1.
2.
● ● ●
3.
● ● ● ● ● ●
4.
5.
DFSClient DFSClient DFSClient /user/cmccabe/tpcds_1 /user/cmccabe/reports /user/awang/reports
6.
● ● ● ● ●
7.
● ● ● ●
8.
● ○ ○ ● ○
9.
● ● ●
10.
● ● ○ ● ○
11.
● Client HDFS create /a delete /b ...
12.
● ○ ○ … ■ …
13.
● ● ○
14.
● ○ ○
15.
● ○ ● ●
16.
NameNodeClient Any events after #123? Event
#124, #125, etc. Client caches highest event number that it’s seen. Client polls periodically. NameNode uses monotonically increasing 64-bit event IDs
17.
● ● ●
18.
HDFS Audit Log 123
AddCloseOp(file=/a) 124 DeleteOp(file=/b) 125 SetReplicationOp(file=/a, rep=5) 126 AddCloseOp(file=/c) 127 RenameOp(src=/c, dst=/d) 128 ConcatOp(dst=/x, src1=/y, src2=/z) ... DFSINotifyInputStream 123 CreateEvent 124 UnlinkEvent 125 MetadataUpdateEvent 126 CloseEvent 127 RenameEvent 128 [AppendEvent /x, UnlinkEvent /y, UnlinkEvent /z] ...
19.
● ● ○ ○ ●
20.
message RenameEventProto { required
string srcPath = 1; required string destPath = 2; required int64 timestamp = 3; }
21.
DFSInotifyEventInputStream stream = dfs.getInotifyEventStream(prevHighestTxId); EventBatch
batch = stream.take(); long newTxid = batch.getTxid(); switch (batch.getEvents()[0].getEventType()) { case Event.EventType.RENAME: … } stream.close();
22.
● ○ ○ ○ ● ○
23.
● ○ ● ○ ○ ○
24.
● ● ● … ●
25.
● ● ○
26.
● ● ●
27.
● ● ● ●
28.
● ● ●