druid/doc/segmentation_propagation.txt

14 lines
441 B
Plaintext
Raw Normal View History

# http://www.websequencediagrams.com/
title Segment Propagation
Realtime->Deep Storage: push(segment)
Realtime->MySQL: write(metadata)
Master->+MySQL: segments?
MySQL-->-Master: metadata
note over Master: rules select segment owner
Master->Zookeeper: writes(ephemeral node)
Zookeeper->Compute: reads(ephemeral node)
Compute->+Deep Storage: pull(segment)
Deep Storage-->-Compute: transfer(segment)
Compute->Zookeeper: delete(ephemeral node)