Distributed processing
Partitioning, shuffle, lazy evaluation and the cost of data movement transfer across every engine and are the actual skill. Batch↔streaming transfer is weaker than it looks: windowing and state have no batch equivalent.
Layer 26 entities0 started
Entities
Section titled “Entities”apache-spark
Not started. Becomes a package with its own syllabus once it begins.
databricks
Not started. Becomes a package with its own syllabus once it begins.
apache-flink
Not started. Becomes a package with its own syllabus once it begins.
apache-beam
Not started. Becomes a package with its own syllabus once it begins.
dask
Not started. Becomes a package with its own syllabus once it begins.
ray
Not started. Becomes a package with its own syllabus once it begins.