Data Science & Analytics

Apache Spark

Apache Spark is a distributed engine for batch, SQL and streaming data processing, used from Python through PySpark. Use when a user asks to process big data, run distributed computations, build ETL pipelines, analyse data at scale, read Parquet from S3, or stream from Kafka with PySpark.

Publisher / source
TerminalSkills Library
Upstream record
TerminalSkills/skills
Version
Version 4
Published
Publication review
Approved for publication
Content fingerprint
0cf8631d2ff12aacfe8b74526d69eef31724638480185ab9379db3b17114bba7