opensource/developer-roadmap
3
0
Fork 0
mirror of https://github.com/kamranahmedse/developer-roadmap.git synced 2026-09-24 15:00:31 +08:00
Code Issues Packages Projects Releases Wiki Activity
Files
89fdaad9c151a8c2584cf0db1bd34c19a4cf8c59
developer-roadmap/roadmaps/python-data-analysis/content/pyspark@XTXm8aIDbRkTXoAck_m3I.md
T
Arik Chakma 274082fd77 feat: clean roadmap content and sync scripts (#10181) 
* refactor: clean to roadmap content

* refactor: move shared helpers into scripts/lib
2026-07-28 05:45:17 +06:00

778 B
Raw Blame History

PySpark

PySpark is the Python API for Apache Spark, the distributed data processing engine. It allows Python code to run Spark jobs on clusters, processing datasets at the scale of terabytes. PySpark provides DataFrame and SQL APIs similar to Pandas and integrates with MLlib for distributed machine learning. It is used when data volume exceeds what Dask or a single machine can handle.

Visit the following resources to learn more:

Reference in New Issue View Git Blame Copy Permalink