GitHub - goamegah/spark-handson: Build and deploy Spark Core Jobs using PySpark, Terraform and AWS Glue serverless service.

Exercises

Find more information in benchmark page.

Find more information in deployment page.

python = "~3.10"
pyspark = "3.5.3"
pytest = "7.1.2"
awsglue-dev = "^2021.12.30"

psutil = "^6.1.0"
tabulate = "^0.9.0"

Find more information in pyproject.toml file.

Name		Name	Last commit message	Last commit date
Latest commit History 71 Commits
.github/workflows		.github/workflows
assets		assets
devops/infrastructure		devops/infrastructure
infra		infra
src		src
tests		tests
.gitignore		.gitignore
BENCHMARK.md		BENCHMARK.md
DEPLOYMENT.md		DEPLOYMENT.md
EXO5.md		EXO5.md
README.md		README.md
SUBMIT.md		SUBMIT.md
clean.py		clean.py
clean.sh		clean.sh
exo0.md		exo0.md
exo1.md		exo1.md
exo2.md		exo2.md
exo3.md		exo3.md
exo4.md		exo4.md
exo5.md		exo5.md
poetry.lock		poetry.lock
pyproject.toml		pyproject.toml