Building A Development Spark Cluster with Postgres Using Docker And Make

Overview My goal is to build a decent approximation of a production Apache Spark EMR environment for development and testing. For development, I need: A Postgres database to persist datasets. A Spark cluster with two worker nodes. A Jupiter notebook server for prototyping. To submit a PySpark job to the