Spark Environment #2
Description
We need a Spark environment is for processing batch or streaming data. This environment will include a spark master and spark workers. It should also include a notebook system that is connected to it as well.
This should include all containers and pods needed to run a spark environment and notebook system to interact with it.