PySpark -> Python + Spark = ❤️🐍
As i was playing around with Spark on my macbook for a school project, i decided i didn't want to use the version our professor gave us, which was a Java project, and had to be coded in Scala, language i'm not really familiar with.
I love python, really, and as i knew Spark supported python i decided to give a look at what options i had to install and run it for testing and analysis of small datasets on my macbook.
So... For my reference when i'll inevitably reinstall it and will forget the steps, and for you, who are presumably looking to install spark and use it within python, here's how i did it!
(more…)