Apache Spark Transformations In this post we will be focussing on general Apache Spark transformation against RDDs. We will keep it simple but try to go as deep as we can. Download link is provided at the bottom for you to run the programs and try it with your input. Goal is to get familiar…
Read More →Tag: worker
Download and configure on Mac/Windows Download the version of Spark that you want to work on from here Copy the downloaded tgz file to a folder where you want it to reside. Either double click the package or run tar -xvzf /path/to/yourfile.tgz command which will extract the spark package. Navigate to bin folder and start ./spark-shell…
Read More →