Tag: worker

General Spark Transformations
By: Date: July 31, 2017 Categories: Apache Spark Tags: , , , , , , , , , ,

Apache Spark Transformations In this post we will be focussing on general Apache Spark transformation against RDDs. We will keep it simple but try to go as deep as we can. Download link is provided at the bottom for you to run the programs and try it with your input. Goal is to get familiar…

Read More →
Install and configure Spark
By: Date: July 27, 2017 Categories: Apache Spark Tags: , , , , , , , , , ,

Download and configure on Mac/Windows Download the version of Spark that you want to work on from here Copy the downloaded tgz file to a folder where you want it to reside. Either double click the package or run tar -xvzf /path/to/yourfile.tgz command which will extract the spark package. Navigate to bin folder and start ./spark-shell…

Read More →