Download and install Gnu on windows (GOW) from the following link.Those who want to install pyspark they need to install few more tools : (It depends on your machine if you are using 64bit windows version, download 64 bit winutils.exe or if it is 32bit windows version use 32bit winutils.exe).winutils.exe 64 bit or 32 bit version, you can download them from below:.
Spark is written in Scala( combination of object-oriented plus functional programming). In 2013 spark was donated to Apache Software Foundation where it became top-level Apache project in 2014. It was open sourced in 2010 under BSD license. Spark provides an interface for programming entire clusters with implicit data parallelism and fault tolerance.Īpache Spark was introduced in 2009 in the UC Berkeley R&D Lab, later it becomes AMPLab. Originally developed at the University of California, Berkeley's AMPLab, the Spark codebase was later donated to the Apache Software Foundation, which has maintained it since. Let me introduce some facts about apache spark :Īpache Spark is an open-source cluster-computing framework.
