Friday, November 2, 2018

Pyspark error in Amazon Linux

Pyspark error in Amazon Linux

Pyspark - For Big data developments, developers might have to use Python and Spark and hence to meet with the needs, Apache Spark had released Pyspark tool. Using this, Developers & Data-scientists can work with Resilient data structures in Python and Py4j is the library that is making all this possible

Now, I have deployed pyspark as per the installation guide for Amazon Linux but were in the version check, wasnt working with pyspark, post the installation



No comments:

Post a Comment