A proof of concept to see if we can run Spark on AWS Lambda.

Photo by Kevin Ku on Unsplash
├─spark-on-lambda
├───spark-class
├───spark-defaults.conf
├───Dockerfile
└───spark_lambda_demo.py

spark-class

Amit Singh Rathore

Cloud | ML | Big Data

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store