A proof of concept to see if we can run Spark on AWS Lambda.

Photo by Kevin Ku on Unsplash
├─spark-on-lambda
├───spark-class
├───spark-defaults.conf
├───Dockerfile
└───spark_lambda_demo.py

spark-class

Understand the basic networking of AWS Virtual Private Cloud

VPC components snapshot

VPC

Eventing, messaging or brokering — understand their facets.

Unordered vs Strictly Ordered

Photo by Jaye Haych on Unsplash

Production, Detection, Asynchronous & Reactive processing of events

Photo by Daniele Franchi on Unsplash

Adjusting the search space to reach the target quickly

Template:

  1. Initialize the search space (start and end)
  2. Find Mid of the search space
  3. Discard/select one half based on the specific…

Amit Singh Rathore

Cloud | ML | Big Data

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store