Using Spark Streaming for Batch Jobs
Before reading I’d familiarize yourself with Spark Streaming a little bit. The title itself seems a bit confusing since you don’t think about streaming as a batch job.
At times engineers come across a unique situation where they don’t want to reread/rewrite a new data set each time when processing updates/inserts into the data store. Due to the data either being to…