Effective Spark Map-like Transformation with External Resource
Suppose we have a Spark RDD, and we want to do transformation on each record by getting the value from an external resource/API/service. How could we do it efficiently?
The most naive way to achieve it can be this:
keyedRDD.map { case(key, record)...