Remote function applications: A framework towards Scala Grid Parallel Collections
If we want to get some piece of functionality executed on another server we typically think of remote actors. However, even though actor model might be good fit for solving concurrency problems, it is not necessarily the best weapon for attacking parallelism. One example are computationally intensive pure functions, which are stateless by their nature.
Once there is a framework in place for efficiently applying functions on remote computers and also composing them, the next question becomes: what does it take to bring Scala Parallel Collections to the next level? That is, how would it look like if we wanted to distribute processing collection operations across a compute grid?
The goal of this talk is to present such framework and the API for grid-parallel versions of several collection operations which involve function application (ex. map, flatMap, filter).
Furthermore, it will show a use case application built on this framework solving a more compute than data intensive problem.