Remote execution (code to the data)

[Dave Morris]

Dear GWS members,

This email is a follow up on a conversation Vicente Navarro and I had at 
the GWS telecon last month.

I was promoting ExecutionPlanner as a way of developing a common API for 
execution service discovery and orchestration.
https://github.com/ivoa-std/ExecutionPlanner

Vicente was concerned that this may be too complex to implement in 
fast-moving digital scenario depicted by Cloud and Container players. It 
might be better to concentrate on what we already have and see if we can 
define some common patterns for accessing platforms based on a minimum 
compatibility at technology stack level (Kubernetes, S3 etc.). Based on 
this assessment we could measure the gap across organisations in order 
to implement PoCs for those that are close to each other.

I'm following up on this in a mailing list thread because I have also 
heard similar concerns and suggestions from other people too.

This thread is somewhere for us to discuss the pros and cons of the two 
directions, the abstract ExecutionPlanner interface, and the more 
pragmatic approach looking for common patterns in how we use the 
technologies.

Please jump in with your thoughts and suggestions.

Cheers,
-- Dave