<html><head><meta http-equiv="Content-Type" content="text/html charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">Hi Brian,<div class=""><br class=""></div><div class="">Thanks for sending these around, it looks like a lot of great ground was covered!</div><div class=""><br class=""></div><div class="">Unfortunately I won’t be able to make it to Victoria in May, but should be in Washington (well, Maryland) in October.</div><div class=""><br class=""></div><div class="">Cheers,</div><div class="">Simon<br class=""><div class=""><br class=""></div><div class=""><br class=""><div class="">
<div style="color: rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">Simon O'Toole<br class="">AAO Data Central Project Scientist<br class="">Australian Astronomical Observatory<br class="">105 Delhi Rd, North Ryde NSW 2113<br class=""></div><div style="color: rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><br class=""></div><br class="Apple-interchange-newline">
</div>
<br class=""><div><blockquote type="cite" class=""><div class="">On 10 Mar 2018, at 10:55 am, Brian Major <<a href="mailto:major.brian@gmail.com" class="">major.brian@gmail.com</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><div dir="ltr" class="">Dear grid,<br class=""><br class="">At the end of February, a "Science Platforms" workshop was held at STScI in Baltimore. It served as a follow-up to the well attended BoF on Science Platforms at held in October at ADASS in Santiago. This workshop was a fruitful 2.5 day informal gathering of (predominantly) US-based data centres and projects to share with each other groups' experiences in building cloud-based science platforms. Thank you to Arfon Smith and the rest of the organizers for putting this on.<br class=""><br class="">Here are the slides from the presentation:<br class=""><br class=""> <a href="https://stsci.app.box.com/s/65e6suh52b9swr2mg63k6t3qphnnbnrj/folder/47579869370" class="">https://stsci.app.box.com/s/65e6suh52b9swr2mg63k6t3qphnnbnrj/folder/47579869370</a><br class=""><br class="">Detailed meeting notes of the breakaway sessions can be found on the dedicated GitHub site for the workshop:<br class=""><br class=""> <a href="https://github.com/spacetelescope/science-platforms-workshop" class="">https://github.com/spacetelescope/science-platforms-workshop</a><br class=""><br class="">Some of my observations/notes:<br class=""><br class=""> - The projects and groups in attendance are converging towards a common set of technologies and architecture to support interactive data analysis. The list is not surprising: a notebook environment (Jupyter / JupyterLab), a notebook spawner (Jupyter Hub), a container environment (Docker), a container orchestration environment (Kubernetes). Data discovery from the notebooks though TAP or a similar query service. Data is made available through an abstraction layer to distributed file systems and/or network storage.<br class=""><br class=""> - A reference architecture reflecting these technologies was discussed.<br class=""><br class=""> - The mechanism for offering and operating batch processing services is less clear.<br class=""><br class=""> - Kubernetes is emerging as a must-have technology for operating container based platforms. However, it probably won't be something that users interact with directly.<br class=""><br class=""> - There were some very good discussions involving the VO:<br class=""> - <a href="https://github.com/spacetelescope/science-platforms-workshop/blob/master/notes/VO-Astropy-Integration-Splinter.md" class="">https://github.com/spacetelescope/science-platforms-workshop/blob/master/notes/VO-Astropy-Integration-Splinter.md</a><br class=""> - <a href="https://github.com/spacetelescope/science-platforms-workshop/blob/master/notes/interoperability-vs-collaboration.md" class="">https://github.com/spacetelescope/science-platforms-workshop/blob/master/notes/interoperability-vs-collaboration.md</a><br class=""><br class=""> - Software is taking a front row seat in astronomy and these platforms are helping in many ways to enable software science reproducibility.<br class=""><br class=""> - Groups are keen on collaborating, whether it be through open source software and standards.<br class=""><br class="">At the IVOA meeting to be held in Victoria at the end of May there will be a session dedicated to the topic of Science Platforms. I encourage you to use this opportunity to share your implementation experiences as the GWS working group looks for ways to integrate these platforms into the astronomy data community.<br class=""><br class="">Cheers,<br class="">Brian<br clear="all" class=""><div class=""><br class=""></div><br style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration-style:initial;text-decoration-color:initial" class=""><div class="gmail_signature" style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration-style:initial;text-decoration-color:initial"><div dir="ltr" class=""><font size="2" color="#999999" class="">Brian Major<br class=""><br class="">Canadian Astronomy Data Centre<br class="">National Research Council Canada</font></div></div><br class=""></div>
</div></blockquote></div><br class=""></div></div></body></html>