<div dir="ltr"><div>Hi Grid,</div><div><br></div><div>Sorry, the links to the presentations have changed. Here they are again:</div><div><br></div><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">- Slides from the workshop:<span> </span></span><a href="https://stsci.box.com/s/5ypxsgpbdhr7r2x92o97ilsl91fe3uwo" rel="noreferrer" target="_blank" style="color:rgb(17,85,204);font-family:arial,sans-serif;font-size:12.8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255)">https://stsci.box.com/s/<wbr>5ypxsgpbdhr7r2x92o97ilsl91fe3u<wbr>wo</a><br style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial"><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">- GitHub repository with notes:<span> </span></span><a href="https://github.com/spacetelescope/science-platforms-workshop" rel="noreferrer" target="_blank" style="color:rgb(17,85,204);font-family:arial,sans-serif;font-size:12.8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255)">https://github.com/<wbr>spacetelescope/science-<wbr>platforms-workshop</a><br style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial"><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">- Slack channel:<span> </span></span><a href="https://scienceplatforms.slack.com/" rel="noreferrer" target="_blank" style="color:rgb(17,85,204);font-family:arial,sans-serif;font-size:12.8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255)">https://scienceplatforms.<wbr>slack.com</a><div><br></div><div>Brian</div><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Mar 9, 2018 at 6:55 PM, Brian Major <span dir="ltr"><<a href="mailto:major.brian@gmail.com" target="_blank">major.brian@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Dear grid,<br><br>At the end of February, a "Science Platforms" workshop was held at STScI in Baltimore. It served as a follow-up to the well attended BoF on Science Platforms at held in October at ADASS in Santiago. This workshop was a fruitful 2.5 day informal gathering of (predominantly) US-based data centres and projects to share with each other groups' experiences in building cloud-based science platforms. Thank you to Arfon Smith and the rest of the organizers for putting this on.<br><br>Here are the slides from the presentation:<br><br> <a href="https://stsci.app.box.com/s/65e6suh52b9swr2mg63k6t3qphnnbnrj/folder/47579869370" target="_blank">https://stsci.app.box.com/s/<wbr>65e6suh52b9swr2mg63k6t3qphnnbn<wbr>rj/folder/47579869370</a><br><br>Detailed meeting notes of the breakaway sessions can be found on the dedicated GitHub site for the workshop:<br><br> <a href="https://github.com/spacetelescope/science-platforms-workshop" target="_blank">https://github.com/<wbr>spacetelescope/science-<wbr>platforms-workshop</a><br><br>Some of my observations/notes:<br><br> - The projects and groups in attendance are converging towards a common set of technologies and architecture to support interactive data analysis. The list is not surprising: a notebook environment (Jupyter / JupyterLab), a notebook spawner (Jupyter Hub), a container environment (Docker), a container orchestration environment (Kubernetes). Data discovery from the notebooks though TAP or a similar query service. Data is made available through an abstraction layer to distributed file systems and/or network storage.<br><br> - A reference architecture reflecting these technologies was discussed.<br><br> - The mechanism for offering and operating batch processing services is less clear.<br><br> - Kubernetes is emerging as a must-have technology for operating container based platforms. However, it probably won't be something that users interact with directly.<br><br> - There were some very good discussions involving the VO:<br> - <a href="https://github.com/spacetelescope/science-platforms-workshop/blob/master/notes/VO-Astropy-Integration-Splinter.md" target="_blank">https://github.com/<wbr>spacetelescope/science-<wbr>platforms-workshop/blob/<wbr>master/notes/VO-Astropy-<wbr>Integration-Splinter.md</a><br> - <a href="https://github.com/spacetelescope/science-platforms-workshop/blob/master/notes/interoperability-vs-collaboration.md" target="_blank">https://github.com/<wbr>spacetelescope/science-<wbr>platforms-workshop/blob/<wbr>master/notes/interoperability-<wbr>vs-collaboration.md</a><br><br> - Software is taking a front row seat in astronomy and these platforms are helping in many ways to enable software science reproducibility.<br><br> - Groups are keen on collaborating, whether it be through open source software and standards.<br><br>At the IVOA meeting to be held in Victoria at the end of May there will be a session dedicated to the topic of Science Platforms. I encourage you to use this opportunity to share your implementation experiences as the GWS working group looks for ways to integrate these platforms into the astronomy data community.<br><br>Cheers,<br>Brian<br clear="all"><div><br></div><br style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration-style:initial;text-decoration-color:initial"><div class="m_3477212427901991105gmail_signature" style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration-style:initial;text-decoration-color:initial"><div dir="ltr"><font size="2" color="#999999">Brian Major<br><br>Canadian Astronomy Data Centre<br>National Research Council Canada</font></div></div><br></div>
</blockquote></div><br></div></div>