Application of distributed caching for Astronomical databases

[Alex Szalay]

I think that you are exactly on the right track. We have been rewriting our SkyQuery application to minimize the data transfers for exactly the same reason.
You should submit your work to the ADASS conference coming up in October.

--Alex

From: dal-bounces at ivoa.net [mailto:dal-bounces at ivoa.net] On Behalf Of KV Santhilata
Sent: Monday, May 18, 2015 5:17 PM
To: dal at ivoa.net
Subject: Application of distributed caching for Astronomical databases

Hi,

My name is Santhilata. I am a research student in the department of Informatics  at King's college London, UK.

  I have attended IVOA-2011 in Pune, India and then I have observed that IVOA is not exactly working in the area of reducing large data transfers. In a typical virtual observatory scenario, a community of like minded astronomers would query for same data repeatedly. With huge number of columns and millions of rows, when a query needs data from multiple (distributed) databases, a distributed caching mechanism is necessary.

I am working on the benefits of caching partial queries as data objects from a community cache. This exactly suits for astronomical data as, the typical queries can be moulded as full / partial data objects. This particular quality enables us to find patterns in the user queries and use those patterns for cache refreshing. I would like to extend this work to develop mobile cache systems.

I would like to present my work at the forth coming IVOA to get suggestions and further ideas. Please suggest me whether this suits to your agenda.



- Regards,

Santhilata K.V





-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.ivoa.net/pipermail/dal/attachments/20150528/18a796a5/attachment.html>