<div dir="ltr"><div class="gmail_default" style="font-size:small"><br></div><div class="gmail_default" style="font-size:small">Hi again,</div><div class="gmail_default" style="font-size:small"><br></div><div class="gmail_default" style="font-size:small">I have finally got to releasing the changes in our registr service with some updated and deleted records and declaring support for persistent deletion tracking in the Identify record.</div><div class="gmail_default" style="font-size:small">Timestamps are ~2019-09-20T16:00:00 for anyone that wants to peek at their logs and let me know that thinsg went OK.</div><div class="gmail_default" style="font-size:small"><br></div><div class="gmail_default" style="font-size:small">The summary:</div><div class="gmail_default" style="font-size:small">- a few updated records</div><div class="gmail_default" style="font-size:small">- one new record<br></div><div class="gmail_default" style="font-size:small">- three deleted records <br clear="all"></div><div><div dir="ltr" class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div>--<br></div><div>Patrick Dowler<br></div>Canadian Astronomy Data Centre<br></div>Victoria, BC, Canada<br></div></div></div></div></div><br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Fri, 13 Sep 2019 at 14:14, Patrick Dowler <<a href="mailto:pdowler.cadc@gmail.com">pdowler.cadc@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div class="gmail_default" style="font-size:small">I'll probably be ready to push this out on Mnday or Tuesday next week. I'll let you know when it happens so you can see how things work when harvested.</div><div class="gmail_default" style="font-size:small"><br></div><div class="gmail_default" style="font-size:small">have a good weekend,</div><div class="gmail_default" style="font-size:small"><br clear="all"></div><div><div dir="ltr" class="gmail-m_-4062431063425753111gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div>--<br></div><div>Patrick Dowler<br></div>Canadian Astronomy Data Centre<br></div>Victoria, BC, Canada<br></div></div></div></div></div><br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Fri, 13 Sep 2019 at 12:09, Theresa Dower <<a href="mailto:dower@stsci.edu" target="_blank">dower@stsci.edu</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div>
<div id="gmail-m_-4062431063425753111gmail-m_-2653266080868638620divtagdefaultwrapper" style="font-size:12pt;color:rgb(0,0,0);font-family:Calibri,Helvetica,sans-serif" dir="ltr">
<p><br>
</p>
<p>Pat,</p>
<p><br>
</p>
<p>Good catch! Yes, also NOT including the element with status 'deleted' in GetRecord is correct. (It is in fact a thing the ST registry did wrong for a long time, and does generate RofR validation errors.) And yes, persistent is the right tag for long-term
deletion support, not 'full'; that's for the harvesting/searching end, sorry. </p>
<p><br>
</p>
<p>--Theresa</p>
</div>
<hr style="display:inline-block;width:98%">
<div id="gmail-m_-4062431063425753111gmail-m_-2653266080868638620divRplyFwdMsg" dir="ltr"><font style="font-size:11pt" face="Calibri, sans-serif" color="#000000"><b>From:</b> <a href="mailto:registry-bounces@ivoa.net" target="_blank">registry-bounces@ivoa.net</a> <<a href="mailto:registry-bounces@ivoa.net" target="_blank">registry-bounces@ivoa.net</a>> on behalf of Patrick Dowler <<a href="mailto:pdowler.cadc@gmail.com" target="_blank">pdowler.cadc@gmail.com</a>><br>
<b>Sent:</b> Thursday, September 12, 2019 6:55:08 PM<br>
<b>To:</b> <a href="mailto:registry@ivoa.net" target="_blank">registry@ivoa.net</a><br>
<b>Subject:</b> Re: deleting a record from the registry</font>
<div> </div>
</div>
<div>
<div dir="ltr">
<div class="gmail_default" style="font-size:small">Theresa,</div>
<div class="gmail_default" style="font-size:small"><br>
</div>
<div class="gmail_default" style="font-size:small">Thanks for the info. It wasn't too hard to add status="deleted" support and will change deletedRecord to persistent in the Identify response as well.
<br>
</div>
<div class="gmail_default" style="font-size:small"><br>
</div>
<div class="gmail_default" style="font-size:small">I see in the link you sent about Deleted record support that OAI says I must not include metadata (element) in GetRecord responses when status="deleted" -- just the header element. That's fine for me as I wanted
to remove the actionable information anyway and as I interpret it I must remove all if it. Am I reading that correctly?</div>
<div class="gmail_default" style="font-size:small"><br>
</div>
<div class="gmail_default" style="font-size:small"><br>
</div>
<div class="gmail_default" style="font-size:small"><br clear="all">
</div>
<div>
<div dir="ltr" class="gmail-m_-4062431063425753111gmail-m_-2653266080868638620gmail_signature">
<div dir="ltr">
<div>
<div dir="ltr">
<div>
<div>--<br>
</div>
<div>Patrick Dowler<br>
</div>
Can<span class="gmail_default" style="font-size:small"></span>adian Astronomy Data Centre<br>
</div>
Victoria, BC, Canada<br>
</div>
</div>
</div>
</div>
</div>
<br>
</div>
<br>
<div class="gmail_quote">
<div dir="ltr" class="gmail_attr">On Thu, 12 Sep 2019 at 10:11, Theresa Dower <<a href="mailto:dower@stsci.edu" target="_blank">dower@stsci.edu</a>> wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div>
<div id="gmail-m_-4062431063425753111gmail-m_-2653266080868638620gmail-m_-5630548835742187147divtagdefaultwrapper" style="font-size:12pt;color:rgb(0,0,0);font-family:Calibri,Helvetica,sans-serif" dir="ltr">
<p>Pat,</p>
<p><br>
</p>
<p>Short answer: Yes, please! Also try to ensure this removes the item from your ListHeaders response, or add deletion status information to the ListIdentifiers response (<a href="http://www.openarchives.org/OAI/openarchivesprotocol.html#ListIdentifiers" class="gmail-m_-4062431063425753111gmail-m_-2653266080868638620gmail-m_-5630548835742187147OWAAutoLink" id="gmail-m_-4062431063425753111gmail-m_-2653266080868638620gmail-m_-5630548835742187147LPlnk108107" target="_blank">http://www.openarchives.org/OAI/openarchivesprotocol.html#ListIdentifiers</a>).</p>
<p><br>
</p>
<p>Long answer: You don't strictly have to do any of this, as your registry is marked "transient" in its Identify response (<a href="http://www.cadc-ccda.hia-iha.nrc-cnrc.gc.ca/reg/oai?verb=Identify" class="gmail-m_-4062431063425753111gmail-m_-2653266080868638620gmail-m_-5630548835742187147OWAAutoLink" id="gmail-m_-4062431063425753111gmail-m_-2653266080868638620gmail-m_-5630548835742187147LPlnk44997" target="_blank">http://www.cadc-ccda.hia-iha.nrc-cnrc.gc.ca/reg/oai?verb=Identify</a>),
regarding the treatment of deleted records. "Transient" is the OAI-PMH tag for promising nothing regarding deleted records, not even consistency (<a href="http://www.openarchives.org/OAI/openarchivesprotocol.html#DeletedRecords" class="gmail-m_-4062431063425753111gmail-m_-2653266080868638620gmail-m_-5630548835742187147OWAAutoLink" id="gmail-m_-4062431063425753111gmail-m_-2653266080868638620gmail-m_-5630548835742187147LPlnk635769" target="_blank">http://www.openarchives.org/OAI/openarchivesprotocol.html#DeletedRecords</a>).
The very existence of this tag suggests a more lax curation atmosphere for some fields using OAI technology than we strive for.
<br>
</p>
<p><br>
</p>
<p>However, to be a good IVOA registry citizen, I would greatly encourage going through this effort rather than just quietly deleting the records. The will keep your ghost records from persisting in full registries' searches until such time as each builds its
own snapshot of all registries from scratch, which does not happen often. If you do go through this effort, you might as well change "transient" to "full" in your registry record to note other registries can trust record status. If you take the time to make
this change and want some end-to-end testing, I'm happy to run the STScI harvester against it and check the logs/status on our end.</p>
<p><br>
</p>
<p>Thanks!</p>
<p>--Theresa<br>
</p>
</div>
<hr style="display:inline-block;width:98%">
<div id="gmail-m_-4062431063425753111gmail-m_-2653266080868638620gmail-m_-5630548835742187147divRplyFwdMsg" dir="ltr"><font style="font-size:11pt" face="Calibri, sans-serif" color="#000000"><b>From:</b>
<a href="mailto:registry-bounces@ivoa.net" target="_blank">registry-bounces@ivoa.net</a> <<a href="mailto:registry-bounces@ivoa.net" target="_blank">registry-bounces@ivoa.net</a>> on behalf of Patrick Dowler <<a href="mailto:pdowler.cadc@gmail.com" target="_blank">pdowler.cadc@gmail.com</a>><br>
<b>Sent:</b> Thursday, September 12, 2019 11:07:29 AM<br>
<b>To:</b> <a href="mailto:registry@ivoa.net" target="_blank">registry@ivoa.net</a><br>
<b>Subject:</b> deleting a record from the registry</font>
<div> </div>
</div>
<div>
<div dir="ltr">
<div class="gmail_default" style="font-size:small"><br>
</div>
<div class="gmail_default" style="font-size:small">As you recall, we are operating a really simple hack OAI publishing registry and I have reached the point where I have to delete some old records. Looking at VOResource, I think the minimum I have to do is:</div>
<div class="gmail_default" style="font-size:small"><br>
</div>
<div class="gmail_default" style="font-size:small">- set the status attr on the resource to "deleted"<br>
</div>
<div class="gmail_default" style="font-size:small">- set the updated attr of the resource to current timestamp so it gets harvested</div>
<div class="gmail_default" style="font-size:small">- set the datestamp in the header to match</div>
<div class="gmail_default" style="font-size:small"><br>
</div>
<div class="gmail_default" style="font-size:small">Is that it? <br>
</div>
<div class="gmail_default" style="font-size:small"><br>
</div>
<div class="gmail_default" style="font-size:small">Can/should I remove other metadata? I'd like to remove the content and capability elements, but would leave the title, shortName, identifier, and curation in the "deleted" record".
<br>
</div>
<div class="gmail_default" style="font-size:small"><br>
</div>
<div class="gmail_default" style="font-size:small">thanks,</div>
<div class="gmail_default" style="font-size:small"><br clear="all">
</div>
<div>
<div dir="ltr" class="gmail-m_-4062431063425753111gmail-m_-2653266080868638620gmail-m_-5630548835742187147gmail_signature">
<div dir="ltr">
<div>
<div dir="ltr">
<div>
<div>--<br>
</div>
<div>Patrick Dowler<br>
</div>
Canadian Astronomy Data Centre<br>
</div>
Victoria, BC, Canada<br>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote></div>
</blockquote></div>