Harvesting experiences

[Gretchen Greene]

Hey Kevin,

No problem, since you have been running for a while it makes sense you would
have deleted resources appearing.
Technically it shouldn't matter for the harvesting because the new
registries will start with a clean slate and have
nothing to delete (assuming it doesn't break on the ingest).  

It would be nice however if we could have only active resources for the turn
on of the new registries such that as deleted resources appear,  we can
validate that our systems are synchronizing properly and that the resources
from previous published versions are no longer required.

-Gretchen

 
-----Original Message-----
From: owner-registry at eso.org [mailto:owner-registry at eso.org] On Behalf Of
KevinBenson
Sent: Tuesday, April 29, 2008 2:23 PM
To: Matthew Graham
Cc: Gretchen Greene; 'Guy Rixon'; 'IVOA Registry WG'
Subject: Re: Harvesting experiences

I missed that memo.  I remember from our telecon that it was agreed any 
deleted resources from 0.10 do not need to be converted to 1.0  But did 
not know that on April 21st to remove any of the deleted resources that 
has happened (if you were already using 1.0).
*Note Astrogrid has been on 1.0 from some months so that is why a few 
deleted ones came in.

So Matthew and Gretchen what would you prefer.  I can remove those few 
resources tomorrow morning from the database quite easily so there are 
no 'deleted' resources.  Or would you prefer to leave 'as is'

cheers,
Kevin

Matthew Graham wrote:
> Hi,
>
> That was my understanding as well which is why I flagged these items.
>
>     Cheers,
>
>     Matthew
> On Apr 29, 2008, at 8:10 AM, Gretchen Greene wrote:
>
>> I thought the plan was for the initial VOR 1.0 populations that we 
>> would do
>> a 'fresh' harvest and not have
>> Deleted resources,  then for ongoing operations,  the deleted resources
>> would be included so that we can
>> Keep synchronization.
>>
>> -----Original Message-----
>> From: owner-registry at eso.org [mailto:owner-registry at eso.org] On 
>> Behalf Of
>> Guy Rixon
>> Sent: Tuesday, April 29, 2008 5:50 AM
>> To: KevinBenson
>> Cc: Matthew Graham; IVOA Registry WG
>> Subject: Re: Harvesting experiences
>>
>> Hi Kevin,
>>
>> independent of the details of OAI, I see a practical problem with
>> returning deleted records in that we build up many of these over
>> time. I think it could bog down the harvesting. So this is at least
>> "fix later" if not "fix RSN".
>>
>> Cheers,
>> Guy
>>
>> On 29 Apr 2008, at 10:28, KevinBenson wrote:
>>
>>> For (3)  is there a problem with returning deleted records?
>>>
>>> Matthew Graham wrote:
>>>> Hi,
>>>>
>>>> I did a harvest of all registries in the RofR this evening and found:
>>>>
>>>> (3) There are deleted records being returned:
>>
>>