New helper query interface method

[KevinBenson]

Yes this is another option, might mean a lot more calls to the registry
going through each identifier.  Are you thinking of just adding a flag to
the current search interface to get back identifiers or a brand new
interface method?

Yep agreed the max return count is not all that great, even though it really
only affected things in the beginning when we had it as such a low number.
At a high number where it is actually higher than our client apps can take
there seems to not be a problem.  But yes some kind of paging system would
be nice to put in, so even the apps that query for things like all
ConeSearches would not run into a problem.

I forgot to say that the resumptionToken idea is on the server side much
like how OAI does it, but I am not certain maybe there is a way to have the
client tell us there is a max number they want back if it is not to high.

Cheers,
Kevin
-----Original Message-----
From: owner-registry at eso.org [mailto:owner-registry at eso.org]On Behalf Of
Guy Rixon
Sent: 14 April 2005 11:16
To: Paul Harrison
Cc: KevinBenson; Tony Linde; 'Registry List'
Subject: Re: New helper query interface method


If we have the query that just returns the list of identifiers, and we have
the query that returns the document for one identifier, then we wouldn't
need
a paging arrangement; the client could do the paging by calling down the
documents one by one by identifier. This would be a lot simpler.

On Thu, 14 Apr 2005, Paul Harrison wrote:

> KevinBenson wrote:
> >>From what I could tell from Yuji e-mail the main thing is about not
> > returning so much data all at once to the client.  Somebody a long time
ago
> > mentioned a resumptionToken or pagingID concept on the query/search.  I
> > think this is something that would be good and needed.  So you could
page
> > through your query results.  That way you might not return thousands at
a
> > time, but a certain amount and let the client page through all the
results
> > with the registry web service.  A user may send a global query; not even
> > sure if we could handle returning 11,000 resources at once, so this is
> > something we should look into.  The idea would be is to return a
pagingID
> > then a client who wants to see more would send it back again to the
registry
> > web service to get the next set of Resources.
>
> This is a good idea that is worth considering..
> >
> > Cheers,
> > Kevin
> >
> > FYI, I will say Astrogrid does use a maxcount kind of property, so that
is
> > the maximum number of resources that is returned from the registry.  But
> > having a paging system would be nicer in case a user wants to see more
> > results.
>
> A max return count that is set on the server is a bad idea - we have
> spend time tearing our hair out in the past wondering why a resource was
> not returned, when it had been cut off silently by such a mechanism..
>
> >
> > -----Original Message-----
> > From: owner-registry at eso.org [mailto:owner-registry at eso.org]On Behalf Of
> > Tony Linde
> > Sent: 14 April 2005 08:27
> > To: 'Registry List'
> > Subject: RE: New helper query interface method
> >
> >
> >
> >>I also think that Yuji Shirasaki's idea of having a search
> >>that returns a list of identifiers for a query is a
> >>potentially good one, and possibly even a function that
> >>returns the number of matches for a query.
> >>- This could of course be done with a single query interface
> >>function but with a slightly extended RQL
> >
> >
> > Perhaps a flag indicating whether to return 'documents', 'identifiers'
or
> > 'count' on the query?
> >
> > T.
> >
> >
> >>-----Original Message-----
> >>From: owner-registry at eso.org [mailto:owner-registry at eso.org]
> >>On Behalf Of Paul Harrison
> >>Sent: 14 April 2005 08:15
> >>To: Ray Plante
> >>Cc: Registry List
> >>Subject: Re: New helper query interface method
> >>
> >>Ray Plante wrote:
> >>
> >>>Hi,
> >>>
> >>>
> >>>
> >>>>GetResource
> >>>
> >>>
> >>>I think it would be good to have an explicit identifier resolver
> >>>function, even though this is possible directly with the
> >>
> >>constraint-based search.
> >>
> >>>(In fact, we should define it as being equivalient to a search with
> >>>the constraint "identifier='{ivo-id}'".)  An immediate use for this
> >>>would be to check that an authority ID is not already registered;
> >>>however, I can imagine other applications using this.
> >>>
> >>>On Wed, 13 Apr 2005, Matthew J. Graham wrote:
> >>>
> >>>
> >>>>But this is exactly the same as the OAI GetRecord method?
> >>>
> >>>
> >>>The proposal is to make it specifically part of the Search
> >>
> >>interface
> >>
> >>>(which should be independent of the Harvesting interface).
> >>>
> >>>cheers,
> >>>Ray
> >>>
> >>
> >>It would please me! -the majority of the queries that I want
> >>to make are of this form, and it would save having to create
> >>adql for the purpose....
> >>
> >>I also think that Yuji Shirasaki's idea of having a search
> >>that returns a list of identifiers for a query is a
> >>potentially good one, and possibly even a function that
> >>returns the number of matches for a query.
> >>- This could of course be done with a single query interface
> >>function but with a slightly extended RQL
> >>
> >>Regards,
> >>	Paul.
> >>
> >>--
> >>Paul Harrison
> >>ESO Garching
> >>www.eso.org
> >>
> >
> >
> >
> >
>
>
> --
> Paul Harrison
> ESO Garching
> www.eso.org
>

Guy Rixon 				        gtr at ast.cam.ac.uk
Institute of Astronomy   	                Tel: +44-1223-337542
Madingley Road, Cambridge, UK, CB3 0HA		Fax: +44-1223-337523