On ObsCore profiles, Obscore extensions and registry matters
BONNAREL FRANCOIS gmail
francois.bonnarel at gmail.com
Tue Nov 26 23:49:47 CET 2024
Dear all,
I wrote an issue to propose a solution to help users to discover
services containing the radio extension
https://github.com/ivoa-std/ObsCoreExtensionForRadioData/issues/73
The last Pull Request on ObsCoreExtensionForRadioData (which is not
merged) describes this solution.
Cheers
Fr/ançois /
> /If we want to complete the basic ObsCore table by a set of new
> standard attributes (= columns) in the TAP_SCHEMA we can define this
> specific set of columns as an "ObsCore profile"/
>
> /The profile is relevant to a "schema" in the tableset which should
> contain all the columns in whatever tables inside the schema./
>
> /It is admitted that in the radio case the basic ObsCore parameters
> and the radio extension specific parameters will be hosted in two
> different tables belonging to the same "ivoa" schema. The
> recommendation is that the basic ObsCore table is called ivoa.obscore
> and that the extension table is called ivoa.obscore_radio./
>
> /The main reason is that the same TAP service may contain data in the
> radio domain and data outside this domain for which the extension
> parameters are irrelevant.
> So storing everything in the same table would imply that many rows in
> the table will show NULL values for the extension parameters./
>
> ------------------------------------------------------------------------
>
> /But how do we help users to discover services which serve these two
> tables ?/
>
> /Each standard data model has a standardID. This is the case of
> ObsCore, of EPN-TAP, of RegTAP..../
>
> /From the registry point of view, the occurrence of an ObsCore table
> itself in a service is recognized via the datamodel element of a
> service capability. This practice has the drawback to match a
> datamodel with a service and not with the tables it serves./
>
> /That's the reason why the practice changed and why EPN-TAP and RegTAP
> used another method./
>
> /This is summarized in this recent IVOA note published by Markus :/
>
> /https://ivoa.net/documents/Notes/TableReg/20240821//
>
> /So if the model is serialized in a single table, let's set the
> standardID of this model as the value of the utype attribute of the
> table in the registry record/
>
> /So if the model is serialized in several tables, let's set the
> standardID of this model as the value of the utype attribute of the
> schema grouping all these tables in the registry record./
>
> /What can happen for the ObsCore extension for radio data ? Obscore
> and it's extension are actually part of the same data model. So they
> have the same basic standardID "ivo://ivoa.net/std/ObsCore" and the
> presence of the extension columns may be rendered by a fragment in the
> URI "ivo://ivoa.net/std/ObsCore#RadioEXt-1.0"/
>
> /Now where can we put this standardID in the registry ?
> Currently the thing is organized in two tables which are strongly
> related. So they are in the same "schema". However setting
> utype="ivo://ivoa.net/std/ObsCore#RadioEXt-1.0" on the schema is not
> appropriate. This would mean all the tables in the schema are dealing
> with radio data. But we may have dataset in the ObsCore table which
> are outside the radio domain./
>
> /Another solution could be to set the
> utype="ivo://ivoa.net/std/ObsCore#RadioEXt-1.0" on the
> ivoa.obscore_radio table only./
>
> /But this may be confusing and encourage users to try to query this
> table only which would be a nonsense. The obscore_radio table alone is
> useless Only a query on a natural join between obscore and
> obscore_radio makes sense./
>
> /Hence the proposal to set the standardID utype on a "view" table
> defined as the natural join of the ObsCore and obscore_radio tables.
> If such a utype is discovered in a service we know that the schemac
> ontaining this view will also contain ObsCore and obscore_radio
> tables. Of course in practice it may be more efficient to query the
> two tables by a direct join instead of this view. But the view is
> there to inform registry users that this service serves ObsCore with
> its radio extension./
>
> /By the way the concept of specific profiles of ObsCore defined this
> way as a full set of columns is agnostic about in which real table we
> find the columns. Hence if we decide later to move some of the
> extension columns in the basic Obscore it's very easy to redefine the
> profile in a new version. This will not break anything./
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.ivoa.net/pipermail/dm/attachments/20241126/2140e7d1/attachment.htm>
More information about the dm
mailing list