<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=utf-8"><meta name=Generator content="Microsoft Word 15 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:0cm;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
span.StylE-mailovZprvy18
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:70.85pt 70.85pt 70.85pt 70.85pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=CS link="#0563C1" vlink="#954F72"><div class=WordSection1><p class=MsoNormal><span style='mso-fareast-language:EN-US'>Hi Mark,<o:p></o:p></span></p><p class=MsoNormal><span style='mso-fareast-language:EN-US'><o:p> </o:p></span></p><p class=MsoNormal><span style='mso-fareast-language:EN-US'>Answers/thoughts inline.<o:p></o:p></span></p><p class=MsoNormal><span style='mso-fareast-language:EN-US'><o:p> </o:p></span></p><p class=MsoNormal><span style='mso-fareast-language:EN-US'>Cheers,<o:p></o:p></span></p><p class=MsoNormal><span style='mso-fareast-language:EN-US'><o:p> </o:p></span></p><p class=MsoNormal><span style='mso-fareast-language:EN-US'>Jiri<o:p></o:p></span></p><p class=MsoNormal><span style='mso-fareast-language:EN-US'><o:p> </o:p></span></p><div style='border:none;border-left:solid blue 1.5pt;padding:0cm 0cm 0cm 4.0pt'><div><div style='border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm'><p class=MsoNormal><b>From:</b> CresitelloDittmar, Mark [mailto:mdittmar@cfa.harvard.edu] <br><b>Sent:</b> Thursday, August 31, 2017 10:22 PM<br><b>To:</b> Jiří Nádvorník <nadvornik.ji@gmail.com><br><b>Cc:</b> François Bonnarel <francois.bonnarel@astro.unistra.fr>; Mireille Louys <mireille.louys@unistra.fr>; Data Models mailing list <dm@ivoa.net>; voevent@ivoa.net; dal@ivoa.net<br><b>Subject:</b> Re: [timeDomain: model for Time series] discussion on Timeseries Data model Note / ND-point .... or not ??? !!!<o:p></o:p></p></div></div><p class=MsoNormal><o:p> </o:p></p><div><div><div><div><div><div><div><p class=MsoNormal style='margin-bottom:12.0pt'>All,<o:p></o:p></p></div><p class=MsoNormal>I am finally able to devote some time to the VO efforts, and have just been reading through these discussions.<o:p></o:p></p></div><p class=MsoNormal style='margin-bottom:12.0pt'>Maybe someone could summarize for me what the current state is. I would like to get back to iterating through example serializations as that seemed to make things more 'concrete' and provided important feedback about what is reasonable and usable.<o:p></o:p></p></div><div><p class=MsoNormal>Anyway. My impression about the discussion...<o:p></o:p></p></div><div><p class=MsoNormal>1) NDPoint.<o:p></o:p></p></div><p class=MsoNormal style='margin-bottom:12.0pt'> One of the differences between Jiri's approach in the Note, and the Cube model is that my model has this element which, as Francois noted, is primarily to associate a set of Observables as being related. The NDPoint collects data axes (time, pos, energy, mag ). Each instance of NDPoint is a set of values which describe a single 'event'. I believe the column-based approach looses this important relation. Recall, the primary use case for this is an Event List.<o:p></o:p></p><p class=MsoNormal style='margin-bottom:12.0pt'><b><i>[[Jiri Nadvornik]] I’d just like to point out that the difference </i></b><b><i><span lang=EN-US>here is that in the TSCube model we collect the data axes in the SparseCube class directly (time, pos, energy, mag) because we don’t find useful to store axis metadata on the level of each Observable, but rather on the whole Dataset.</span></i></b><span lang=EN-US><o:p></o:p></span></p></div><p class=MsoNormal>2) Errors<o:p></o:p></p></div><p class=MsoNormal> The Observables in the cube model are STC CoordMeasure instances, which include the measured value, associated error, and frame reference. The error modeling to date is assuming a 1-1 association of the value to its error (eg Value +/- Error ). The modeling of errors in STC2 is very extensible and targets the most common error types. It is very compatible to have a separate effort take place to model other sorts of errors ( statistical distributions ) and extend the base STC-2 error class.<o:p></o:p></p><p class=MsoNormal><b><i>[[Jiri Nadvornik]] I agree that the Error class in STC2 is very extensible, but I would go even one step further here because when we have „statistical distribution“ for Error, what’s the Value then? I’d suppose it is just some Expectation or Mean value, which is already part of that statistical distribution.</i></b><o:p></o:p></p></div><div><p class=MsoNormal><br>If the relation is a bit more broad, and the 'measure' itself is a statistical distribution kind of thing, then what you are describing is not an Observable. This sort of thing I expected might come up with simulated data (when we think about bringing SimDM and Cube more in line with each other.. (they are quite compatible)). If this is the case, we we should define a different kind of DataAxis which better facilitates the statistical/mathematical nature of the measurement.<o:p></o:p></p><p class=MsoNormal><b><i>[[Jiri Nadvornik]] I don’t agree completely on the first statement here – I think that even an Observable ‚measure‘ can be represented with a statistical distribution. Typically, a point spread function will have a gaussian distribution where the Flux Value+Error would be just Mean+Sigma of that statistical distribution.<o:p></o:p></i></b></p></div><div><div><div><div><div><p class=MsoNormal><o:p> </o:p></p></div><div><p class=MsoNormal>If the data can not be described as a series of 'events'<o:p></o:p></p></div><div><p class=MsoNormal> "at time T1, we measured these items"<o:p></o:p></p></div><div><p class=MsoNormal> "this source, has these proprerties"<o:p></o:p></p></div><div><p class=MsoNormal style='margin-bottom:12.0pt'>then the data is not a SparseCube. I'm under the impression that most time series do fit this description, but if there are some which do not, we should evaluate an example to see if it needs a different sort of DataProduct.<o:p></o:p></p><p class=MsoNormal style='margin-bottom:12.0pt'><b><i>[[Jiri Nadvornik]] I still think we can fit into this ‚event‘ description with all our use cases. I think in every case the Time Axis points can be actually represented by a single Value, rather than needing some kind of distribution here.<o:p></o:p></i></b></p><p class=MsoNormal style='margin-bottom:12.0pt'><b><i>Does anyone have a time series use case where we have uncertainty when exactly was the ‚measurement‘ taken?</i></b><o:p></o:p></p></div><div><p class=MsoNormal>Mark<o:p></o:p></p></div><div><p class=MsoNormal><o:p> </o:p></p><div><div><p class=MsoNormal><o:p></o:p></p></div></div></div></div></div></div></div></div></div></div></body></html>