Transfer of large data

[Wil O'Mullane]

We are also discussng attachments and stageing(VOStore).
indeed this needs to become part of the next SkyNode spec.

VoStore would be nice to get going.

On Thu, Jul 21, 2005 at 05:31:41PM +0900, Masahiro TANAKA wrote:
> Dear all,
> 
> Have you experienced large data transfer (e.g. >100MB) between
> distributed VO machine?  Would you tell your practical solution?
> 
> Our JVO team has built a SkyNode server which receives a query and
> returns a result VOTable through Web Services, using Apache Axis.
> Then we encounter a performance problem in large data transfer
> using SOAP messages; Large amount of memory is allocated to hold
> the entire data as Java objects. It slows processing speed, too.
> Sending large data through SOAP messages seems unrealistic.
> 
> So we are considering SkyNodes pass result VOTable using:
>  1. Staging (Result data are separately transferred through HTTP or
> 	     FTP, like SIAP)
>  2. Attachment
> Both will need some extension to SkyNode protocol.
> 
> Masahiro Tanaka