Transfer of large data
Masahiro TANAKA
masahiro.tanaka at nao.ac.jp
Thu Jul 21 01:31:41 PDT 2005
Dear all,
Have you experienced large data transfer (e.g. >100MB) between
distributed VO machine? Would you tell your practical solution?
Our JVO team has built a SkyNode server which receives a query and
returns a result VOTable through Web Services, using Apache Axis.
Then we encounter a performance problem in large data transfer
using SOAP messages; Large amount of memory is allocated to hold
the entire data as Java objects. It slows processing speed, too.
Sending large data through SOAP messages seems unrealistic.
So we are considering SkyNodes pass result VOTable using:
1. Staging (Result data are separately transferred through HTTP or
FTP, like SIAP)
2. Attachment
Both will need some extension to SkyNode protocol.
Masahiro Tanaka
More information about the dal
mailing list