[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[gnuastro-devel] [task #15181] Fits program using network libraries for
From: |
Mohammad Akhlaghi |
Subject: |
[gnuastro-devel] [task #15181] Fits program using network libraries for optimal download |
Date: |
Thu, 14 Feb 2019 06:30:55 -0500 (EST) |
User-agent: |
Mozilla/5.0 (X11; Linux x86_64; rv:65.0) Gecko/20100101 Firefox/65.0 |
URL:
<https://savannah.gnu.org/task/?15181>
Summary: Fits program using network libraries for optimal
download
Project: GNU Astronomy Utilities
Submitted by: makhlaghi
Submitted on: Thu 14 Feb 2019 11:30:52 AM UTC
Should Start On: Thu 14 Feb 2019 12:00:00 AM UTC
Should be Finished on: Thu 14 Feb 2019 12:00:00 AM UTC
Category: Fits
Priority: 5 - Normal
Item Group: Enhancement
Status: Postponed
Privacy: Public
Percent Complete: 0%
Assigned to: None
Open/Closed: Open
Discussion Lock: Any
Effort: 0.00
_______________________________________________________
Details:
CFITSIO allows the usage of network addresses as input FITS files. However,
after some tests, I noticed that it simply first downloads the full file, then
prepares the required extension/region. So in effect, its is no different from
a full download of the full file first, then running CFITSIO on it.
But if we follow the FITS standard, and considering the fact that we can ask
download libraries (like cURL), to only download certain byte ranges. In this
way, we can optimize the network traffic when only certain extensions/parts of
a file on the server are requested.
As servers are hosting larger and larger datasets, optimal usage of network
traffic can greatly help in speeding up of processing.
_______________________________________________________
Reply to this item at:
<https://savannah.gnu.org/task/?15181>
_______________________________________________
Message sent via Savannah
https://savannah.gnu.org/
- [gnuastro-devel] [task #15181] Fits program using network libraries for optimal download,
Mohammad Akhlaghi <=