Re: [Savannah-hackers-public] Re: GNU Planet and Savannah

[Sylvain Beucler]

Hi,

In about 4 days 1/2, GNU Planet downloaded ~200MB from the Savannah
frontend out of ~35GB, so ~0.5%. At the previous 4x rate => 2%.

In the same interval, GNU Planet made ~56000 requests out of 1.6M, so
around 3.5%. At the previous 4x rate => 14%.


So the issue isn't the bandwidth, but the number of requests.

Hence I am more interested in optimizations that lower the number of
requests.

I'll try to have a look at planetplanet and see what can be done in
that regard.

-- 
Sylvain

On Thu, Jan 15, 2009 at 11:01:18AM +0100, Nacho Gonzalez Lopez wrote:
> Hi all.
> 
> I was reading about planet and thinking about how reduce the bandwidth
> consumption in GNUplanet and savannah. The main problem I see is that we
> must to check 360 RSS feed from savannah for complete the information of
> GNUplanet.
> 
> I think we have two options:
> 
> 1.- Implement a GNU RSS feed in savannah for check. This feed must
> contain latest news of all GNU projects. We will only check this feed
> and use it to feed our Planet. This is a little bit hard to implement,
> because we must to change both software (savannah and planet).
> 
> 2.- Install a planet locally in savannah for use planet cache.
> When planet checks a feed, it stores all new data in a cache and then
> builds the webpage with this information. We could install a planet
> locally in savannah for get all feeds in local (saving bandwidth) and
> later "rsync" this directory from GNUchapters machine. This must get
> only the updated feeds. You also can ignore GNUplanet hits in your
> webstats, because the access will be local :).
> 
> 
> I think the second option is easiest and we only must to make little
> changes in planet (prevent planet to update the cache file if it isn't
> updated or make a "intelligent" script that syncs only only really
> updated files). No changes in savannah sources or platform are needed :)
> 
> If you are agree with me and let me access to savannah webserver (a
> non-privileged account must be enough), I'll install and maintain this
> mirror :). I already have a savannah account (nacho) but I think it's
> only a web account without any shell access.
> 
> Best regards,
> Nacho.