[Savannah-cvs] [87] update for new "allgnu" mirmon instanced,

[karl]

Revision: 87
          http://svn.sv.gnu.org/viewvc/?view=rev&root=administration&revision=87
Author:   karl
Date:     2014-06-10 18:28:11 +0000 (Tue, 10 Jun 2014)
Log Message:
-----------
update for new "allgnu" mirmon instanced,
requested by GNU webmaster Dora Scilipoti,
sv-hackers-private 29 Apr 2014 19:20:46.

Modified Paths:
--------------
    trunk/sviki/Mirmon.mdwn

Modified: trunk/sviki/Mirmon.mdwn
===================================================================
--- trunk/sviki/Mirmon.mdwn     2014-05-20 23:07:03 UTC (rev 86)
+++ trunk/sviki/Mirmon.mdwn     2014-06-10 18:28:11 UTC (rev 87)
@@ -1,49 +1,78 @@
-Mirmon operates on download.savannah.gnu.org.  We run mirmon for mirrors
-of ftp.gnu.org and of dl.sv.nongnu.org.  In each case, there is a
-multiplexor so users can be automatically redirected.
+Our [mirmon](http://www.staff.science.uu.nl/~penni101/mirmon/) instance
+operates on download.savannah.gnu.org.  We run [three instances of
+mirmon](http://download.savannah.gnu.org/mirmon/): one each for http
+mirrors of ftp.gnu.org and of dl.sv.nongnu.org for use by a multiplexor
+so users can be automatically redirected, and a third for all mirrors of
+ftp.gnu.org, for human consumption.
 
-Stuff for GNU:
+The general information page for folks willing to run mirrors for either
+gnu or nongnu is <http://www.gnu.org/server/mirror.html>.  More mirrors
+are always welcome.  Savannah admins: the process for adding new nongnu
+mirrors is at the end of the [[DownloadArea]] page.
 
-- gnu mirror list - <http://www.gnu.org/prep/ftp.html>
-    (generated from <http://www.gnu.org/prep/FTP>)
-- gnu mirmon conf - `/etc/mirmon-gnu.conf`
-- gnu mirmon web page - <http://download.savannah.gnu.org/mirmon/gnu/>
-- gnu multiplexor example - <http://ftpmirror.gnu.org/emacs/>
-- gnu direct, not multiplexed - <http://ftp.gnu.org/gnu/emacs/>
+GNU info
+--------
 
-Stuff for nongnu:
+The list of ftp.gnu.org mirrors is <http://www.gnu.org/prep/ftp.html>,
+generated from <http://www.gnu.org/prep/FTP>, maintained by webmasters.
 
-- nongnu mirror list -
+The "gnu" mirmon instance is for the multiplexor that automatically
+redirects downloads to a (hopefully) nearby and up to date mirror.
+Only http urls are included, because everything else has proven too
+unreliable for users in practice.
+
+- gnu multiplexor mirmon conf - `/etc/mirmon-gnu.conf`
+- gnu multiplexor mirmon web page - 
<http://download.savannah.gnu.org/mirmon/gnu/>
+- gnu multiplexor download example - <http://ftpmirror.gnu.org/emacs/>
+- gnu direct download, not multiplexed - <http://ftp.gnu.org/gnu/emacs/>
+
+The "allgnu" mirmon instance is for humans to look at, most notably
+those checking and updating the status of GNU mirrors (a thankless but
+useful task):
+
+- all gnu mirmon conf - `/etc/mirmon-allgnu.conf`
+- all gnu mirmon web page - <http://download.savannah.gnu.org/mirmon/allgnu/>
+
+nongnu info
+-----------
+
+The savannah mirmon is a multiplexor for savannah.nongnu.org, operating
+in the same way:
+
+- nongnu (Savannah) mirror list -
     <http://dl.sv.gnu.org/releases-noredirect/00_MIRRORS.html>
-    (maintained by hand)
-- nongnu mirmon conf - `/etc/mirmon.conf`
-- nongnu mirmon web page - <http://download.savannah.gnu.org/mirmon/savannah/>
-- nongnu multiplexor example - <http://dl.sv.nongnu.org/releases/cybop/>
-- nongnu direct, not multiplexed -
-    <http://download.savannah.gnu.org/releases-noredirect/cybop/>)
+    (maintained by sv admins, see [[DownloadArea]])
+- nongnu multiplexor mirmon conf - `/etc/mirmon.conf`
+- nongnu multiplexor mirmon web page - 
<http://download.savannah.gnu.org/mirmon/savannah/>
+- nongnu multiplexor download example - 
<http://dl.sv.nongnu.org/releases/cybop/>
+- nongnu direct download, not multiplexed -
+    <http://download.savannah.gnu.org/releases-noredirect/cybop/>
 
-Mirror information/request page for both gnu and nongnu is
-<http://www.gnu.org/server/mirror.html>.
+dl.sv also runs the multiplexor for TeX's CTAN, but we do not run mirmon
+for that, they have their own.  `/root/mirmon/ctan`,
+`/root/bin/mirrors-ctan.sh`, etc.
 
-dl.sv also runs the multiplexor for CTAN, although we do not run mirmon.
-`/root/mirmon/ctan`, `/root/bin/ctan-mirror.sh`, etc.
+More multiplexor and other details
+----------------------------------
 
-More details:
-
-- the list of GNU mirrors for mirmon is in
+- the actual redirection is done in the web server, specifically the
+  module `Apache2::Geo::Mirror->auto_redirect`,
+- which takes the list of GNU mirrors from the file
  `dl:/usr/local/share/GeoIP/gnu-mirror-list.txt`,
-- which is automatically created by `dl:/root/bin/gnu-mirmon.pl`
-  from <http://www.gnu.org/prep/ftp.html>,
-- nightly via `dl:/etc/cron.d/mirmon` cron.
+- which is automatically created by `dl:/root/bin/mirrors-gnu.sh`
+  from the current mirmon state and the http-only list of mirrors in
+  `dl:/usr/local/share/GeoIP/gnu-download.txt`,
+- which in turn is updated nightly by a `dl:/etc/cron.d/mirmon` cron job
+  running `dl:/root/bin/gnu-mirmon.pl`.
 
-In turn, `/usr/local/bin/gnu-mirmon2geoip.pl` uses state file to build
-gnu-download.txt, which is used by `Apache2::Geo::Mirror->auto_redirect`
-to do the redirecting.  Those redirection info files are updated hourly
-(ditto the CTAN and nongnu multiplexors), via other
-`dl:/etc/cron.d/mirmon` cron entries.
+The mirmon state and redirection lists are updated hourly for all three
+multiplexors (gnu, nongnu, ctan), each of which has its own
+`dl:/root/bin/mirrors-*.sh` script run via `mirmon` cron entries;
+likewise the "allgnu" state. The geo location data is updated monthly
+via `dl:/etc/cron.d/maxmind`, stored in `dl:/usr/local/share/GeoIP`.
 
-The geo location data is stored in `dl:/usr/local/share/GeoIP`, updated
-monthly via `/etc/cron.d/maxmind`.
-
-Savannah admins: process for adding new nongnu mirrors is at the end of
-the [[DownloadArea]] page.
+A special thing about allgnu: because we want to check rsync urls, we
+want at least mirmon version 1.39 (ca.2009), which is newer than what
+the OS version on dl provides.  So the current mirmon is in
+`dl:/usr/local/share/mirmon` (just unpacking the tarball suffices) and
+the allgnu mirmon job uses that, instead of the OS mirmon.