Re: [Bug-wget] wget 1.11.4 ignoring -np

[Micah Cowan]

On Mon, Dec 2, 2013 at 3:15 PM, Fernando Cassia <address@hidden> wrote:

> Hi Micah,
>
> You are listed as the current maintainer of wget.


Listed where? See http://www.gnu.org/software/wget/ for official
information about wget; I haven't been maintaining it for a few years now.
That'd be Giuseppe Scrivano. But support questions would best be addressed
to address@hidden, the support mailing list. I've copied this response
there (note that any messages you send there may have to go through a small
wait until it passes moderation, unless you're subscribed to that list).

Regarding the problem you mention below, are you certain that:
  (a) It's an essentially unmodified GNU Wget (there are Windows "wget"
ports that don't actually have to do with GNU's, and mimic some, but not
all, of GNU's behavior)
  (b) You're really specifying
www.somehost.com/mirrors/mozilla/extensions/and not
www.somehost.com/mirrors/mozilla/extensions (no final slash)? Because even
though they may be the same page in reality, and the server may even
redirect the latter to the former, wget would see the final "extensions" as
a file, and the preceding "/mirrors/mozilla/" as the actual dir, and so
would happily spider anything provided that it begins /mirrors/mozilla. The
final slash makes a big difference!

Good luck!

-mjc

(no further response text follows)


> I'm using someone
> else's port to 64-bit windows (win64, amd64).
> It runs fine with the exception of one thing: I always use
>
> wget -m -np -k -c
> -m = mirroring
> -np = don't go above the specified (start) URL
> -k = convert all html links to symlinks
> -c = continue if file already exists (useful if the mirroring
> operation is interrupted, to continue fetching files cut in the middle
> of the transfer, instead of requesting the entire file again).
>
> Well in this instance, I began using wget to mirror one of the firefox
> extensions sites with a start url like
>
> www.somehost.com/mirrors/mozilla/extensions/
>
> That's the URL I used as a start, and I put -np
>
> Yet I'm seeing that right now, it's fetching the whole list of Firefox
> browsers, every single firefox version, from
> www.somehost.com/mirrors/mozilla/firefox
> which is a directore ABOVE the /mozilla/extensions that I used as a start.
>
> So HOW can wget ignore -np ??
>
> The base URL is a standard Apache http server directory browsing mode.
> Thanks for reading and your time, and thanks in advance for any
> assistance you might be able to provide on this matter.
>
> FC
>
> --
> During times of Universal Deceit, telling the truth becomes a
> revolutionary act
> Durante épocas de Engaño Universal, decir la verdad se convierte en un
> Acto Revolucionario
> - George Orwell
>