[PLUG] wget timeout value

[Mark Griskey]

wget and the -T option, in my experience was a headache, simply because 
setting it seemed to do nothing.  It seems that wget, at least on Linux, is 
using the value in: 

/proc/sys/net/ipv4/tcp_retries2

for timeouts, which is set to 15 minutes. Lower this value and your timeout 
will match.  I had to use wget for a very large harvesting project, and this 
was the source of much frustration.

However, there is a patch, that will allow wget's -T to behave independent of 
the value in tcp_retries2.

Here is the link:
http://www.geocrawler.com/archives/3/409/2000/11/0/4723942/

I've been using a version of wget compiled with this patch for quite sometime 
and have been very happy with the results.

More information can be found here:

http://www.geocrawler.com/archives/3/409/2000/1/0/3189215/

I'd be more than happy to help you compile a version with the patch in place 
should you need it.

Mark





On Friday 17 October 2003 07:58 pm, Brian Quade wrote:
> I have been using wget to download files and was reading the man page to
> see how I could optimize it more.  The -T option sets the timeout value
> which is 900 seconds (15 minutes) by default.  The documentation says,
> "Please do not lower the timeout value unless you know what you are
> doing".  So I am wondering what could happen if I set it to 10 or
> something?  Does anyone know?  Would it crash the server or lock up my
> system or something?  Would it just be too much of a load on the server
> reconnecting too often?  I'm really curious but I feel like I shouldn't
> do it because, "I don't know what I am doing".
>
>
> _______________________________________________
> PLUG mailing list
> PLUG at lists.pdxlinux.org
> http://lists.pdxlinux.org/mailman/listinfo/plug

-- 
------------------------
Mark Griskey
www.linuxhardware.net