我正在使用wget
递归选项 ( -r
) 下载文件并启用递归以转到其他域 ( -H
)。当它找不到某个文件时,wget 只是继续尝试
--2013-05-05 13:38:52-- http://clnet.ucla.edu/robots.txt
Resolving clnet.ucla.edu... 128.97.168.150
Connecting to clnet.ucla.edu|128.97.168.150|:80... failed: Connection timed out.
Retrying.
--2013-05-05 13:39:14-- (try: 2) http://clnet.ucla.edu/robots.txt
Connecting to clnet.ucla.edu|128.97.168.150|:80... failed: Connection timed out.
Retrying.
向下尝试 10,依此类推。有没有办法告诉 wget 只是忽略这个文件?