机器人采集时，有一种分页无法采集

下面的这个网站，导航分页无法采集。
因为后面分页的连接本身没有前缀，只有“xxx.html”。这个前缀应该是第一页当前的目录，加前缀时没有这个选项。


# SupeSite Dump
# Version: SupeSite 5.0.1
# Time: 2006-12-16 22:06:09
#
# This file was BASE64 encoded
#
# SupeSite: http://www.supesite.com
# Please visit our website for latest news about SupeSite
# --------------------------------------------------------


YTozNzp7czo3OiJyb2JvdGlkIjtzOjE6IjQiO3M6NDoibmFtZS
I7czoxNToiaXQuY29tLmNu0vTP5LDmIjtzOjM6InVpZCI7czox
OiIyIjtzOjg6ImRhdGVsaW5lIjtzOjEwOiIxMTY2MjU4OTA3Ij
tzOjg6Imxhc3R0aW1lIjtzOjEwOiIxMTY2MjU4OTIzIjtzOjg6
InJvYm90bnVtIjtzOjI6IjIyIjtzOjExOiJsaXN0dXJsdHlwZS
I7czo2OiJtYW51YWwiO3M6NzoibGlzdHVybCI7czoyODoiaHR0
cDovL3d3dy5pdC5jb20uY24vZGl5L3NiLyI7czoxMzoibGlzdH
BhZ2VzdGFydCI7czoxOiIwIjtzOjExOiJsaXN0cGFnZWVuZCI7
czoxOiIwIjtzOjY6ImFsbG51bSI7czoyOiIxMCI7czo2OiJwZX
JudW0iO3M6MToiMSI7czo3OiJzYXZlcGljIjtzOjE6IjEiO3M6
NjoiZW5jb2RlIjtzOjA6IiI7czoxMzoicGljdXJsbGlua3ByZS
I7czowOiIiO3M6OToic2F2ZWZsYXNoIjtzOjE6IjAiO3M6MTQ6
InN1YmplY3R1cmxydWxlIjtzOjM1NzoiPFREIGJhY2tncm91bm
Q9L2ltYWdlcy9saW5lX2guZ2lmIGhlaWdodD0xPjwvVEQ+Kjwv
dGFibGU+PHRhYmxlIHdpZHRoPSIxMDAlIiBib3JkZXI9IjAiIG
FsaWduPSJjZW50ZXIiIGNlbGxwYWRkaW5nPSIwIiBjZWxsc3Bh
Y2luZz0iMCI+PHRyPjx0ZCBoZWlnaHQ9IjIxIj5bbGlzdF08L3
RhYmxlPjwhLS0vLy0tPjwvdGQ+KiAgICAgICAgICA8L3RyPiog
ICAgICAgICAgPHRyIGFsaWduPSJjZW50ZXIiIHZhbGlnbj0idG
9wIj4gKiAgICAgICAgICAgIDx0ZCBjb2xzcGFuPSIyIj4gPHRh
YmxlIGhlaWdodD0iNjciIGJvcmRlcj0iMCIgY2VsbHNwYWNpbm
c9IjAiIGNlbGxwYWRkaW5nPSIwIj4qICAgICAgICAgICAgICAg
IDx0cj4gIjtzOjE4OiJzdWJqZWN0dXJsbGlua3J1bGUiO3M6Mj
c6IjxhIGhyZWY9Jy4uLy4uW3VybF0nIHRhcmdldCI7czoxNzoi
c3ViamVjdHVybGxpbmtwcmUiO3M6MjA6Imh0dHA6Ly93d3cuaX
QuY29tLmNuIjtzOjExOiJzdWJqZWN0cnVsZSI7czo3NToiPGlt
ZyBzcmM9LzAuZ2lmIGhlaWdodD0xPjwvZGl2PiogICAgICAgIC
AgPGRpdiBpZD1hcnRfdGl0bGU+W3N1YmplY3RdPC9kaXY+Ijtz
OjEzOiJzdWJqZWN0ZmlsdGVyIjtzOjA6IiI7czoxNDoic3Viam
VjdHJlcGxhY2UiO3M6MDoiIjtzOjE2OiJzdWJqZWN0cmVwbGFj
ZXRvIjtzOjA6IiI7czoxMDoic3ViamVjdGtleSI7czowOiIiO3
M6MTg6InN1YmplY3RhbGxvd3JlcGVhdCI7czoxOiIwIjtzOjEy
OiJkYXRlbGluZXJ1bGUiO3M6MDoiIjtzOjg6ImZyb21ydWxlIj
tzOjA6IiI7czoxMDoiYXV0aG9ycnVsZSI7czowOiIiO3M6MTE6
Im1lc3NhZ2VydWxlIjtzOjg0OiI8ZGl2IGlkPWFydF90ZXh0IG
NsYXNzPXRleHQxPjxTUEFOIElEPWFkX2h6aD48L1NQQU4+PFA+
W21lc3NhZ2VdPGJyIGNsZWFyPWFsbD48L2Rpdj4iO3M6MTM6Im
1lc3NhZ2VmaWx0ZXIiO3M6NTk6IjxhIGhyZWY9Kj58KDxhIGhy
ZWY9KjwvQT4pfDwvYT58PEEqPnw8L0E+fHRpdGxlPScqJ3xhbH
Q9JyonIjtzOjE1OiJtZXNzYWdlcGFnZXR5cGUiO3M6NDoibmV4
dCI7czoxNToibWVzc2FnZXBhZ2VydWxlIjtzOjUwOiI8Yj7OxN
XCtby6vaO6PC9iPjx1bD5bcGFnZWFyZWFdPC91bD48YnIgY2xl
YXI9YWxsPiI7czoxODoibWVzc2FnZXBhZ2V1cmxydWxlIjtzOj
IzOiI8YSBocmVmPSJbcGFnZV0iIHRhcmdldCI7czoyMToibWVz
c2FnZXBhZ2V1cmxsaW5rcHJlIjtzOjA6IiI7czoxNDoibWVzc2
FnZXJlcGxhY2UiO3M6MTI6Ii4uLy4uLy4uLy4uLyI7czoxNjoi
bWVzc2FnZXJlcGxhY2V0byI7czoyMToiaHR0cDovL3d3dy5pdC
5jb20uY24vIjtzOjc6InZlcnNpb24iO3M6NToiNS4wLjEiO30=

刚才搜索了一下帖子，发现有些图片的连接前缀，也需要当前文件所在的URL。希望下个版本中能改进~~

采集只能采一些规律性的页面，机器的东西毕竟是死的，页面是人做的，千变万化，采集并不全部有效。
象这种页面您就不要采了