本帖最后由 chenyayu 于 2008-10-21 03:32 编辑
今天新装了SupeSite后,导入以前的采集机器人后出现怪问题:- 采集机器人开始工作
- 处理索引列表页面 http://auto.163.com/special/00081K7D/rss_autoall.xml 开始
- 列表缓存文件成功读取 (/var/www/public/site/data/robot/1_86f866960d7b4ad3e6b8b8bd0d3bf7a7.php)
- 处理内容 http://auto.163.com/08/1020/09/4OMGOE7K00081GDM.html 完成
- [3] [10-15万元之选 不可错过的三款紧凑型车] 处理标题完成
- [3] [易车] 处理文章来源完成
- [3] 处理内容完成
复制代码 然后就停在这个位置不动了!同样的机器人在WinXP搭建的环境下能顺利采集,但到了新机器上就是不行!已经搞了2天了,本人完全虚脱了...
新机是嵌入式主板:VIA EPIA-5000,C3-533M CPU,128M内存,40G硬盘,配置不高不过跑起Linux来虽不能说飞快,不过也还算流畅的。
运行ulimit的结果如下:- ulimit -a
- core file size (blocks, -c) 0
- data seg size (kbytes, -d) unlimited
- file size (blocks, -f) unlimited
- max locked memory (kbytes, -l) unlimited
- max memory size (kbytes, -m) unlimited
- open files (-n) 1024
- pipe size (512 bytes, -p) 8
- stack size (kbytes, -s) 8192
- cpu time (seconds, -t) unlimited
- max user processes (-u) 959
- virtual memory (kbytes, -v) unlimited
复制代码 sysctl.conf的内容:- # Controls IP packet forwarding
- net.ipv4.ip_forward = 0
- # Controls source route verification
- net.ipv4.conf.default.rp_filter = 1
- # Controls the System Request debugging functionality of the kernel
- kernel.sysrq = 0
- # Controls whether core dumps will append the PID to the core filename.
- # Useful for debugging multi-threaded applications.
- kernel.core_uses_pid = 1
- # Use TCP syncookies when needed
- net.ipv4.tcp_syncookies = 1
- #Enable TCP Window scaling
- net.ipv4.tcp_window_scaling = 1
- # Increase TCP max buffer size
- net.core.rmem_max = 16777216
- net.core.wmem_max = 16777216
- # Increase Linux autotuning TCP buffer limits
- net.ipv4.tcp_rmem = 4096 87380 16777216
- net.ipv4.tcp_wmem = 4096 65536 16777216
- # Increase number of ports available
- net.ipv4.ip_local_port_range = 1024 65000
复制代码 我实在想不到是哪里出了问题,请大家帮我看看,感激不尽! |