Changes between Version 40 and Version 41 of crawlzilla-1.0
- Timestamp:
- Apr 6, 2011, 5:40:40 PM (14 years ago)
Legend:
- Unmodified
- Added
- Removed
- Modified
-
crawlzilla-1.0
v40 v41 143 143 = 功能 = 144 144 145 == 爬取程式 go.sh ==145 == 佇列爬取程式 go.sh == 146 146 * /opt/crawlzilla/main/go.sh <username> <jobname> <depth> 147 147 * go.sh 用以 lib_crawl_default.sh 為基礎,將參數餵給 lib_crawl_tmp.sh ,最後用 at 呼叫 lib_crawl_tmp.sh 執行 lib_crawl_go.sh … … 167 167 * redo 為是否重爬, 非必要欄位, 是="redo", 不是="" 168 168 169 == commend模式執行爬取: prepare_go.sh == 169 == 直接爬取程式 lib_crawl_go.sh == 170 * /opt/crawlzilla/main/go.sh <username> <jobname> <depth> 171 * 不丟到at,直接執行 (go.sh 的最後階段) 172 173 == 爬取準備 prepare_go.sh == 174 * /opt/crawlzilla/main/prepare_go.sh <username> <jobname> <url_file> 175 * 方便command 端測試用,會產生指定的 <username> 與 <jobname>,並詢問是否引發 go.sh 170 176 171 177 == 修復爬取的程式: fix.sh == 178 * /opt/crawlzilla/main/fix.sh <username> <jobname> 172 179 173 180 == shell ==