Changes between Version 5 and Version 6 of waue/2009/0609

Timestamp:

Jun 9, 2009, 4:39:34 PM (16 years ago)

Author:

waue

Comment:

--

waue/2009/0609

@@ -9 +9 @@
  === readdb ===
  - read / dump crawl db
- - Usage: CrawlDbReader <crawldb> (-stats | -dump <out_dir> | -topN <nnnn> <out_dir> [<min>] | -url <url>)
+ - Usage: !CrawlDbReader <crawldb> (-stats | -dump <out_dir> | -topN <nnnn> <out_dir> [<min>] | -url <url>)
  - -stats [-sort]       print overall statistics to System.out
 {{{
@@ -21 +21 @@
 }}} 
  - -dump <out_dir> [-format normal|csv ]        dump the whole db to a text file in <out_dir>
+{{{
+$ nutch readdb /tmp/search/crawldb/ -dump ./dump
+$ vim ./dump/part-00000
+}}}
  - -url <url>   print information on <url> to System.out
+{{{
+$ nutch readdb /tmp/search/crawldb/ -url http://www.nchc.org.tw/tw/
+URL: http://www.nchc.org.tw/tw/
+
+Version: 7
+
+Status: 6 (db_notmodified)
+
+Fetch time: Thu Jul 09 14:34:48 CST 2009
+
+Modified time: Thu Jan 01 08:00:00 CST 1970
+
+Retries since fetch: 0
+
+Retry interval: 2592000 seconds (30 days)
+
+Score: 3.1152809
+
+Signature: ce0202bbd593b09b86ce8a9aa991b321
+
+Metadata: _pst_: success(1), lastModified=0
+}}}
  - -topN <nnnn> <out_dir> [<min>]       dump top <nnnn> urls sorted by score to <out_dir>
 
  === inject ===
  - inject new urls into the database
- - Usage: Injector <crawldb> <url_dir>
+ - Usage: !Injector <crawldb> <url_dir>
 
  === readlinkdb ===