code 206179d64c1730862328e9b750e98bd8aa1c16b5 (2016-08-09 17:58:18 +0200)
7a8e6602839c4870cdb1527a808086867f8c1ec45ca9d6f9f352c259860d2a8b  classification-results.sh
== data: the script's Google Drive route
googledrive.com/host for ag_news: HTTP 404
== declared fallback: s3.amazonaws.com/fast-ai-nlp mirror of the same tarballs
9a8c300eabb45750237fcc669f61cb8a3448f3ef6f6098e1ce340e444f6872be  ag_news_csv.tgz
4af62eeee139d0142e0747340b68646d23483d9475c33ea0641ee9175b423443  amazon_review_full_csv.tgz
d2a3ee7a214497a5d1b8eaed7c8d7ba2737de00ada3b0ec46243983efa100361  amazon_review_polarity_csv.tgz
42db5221ddedddb673a4cabcc5f3a7d869714c878bcfe4ba94b29d14aa38e417  dbpedia_csv.tgz
6b77fc935561d339b82aa552d7e31ea59eff492a494920579b3ce70604efb5c2  sogou_news_csv.tgz
2d4277855faf8b35259009425fa8f7fe1888b5644b47165508942d000f4c96ae  yahoo_answers_csv.tgz
56006b0a17a370f1e366504b1f2c3e3754e4a3dda17d3e718a885c552869a559  yelp_review_full_csv.tgz
528f22e286cad085948acbc3bea7e58188416546b0e364d0ae4ca0ce666abe35  yelp_review_polarity_csv.tgz
ag_news_csv
amazon_review_full_csv
amazon_review_polarity_csv
dbpedia_csv
sogou_news_csv
yahoo_answers_csv
yelp_review_full_csv
yelp_review_polarity_csv
normalize_text is a function
normalize_text () 
{ 
ag_news: 120000 train, 7600 test
dbpedia: 560000 train, 70000 test
yelp_review_polarity: 560000 train, 38000 test
yelp_review_full: 650000 train, 50000 test
yahoo_answers: 1400000 train, 60000 test
sogou_news: 450000 train, 60000 test
amazon_review_full: 3000000 train, 650000 test
amazon_review_polarity: 3600000 train, 400000 test
== classification-results.sh, unchanged (it skips downloading because data/*.train exist)
Working on dataset ag_news
P@1: 0.922
Working on dataset sogou_news
P@1: 0.967
Working on dataset dbpedia
P@1: 0.986
Working on dataset yelp_review_polarity
P@1: 0.957
Working on dataset yelp_review_full
P@1: 0.639
Working on dataset yahoo_answers
P@1: 0.724
Working on dataset amazon_review_full
P@1: 0.602
Working on dataset amazon_review_polarity
P@1: 0.946
== same settings without bigrams (-wordNgrams 1)
Working on dataset ag_news (unigram)
P@1: 0.914
Working on dataset sogou_news (unigram)
P@1: 0.937
Working on dataset dbpedia (unigram)
P@1: 0.983
Working on dataset yelp_review_polarity (unigram)
P@1: 0.939
Working on dataset yelp_review_full (unigram)
P@1: 0.603
Working on dataset yahoo_answers (unigram)
P@1: 0.718
Working on dataset amazon_review_full (unigram)
P@1: 0.556
Working on dataset amazon_review_polarity (unigram)
P@1: 0.911
RUNS_DONE
