 tim at the other extreme training on half my ham spam and scoring aginst the other half false positive rate NUMBER NUMBER false negative rate NUMBER NUMBER alas all NUMBER of the NUMBER NUMBER clues there are html related that begged to try it again but with tokenize retain_pure_html_tags false the random halves getting trained on and scored against are different here and i repaired the bug that dropped NUMBER ham and NUMBER spam on the floor so this isn t exactly a NUMBER change difference between runs ham distribution for all runs NUMBER items NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER spam distribution for all runs NUMBER items NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER false positive rate NUMBER NUMBER false negative rate NUMBER NUMBER yay that may mean that html tags aren t really needed in my test data provided it s trained on enough stuff curiously the sole false positive here is the same as the sole false positive on the half half run reported in the preceding msg i assume the nigerian scam false positive just happened to end up in the training data both times data ham setNUMBER NUMBER txt prob NUMBER NUMBER prob python NUMBER NUMBER prob alteration NUMBER NUMBER prob edinburgh NUMBER NUMBER prob subject python NUMBER NUMBER prob header errors to NUMBER NUMBER NUMBER prob thanks NUMBER NUMBER prob help NUMBER NUMBER prob road NUMBER NUMBER prob there NUMBER NUMBER prob us NUMBER NUMBER prob our NUMBER NUMBER prob company NUMBER NUMBER prob visit NUMBER NUMBER prob sent NUMBER NUMBER prob e mail NUMBER NUMBER prob courses NUMBER NUMBER prob received NUMBER NUMBER prob analyst NUMBER NUMBER prob investment NUMBER NUMBER prob regulated NUMBER NUMBER prob e mails NUMBER NUMBER prob mills NUMBER NUMBER received from NUMBER NUMBER NUMBER NUMBER helo URL by URL with esmtp exim NUMBER NUMBER NUMBER id NUMBERrdsu NUMBERk NUMBER for python list URL wed NUMBER oct NUMBER NUMBER NUMBER NUMBER NUMBER received from URL URL NUMBER NUMBER NUMBER NUMBER by URL pro NUMBER NUMBER NUMBER pro NUMBER NUMBER NUMBER with smtp id iaaNUMBERfor python list URL wed NUMBER oct NUMBER NUMBER NUMBER NUMBER NUMBER received from slNUMBER NUMBER NUMBER NUMBER NUMBER by URL lotus smtp mta vNUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER with smtp id NUMBERaeNUMBER NUMBERbNUMBER wed NUMBER oct NUMBER NUMBER NUMBER NUMBER NUMBER message id NUMBEReNUMBERcNUMBERd bbNUMBER eNUMBERfac slNUMBER internal URL from vickie mills vickie_mills URL to python list URL subject training courses in python in uk date wed NUMBER oct NUMBER NUMBER NUMBER NUMBER NUMBER mime version NUMBER NUMBER content type text plain charset iso NUMBER NUMBER content transfer encoding NUMBERbit x priority NUMBER x msmail priority normal x mailer microsoft outlook express NUMBER NUMBER NUMBER NUMBER x mimeole produced by microsoft mimeole vNUMBER NUMBER NUMBER NUMBER sender python list admin URL errors to python list admin URL x beenthere python list URL x mailman version NUMBER NUMBER NUMBER NUMBER precedence bulk list help mailto python list request URL list post mailto python list URL list subscribe URL mailto python list request URL list id general discussion list for the python programming language python list URL list unsubscribe URL mailto python list request URL list archive URL hi there i am looking for you recommendations on training courses available in the uk on python can you help thanks vickie mills is training analyst tel NUMBER NUMBER NUMBER fax NUMBER NUMBER NUMBER e mail vickie_mills URL for more information on standard life visit our website URL the standard life assurance company standard life house NUMBER lothian road edinburgh ehNUMBER NUMBERdh is registered in scotland no szNUMBER and regulated by the personal investment authority tel NUMBER NUMBER NUMBER calls may be recorded or monitored this confidential e mail is for the addressee only if received in error do not retain copy disclose it without our consent and please return it to us we virus scan all e mails but are not responsible for any damage caused by a virus or alteration by a third party after it is sent the top NUMBER discriminators are more interesting now income NUMBER NUMBER NUMBER httpNUMBER python NUMBER NUMBER NUMBER header mime version NUMBER NUMBER NUMBER NUMBER httpNUMBER remove NUMBER NUMBER NUMBER content type text html NUMBER NUMBER NUMBER string NUMBER NUMBER NUMBER http NUMBER jpg NUMBER NUMBER NUMBER object NUMBER NUMBER NUMBER python NUMBER NUMBER NUMBER python NUMBER NUMBER NUMBER language NUMBER NUMBER NUMBER NUMBER NUMBER NUMBER header return path NUMBER NUMBER NUMBER NUMBER unsubscribe NUMBER NUMBER NUMBER header received NUMBER NUMBER NUMBER NUMBER def NUMBER NUMBER NUMBER http NUMBER gif NUMBER NUMBER NUMBER module NUMBER NUMBER NUMBER import NUMBER NUMBER NUMBER header received NUMBER NUMBER NUMBER NUMBER header errors to NUMBER NUMBER NUMBER NUMBER header in reply to NUMBER NUMBER NUMBER NUMBER wrote NUMBER NUMBER NUMBER nbsp NUMBER NUMBER NUMBER subject python NUMBER NUMBER NUMBER header user agent NUMBER NUMBER NUMBER NUMBER header x complaints to NUMBER NUMBER NUMBER NUMBER wrote NUMBER NUMBER NUMBER python NUMBER NUMBER NUMBER header organization NUMBER NUMBER NUMBER NUMBER there are still two html clues remaining there nbsp and content type text html anthony s trick accounts for almost a third of these python appears in NUMBER of them httpNUMBER python means that python was found in the NUMBERst field of an embedded http url sticking a gif or a jpg in a url both score as NUMBER NUMBER spam clues note the damning pattern of capitalization in header mime version NUMBER this counting is case sensitive and nobody ever would have guessed that mime is more damning than subject or date why would spam be likely to end up with two instances of return path in the headers 