THAT WHERE ONE SAID IT WAS PROBABLY AN ENGLISH PHRASE AND THE OTHER SAID IT WAS PROBABLY A FRENCH PHRASE AND I FOUND A GOOD FEW EXAMPLES WHERE YOU HAD A SITE THAT LOOKED UH WELL ONE THAT I REMEMBER OFF HAND WAS IT WAS A PAGE AND IT WAS A BIG PICTURE AND LINKS DOWN THE SITE BUT THE LINKS WERE ALL PICTURES SO YOU COULDN'T THE THE WORDS WERE IN FRENCH AND THE LINKS BUT THERE WERE NO WORDS PICKED UP BY THE WHEN I DID THE CRAWL FOR THE MODEL AND THERE WAS A SMALL BIT DOWN HERE AND IN THIS THERE WAS UH MEANT TO BE PICTURE IN THERE BUT IT DIDN'T LOAD UH OR UH B IT WAS MEANT TO BE SOMETHING ELSE AND IT SAID UH IN ENGLISH IT SAID FOUR O. FOUR THIS PAGE CANNOT BE FOUND SO ALL THE WORDS ON THIS PAGE WERE ENGLISH BUT IT WAS VERY VERY CLEARLY A FRENCH PAGE SO THE FIRST MODEL SAID IT WAS AN ENGLISH PAGE 'CAUSE ALL THE WORDS WERE IN ENGLISH SECOND MODEL SAID VERY DEFINITELY A FRENCH PAGE BECAUSE ALL OF THESE POINTED TO FRENCH SITES AND IT WAS ONLY POINTED TO IT WAS SOMETHING DOT F. R. AS WELL IT'S OKAY SO IT WAS A A GOOD POINT FOR YOU MM MM-HMM MM SO I I FOUND A COUPLE OF EXAMPLES THAT WERE KINDA LIKE THAT MM BUT THE THE PROBLEM THAT I FOUND WHEN I RAN IT UH THE TH THE THING THAT WAS A BAD POINT WAS THAT IF YOU HAVE UH SAY TRYIN I WAS TRYING TO SAY IF YOU COULD EVALUATE THIS WITH SEARCH GIVEN SOME KEYWORDS LIKE WHICH MODEL WOULD MORE LIKELY FIND YOU A P GOOD DOCUMENT THAT THAT SORT OF APPROACH UH WHAT I FOUND WAS THAT SAY YOU HAD UH UH TH THA THAT'S NOT TOO RELEVANT NECESSARILY BUT IF YOU HAVE SAY A TOPIC DISTRIBUTION FOR UH ONE PAGE AND IT VERY VERY HIGHLY SCORES ON THE P. L. S. A. FOR ONE OF THE THE TOPICS AND THAT'S RIGHT OKAY THIS MODEL BECAUSE IT'S AVERAGING OUT OVER ALL THE PAGES NEARBY ALL OF THE TOPIC DISTRIBUTIONS BECOME MORE FLAT IT IT BECOMES MORE UNCERTAIN ABOUT EVERYTHING OKAY MM MM PROBABLY NOT YEAH MM MM YEAH EVERY PAGE IS LINKED EVENTUALLY TO EVERYTHING ELSE SO IT EVERY PAGE HAS INFORMATION INCORPORATED IN IT OR I THE DISTRIBUTION LEARNED FOR EVERY PAGE HAS INFORMATION INCORPORATED IN IT FROM EVERY OTHER PAGE'S DISTRIBUTION AS WELL SO IT AVERAGES OUT IT FLATTENS ALL THE DISTRIBUTIONS DEPENDING ON WHAT THIS ALPHA IS BUT ALSO IT DEPENDS ON THAT COULD BE A GOOD EFFECT BECAUSE IF YOU IF YOU CAN BE IF YOU CAN IF YOU ARE UH HIGHLY RELIABLE ABOUT ONE PAGE BUT ALL THE PAGE LINKING TO IT ARE ACTUALLY ABOUT VERY DIFFERENT TOPICS SO YOU COULD SAY MAYBE I WAS WRONG FROM DECIDING ONLY DUE TO THE TEXT THAT THIS PAGE WAS ABOUT THIS ASPECT DISTRIBUTION BECAUSE BECAUSE ALL THE OTHER PAGES ARE VOTING IN DIFFERENT DIRECTION WELL I I THINK THAT THE THING IS YEAH THAT THAT THERE'S A BALANCE IN THE UH FOR EXAMPLE TAKE A PAGE LIKE UH SLASHDOT AND IT'S LIKE A NEWS SITE UH FOR GEEKS AND YOU HAVE UH NERDS YEAH NEWS FOR NERDS STUFF THAT MATTERS UH ALL OF THE LIKE HUNDREDS OF THOUSANDS OF PAGES POINT TO THAT BUT THEY'RE ABOUT COMPLETELY DIFFERENT THINGS SO YOU IN EFFECT ARE LOSING INFORMATION ABOUT WHAT THAT PAGE IS ABOUT BECAUSE THERE'S SO MANY THINGS POINTING TO IT AND THEY ALL AVERAGE OUT AS YEAH SO THAT OR SOMETHING UH YEAH MM UM SO I THOUGHT YOU WANNA PROBABLY SET THIS ALPHA PER PAGE THERE'S PROBABLY SOME HEURISTICS FOR EXAMPLE THIS PAGE THERE'S NO TEXT IN IT WILL SET IT VERY LOW IN USER INFORMATION FOR THE LINKS PROBLEM IS THIS IS WHAT PEDRO IMMEDIATELY SAID WHAT IF YOU HAVE A PAGE THAT LOOKS LIKE THIS IT'S GOT A BIG PICTURE OF A CAR UH MM-HMM PEDRO'S ALWAYS SPEAKS ABOUT CARS MM-HMM UH SU YOU SUGGESTED DOING LIKELIHOOD BUT AT THAT TIME AND I CAN'T REMEMBER WHAT MY PROBLEM WAS WITH THAT IT MIGHT NOT HAVE BEEN A GOOD THING BUT YOU'VE GOT TWO LIKELIHOODS FOR IT AS WELL NO MAYBE NOT MM AND THEN MAYBE YOU CAN FIND SOME PATTERNS THAT ARE THEN THEN ONCE YOU HAVE THE ONCE YOU HAVE THE TASK YOU COULD LOOK AT AT WHICH PAGES ARE COMPLETELY MISSED BY ONE MODEL WHICH OTHERS ARE ARE SUCCESSFUL WITH ONE MODEL AND AND YOU CAN MAYBE INFER SOME SOME RULES AFTERWARDS BUT IF YOU HAVE NO TASK YOU CAN UH BLINDLY SELECT S GOOD ALPHAS OKAY THERE'S OH OF COURSE YEAH MM MM THE THE LONG PAGES FOR EXAMPLE HAVE GOOD P. L. S. A. MODEL WITHOUT FUSING LINKS SO THEN YOU CAN INFER SOME HEURISTICS LIKE OKAY THE ALPHA SHOULD BE PROPORTIONAL TO THE LENGTHS OR ANYTHING LIKE THAT OR TO THE NUMBER OF IMAGE IN THE PAGES OR ANYTHING BUT YOU SHOULD HAVE SOME SOME TASK WHERE YOU CAN INDIVIDUALLY LOOK AT THE PERFORMANCE ON EVERY ON EVERY PAGE AND AND AND AND AT AS A SECOND STEP YOU COULD INFER SOME KIND OF RULE ABOUT HOW TO SELECT ALPHAS WITH RESPECT TO THE TASK YEAH OKAY IT YEAH D NO YEAH I SO UH I I THINK THAT THAT'S TOO EASY YOU CAN DO IT WITH SOME HEURISTICS AND YOU CAN LEARN IT FROM THE TASK RESULTS IN OR COMBINE THE TWO SO THA THAT'S KINDA STRAIGHTFORWARD I THINK MM PROBABLY HEURISTIC IT WILL BE EASIER TO COMPUTE BECAUSE THE CLOSER A NETWORK IS TO BEING A SMALL WORLD NETWORK SO SMALL WORLD NETWORK MEAN BASICALLY SOME FAR LINKS BUT GENERALLY VERY CLUSTERED LOCALLY UH NOW THE THING ABOUT DOING A WEB CRAWL IS THE BIGGER YOUR WEB CRAWL THE CLOSER IT'LL BE TO THE OVERALL STRUCTURE OF THE NET N THE INTERNET WHICH IS A SMALL WORLD NETWORK THE SMALLER YOUR WEB CRAWL THE LESS SMALL WORLD NETWORK LIKE IT'S GONNA BE MM-HMM SO THE MORE PAGES YOU GET THE BETTER YOUR RESULTS AND PEOPLE RUNNING THIS STYLE OF ALGORITHM THE PAGE RANK STYLE STUFF GENERALLY RUN IT ON ABOUT TWO MILLION OR TWENTY MILLION PAGES OR WHATEVER THE THE STANFORD WEB BASE DATA SET THAT I WAS USING FOR THIS FOR FOR A BIT OF THIS UM THEY HAVE A A D I CAN'T REMEMBER OFF HAND BUT THEY HAVE M MAYBE A BIT OVER A THETA BYTE WORTH OF WEB PAGES IN THIS A BUNCH OF SERVERS UH YEAH MAYBE WIKIPEDIA IS A GOOD THING TO DO WAS I WAS CONCERNED ABOUT WIKIPEDIA THOUGH WAS THAT IT'S WHILE IT HAS A HIGH LEVEL OF INSIDE LINKS THAT HAS A LOT OF DIRECTORY STYLE LINKS AS WELL THAT MIGHT MESS UP IT ACTUALLY BEING A SEE WH WHILE YOU HAVE SO YOU YOU CAN SELECT ONLY THE LINKS WHICH ARE WITHIN THE ARTICLE OR WITHIN THE CATEGORIES OR IT'S IT'S IT'S WELL STRUCTURED IT'S IT'S UH EASY TO MANIPULATE AND