BUT WHEN DO WE NEED CHUNKING BY AND IT YOU KNOW SO Y I DON'T LIKE THE IDEA THAT YOU KNOW YOU START SOMETHING AND THEN EIGHTEEN MONTHS LATER YOU PICK UP TO DO THE LAST TEN PERCENT OF THE WORK TO FINISH IT OFF OR WHATEVER SO IT I LIKE THINGS KINDA TIDY RIGHT SO HOW MUCH WORK IS THERE LEFT AND WHEN DO WE ACTUALLY NEED IT BY WOULD BE USEFUL TO DISCUSS WELL YOU WANTED TO DO THE CHUNKING ON THE AMI DATA RIGHT BECAUSE M THERE'S I MEAN THERE'S HUB SET A. IS TRANSCRIBED I THINK UM IN FINAL FORM YOU WE CAN CHECK THE WIKIS BUT YOU KNOW THE DATA IS ROLLING IN SO THE PROBLEM WAS YOU DIDN'T HAVE ICSI DATA THAT WAS HAND LABELLED FOR CHUNKS AND WE DECIDED LABELLING THE ICSI DATA FOR CHUNKS WOULD BE PROBABLY DIFFICULT AND MAYBE NOT VERY USEFUL AND SO IT IT MI OKAY SO OKAY IF THERE IF THERE WAS IF THERE WAS HAND LABELLED DATA THAT YOU COULD EVALUATE AGAIN SO TRAIN ON SOME AND EVALUATE ON SOME WOULDN'T THAT UM 'CAUSE YOU'VE TRAINED ON SWITCHBOARD RIGHT WHERE THERE THERE ARE CHUNKS SO IF YOU HAD SOME ICSI DATA THAT YOU COULD MAYBE USE I DON'T KNOW UM AS A WHAT'S THE N THERE'S T THERE'S A TRAINING SET AND THEN THERE'S THE DEVELOPMENT SET AND THEN THERE'S THE TEST SET MAYBE YOU'D USE SOME CHUNKED ICSI STUFF AS DEVELOPMENT OR SOMETHING AND DO SOME LAST TWEAKS AND THEN EVALUATE BUT YOU KNOW W H I MEAN I CAN SEE WHY WEI XUN DIDN'T WANNA SPEND HIS TIME CHUNKING ICSI D WHICH MEANS WE HAVE TO GET SOME PORTION OF THE DATA HAND CHUNKED MM-HMM BUT THAT SHOULDN'T BE THAT HARD TO DO RIGHT HOW MUCH DATA DO YOU NEED HOW MUCH UM WELL WAS IT HARD IN SWITCHBOARD SWITCHBOARD IS ALL CHUNKED RIGHT SO HE DIDN'T HAVE TO THINK ABOUT HOW MUCH SO WE NEED TO KNOW HOW MUCH DATA YOU NEED HAND CHUNKED AND THEN UH HOW DO YOU HAND CHUNK STUFF RIGHT SO YOU WERE WERE WORKING ON INSTRUCTIONS FOR DOING HAND CHUNKING MM FOR SWITCHBOARD YEAH BUT THEN HE THERE WERE TWO POSSIBLE OPTIONS FOR UH FOR DOING THIS ON THE AMI DATA YOU COULD EITHER UM ESSENTIALLY GO THE SAME ROUTE AS THEY DID WITH THE SWITCHBOARD UM YOU KNOW DO THE PENN TREE BANK AND THEN CREATE THE CHUNKS OFF THAT OR YOU COULD CHUNK DIRECTLY AND IT WASN'T CLEAR TO US WHICH ONE OF THOSE TWO METHODS WAS THE RIGHT WAY TO DO THIS DIRECT CHUNKING 'CAUSE WE ARE NOT GOING TO IN A TREE OUT OF THE AMI DATA RIGHT WELL SO YOU'D HAVE TO PRODUCE AS PART OF THIS EXERCISE YOU WOULD'VE THOUGHT SO BUT I DUNNO OH YES YEAH I'D FORGOTTEN ABOUT THAT MIGHT BE YEAH IF THE WELL I DON'T KNOW VERY MUCH ABOUT GRAMMAR IS TH IS THAT SIMILAR ENOUGH THAT THAT THIS SAME METHOD COULD APPLY THAT WE DERIVE CHUNKS OFF THE H. P. S. G. OUTPUT I THINK YOU MIGHT LOSE A LOT IN YOU KNOW THIS STEP SO BASICALLY YOUR YOUR CHUNKER IS TRAINED ON SOMETHING THAT WAS DERIVED OFF PENN TREE BANK AND IT MIGHT BE DIFFERENT ENOUGH THAT THAT ACTUALLY CAUSES IT NOT TO MATCH YOU KNOW IF YOU'RE SUDDENLY EVALUATING AGAINST CHUNKS THAT WERE DONE USING H. P. S. G. I DON'T KNOW ABOUT GRAMMAR BUT IT YOU KNOW IT WELL THEY'RE USING THE E. R. G. RIGHT THE WHICH PROBABLY HAS A L MAYBE FINER G UH WHICH I BELIEVE HAS FINER GRAINED DISTINCTIONS THAN AND DIFFERENT LABELS THAN THE PENN TREE BANK OR IS IS EASY TO MAP BETWEEN FINER GRAINED DISTINCTIONS AND COARSER ONES THINK SO 'CAUSE THE PENN TREE BANK PARSERS ARE PRETTY MINIMAL BECAUSE THEY DIDN'T WANNA COMMIT TO A SPECIFIC GRAMMATICAL THEORY SO I MEAN IT PROBABLY IS WORTH LOOKING AT 'CAUSE THEY'RE DOING THIS WITH DAN FLICKINGER RIGHT WHICH IS THE SAME UM PARSER AS THE REDWOODS TREE BANK WAS MADE WITH THAT ALEX TALKED ABOUT YESTERDAY SO YOU CAN LOOK AT REDWOODS PARSES UM AND SEE HOW DIFFERENT THEY ARE FROM TREE BANK PARSES AND YOU MIGHT WANNA TALK TO ALEX TO FIND OUT IF SOMEBODY'S ALREADY DONE THIS TURN REDWOODS STUFF INTO TREE BANK STUFF SO THAT THEY CAN COMPARE YOU KNOW AGAINST RESULTS THAT ARE REPORTED ON TREE BANK WELL THAT WAS THE IDEA I BELIEVE BUT UM IT WAS SUPPOSED TO BE ANOTHER TREE BANK RIGHT SO Y THAT SORT OF ASSUMES THAT WE THINK IT'S BETTER TO DO THIS BY DERIVING CHUNKS FROM UM SOME PARSED FORMAT THAN JUST HAND CHUNKING THE STUFF WELL THE GOOD THING ABOUT THAT IS THAT THEN YOU KNOW THAT WHEN YOU GO THROUGH AND PARSE YOU'LL BE GETTING THE SAME CHUNKS AS WHEN YOU DO THIS PROCESS AUTOMATICALLY 'CAUSE THE PROBLEM W WHEN YOU GO THROUGH AND HAND DO IT IS THEN SUDDENLY YOU INTRODUCE YOUR AUTOMATIC METHOD AND YOUR ACCURACY GOES CAN GO WAY DOWN I MEAN SOMETIMES IT DOESN'T IF YOU KNOW SORT OF FOR PART OF SPEECH TAGGING YOU KNOW WHETHER YOU DO IT BY HAND OR MACHINE IT'S PRETTY MUCH THE SAME ACCURACY RIGHT BUT SO LET'S TRY IT THIS WAY AND THEN THAT THAT PUTS OFF THE QUESTION OF UM WHEN DO WE HAVE TO DO THIS TO WHEN WE GET H. P. S. G. STUFF RIGHT SO CAN YOU ASK UM D. F. K. I. WHETHER THEY CAN GIVE US A COUPLE AMI MEETINGS RUN THROUGH THEIR H. P. S. G. PROCESS I DON'T EVEN KNOW WHAT TIME SCALE THEY HAD IN MIND I MEAN IT IS THIS SOMETHING THEY W THEY WERE DOING IT AT THE MOMENT BUT I DON'T KNOW WHETHER THIS WAS VERY PRELIMINARY OR DO YOU REMEMBER THEY TALKED ABOUT IT AT THE MEETING THAT WE WENT TO IN TWENTY MINUTE YEAH I WAS THINKING ENSCHEDE WHY CAN'T I REMEMBER THE N THE F THE RIGHT NAME OF THIS PLACE YES TWENTE WHICH YOU WERE THERE JEAN YEAH OKAY Y YOU'RE EXPECTING ME TO REMEMBER STUFF AREN'T YOU NO NO NO NO NO NO NO I I I KNOW YOU MISSED A MEETING AND S AND SO THERE THERE MAY HAVE BEEN YOU MISSED THE ONE IN T. N. O. T. N. O. OKAY SEE I WASN'T THERE SO I DON'T KNOW WHERE IT WAS UM YEAH AT LEAST BIO YEAH WELL MAYBE OKAY YEAH SO ASK 'EM RIGHT MM-HMM THE PARSE I MEAN THAT'S WASN'T SOMETHING SHE DID BUT THAT'S THE DATA SHE'S USING RIGHT SO WE HAVE ALL THAT STUFF HERE YOU KNOW THE PARSED VERBMOBIL MATERIAL SO YOU CAN LOOK AT THAT AND SEE WHAT THE PARSE TREES LOOK LIKE YOU DON'T NEED TO WAIT FOR D. F. K. I. AND IF IT TURNS OUT THAT YOU THINK OH THERE'S NO WAY I CAN MAP THESE INTO PENN TREE BANK STYLE BRACKETING THEN THEN WE HAVE TO THINK OF SOMETHING ELSE RIGHT HMM MM-HMM BUT I THINK THEY HAD THAT IN MIND SO IT'S IT'S WORTH ALSO TALKING TO HER ABOUT THAT OKAY GOOD