Start entering some encoder sentence (enter triggers request)... our tool helps to find errors in seq2seq models using visual analysis methods .   that &apos;s year by year . this comes from our friends at <unk>   i &apos;ll get an esl class in <unk> learning &quot; it &apos;s raining , it &apos;s pouring . &quot;   you send one blessed email to whomever you &apos;re thinking of at <unk>   she <unk> for jobs down in <unk> province in the south .   science columnist lee <unk> describes a remarkable project at <unk> divide , antarctica , where a hardy team are drilling into <unk> ice to extract vital data on our changing climate . that technology will be used on <unk> animals .   i work in <unk> homes , largely .   so for example , there was one study that was done in a population of <unk> jews in new york city .   in this manner , the world bank has now <unk> 30,000 project activities in <unk> countries , and donors are using a common platform to map all their projects . now compassion , when it enters the news , too o en comes in the form of <unk> feature pieces or <unk> about heroic people you could never be like or happy endings or examples of self-sacrifice that would seem to be too good to be true most of the time   and they caught a couple of my guys who had hidden cameras in <unk> bags .   and with these keys , they may have been able to get inside <unk> &apos;s systems , to see and hear everything , and maybe even infect some of them . on that table you can see 48 hours &apos; worth of <unk> goods from passengers entering in to the united states .   so these are consumers organizing , <unk> their resources to <unk> companies to do good .   tony in chicago has been taking on growing experiments , like lots of other window farmers , and he &apos;s been able to get his strawberries to fruit for nine months of the year in <unk> conditions by simply changing out the organic nutrients .   so the first time i worked with colors was by making these <unk> of <unk> <unk> .  Fig. 1 . Example of Seq2Seq-Vis. In the translation view (left), the source sequence "our tool helps to find errors in seq2seq models using visual analysis methods." is translated into a German sentence. The word "seq2seq" has correct attention between encoder and decoder (red highlight) but is not part of the language dictionary. When investigating the encoder neighborhoods (right), the user sees that "seq2seq" is close to other unknown words " unk ". The buttons enable user interactions for deeper analysis. Abstract-Neural sequence-to-sequence models have proven to be accurate and robust for many sequence prediction tasks, and have become the standard approach for automatic translation of text. The models work with a five-stage blackbox pipeline that begins with encoding a source sequence to a vector space and then decoding out to a new target sequence. This process is now standard, but like many deep learning methods remains quite difficult to understand or debug. In this work, we present a visual analysis tool that allows interaction and "what if"-style exploration of trained sequence-to-sequence models through each stage of the translation process. The aim is to identify which patterns have been learned, to detect model errors, and to probe the model with counterfactual scenario. We demonstrate the utility of our tool through several real-world sequence-to-sequence use cases on large-scale models.
Furthermore, Seq2Seq REF designed a visual debugging tools for the sequence-to-sequence learning model and enables users to interact with the model to develop an insight about the model.
Seq2seq-Vis: A Visual Debugging Tool for Sequence-to-Sequence Models
IEEE Transactions on Visualization and Computer Graphics
IEEE Transactions on Visualization and Computer Graphics
Computer Science Medicine