Benjamin Hoover commited on
Commit
81fd184
1 Parent(s): b31a4aa

Update styles

Browse files
README.md CHANGED
@@ -1,217 +1,8 @@
1
- # exBERT
2
 
3
  [![License](https://img.shields.io/badge/License-Apache%202.0-blue.svg)](https://opensource.org/licenses/Apache-2.0)
4
 
 
 
5
 
6
- ### A Visual Analysis Tool to Explore Learned Representations in Transformers Models
7
- by Ben Hoover, Hendrik Strobelt, Sebastian Gehrmann <br/>
8
- from IBM Research and Harvard NLP
9
-
10
- Link to pre-paper and demo: [exbert.net](http://exbert.net)
11
-
12
-
13
- <div style='text-align:center;'>
14
-
15
- <img src="client/src/img/exbert_teaser_V2.png">
16
-
17
- <div style='font-size:70%;'>An overview of the different components of the tool. The token ``escape'' is selected and masked at 0-[all]. The results from a corpus search by token embedding are shown and summarized in (d-g). Users can enter a sentence in (a) and modify the attention view through selections in (b). Self attention is displayed in (c). The blue matrices show the attention of a head (column) to a token (row). Tokens and heads that are selected in (c) can be searched over the annotated corpus (shown: Wizard of Oz) with results presented in (d). Every token in (d) displays its linguistic metadata on hover. A colored summary of the matched token (black highlight) and its context is shown in (e), which can be expanded or collapsed with the buttons above it. The histograms in (f) and (g) summarize the metadata of the results in (d) for the matched token and the token of max attention, respectively.</div>
18
-
19
- </div>
20
-
21
- ### Version 0.9
22
-
23
- - [Overview](#overview)
24
- - [Components](#components)
25
- - [Install and Getting Started](#install-and-getting-started)
26
- - [Development](#development)
27
-
28
-
29
-
30
-
31
-
32
- ## Overview
33
-
34
- exBERT is a tool that enables users to explore what and how transformers learn to model languages. The tool comes equipped with a pretrained base version of BERT, a state of the art architecture based on transformers. To explore what this architecture has learned, you can input any sentence to the model and the tool will parse the sentence into tokens suitable for BERT (using the BPE tokenizer) and pass these tokens through the model. The attentions and ensuing word embeddings of each encoder are then extracted and displayed for interaction.
35
-
36
- To ease interpretability of language features, several key features of BERT have been disabled:
37
-
38
- 1. The attentions toward [CLS] and [SEP] tokens have been zeroed. The [CLS] token is typically useful in classification tasks where the entire sentence needs to have an embedding to summarize it, and the [SEP] has been shown to be a no-op for heads that haven't learned anything.
39
- 2. BERT is able to concatenate two sections of text for training (separated by the [SEP] token mentioned above), and attention patterns can be learned between the two sentences. This enables BERT to apply to a wide range of applications. However, the intention of this tool is to focus on self-attention - that is, the attention of the words in a sentence to other words in the same sentence - and the functionality to look at attention between different words has been dropped.
40
-
41
- Even though BERT is able to analyze large chunks of paragraph at once, this tool primarily focuses on language features within one sentence and thus only searches across a corpus that has been split by sentence.
42
-
43
- Importantly, BERT's ability to mask particular tokens (by using the [MASK] token in place of the original token) has been preserved.
44
-
45
- ## Components
46
-
47
- ![components](client/src/img/annotated_instructions2.png)
48
-
49
-
50
- ### 1) The Attention Explorer
51
-
52
-
53
- #### 1a) Sentence Input
54
-
55
- Type in any english sentence you want to analyze in the ensuing visualization. Just note that the longer the sentence, the longer the visualization will require to initialize.
56
-
57
-
58
- #### 1b) Threshold Slider
59
-
60
- The Threshold Slider is used to control how much attention is displayed in the main attention graph. For each word, show the largest attentions until X amount of the total attention has been displayed. At 1, all the attention connections are shown. At 0, nothing is shown. Use this if you are only interested in seeing what each word is most interested in.
61
-
62
-
63
- #### 1c) Layer Selection
64
-
65
- Choose the layer of BERT to analyze
66
-
67
-
68
- #### 1d) Head Selector
69
-
70
- Display the selected heads, with the option to select all or none. For convenience, interaction has been added to the Attention Summary Boxes that allows you to select or deselect heads from the visualization itself.
71
-
72
-
73
- #### 1e) Attention Summary Boxes
74
-
75
- Every row represents the total attention to a token, and every column represents a different head. By looking down a column, you can see how strongly any particular head is activated at a particular head/layer. By hovering over any column, you can see that attentions that belong to just that head in the main graph. By selecting a column, you can select or deselect that head. This will both remove the effect of that head on the overall visualization and indicate which heads you are interested in searching over in the corpus.
76
-
77
- The left side indicates how much total attention each head is going out of each word. The right side indicates the total attention from each head going into each word.
78
-
79
-
80
- #### 1f) Attention Graph
81
-
82
- This central display shows how tokens attend to other tokens in the same sentence. By hovering over any token, you can see only the attentions going into or out of that particular word. By single clicking on it, you can freeze the view of that particular token and explore how the heads interact with only that token's attention. This also indicates which embedding / headlist you are interested in searching the corpus for. By double clicking on the token, you can mask that token, which passes all the tokens back to BERT with the [MASK] token replacing the token you just double clicked. This often changes quite a few of the attentions and will rerender the attention graph. You can then continue to explore the attentions and select tokens and head as usual.
83
-
84
-
85
- ### 2) Corpus Explorer
86
-
87
- Right now, the only available corpus to search is the Wizard of Oz (WoZ). This corpus has been split into sentences, parsed for language features such as part of speech (POS), dependency (DEP), and entity information using SPACY, merged into the BERT tokenization scheme, stored into an HDF5 file, and indexed by FAISS for quick lookup. This same procedure will need to be applied to other corpora to be searched.
88
-
89
-
90
- #### 2a) Search Buttons:
91
-
92
- There are two buttons to perform a search of the available corpus: Search by Head and Search by Embedding.
93
-
94
- To search by embedding, the embedding of the selected token and the layer at which to compare embeddings are passed to the backend. The processed corpus is searched for the words that are nearest to the embedding (by inner product search) at that particular layer and displayed in the Corpus Explorer.
95
-
96
- To search by head, the selected layer, the selected heads, and the concatenated head vector for the selected token are passed to the backend. The head vector is then set to 0 at all indices that are from one of the unselected heads. This vector is then searched across the corpus by inner product.
97
-
98
- Note that the term "inner product" is used. Since the embeddings and the head vectors are normalized, this is equivalent to performing a cosine-similarity search.
99
-
100
-
101
- #### 2b) Histogram Information
102
-
103
- There are two different histograms of information that are displayed: the Metadata histogram (in purple) and the positional histogram (in black). By selecting the dropdown underneath the Metadata histogram, you can change the displayed matrix in the Corpus controller.
104
-
105
-
106
- #### 2c) Corpus Metadata Matrix control buttons
107
-
108
- The control buttons allow you to see a certain amount of context on either side of the matched word. The arrows add context one word to the left or right, whereas the red X deletes a context from the left or right. The blue refresh symbol is used to adjust the heights of each cell to correspond to the height of it's sentence, which is important when the browser window has been resized in some way.
109
-
110
-
111
- #### 2d) Corpus Metadata Matrix
112
-
113
- The metadata matrix is an array of colors that summarize the metadata information of the corresponding sentence to its right. By hovering over any cell, you will be able to see what that particular color represents. There are unfortunately too many values for POS and DEP to give each a unique color that is distinct from all other colors, so some colors may overlap. Black cells indicate that you have reached a sentence boundary.
114
-
115
-
116
- #### 2e) Corpus Explorer
117
-
118
- This display shows all words most closely matching the selected token / layer / head information indicated in the Attention Explorer. Matched words have a thick red border. Hovering over any word will give you its POS and DEP information, the amount of attention the matched word is paying to that word, and will read ENTITY if that word was determined to be an entity in the original corpus.
119
-
120
- ## Install and Getting Started
121
-
122
- Note: This code has possible OS dependencies as it was developed exclusively on MacOS.
123
-
124
- ### Setting up the Environment
125
- 1. From the root of this project, create a new conda directory with `conda env create -f environment.yml`. This will create an environment named `exbert`.
126
- 2. Activate this environment with `conda activate exbert`. At this point, if you want to install the development dependencies, you can do so with `conda env update -f environment-dev.yml`
127
- 3. You will need to install spacy's `en_core_web_sm` as well. To do this, run: `python -m spacy download en_core_web_sm`
128
-
129
-
130
- ### Generating Example Data
131
-
132
- please see the [instructions here](https://github.com/bhoov/exbert/tree/master/server/data_processing)
133
-
134
-
135
- ### Running Locally
136
- Starting the backend:
137
-
138
- ```bash
139
- conda activate exbert
140
- python server/main.py
141
- ```
142
-
143
- ### Notes on setting up conda
144
- If setting up conda for the first time, we recommend downloading Miniconda with the following curl command:
145
-
146
- ```
147
- curl 'https://repo.continuum.io/miniconda/Miniconda3-latest-Linux-x86_64.sh'
148
- ```
149
-
150
- Promptly refresh your shell environment and run `conda update conda` to be able to install from the `conda env create` command above.
151
-
152
-
153
- ## Development
154
-
155
- If you want to make custom changes to the code, these are some hints to get you started.
156
-
157
- ### Use as package
158
- Some find it useful to expose the code inside `server` for development in an environment like Jupyter Notebooks. From the root folder with the `exbert` environment active:
159
-
160
- ```bash
161
- conda env update -f environment-dev.yml
162
- pip install -e ./server
163
- ```
164
-
165
- Now the `exbert` environment should allow the server code to be accessible in any folder so long as there are no additional module name clashes in the environment.
166
-
167
- ### Compiling the frontend
168
-
169
- ```bash
170
- cd client/src
171
- npm install #installs all necessary node packages
172
- npm run build #This will create the static files living in `client/dist`.
173
- ```
174
-
175
- ## Running a development environment
176
- You can run a client server that automatically recompiles the frontend with `npm run ww`. After making a change, you should be able to refresh the browser window to see your most recent changes.
177
-
178
- Because the backend has to load in a lot of data for inference, we do not allow auto-backend refresh on every saved change in flask even though the framework supports it.
179
-
180
- ### Uploading your own model locally
181
- Uploading your own model consists of the following steps:
182
-
183
- 1. *Save your pretrained huggingface model* according to the naming conventions specified in the "modeling_auto.py" of the original transformers repo:
184
-
185
- ```
186
- The model class to instantiate is selected as the first pattern matching
187
- in the `pretrained_model_name_or_path` string (in the following order):
188
- - contains `t5`: T5Model (T5 model)
189
- - contains `distilbert`: DistilBertModel (DistilBERT model)
190
- - contains `albert`: AlbertModel (ALBERT model)
191
- - contains `camembert`: CamembertModel (CamemBERT model)
192
- - contains `xlm-roberta`: XLMRobertaModel (XLM-RoBERTa model)
193
- - contains `roberta`: RobertaModel (RoBERTa model)
194
- - contains `bert`: BertModel (Bert model)
195
- - contains `openai-gpt`: OpenAIGPTModel (OpenAI GPT model)
196
- - contains `gpt2`: GPT2Model (OpenAI GPT-2 model)
197
- - contains `transfo-xl`: TransfoXLModel (Transformer-XL model)
198
- - contains `xlnet`: XLNetModel (XLNet model)
199
- - contains `xlm`: XLMModel (XLM model)
200
- - contains `ctrl`: CTRLModel (Salesforce CTRL model)
201
- ```
202
-
203
- Right now, only BERT, RoBERTa, GPT2, and DistilBERT are supported for context searching. You can use the rest without the context searching as desired.
204
-
205
- 2. *Create the reference corpus*. **Warning**: Depending on the number of layers and size of the hidden dimension in the model, this step could take many gigabytes on your computer to store the hidden representations and attentions at every layer.
206
-
207
- ## Notes on SubRepo Usage
208
- This project makes use of two public pip repositories (`transformers` and `spacyface`), both of which needed modification as this project was being developed. The `git-subrepo` tool was used to achieve this workflow with a forked repository of both transformers and spacyface. However, this introduces the following steps when setting up the environment:
209
-
210
- 1. From the `transformers/` directory, run `pip install -e .`
211
- 2. Repeat for the `spacyface/` directory.
212
-
213
- ## Acknowledgements
214
- This project was inspired in part by the original [BertViz by Jesse Vig](https://github.com/jessevig/bertviz).
215
-
216
- ## Debugging
217
- - If you get a `No module named '_swigfaiss'` error, check that `libomp` is installed on your system. If you are on a mac, this is as simple as `brew install libomp`.
 
1
+ # exFormer
2
 
3
  [![License](https://img.shields.io/badge/License-Apache%202.0-blue.svg)](https://opensource.org/licenses/Apache-2.0)
4
 
5
+ ## Description
6
+ This repository contains the visualization component from exBERT and a minimalized server that does not support
7
 
8
+ The performance of this app will exceed that of exBERT on a slower internet connection as signifcantly less information (like that of the embeddings and results from FAISS searches) is needed to be sent over the REST API.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
client/dist/main.css CHANGED
@@ -1,4 +1,4 @@
1
  @font-face{font-family:IBM Plex Sans;font-style:normal;font-weight:300;src:local("IBM Plex Sans Light"),local("IBMPlexSans-Light"),url(7eeb10384e8e1ef96c87f7074cf2ef59.ttf) format("truetype")}@font-face{font-family:IBM Plex Sans;font-style:normal;font-weight:400;src:local("IBM Plex Sans Regular"),local("IBMPlexSans-Regular"),url(05ca9c06114e79436ea9b5c8d4a7869c.ttf) format("truetype")}@font-face{font-family:IBM Plex Sans;font-style:normal;font-weight:600;src:local("IBM Plex Sans SemiBold"),local("IBMPlexSans-SemiBold"),url(a849e7649e2005ab4aecfa50d96120e1.ttf) format("truetype")}@font-face{font-family:IBM Plex Sans;font-style:normal;font-weight:700;src:local("IBM Plex Sans Bold"),local("IBMPlexSans-Bold"),url(4171e41154ba857f85c536f167d581ba.ttf) format("truetype")}
2
- body{background-color:#fff;font-family:IBM Plex Sans,sans-serif;font-weight:400}.sticky{position:fixed}.noscroll{overflow:hidden}.vpartial{max-height:90vh}.scrolling{overflow:auto;max-height:98%}.btn .btn-xs{padding:.25rem .4rem;font-size:.875rem;line-height:.5;border-radius:.2rem}button{-webkit-transition-duration:.4s;transition-duration:.4s;background:transparent;padding:5px;border-radius:5px;background-color:#d3d3d3}button.selected,button:active :focus{background-color:#98b7d9}#loader{border:5px solid #f3f3f3;border-radius:50%;border-top:5px solid #3498db;width:100px;height:100px;-webkit-animation:spin 2s linear infinite;animation:spin 2s linear infinite;position:absolute;left:50%;top:20%;display:none}@-webkit-keyframes spin{0%{-webkit-transform:rotate(0deg)}to{-webkit-transform:rotate(1turn)}}@keyframes spin{0%{transform:rotate(0deg)}to{transform:rotate(1turn)}}svg{vertical-align:top}select{font-size:9pt;font-weight:600;background-color:transparent;padding:8px 6px;-webkit-box-sizing:border-box;-moz-box-sizing:border-box;box-sizing:border-box;border-radius:4px;border:0;outline:0}.navbar{position:absolute;top:0;left:0;width:100%;height:50px;background-color:#faebd7}.navbarContent{margin:10px 20px}.navbarContent span{padding-left:10px}.navbarContent button{margin-left:10px}.navbarTitle{font-size:12pt;font-weight:700}.main_frame{position:fixed;top:55px;overflow-x:hidden;overflow-y:auto}.floating_content{padding:10px;height:94%}.container{width:100%;height:95%;text-align:center;display:inline-block;margin:5px auto}#bottom-margin{height:100px}.content{max-width:960px;margin:auto}.whitespace{height:8vh}#sentence-input{margin-bottom:-30px;margin-right:-30px;margin-left:10px;width:90%}#sentence-input form{display:flex;flex-direction:row;flex-wrap:nowrap;justify-content:space-evenly;align-items:center}#sentence-input form .form-group{flex-grow:3}#sentence-input form .form-group input{width:100%;margin-right:5%}#sentence-input form .padding{flex-grow:0.3}#sentence-input form .btn{flex-grow:1}.input-description{font-weight:800}.connector-controls{display:grid;grid-template-columns:.5fr .5fr}.slide-container{grid-column-start:1;grid-column-end:2;grid-row-start:1;grid-row-end:2;margin:auto;text-align:center;width:75%}.slider{-webkit-appearance:none;width:10px;height:10px;border-radius:5px;background:#d3d3d3;outline:none;opacity:.7;-webkit-transition:.2s;transition:opacity .2s}.slider:hover{opacity:1}.slider::-webkit-slider-thumb{-webkit-appearance:none;appearance:none;width:15px;height:15px;border-radius:50%;background:#666;cursor:pointer}#layer-selection{grid-column-start:1;grid-column-end:2;grid-row-start:2;grid-row-end:3}.layer-select{margin-bottom:2em}#atn-container{display:flex;flex-direction:row;flex-wrap:nowrap;justify-content:center;align-items:top;margin:0 auto;width:100%;vertical-align:top}#atn-container #left-att-heads{order:1;display:inline-block;vertical-align:top}#atn-container #left-tokens{order:2;text-align:right;vertical-align:top}#atn-container #atn-display{order:3;vertical-align:top}#atn-container #right-tokens{order:4;text-align:left;vertical-align:top}#atn-container #right-att-heads{order:5;vertical-align:top}.att-rect{transition:fill .1s}.token{display:block}.atn-curve{fill:none;stroke:purple}.masked-token{color:rgba(0,0,0,.2)}.unselected{fill:gray}.selected-token{border:3px solid #99c400}.switch{position:relative;display:inline-block;width:60px;height:34px}.switch input{opacity:0;width:0;height:0}.short-slider{cursor:pointer;top:0;left:0;right:0;bottom:0;background-color:#ccc}.short-slider,.short-slider:before{position:absolute;-webkit-transition:.4s;transition:.4s}.short-slider:before{content:"";height:26px;width:26px;left:4px;bottom:4px;background-color:#fff}input:checked+.short-slider{background-color:#2196f3}input:focus+.short-slider{box-shadow:0 0 1px #2196f3}input:checked+.short-slider:before{-webkit-transform:translateX(26px);-ms-transform:translateX(26px);transform:translateX(26px)}.short-slider.round{border-radius:34px}.short-slider.round:before{border-radius:50%}#select-all-heads{margin-top:20px;margin-bottom:20px}#corpus-vis{margin:0 auto}#corpus-vis #main-corpus-vis{display:-webkit-flex;display:flex}#corpus-vis #main-corpus-vis #corpus-mat-container{-webkit-flex:initial;flex:initial;vertical-align:top;float:left}#corpus-vis #main-corpus-vis #corpus-mat-container .corpus-mat{display:inline-block;margin-right:.05em;margin-left:.05em}#corpus-vis #main-corpus-vis #corpus-mat-container .offset-0{border:.2em solid #000}#corpus-vis #main-corpus-vis #corpus-mat-container .mat-hover-display{pointer-events:none;display:flex;position:absolute;visibility:hidden;background-color:#c8c8c8;border-radius:8px 8px 1px 8px;margin:auto}#corpus-vis #main-corpus-vis #corpus-mat-container .mat-hover-display p{margin:auto}#corpus-vis #main-corpus-vis #corpus-similar-sentences-div{-webkit-flex:1;flex:1;vertical-align:top;float:left;max-width:80%;max-height:100%}#corpus-vis #main-corpus-vis #corpus-similar-sentences-div .hovered-col{color:orange}#corpus-vis .btn{margin-left:.25em}#corpus-vis .inspector-row{display:block;margin-left:10px;padding-top:.5em;padding-bottom:.5em}#corpus-vis .inspector-cell{display:inline-block;margin-right:3px;text-align:left}#corpus-vis .celltooltip{position:relative;display:inline-block;border-bottom:1px dotted #000}#corpus-vis .celltooltip .tooltiptext{visibility:hidden;width:120px;background-color:#000;color:#fff;text-align:center;padding:5px 0;border-radius:6px;position:absolute}#corpus-vis .celltooltip:hover .tooltiptext{width:120px;bottom:100%;left:50%;margin-left:-60px;visibility:visible}#corpus-vis .celltooltip .tooltiptext:after{content:" ";position:absolute;top:100%;left:50%;margin-left:-5px;border-width:5px;border-style:solid;border-color:#000 transparent transparent}#corpus-vis .matched-cell{border:3px solid #99c400;border-radius:.4em}#corpus-vis .gray-cell{color:rgba(0,0,0,.35)}#corpus-vis .next-cell{color:rgba(228,1,1,.8);-moz-box-shadow:0 0 3px #ccc;-webkit-box-shadow:0 0 3px #ccc;box-shadow:0 0 3px #ccc}#histograms{display:block;max-width:100%}#histograms .histogram{display:inline-block;overflow-x:auto}#histograms div{margin-top:10px}#histograms #max-att-histogram .bar{fill:#000}.pos-selector{margin-bottom:40px}body{font-family:IBM Plex Sans}.layerCheckbox{background-color:#d3d3d3;padding-left:8px;padding-right:8px}.layerCheckbox.active{color:#fff;background-color:#6c7067}.main-grid{width:100%;display:grid;grid-template-columns:.18fr .2fr .2fr .04fr .2fr .2fr .18fr;overflow:auto;max-height:100vh}.left-half{grid-column-start:1;grid-column-end:4;margin-left:10px;margin-right:10px}.vpartial-90{max-height:90vh}.vpartial-95{max-height:95vh}.right-half{grid-column-start:5;grid-column-end:9;max-height:98vh}.vertical-separator{border-left:thick solid #42222298;margin:0 auto;margin-top:10px;margin-bottom:10px;border-radius:3px;grid-column-start:4;grid-column-end:5;grid-row-start:1;grid-row-end:5}#vis-break{height:15px}label{margin-left:5px}#header{width:100%;background-color:#d3d3d3;height:40px;margin-bottom:5px}#header .header-logo{height:20px;display:inline-block;margin-left:10px;margin-top:5px;margin-bottom:5px}#header .header-info{font-size:9pt;height:30px;display:inline-block;float:right;margin-right:10px;margin-top:10px}#header #headertext{text-align:center;display:inline-block;font-size:18px;margin-left:30%;margin-top:5px;margin-bottom:5px}.highlighted{background:rgba(152,83,216,.8)}#meta-dropdown,#position-meta-dropdown{margin-bottom:.75em;margin-left:4em}#corpus-control-buttons{margin-bottom:1em;position:fixed relative}#corpus-control-buttons span{margin-left:5px}#selected-heads{margin-bottom:1em}#corpus-selection-description{display:inline-block;margin-right:15px}#corpus-querying,#corpus-querying .btn{display:inline-block}#usage-info{margin-top:10px;color:#575757;font-size:14px}.tick{font-size:18px}#connector-container .mat-hover-display{pointer-events:none;display:block;position:absolute;visibility:hidden;background-color:hsla(0,0%,78%,.93);font-size:14px}#connector-container .mat-hover-display p{margin:4px 1px 1px 4px}.right-token-hover{border-radius:1px 8px 8px 8px;text-align:left}.left-token-hover{border-radius:8px 1px 8px 8px;text-align:right}.next-token{color:rgba(228,1,1,.8);-moz-box-shadow:0 0 3px #ccc;-webkit-box-shadow:0 0 3px #ccc;box-shadow:0 0 3px #ccc}
3
 
4
- /*# sourceMappingURL=data:application/json;charset=utf-8;base64,eyJ2ZXJzaW9uIjozLCJzb3VyY2VzIjpbIndlYnBhY2s6Ly8vLi9mb250cy9wbGV4X3NhbnMuY3NzIiwid2VicGFjazovLy8uL2Nzcy9jc3MvYmFzZS5zY3NzIiwid2VicGFjazovLy8uL2Nzcy9jc3MvU2VudGVuY2VJbnB1dC5zY3NzIiwid2VicGFjazovLy8uL2Nzcy9jc3MvQXR0ZW50aW9uQ29ubmVjdG9yQ29udHJvbHMuc2NzcyIsIndlYnBhY2s6Ly8vLi9jc3MvY3NzL0NvcnB1c1Zpcy5zY3NzIiwid2VicGFjazovLy8uL2Nzcy9jc3MvSGlzdG9ncmFtcy5zY3NzIiwid2VicGFjazovLy8uL2Nzcy9jc3MvbWFpbi5zY3NzIl0sIm5hbWVzIjpbXSwibWFwcGluZ3MiOiJBQUNBLFdBQ0UsMEJBQ0Esa0JBQ0EsZ0JBQ0EsNEdBQTJILENBRzdILFdBQ0UsMEJBQ0Esa0JBQ0EsZ0JBQ0EsZ0hBQWlJLENBR25JLFdBQ0UsMEJBQ0Esa0JBQ0EsZ0JBQ0Esa0hBQW9JLENBR3RJLFdBQ0UsMEJBQ0Esa0JBQ0EsZ0JBQ0EsMEdBQXdILENBQ3pILGdEO0FDM0JELEtBQ0Usc0JBQ0EscUNBQ0EsZUFBZ0IsQ0FHbEIsUUFDRSxjQUFlLENBR2pCLFVBQ0UsZUFBZ0IsQ0FHbEIsVUFDRSxlQUFnQixDQUdsQixXQUNFLGNBQ0EsY0FBZSxDQUdqQixhQUVJLHFCQUNBLGtCQUNBLGVBQ0EsbUJBQXFCLENBSXpCLE9BQ0UsZ0NBQ0Esd0JBQ0EsdUJBQ0EsWUFDQSxrQkFDQSx3QkFBMkIsQ0FPN0IscUNBQ0Usd0JBQXlCLENBRzNCLFFBQ0UseUJBQ0Esa0JBQ0EsNkJBQ0EsWUFDQSxhQUNBLDBDQUNBLGtDQUNBLGtCQUNBLFNBQ0EsUUFDQSxZQUFhLENBSWYsd0JBQ0UsR0FDRSw4QkFBK0IsQ0FFakMsR0FDRSwrQkFBaUMsRUFJckMsZ0JBQ0UsR0FDRSxzQkFBdUIsQ0FFekIsR0FDRSx1QkFBeUIsRUFJN0IsSUFDRSxrQkFBbUIsQ0FHckIsT0FDRSxjQUNBLGdCQUdBLDZCQUtBLGdCQU1BLDhCQUNBLDJCQUNBLHNCQUNBLGtCQUNBLFNBQ0EsU0FBVSxDQUVaLFFBQ0Usa0JBQ0EsTUFDQSxPQUNBLFdBQ0EsWUFDQSx3QkFBOEIsQ0FJaEMsZUFDRSxnQkFBaUIsQ0FTbEIsb0JBTkcsaUJBQWtCLENBQ25CLHNCQUdDLGdCQUFpQixDQUlyQixhQUNFLGVBRUEsZUFBaUIsQ0FHbkIsWUFDRSxlQUNBLFNBR0Esa0JBQ0EsZUFBZ0IsQ0FHbEIsa0JBQ0UsYUFDQSxVQUFXLENBR2IsV0FDRSxXQUNBLFdBQ0Esa0JBQ0EscUJBQ0EsZUFBZ0IsQ0FHbEIsZUFDRSxZQUFhLENBR2YsU0FDRSxnQkFDQSxXQUFZLENBR2QsWUFDRSxVQUFXLENDeEtiLGdCQUNJLG9CQUNBLG1CQUNBLGlCQUNBLFNBQVUsQ0E2QmIscUJBMUJPLGFBQ0EsbUJBQ0EsaUJBQ0EsNkJBQ0Esa0JBQW1CLENBcUJ0QixpQ0FsQk8sV0FBWSxDQU9mLHVDQUhPLFdBQ0EsZUFBZ0IsQ0FDbkIsOEJBSUQsYUFBYyxDQUNqQiwwQkFJRyxXQUFZLENDOUJ4QixtQkFDQyxlQUNELENBRUEsb0JBQ0MsYUFDQSwrQkFBa0MsQ0FHbkMsaUJBQ0Msb0JBQ0Esa0JBQ0EsaUJBQ0EsZUFDQSxZQUNBLGtCQUNBLFNBQVUsQ0FHWCxRQUNDLHdCQUNBLFdBQ0EsWUFDQSxrQkFDQSxtQkFDQSxhQUNBLFdBQ0EsdUJBQ0Esc0JBQXVCLENBR3hCLGNBQ0MsU0FBVSxDQUdYLDhCQUNDLHdCQUNBLGdCQUNBLFdBQ0EsWUFDQSxrQkFDQSxnQkFDQSxjQUFlLENBR2hCLGlCQUNDLG9CQUNBLGtCQUNBLGlCQUNBLGNBQWUsQ0FHaEIsY0FDQyxpQkFBa0IsQ0FHbkIsZUFDQyxhQUNBLG1CQUNBLGlCQUNBLHVCQUNBLGdCQUVBLGNBQ0EsV0FDQSxrQkFBbUIsQ0ErQm5CLCtCQTVCQyxRQUNBLHFCQUNBLGtCQUFtQixDQUNuQiw0QkFHQSxRQUNBLGlCQUNBLGtCQUFtQixDQUNuQiw0QkFJQSxRQUNBLGtCQUFtQixDQUNuQiw2QkFHQSxRQUNBLGdCQUNBLGtCQUFtQixDQUNuQixnQ0FHQSxRQUNBLGtCQUFtQixDQUtyQixVQUNDLG1CQUFxQixDQUd0QixPQUNDLGFBQWMsQ0FHZixXQUNDLFVBRUEsYUFBYyxDQUdmLGNBQ0Msb0JBQXNCLENBR3ZCLFlBQ0MsU0FBVSxDQUdYLGdCQUdDLHdCQUE4QixDQUkvQixRQUNDLGtCQUNBLHFCQUNBLFdBQ0EsV0FBWSxDQVFaLGNBSkMsVUFDQSxRQUNBLFFBQVMsQ0FLWCxjQUVDLGVBQ0EsTUFDQSxPQUNBLFFBQ0EsU0FDQSxxQkFBc0IsQ0FldEIsbUNBckJBLGtCQU9BLHVCQUNBLGNBQWUsQ0FZZCxxQkFSQSxXQUNBLFlBQ0EsV0FDQSxTQUNBLFdBQ0EscUJBQXVCLENBTXpCLDRCQUNDLHdCQUF5QixDQUcxQiwwQkFDQywwQkFBMkIsQ0FHNUIsbUNBQ0MsbUNBQ0EsK0JBQ0EsMEJBQTJCLENBSTVCLG9CQUNDLGtCQUFtQixDQUdwQiwyQkFDQyxpQkFBa0IsQ0FHbkIsa0JBQ0MsZ0JBQ0Esa0JBQW1CLENDL0xwQixZQUNFLGFBQWMsQ0E2SGYsNkJBMUhHLHFCQUNBLFlBQWEsQ0E0Q2QsbURBekNHLHFCQUNBLGFBQ0EsbUJBQ0EsVUFBVyxDQXdCWiwrREFyQkcscUJBQ0EsbUJBQ0EsaUJBQW1CLENBQ3BCLDZEQUdDLHNCQUF5QixDQUMxQixzRUFHQyxvQkFDQSxhQUNBLGtCQUNBLGtCQUNBLHlCQUNBLDhCQUNBLFdBQVksQ0FJYix3RUFGRyxXQUFZLENBQ2IsMkRBS0gsZUFDQSxPQUNBLG1CQUNBLFdBQ0EsY0FDQSxlQUFnQixDQUtqQix3RUFGRyxZQUFhLENBQ2QsaUJBS0gsaUJBQW1CLENBQ3BCLDJCQUdDLGNBQ0EsaUJBQ0EsaUJBQ0EsbUJBQXFCLENBQ3RCLDRCQUdDLHFCQUNBLGlCQUNBLGVBQWdCLENBQ2pCLHlCQUlDLGtCQUNBLHFCQUNBLDZCQUErQixDQUNoQyxzQ0FJQyxrQkFDQSxZQUNBLHNCQUNBLFdBQ0Esa0JBQ0EsY0FDQSxrQkFHQSxpQkFBa0IsQ0FDbkIsNENBSUMsWUFDQSxZQUNBLFNBQ0Esa0JBQ0Esa0JBQW1CLENBQ3BCLDRDQUlDLFlBQ0Esa0JBQ0EsU0FDQSxTQUNBLGlCQUNBLGlCQUNBLG1CQUNBLHlDQUF1RCxDQUN4RCwwQkFJQyx5QkFFQSxrQkFBb0IsQ0FDckIsdUJBR0MscUJBQTBCLENBQzNCLHVCQUVDLHVCQUNBLDZCQUNBLGdDQUNBLHVCQUF3QixDQzFINUIsWUFDSSxjQUNBLGNBQWUsQ0FzQmhCLHVCQW5CRyxxQkFDQSxlQUFnQixDQUNqQixnQkFHQyxlQUFnQixDQUNqQixvQ0FVSyxTQUFXLENBS25CLGNBQ0Usa0JBQW1CLENDcEJ2QixLQUNFLHlCQUE0QixDQUc5QixlQUNFLHlCQUNBLGlCQUNBLGlCQUFrQixDQU1uQixzQkFIRyxXQUNBLHdCQUF5QixDQUk3QixXQUNFLFdBQ0EsYUFDQSw0REFDQSxjQUNBLGdCQUFpQixDQUduQixXQUNFLG9CQUNBLGtCQUNBLGlCQUNBLGlCQUFrQixDQUdwQixhQUNFLGVBQWdCLENBR2xCLGFBQ0UsZUFBZ0IsQ0FHbEIsWUFDRSxvQkFDQSxrQkFDQSxlQUFnQixDQUdsQixvQkFDRSxrQ0FDQSxjQUNBLGdCQUNBLG1CQUNBLGtCQUNBLG9CQUNBLGtCQUNBLGlCQUNBLGNBQWUsQ0FHakIsV0FDRSxXQUFZLENBR2QsTUFDRSxlQUFnQixDQU9sQixRQUNFLFdBQ0EseUJBQ0EsWUFDQSxpQkFBa0IsQ0E0Qm5CLHFCQXpCRyxZQUNBLHFCQUNBLGlCQUNBLGVBQ0EsaUJBQWtCLENBQ25CLHFCQUVDLGNBQ0EsWUFDQSxxQkFDQSxZQUNBLGtCQUNBLGVBQWdCLENBRWpCLG9CQUlDLGtCQUNBLHFCQUNBLGVBQ0EsZ0JBQ0EsZUFDQSxpQkFBa0IsQ0FJdEIsYUFDRSw4QkFBbUMsQ0FRckMsdUNBQ0Usb0JBQ0EsZUFBZ0IsQ0FJbEIsd0JBQ0Usa0JBQ0EsdUJBQXdCLENBSXpCLDZCQUZHLGVBQWUsQ0FJbkIsZ0JBQ0UsaUJBQWtCLENBR3BCLDhCQUNFLHFCQUNBLGlCQUFrQixDQUdwQix1Q0FHSSxvQkFBcUIsQ0FJekIsWUFDRSxnQkFDQSxjQUNBLGNBQWUsQ0FHakIsTUFDRSxjQUFlLENBR2pCLHdDQUVJLG9CQUNBLGNBQ0Esa0JBQ0Esa0JBQ0Esb0NBQ0EsY0FBZSxDQUtoQiwwQ0FIRyxzQkFBdUIsQ0FNN0IsbUJBQ0ksOEJBQ0EsZUFBZ0IsQ0FHcEIsa0JBQ0ksOEJBQ0EsZ0JBQWlCLENBR3JCLFlBQ0UsdUJBQ0EsNkJBQ0EsZ0NBQ0EsdUJBQXdCLEMiLCJmaWxlIjoibWFpbi5jc3MiLCJzb3VyY2VzQ29udGVudCI6WyIvKiBjeXJpbGxpYy1leHQgKi9cbkBmb250LWZhY2Uge1xuICBmb250LWZhbWlseTogJ0lCTSBQbGV4IFNhbnMnO1xuICBmb250LXN0eWxlOiBub3JtYWw7XG4gIGZvbnQtd2VpZ2h0OiAzMDA7XG4gIHNyYzogbG9jYWwoJ0lCTSBQbGV4IFNhbnMgTGlnaHQnKSwgbG9jYWwoJ0lCTVBsZXhTYW5zLUxpZ2h0JyksIHVybChJQk1fUGxleF9TYW5zL0lCTVBsZXhTYW5zLUxpZ2h0LnR0ZikgZm9ybWF0KCd0cnVldHlwZScpO1xufVxuXG5AZm9udC1mYWNlIHtcbiAgZm9udC1mYW1pbHk6ICdJQk0gUGxleCBTYW5zJztcbiAgZm9udC1zdHlsZTogbm9ybWFsO1xuICBmb250LXdlaWdodDogNDAwO1xuICBzcmM6IGxvY2FsKCdJQk0gUGxleCBTYW5zIFJlZ3VsYXInKSwgbG9jYWwoJ0lCTVBsZXhTYW5zLVJlZ3VsYXInKSwgdXJsKElCTV9QbGV4X1NhbnMvSUJNUGxleFNhbnMtUmVndWxhci50dGYpIGZvcm1hdCgndHJ1ZXR5cGUnKTtcbn1cblxuQGZvbnQtZmFjZSB7XG4gIGZvbnQtZmFtaWx5OiAnSUJNIFBsZXggU2Fucyc7XG4gIGZvbnQtc3R5bGU6IG5vcm1hbDtcbiAgZm9udC13ZWlnaHQ6IDYwMDtcbiAgc3JjOiBsb2NhbCgnSUJNIFBsZXggU2FucyBTZW1pQm9sZCcpLCBsb2NhbCgnSUJNUGxleFNhbnMtU2VtaUJvbGQnKSwgdXJsKElCTV9QbGV4X1NhbnMvSUJNUGxleFNhbnMtU2VtaUJvbGQudHRmKSBmb3JtYXQoJ3RydWV0eXBlJyk7XG59XG5cbkBmb250LWZhY2Uge1xuICBmb250LWZhbWlseTogJ0lCTSBQbGV4IFNhbnMnO1xuICBmb250LXN0eWxlOiBub3JtYWw7XG4gIGZvbnQtd2VpZ2h0OiA3MDA7XG4gIHNyYzogbG9jYWwoJ0lCTSBQbGV4IFNhbnMgQm9sZCcpLCBsb2NhbCgnSUJNUGxleFNhbnMtQm9sZCcpLCB1cmwoSUJNX1BsZXhfU2Fucy9JQk1QbGV4U2Fucy1Cb2xkLnR0ZikgZm9ybWF0KCd0cnVldHlwZScpO1xufVxuIiwiYm9keSB7XG4gIGJhY2tncm91bmQtY29sb3I6IHJnYigyNTUsIDI1NSwgMjU1KTtcbiAgZm9udC1mYW1pbHk6ICdJQk0gUGxleCBTYW5zJywgc2Fucy1zZXJpZjtcbiAgZm9udC13ZWlnaHQ6IDQwMDtcbn1cblxuLnN0aWNreSB7XG4gIHBvc2l0aW9uOiBmaXhlZDtcbn1cblxuLm5vc2Nyb2xsIHtcbiAgb3ZlcmZsb3c6IGhpZGRlbjtcbn1cblxuLnZwYXJ0aWFsIHtcbiAgbWF4LWhlaWdodDogOTB2aDtcbn1cblxuLnNjcm9sbGluZyB7XG4gIG92ZXJmbG93OiBhdXRvO1xuICBtYXgtaGVpZ2h0OiA5OCU7XG59XG5cbi5idG4ge1xuICAuYnRuLXhzIHtcbiAgICBwYWRkaW5nICA6IC4yNXJlbSAuNHJlbTtcbiAgICBmb250LXNpemUgIDogLjg3NXJlbTtcbiAgICBsaW5lLWhlaWdodCAgOiAuNTtcbiAgICBib3JkZXItcmFkaXVzIDogLjJyZW07XG4gIH1cbn1cblxuYnV0dG9uIHtcbiAgLXdlYmtpdC10cmFuc2l0aW9uLWR1cmF0aW9uOiAwLjRzOyAvKiBTYWZhcmkgKi9cbiAgdHJhbnNpdGlvbi1kdXJhdGlvbjogMC40cztcbiAgYmFja2dyb3VuZDogdHJhbnNwYXJlbnQ7XG4gIHBhZGRpbmc6IDVweDtcbiAgYm9yZGVyLXJhZGl1czogNXB4O1xuICBiYWNrZ3JvdW5kLWNvbG9yOiBsaWdodGdyYXk7XG5cbiAgJi5zZWxlY3RlZCB7XG4gICAgYmFja2dyb3VuZC1jb2xvcjogIzk4YjdkOTtcbiAgfVxufVxuXG5idXR0b246YWN0aXZlIDpmb2N1cyB7XG4gIGJhY2tncm91bmQtY29sb3I6ICM5OGI3ZDk7XG59XG5cbiNsb2FkZXIge1xuICBib3JkZXI6IDVweCBzb2xpZCAjZjNmM2YzO1xuICBib3JkZXItcmFkaXVzOiA1MCU7XG4gIGJvcmRlci10b3A6IDVweCBzb2xpZCAjMzQ5OGRiO1xuICB3aWR0aDogMTAwcHg7XG4gIGhlaWdodDogMTAwcHg7XG4gIC13ZWJraXQtYW5pbWF0aW9uOiBzcGluIDJzIGxpbmVhciBpbmZpbml0ZTsgLyogU2FmYXJpICovXG4gIGFuaW1hdGlvbjogc3BpbiAycyBsaW5lYXIgaW5maW5pdGU7XG4gIHBvc2l0aW9uOiBhYnNvbHV0ZTtcbiAgbGVmdDogNTAlO1xuICB0b3A6IDIwJTtcbiAgZGlzcGxheTogbm9uZTtcbn1cblxuLyogU2FmYXJpICovXG5ALXdlYmtpdC1rZXlmcmFtZXMgc3BpbiB7XG4gIDAlIHtcbiAgICAtd2Via2l0LXRyYW5zZm9ybTogcm90YXRlKDBkZWcpO1xuICB9XG4gIDEwMCUge1xuICAgIC13ZWJraXQtdHJhbnNmb3JtOiByb3RhdGUoMzYwZGVnKTtcbiAgfVxufVxuXG5Aa2V5ZnJhbWVzIHNwaW4ge1xuICAwJSB7XG4gICAgdHJhbnNmb3JtOiByb3RhdGUoMGRlZyk7XG4gIH1cbiAgMTAwJSB7XG4gICAgdHJhbnNmb3JtOiByb3RhdGUoMzYwZGVnKTtcbiAgfVxufVxuXG5zdmcge1xuICB2ZXJ0aWNhbC1hbGlnbjogdG9wO1xufVxuXG5zZWxlY3Qge1xuICBmb250LXNpemU6IDlwdDtcbiAgZm9udC13ZWlnaHQ6IDYwMDtcblxuICAvL2JhY2tncm91bmQ6IHVybChcImRhdGE6aW1hZ2Uvc3ZnK3htbDt1dGY4LDxzdmcgeG1sbnM9J2h0dHA6Ly93d3cudzMub3JnLzIwMDAvc3ZnJyB3aWR0aD0nMTBweCcgaGVpZ2h0PScxMHB4Jz48cG9seWxpbmUgcG9pbnRzPScwLDAgMTAsMCA1LDEwJy8+PC9zdmc+XCIpO1xuICBiYWNrZ3JvdW5kLWNvbG9yOiB0cmFuc3BhcmVudDtcbiAgLy9iYWNrZ3JvdW5kLXJlcGVhdDogbm8tcmVwZWF0O1xuICAvL2JhY2tncm91bmQtcG9zaXRpb246IHJpZ2h0IDVweCB0b3AgOXB4O1xuICAvL2JhY2tncm91bmQtc2l6ZTogN3B4IDdweDtcbiAgLy9wYWRkaW5nOiA1cHggMTVweCA1cHggNXB4O1xuICBwYWRkaW5nOiA4cHggNnB4O1xuICAvL3dpZHRoOiBhdXRvO1xuICAvL2ZvbnQtc2l6ZToxNnB4O1xuICAvL2ZvbnQtd2VpZ2h0OiBib2xkO1xuICAvL3RleHQtYWxpZ246Y2VudGVyO1xuICAvL3RleHQtc2hhZG93OjAgLTFweCAwIHJnYmEoMCwgMCwgMCwgMC4yNSk7XG4gIC13ZWJraXQtYm94LXNpemluZzogYm9yZGVyLWJveDtcbiAgLW1vei1ib3gtc2l6aW5nOiBib3JkZXItYm94O1xuICBib3gtc2l6aW5nOiBib3JkZXItYm94O1xuICBib3JkZXItcmFkaXVzOiA0cHg7XG4gIGJvcmRlcjogMDtcbiAgb3V0bGluZTogMDtcbn1cbi5uYXZiYXIge1xuICBwb3NpdGlvbjogYWJzb2x1dGU7XG4gIHRvcDogMDtcbiAgbGVmdDogMDtcbiAgd2lkdGg6IDEwMCU7XG4gIGhlaWdodDogNTBweDtcbiAgYmFja2dyb3VuZC1jb2xvcjogYW50aXF1ZXdoaXRlO1xuICAvL3BhZGRpbmc6IDEwcHggMTBweCAxMHB4IDMwcHg7XG59XG5cbi5uYXZiYXJDb250ZW50IHtcbiAgbWFyZ2luOiAxMHB4IDIwcHg7XG5cbiAgc3BhbiB7XG4gICAgcGFkZGluZy1sZWZ0OiAxMHB4O1xuICB9XG5cbiAgYnV0dG9uIHtcbiAgICBtYXJnaW4tbGVmdDogMTBweDtcbiAgfVxufVxuXG4ubmF2YmFyVGl0bGUge1xuICBmb250LXNpemU6IDEycHQ7XG4gIC8vbWFyZ2luOiA1cHQ7XG4gIGZvbnQtd2VpZ2h0OiBib2xkO1xufVxuXG4ubWFpbl9mcmFtZSB7XG4gIHBvc2l0aW9uOiBmaXhlZDtcbiAgdG9wOiA1NXB4O1xuICAvL21hcmdpbjogMHB4IDUwcHggMHB4IDUwcHg7XG4gIC8vYmFja2dyb3VuZDogI2ZmZmZmZjtcbiAgb3ZlcmZsb3cteDogaGlkZGVuO1xuICBvdmVyZmxvdy15OiBhdXRvO1xufVxuXG4uZmxvYXRpbmdfY29udGVudCB7XG4gIHBhZGRpbmc6IDEwcHg7XG4gIGhlaWdodDogOTQlO1xufVxuXG4uY29udGFpbmVyIHtcbiAgd2lkdGg6IDEwMCU7XG4gIGhlaWdodDogOTUlO1xuICB0ZXh0LWFsaWduOiBjZW50ZXI7XG4gIGRpc3BsYXk6IGlubGluZS1ibG9jaztcbiAgbWFyZ2luOiA1cHggYXV0bztcbn1cblxuI2JvdHRvbS1tYXJnaW4ge1xuICBoZWlnaHQ6IDEwMHB4O1xufVxuXG4uY29udGVudCB7XG4gIG1heC13aWR0aDogOTYwcHg7XG4gIG1hcmdpbjogYXV0bztcbn1cblxuLndoaXRlc3BhY2Uge1xuICBoZWlnaHQ6IDh2aDtcbn0iLCJcbiNzZW50ZW5jZS1pbnB1dCB7XG4gICAgbWFyZ2luLWJvdHRvbTogLTMwcHg7XG4gICAgbWFyZ2luLXJpZ2h0OiAtMzBweDtcbiAgICBtYXJnaW4tbGVmdDogMTBweDtcbiAgICB3aWR0aDogOTAlO1xuXG4gICAgZm9ybSB7XG4gICAgICAgIGRpc3BsYXk6IGZsZXg7XG4gICAgICAgIGZsZXgtZGlyZWN0aW9uOiByb3c7XG4gICAgICAgIGZsZXgtd3JhcDogbm93cmFwO1xuICAgICAgICBqdXN0aWZ5LWNvbnRlbnQ6IHNwYWNlLWV2ZW5seTtcbiAgICAgICAgYWxpZ24taXRlbXM6IGNlbnRlcjtcblxuICAgICAgICAuZm9ybS1ncm91cCB7XG4gICAgICAgICAgICBmbGV4LWdyb3c6IDM7XG5cbiAgICAgICAgICAgIGlucHV0IHtcbiAgICAgICAgICAgICAgICAvLyBmbGV4LWdyb3c6IDQ7XG4gICAgICAgICAgICAgICAgd2lkdGg6IDEwMCU7XG4gICAgICAgICAgICAgICAgbWFyZ2luLXJpZ2h0OiA1JTtcbiAgICAgICAgICAgIH1cbiAgICAgICAgfVxuICAgICAgICBcbiAgICAgICAgLnBhZGRpbmcge1xuICAgICAgICAgICAgZmxleC1ncm93OiAwLjM7XG4gICAgICAgIH1cblxuXG4gICAgICAgIC5idG4ge1xuICAgICAgICAgICAgZmxleC1ncm93OiAxO1xuICAgICAgICAgICAgLy8gZGlzcGxheTogaW5saW5lLWJsb2NrO1xuICAgICAgICB9XG4gICAgfVxufSIsIi5pbnB1dC1kZXNjcmlwdGlvbiB7XG5cdGZvbnQtd2VpZ2h0OiA4MDBcbn1cblxuLmNvbm5lY3Rvci1jb250cm9scyB7XG5cdGRpc3BsYXk6IGdyaWQ7XG5cdGdyaWQtdGVtcGxhdGUtY29sdW1uczogMC41ZnIgMC41ZnI7XG59XG5cbi5zbGlkZS1jb250YWluZXIge1xuXHRncmlkLWNvbHVtbi1zdGFydDogMTtcblx0Z3JpZC1jb2x1bW4tZW5kOiAyO1xuXHRncmlkLXJvdy1zdGFydDogMTtcblx0Z3JpZC1yb3ctZW5kOiAyO1xuXHRtYXJnaW46IGF1dG87XG5cdHRleHQtYWxpZ246IGNlbnRlcjtcblx0d2lkdGg6IDc1JTsgXG59XG5cbi5zbGlkZXIge1xuXHQtd2Via2l0LWFwcGVhcmFuY2U6IG5vbmU7XG5cdHdpZHRoOiAxMHB4O1xuXHRoZWlnaHQ6IDEwcHg7XG5cdGJvcmRlci1yYWRpdXM6IDVweDtcblx0YmFja2dyb3VuZDogI2QzZDNkMztcblx0b3V0bGluZTogbm9uZTtcblx0b3BhY2l0eTogMC43O1xuXHQtd2Via2l0LXRyYW5zaXRpb246IC4ycztcblx0dHJhbnNpdGlvbjogb3BhY2l0eSAuMnM7XG59XG5cbi5zbGlkZXI6aG92ZXIge1xuXHRvcGFjaXR5OiAxO1xufVxuXG4uc2xpZGVyOjotd2Via2l0LXNsaWRlci10aHVtYiB7XG5cdC13ZWJraXQtYXBwZWFyYW5jZTogbm9uZTtcblx0YXBwZWFyYW5jZTogbm9uZTtcblx0d2lkdGg6IDE1cHg7XG5cdGhlaWdodDogMTVweDtcblx0Ym9yZGVyLXJhZGl1czogNTAlO1xuXHRiYWNrZ3JvdW5kOiAjNjY2NjY2O1xuXHRjdXJzb3I6IHBvaW50ZXI7XG59XG5cbiNsYXllci1zZWxlY3Rpb24ge1xuXHRncmlkLWNvbHVtbi1zdGFydDogMTtcblx0Z3JpZC1jb2x1bW4tZW5kOiAyO1xuXHRncmlkLXJvdy1zdGFydDogMjtcblx0Z3JpZC1yb3ctZW5kOiAzO1xuXG59XG4ubGF5ZXItc2VsZWN0IHtcblx0bWFyZ2luLWJvdHRvbTogMmVtO1xufVxuXG4jYXRuLWNvbnRhaW5lciB7XG5cdGRpc3BsYXk6IGZsZXg7XG5cdGZsZXgtZGlyZWN0aW9uOiByb3c7XG5cdGZsZXgtd3JhcDogbm93cmFwO1xuXHRqdXN0aWZ5LWNvbnRlbnQ6IGNlbnRlcjtcblx0YWxpZ24taXRlbXM6IHRvcDtcblxuXHRtYXJnaW46IDAgYXV0bztcblx0d2lkdGg6IDEwMCU7XG5cdHZlcnRpY2FsLWFsaWduOiB0b3A7XG5cblx0I2xlZnQtYXR0LWhlYWRzIHtcblx0XHRvcmRlcjoxO1xuXHRcdGRpc3BsYXk6IGlubGluZS1ibG9jaztcblx0XHR2ZXJ0aWNhbC1hbGlnbjogdG9wO1xuXHR9XG5cblx0I2xlZnQtdG9rZW5zIHtcblx0XHRvcmRlcjogMjtcblx0XHR0ZXh0LWFsaWduOiByaWdodDtcblx0XHR2ZXJ0aWNhbC1hbGlnbjogdG9wO1xuXHR9XG5cblxuXHQjYXRuLWRpc3BsYXkge1xuXHRcdG9yZGVyOiAzO1xuXHRcdHZlcnRpY2FsLWFsaWduOiB0b3A7XG5cdH1cblxuXHQjcmlnaHQtdG9rZW5zIHtcblx0XHRvcmRlcjogNDtcblx0XHR0ZXh0LWFsaWduOiBsZWZ0O1xuXHRcdHZlcnRpY2FsLWFsaWduOiB0b3A7XG5cdH1cblxuXHQjcmlnaHQtYXR0LWhlYWRzIHtcblx0XHRvcmRlcjogNTtcblx0XHR2ZXJ0aWNhbC1hbGlnbjogdG9wO1xuXHR9XG5cdFxufVxuXG4uYXR0LXJlY3Qge1xuXHR0cmFuc2l0aW9uOiBmaWxsIDAuMXM7XG59XG5cbi50b2tlbiB7XG5cdGRpc3BsYXk6IGJsb2NrO1xufVxuXG4uYXRuLWN1cnZlIHtcblx0ZmlsbDogbm9uZTtcblx0Ly8gc3Ryb2tlLXdpZHRoOiAzO1xuXHRzdHJva2U6IHB1cnBsZTtcbn1cblxuLm1hc2tlZC10b2tlbiB7XG5cdGNvbG9yOiByZ2JhKDAsMCwwLDAuMilcbn1cblxuLnVuc2VsZWN0ZWQge1xuXHRmaWxsOiBncmF5O1xufVxuXG4uc2VsZWN0ZWQtdG9rZW4ge1xuXHRib3JkZXItc3R5bGU6IHNvbGlkO1xuXHRib3JkZXItd2lkdGg6IDNweDtcblx0Ym9yZGVyLWNvbG9yOiByZ2IoMTUzLCAxOTYsIDApO1xufVxuXG4vKiBUaGUgc3dpdGNoIC0gdGhlIGJveCBhcm91bmQgdGhlIHNsaWRlciAqL1xuLnN3aXRjaCB7XG5cdHBvc2l0aW9uOiByZWxhdGl2ZTtcblx0ZGlzcGxheTogaW5saW5lLWJsb2NrO1xuXHR3aWR0aDogNjBweDtcblx0aGVpZ2h0OiAzNHB4O1xuXG4vKiBIaWRlIGRlZmF1bHQgSFRNTCBjaGVja2JveCAqL1xuXHRpbnB1dCB7XG5cdFx0b3BhY2l0eTogMDtcblx0XHR3aWR0aDogMDtcblx0XHRoZWlnaHQ6IDA7XG5cdH1cbn1cblxuLyogVGhlIHNsaWRlciAqL1xuLnNob3J0LXNsaWRlciB7XG5cdHBvc2l0aW9uOiBhYnNvbHV0ZTtcblx0Y3Vyc29yOiBwb2ludGVyO1xuXHR0b3A6IDA7XG5cdGxlZnQ6IDA7XG5cdHJpZ2h0OiAwO1xuXHRib3R0b206IDA7XG5cdGJhY2tncm91bmQtY29sb3I6ICNjY2M7XG5cdC13ZWJraXQtdHJhbnNpdGlvbjogLjRzO1xuXHR0cmFuc2l0aW9uOiAuNHM7XG5cblx0JjpiZWZvcmUge1xuXHRcdHBvc2l0aW9uOiBhYnNvbHV0ZTtcblx0XHRjb250ZW50OiBcIlwiO1xuXHRcdGhlaWdodDogMjZweDtcblx0XHR3aWR0aDogMjZweDtcblx0XHRsZWZ0OiA0cHg7XG5cdFx0Ym90dG9tOiA0cHg7XG5cdFx0YmFja2dyb3VuZC1jb2xvcjogd2hpdGU7XG5cdFx0LXdlYmtpdC10cmFuc2l0aW9uOiAuNHM7XG5cdFx0dHJhbnNpdGlvbjogLjRzO1xuXHR9XG59XG5cbmlucHV0OmNoZWNrZWQgKyAuc2hvcnQtc2xpZGVyIHtcblx0YmFja2dyb3VuZC1jb2xvcjogIzIxOTZGMztcbn1cblxuaW5wdXQ6Zm9jdXMgKyAuc2hvcnQtc2xpZGVyIHtcblx0Ym94LXNoYWRvdzogMCAwIDFweCAjMjE5NkYzO1xufVxuXG5pbnB1dDpjaGVja2VkICsgLnNob3J0LXNsaWRlcjpiZWZvcmUge1xuXHQtd2Via2l0LXRyYW5zZm9ybTogdHJhbnNsYXRlWCgyNnB4KTtcblx0LW1zLXRyYW5zZm9ybTogdHJhbnNsYXRlWCgyNnB4KTtcblx0dHJhbnNmb3JtOiB0cmFuc2xhdGVYKDI2cHgpO1xufVxuXG4vKiBSb3VuZGVkIHNsaWRlcnMgKi9cbi5zaG9ydC1zbGlkZXIucm91bmQge1xuXHRib3JkZXItcmFkaXVzOiAzNHB4O1xufVxuXG4uc2hvcnQtc2xpZGVyLnJvdW5kOmJlZm9yZSB7XG5cdGJvcmRlci1yYWRpdXM6IDUwJTtcbn1cblxuI3NlbGVjdC1hbGwtaGVhZHN7IFxuXHRtYXJnaW4tdG9wOiAyMHB4O1xuXHRtYXJnaW4tYm90dG9tOiAyMHB4O1xufSIsIiNjb3JwdXMtdmlzIHtcbiAgbWFyZ2luOiAwIGF1dG87XG5cbiAgI21haW4tY29ycHVzLXZpcyB7XG4gICAgZGlzcGxheTogLXdlYmtpdC1mbGV4O1xuICAgIGRpc3BsYXk6IGZsZXg7XG5cbiAgICAjY29ycHVzLW1hdC1jb250YWluZXIge1xuICAgICAgLXdlYmtpdC1mbGV4OiBpbml0aWFsO1xuICAgICAgZmxleDogaW5pdGlhbDtcbiAgICAgIHZlcnRpY2FsLWFsaWduOiB0b3A7XG4gICAgICBmbG9hdDogbGVmdDtcblxuICAgICAgLmNvcnB1cy1tYXQge1xuICAgICAgICBkaXNwbGF5OiBpbmxpbmUtYmxvY2s7XG4gICAgICAgIG1hcmdpbi1yaWdodDogMC4wNWVtO1xuICAgICAgICBtYXJnaW4tbGVmdDogMC4wNWVtO1xuICAgICAgfVxuXG4gICAgICAub2Zmc2V0LTAge1xuICAgICAgICBib3JkZXI6IDAuMmVtIHNvbGlkIGJsYWNrO1xuICAgICAgfVxuXG4gICAgICAubWF0LWhvdmVyLWRpc3BsYXkge1xuICAgICAgICBwb2ludGVyLWV2ZW50czogbm9uZTtcbiAgICAgICAgZGlzcGxheTogZmxleDtcbiAgICAgICAgcG9zaXRpb246IGFic29sdXRlO1xuICAgICAgICB2aXNpYmlsaXR5OiBoaWRkZW47XG4gICAgICAgIGJhY2tncm91bmQtY29sb3I6IHJnYmEoMjAwLCAyMDAsIDIwMCwgMSk7XG4gICAgICAgIGJvcmRlci1yYWRpdXM6IDhweCA4cHggMXB4IDhweDtcbiAgICAgICAgbWFyZ2luOiBhdXRvO1xuICAgICAgICBwIHtcbiAgICAgICAgICBtYXJnaW46IGF1dG87XG4gICAgICAgIH1cbiAgICAgIH1cbiAgICB9XG5cbiAgICAjY29ycHVzLXNpbWlsYXItc2VudGVuY2VzLWRpdiB7XG4gICAgICAtd2Via2l0LWZsZXg6IDE7XG4gICAgICBmbGV4OiAxO1xuICAgICAgdmVydGljYWwtYWxpZ246IHRvcDtcbiAgICAgIGZsb2F0OiBsZWZ0O1xuICAgICAgbWF4LXdpZHRoOiA4MCU7XG4gICAgICBtYXgtaGVpZ2h0OiAxMDAlO1xuXG4gICAgICAuaG92ZXJlZC1jb2wge1xuICAgICAgICBjb2xvcjogb3JhbmdlO1xuICAgICAgfVxuICAgIH1cbiAgfVxuXG4gIC5idG4ge1xuICAgIG1hcmdpbi1sZWZ0OiAwLjI1ZW07XG4gIH1cblxuICAuaW5zcGVjdG9yLXJvdyB7XG4gICAgZGlzcGxheTogYmxvY2s7XG4gICAgbWFyZ2luLWxlZnQ6IDEwcHg7XG4gICAgcGFkZGluZy10b3A6IDAuNWVtO1xuICAgIHBhZGRpbmctYm90dG9tOiAwLjVlbTtcbiAgfVxuXG4gIC5pbnNwZWN0b3ItY2VsbCB7XG4gICAgZGlzcGxheTogaW5saW5lLWJsb2NrO1xuICAgIG1hcmdpbi1yaWdodDogM3B4O1xuICAgIHRleHQtYWxpZ246IGxlZnQ7XG4gIH1cblxuICAvKiBUb29sdGlwIGNvbnRhaW5lciAqL1xuICAuY2VsbHRvb2x0aXAge1xuICAgIHBvc2l0aW9uOiByZWxhdGl2ZTtcbiAgICBkaXNwbGF5OiBpbmxpbmUtYmxvY2s7XG4gICAgYm9yZGVyLWJvdHRvbTogMXB4IGRvdHRlZCBibGFjazsgLyogSWYgeW91IHdhbnQgZG90cyB1bmRlciB0aGUgaG92ZXJhYmxlIHRleHQgKi9cbiAgfVxuXG4gIC8qIFRvb2x0aXAgdGV4dCAqL1xuICAuY2VsbHRvb2x0aXAgLnRvb2x0aXB0ZXh0IHtcbiAgICB2aXNpYmlsaXR5OiBoaWRkZW47XG4gICAgd2lkdGg6IDEyMHB4O1xuICAgIGJhY2tncm91bmQtY29sb3I6IGJsYWNrO1xuICAgIGNvbG9yOiAjZmZmO1xuICAgIHRleHQtYWxpZ246IGNlbnRlcjtcbiAgICBwYWRkaW5nOiA1cHggMDtcbiAgICBib3JkZXItcmFkaXVzOiA2cHg7XG5cbiAgICAvKiBQb3NpdGlvbiB0aGUgdG9vbHRpcCB0ZXh0IC0gc2VlIGV4YW1wbGVzIGJlbG93ISAqL1xuICAgIHBvc2l0aW9uOiBhYnNvbHV0ZTtcbiAgfVxuXG4gIC8qIFNob3cgdGhlIHRvb2x0aXAgdGV4dCB3aGVuIHlvdSBtb3VzZSBvdmVyIHRoZSB0b29sdGlwIGNvbnRhaW5lciAqL1xuICAuY2VsbHRvb2x0aXA6aG92ZXIgLnRvb2x0aXB0ZXh0IHtcbiAgICB3aWR0aDogMTIwcHg7XG4gICAgYm90dG9tOiAxMDAlO1xuICAgIGxlZnQ6IDUwJTtcbiAgICBtYXJnaW4tbGVmdDogLTYwcHg7IC8qIFVzZSBoYWxmIG9mIHRoZSB3aWR0aCAoMTIwLzIgPSA2MCksIHRvIGNlbnRlciB0aGUgdG9vbHRpcCAqL1xuICAgIHZpc2liaWxpdHk6IHZpc2libGU7XG4gIH1cblxuICAvKiBBZGQgbGl0dGxlIGFycm93IHRvIGJveCAqL1xuICAuY2VsbHRvb2x0aXAgLnRvb2x0aXB0ZXh0OjphZnRlciB7XG4gICAgY29udGVudDogXCIgXCI7XG4gICAgcG9zaXRpb246IGFic29sdXRlO1xuICAgIHRvcDogMTAwJTsgLyogQXQgdGhlIGJvdHRvbSBvZiB0aGUgdG9vbHRpcCAqL1xuICAgIGxlZnQ6IDUwJTtcbiAgICBtYXJnaW4tbGVmdDogLTVweDtcbiAgICBib3JkZXItd2lkdGg6IDVweDtcbiAgICBib3JkZXItc3R5bGU6IHNvbGlkO1xuICAgIGJvcmRlci1jb2xvcjogYmxhY2sgdHJhbnNwYXJlbnQgdHJhbnNwYXJlbnQgdHJhbnNwYXJlbnQ7XG4gIH1cblxuICAubWF0Y2hlZC1jZWxsIHtcbiAgICBib3JkZXItc3R5bGU6IHNvbGlkO1xuICAgIGJvcmRlci1jb2xvcjogcmdiKDE1MywgMTk2LCAwKTtcbiAgICBib3JkZXItd2lkdGg6IDNweDtcbiAgICBib3JkZXItcmFkaXVzOiAwLjRlbTtcbiAgfVxuXG4gIC5ncmF5LWNlbGwge1xuICAgIGNvbG9yOiByZ2JhKDAsIDAsIDAsIDAuMzUpO1xuICB9XG4gIC5uZXh0LWNlbGwge1xuICAgIGNvbG9yOiByZ2JhKDIyOCwgMSwgMSwgMC44KTtcbiAgICAtbW96LWJveC1zaGFkb3c6IDAgMCAzcHggI2NjYztcbiAgICAtd2Via2l0LWJveC1zaGFkb3c6IDAgMCAzcHggI2NjYztcbiAgICBib3gtc2hhZG93OiAwIDAgM3B4ICNjY2M7XG4gIH1cbn1cbiIsIlxuXG4jaGlzdG9ncmFtcyB7XG4gICAgZGlzcGxheTogYmxvY2s7XG4gICAgbWF4LXdpZHRoOiAxMDAlO1xuXG4gICAgLmhpc3RvZ3JhbSB7XG4gICAgICBkaXNwbGF5OiBpbmxpbmUtYmxvY2s7XG4gICAgICBvdmVyZmxvdy14OiBhdXRvO1xuICAgIH1cbiAgICBcbiAgICBkaXYge1xuICAgICAgbWFyZ2luLXRvcDogMTBweDtcbiAgICB9XG5cbiAgICAjbWF0Y2hlZC1oaXN0b2dyYW0geyBcbiAgICAgIC5iYXIge1xuXG4gICAgICAgfVxuICAgIH1cbiAgXG4gICAgI21heC1hdHQtaGlzdG9ncmFtIHsgXG4gICAgICAuYmFyIHtcbiAgICAgICAgICBmaWxsOiBibGFjaztcbiAgICAgIH1cbiAgICB9XG4gIH1cblxuICAucG9zLXNlbGVjdG9yIHtcbiAgICBtYXJnaW4tYm90dG9tOiA0MHB4O1xuICB9IiwiQGltcG9ydCBcInBhbGV0dGUuc2Nzc1wiO1xuLy9AaW1wb3J0IFwiTGF0b0xpZ2h0LnNjc3NcIjtcbkBpbXBvcnQgXCIuLi9mb250cy9wbGV4X3NhbnMuY3NzXCI7XG5AaW1wb3J0IFwiYmFzZVwiO1xuQGltcG9ydCBcIlNlbnRlbmNlSW5wdXRcIjtcbkBpbXBvcnQgXCJBdHRlbnRpb25Db25uZWN0b3JDb250cm9sc1wiO1xuQGltcG9ydCBcIkNvcnB1c1Zpc1wiO1xuQGltcG9ydCBcIkhpc3RvZ3JhbXNcIjtcblxuYm9keSB7XG4gIGZvbnQtZmFtaWx5OiAnSUJNIFBsZXggU2Fucyc7XG59XG5cbi5sYXllckNoZWNrYm94IHtcbiAgYmFja2dyb3VuZC1jb2xvcjogbGlnaHRncmV5O1xuICBwYWRkaW5nLWxlZnQ6IDhweDtcbiAgcGFkZGluZy1yaWdodDogOHB4O1xuXG4gICYuYWN0aXZle1xuICAgIGNvbG9yOiAjZmZmO1xuICAgIGJhY2tncm91bmQtY29sb3I6ICM2YzcwNjc7XG4gIH1cbn1cblxuLm1haW4tZ3JpZCB7XG4gIHdpZHRoOiAxMDAlO1xuICBkaXNwbGF5OiBncmlkO1xuICBncmlkLXRlbXBsYXRlLWNvbHVtbnM6IDAuMThmciAwLjJmciAwLjJmciAwLjA0ZnIgMC4yZnIgMC4yZnIgMC4xOGZyO1xuICBvdmVyZmxvdzogYXV0bztcbiAgbWF4LWhlaWdodDogMTAwdmg7XG59XG5cbi5sZWZ0LWhhbGYge1xuICBncmlkLWNvbHVtbi1zdGFydDogMTtcbiAgZ3JpZC1jb2x1bW4tZW5kOiA0O1xuICBtYXJnaW4tbGVmdDogMTBweDtcbiAgbWFyZ2luLXJpZ2h0OiAxMHB4O1xufVxuXG4udnBhcnRpYWwtOTAge1xuICBtYXgtaGVpZ2h0OiA5MHZoO1xufVxuXG4udnBhcnRpYWwtOTUge1xuICBtYXgtaGVpZ2h0OiA5NXZoO1xufVxuXG4ucmlnaHQtaGFsZiB7XG4gIGdyaWQtY29sdW1uLXN0YXJ0OiA1O1xuICBncmlkLWNvbHVtbi1lbmQ6IDk7XG4gIG1heC1oZWlnaHQ6IDk4dmg7XG59XG5cbi52ZXJ0aWNhbC1zZXBhcmF0b3Ige1xuICBib3JkZXItbGVmdDogdGhpY2sgc29saWQgIzQyMjIyMjk4O1xuICBtYXJnaW46IDAgYXV0bztcbiAgbWFyZ2luLXRvcDogMTBweDtcbiAgbWFyZ2luLWJvdHRvbTogMTBweDtcbiAgYm9yZGVyLXJhZGl1czogM3B4O1xuICBncmlkLWNvbHVtbi1zdGFydDogNDtcbiAgZ3JpZC1jb2x1bW4tZW5kOiA1O1xuICBncmlkLXJvdy1zdGFydDogMTtcbiAgZ3JpZC1yb3ctZW5kOiA1O1xufVxuXG4jdmlzLWJyZWFrIHtcbiAgaGVpZ2h0OiAxNXB4O1xufVxuXG5sYWJlbCB7XG4gIG1hcmdpbi1sZWZ0OiA1cHg7XG59XG5cbi8vIGhlYWRlciB7XG4vLyAgIGZvbnQtc2l6ZTogMmVtO1xuLy8gfVxuXG4jaGVhZGVyIHtcbiAgd2lkdGg6IDEwMCU7XG4gIGJhY2tncm91bmQtY29sb3I6IGxpZ2h0Z3JheTtcbiAgaGVpZ2h0OiA0MHB4O1xuICBtYXJnaW4tYm90dG9tOiA1cHg7XG5cbiAgLmhlYWRlci1sb2dve1xuICAgIGhlaWdodDogMjBweDtcbiAgICBkaXNwbGF5OmlubGluZS1ibG9jaztcbiAgICBtYXJnaW4tbGVmdDogMTBweDtcbiAgICBtYXJnaW4tdG9wOiA1cHg7XG4gICAgbWFyZ2luLWJvdHRvbTogNXB4O1xuICB9XG4gIC5oZWFkZXItaW5mb3tcbiAgICBmb250LXNpemU6IDlwdDtcbiAgICBoZWlnaHQ6IDMwcHg7XG4gICAgZGlzcGxheTppbmxpbmUtYmxvY2s7XG4gICAgZmxvYXQ6cmlnaHQ7XG4gICAgbWFyZ2luLXJpZ2h0OiAxMHB4O1xuICAgIG1hcmdpbi10b3A6IDEwcHg7XG4gICAgLy9tYXJnaW4tYm90dG9tOiA1cHg7XG4gIH1cblxuXG4gICNoZWFkZXJ0ZXh0e1xuICAgIHRleHQtYWxpZ246IGNlbnRlciA7XG4gICAgZGlzcGxheTogaW5saW5lLWJsb2NrO1xuICAgIGZvbnQtc2l6ZTogMThweDtcbiAgICBtYXJnaW4tbGVmdDogMzAlO1xuICAgIG1hcmdpbi10b3A6IDVweDtcbiAgICBtYXJnaW4tYm90dG9tOiA1cHg7XG4gIH1cbn1cblxuLmhpZ2hsaWdodGVkIHtcbiAgYmFja2dyb3VuZDogcmdiYSgxNTIsIDgzLCAyMTYsIDAuOCk7XG59XG5cbiNtZXRhLWRyb3Bkb3duIHtcbiAgbWFyZ2luLWJvdHRvbTogMC43NWVtO1xuICBtYXJnaW4tbGVmdDogNGVtO1xufVxuXG4jcG9zaXRpb24tbWV0YS1kcm9wZG93biB7XG4gIG1hcmdpbi1ib3R0b206IDAuNzVlbTtcbiAgbWFyZ2luLWxlZnQ6IDRlbTtcbn1cblxuXG4jY29ycHVzLWNvbnRyb2wtYnV0dG9ucyB7XG4gIG1hcmdpbi1ib3R0b206IDFlbTtcbiAgcG9zaXRpb246IGZpeGVkIHJlbGF0aXZlO1xuICBzcGFuIHtcbiAgICBtYXJnaW4tbGVmdDo1cHg7XG4gIH1cbn1cblxuI3NlbGVjdGVkLWhlYWRzIHtcbiAgbWFyZ2luLWJvdHRvbTogMWVtO1xufVxuXG4jY29ycHVzLXNlbGVjdGlvbi1kZXNjcmlwdGlvbiB7XG4gIGRpc3BsYXk6IGlubGluZS1ibG9jaztcbiAgbWFyZ2luLXJpZ2h0OiAxNXB4O1xufVxuXG4jY29ycHVzLXF1ZXJ5aW5nIHtcbiAgZGlzcGxheTogaW5saW5lLWJsb2NrO1xuICAuYnRuIHtcbiAgICBkaXNwbGF5OiBpbmxpbmUtYmxvY2s7XG4gIH1cbn1cblxuI3VzYWdlLWluZm8ge1xuICBtYXJnaW4tdG9wOiAxMHB4O1xuICBjb2xvcjogcmdiKDg3LCA4NywgODcpO1xuICBmb250LXNpemU6IDE0cHg7XG59XG5cbi50aWNrIHtcbiAgZm9udC1zaXplOiAxOHB4O1xufVxuXG4jY29ubmVjdG9yLWNvbnRhaW5lciB7XG4gIC5tYXQtaG92ZXItZGlzcGxheXtcbiAgICBwb2ludGVyLWV2ZW50czogbm9uZTtcbiAgICBkaXNwbGF5OiBibG9jaztcbiAgICBwb3NpdGlvbjogYWJzb2x1dGU7XG4gICAgdmlzaWJpbGl0eTogaGlkZGVuO1xuICAgIGJhY2tncm91bmQtY29sb3I6IHJnYmEoMjAwLCAyMDAsIDIwMCwgMC45Myk7XG4gICAgZm9udC1zaXplOiAxNHB4O1xuICAgIHAge1xuICAgICAgbWFyZ2luOiA0cHggMXB4IDFweCA0cHg7XG4gICAgICAvLyBtYXJnaW46IGF1dG87XG4gICAgfVxuICB9XG59XG5cbi5yaWdodC10b2tlbi1ob3ZlciB7XG4gICAgYm9yZGVyLXJhZGl1czogMXB4IDhweCA4cHggOHB4O1xuICAgIHRleHQtYWxpZ246IGxlZnQ7XG59XG5cbi5sZWZ0LXRva2VuLWhvdmVyIHtcbiAgICBib3JkZXItcmFkaXVzOiA4cHggMXB4IDhweCA4cHg7XG4gICAgdGV4dC1hbGlnbjogcmlnaHQ7XG59XG5cbi5uZXh0LXRva2VuIHtcbiAgY29sb3I6IHJnYmEoMjI4LCAxLCAxLCAwLjgpO1xuICAtbW96LWJveC1zaGFkb3c6IDAgMCAzcHggI2NjYztcbiAgLXdlYmtpdC1ib3gtc2hhZG93OiAwIDAgM3B4ICNjY2M7XG4gIGJveC1zaGFkb3c6IDAgMCAzcHggI2NjYztcbn0iXSwic291cmNlUm9vdCI6IiJ9*/
 
1
  @font-face{font-family:IBM Plex Sans;font-style:normal;font-weight:300;src:local("IBM Plex Sans Light"),local("IBMPlexSans-Light"),url(7eeb10384e8e1ef96c87f7074cf2ef59.ttf) format("truetype")}@font-face{font-family:IBM Plex Sans;font-style:normal;font-weight:400;src:local("IBM Plex Sans Regular"),local("IBMPlexSans-Regular"),url(05ca9c06114e79436ea9b5c8d4a7869c.ttf) format("truetype")}@font-face{font-family:IBM Plex Sans;font-style:normal;font-weight:600;src:local("IBM Plex Sans SemiBold"),local("IBMPlexSans-SemiBold"),url(a849e7649e2005ab4aecfa50d96120e1.ttf) format("truetype")}@font-face{font-family:IBM Plex Sans;font-style:normal;font-weight:700;src:local("IBM Plex Sans Bold"),local("IBMPlexSans-Bold"),url(4171e41154ba857f85c536f167d581ba.ttf) format("truetype")}
2
+ body{background-color:#fff;font-family:IBM Plex Sans,sans-serif;font-weight:400}.sticky{position:fixed}.noscroll{overflow:hidden}.vpartial{max-height:90vh}.scrolling{overflow:auto;max-height:98%}.btn .btn-xs{padding:.25rem .4rem;font-size:.875rem;line-height:.5;border-radius:.2rem}button{-webkit-transition-duration:.4s;transition-duration:.4s;background:transparent;padding:5px;border-radius:5px;background-color:#d3d3d3}button.selected,button:active :focus{background-color:#98b7d9}#loader{border:5px solid #f3f3f3;border-radius:50%;border-top:5px solid #3498db;width:100px;height:100px;-webkit-animation:spin 2s linear infinite;animation:spin 2s linear infinite;position:absolute;left:50%;top:20%;display:none}@-webkit-keyframes spin{0%{-webkit-transform:rotate(0deg)}to{-webkit-transform:rotate(1turn)}}@keyframes spin{0%{transform:rotate(0deg)}to{transform:rotate(1turn)}}svg{vertical-align:top}select{font-size:9pt;font-weight:600;background-color:transparent;padding:8px 6px;-webkit-box-sizing:border-box;-moz-box-sizing:border-box;box-sizing:border-box;border-radius:4px;border:0;outline:0}.navbar{position:absolute;top:0;left:0;width:100%;height:50px;background-color:#faebd7}.navbarContent{margin:10px 20px}.navbarContent span{padding-left:10px}.navbarContent button{margin-left:10px}.navbarTitle{font-size:12pt;font-weight:700}.main_frame{position:fixed;top:55px;overflow-x:hidden;overflow-y:auto}.floating_content{padding:10px;height:94%}.container{width:100%;height:95%;text-align:center;display:inline-block;margin:5px auto}#bottom-margin{height:100px}.content{max-width:960px;margin:auto}.whitespace{height:8vh}#sentence-input{margin-bottom:0;margin-right:0;margin-left:10px;width:100%}#sentence-input form{display:flex;flex-direction:row;flex-wrap:nowrap;justify-content:space-evenly;align-items:center}#sentence-input form .form-group{flex-grow:3}#sentence-input form .form-group input{width:50%;max-width:700px;margin-right:5%}#sentence-input form .btn{flex-grow:1}.input-description{font-weight:800}#connector-container{margin:40px;align-items:center}.connector-controls{display:grid;grid-template-columns:.5fr .5fr}.slide-container{grid-column-start:1;grid-column-end:2;grid-row-start:1;grid-row-end:2;margin:auto;text-align:center;width:75%}.slider{-webkit-appearance:none;width:10px;height:10px;border-radius:5px;background:#d3d3d3;outline:none;opacity:.7;-webkit-transition:.2s;transition:opacity .2s}.slider:hover{opacity:1}.slider::-webkit-slider-thumb{-webkit-appearance:none;appearance:none;width:15px;height:15px;border-radius:50%;background:#666;cursor:pointer}#layer-selection{grid-column-start:1;grid-column-end:2;grid-row-start:2;grid-row-end:3}.layer-select{margin-bottom:2em}#atn-container{display:flex;flex-direction:row;flex-wrap:nowrap;justify-content:center;align-items:top;margin:0 auto;width:100%;vertical-align:top}#atn-container #left-att-heads{order:1;display:inline-block;vertical-align:top}#atn-container #left-tokens{order:2;text-align:right;vertical-align:top}#atn-container #atn-display{order:3;vertical-align:top}#atn-container #right-tokens{order:4;text-align:left;vertical-align:top}#atn-container #right-att-heads{order:5;vertical-align:top}.att-rect{transition:fill .1s}.token{display:block}.atn-curve{fill:none;stroke:purple}.masked-token{color:rgba(0,0,0,.2)}.unselected{fill:gray}.selected-token{border:3px solid #99c400}.switch{position:relative;display:inline-block;width:60px;height:34px}.switch input{opacity:0;width:0;height:0}.short-slider{cursor:pointer;top:0;left:0;right:0;bottom:0;background-color:#ccc}.short-slider,.short-slider:before{position:absolute;-webkit-transition:.4s;transition:.4s}.short-slider:before{content:"";height:26px;width:26px;left:4px;bottom:4px;background-color:#fff}input:checked+.short-slider{background-color:#2196f3}input:focus+.short-slider{box-shadow:0 0 1px #2196f3}input:checked+.short-slider:before{-webkit-transform:translateX(26px);-ms-transform:translateX(26px);transform:translateX(26px)}.short-slider.round{border-radius:34px}.short-slider.round:before{border-radius:50%}#select-all-heads{margin-top:20px;margin-bottom:20px}body{font-family:IBM Plex Sans;margin-left:auto;margin-right:auto;width:80%;max-width:1500px}.layerCheckbox{background-color:#d3d3d3;padding-left:8px;padding-right:8px}.layerCheckbox.active{color:#fff;background-color:#6c7067}.main-grid{width:100%;display:grid;grid-template-columns:.18fr .2fr .2fr .04fr .2fr .2fr .18fr;overflow:auto;max-height:100vh}#vis-break{height:15px}label{margin-left:5px}#header{width:100%;background-color:#d3d3d3;height:40px;margin-bottom:5px}#header .header-logo{height:20px;display:inline-block;margin-left:10px;margin-top:5px;margin-bottom:5px}#header .header-info{font-size:9pt;height:30px;display:inline-block;float:right;margin-right:10px;margin-top:10px}#header #headertext{text-align:center;display:inline-block;font-size:18px;margin-left:30%;margin-top:5px;margin-bottom:5px}.highlighted{background:rgba(152,83,216,.8)}#selected-heads{margin-bottom:1em}#corpus-selection-description{display:inline-block;margin-right:15px}#corpus-querying,#corpus-querying .btn{display:inline-block}#usage-info{margin-top:10px;color:#575757;font-size:14px}.tick{font-size:18px}#connector-container .mat-hover-display{pointer-events:none;display:block;position:absolute;visibility:hidden;background-color:hsla(0,0%,78%,.93);font-size:14px}#connector-container .mat-hover-display p{margin:4px 1px 1px 4px}.right-token-hover{border-radius:1px 8px 8px 8px;text-align:left}.left-token-hover{border-radius:8px 1px 8px 8px;text-align:right}.next-token{color:rgba(228,1,1,.8);-moz-box-shadow:0 0 3px #ccc;-webkit-box-shadow:0 0 3px #ccc;box-shadow:0 0 3px #ccc}
3
 
4
+ /*# sourceMappingURL=data:application/json;charset=utf-8;base64,eyJ2ZXJzaW9uIjozLCJzb3VyY2VzIjpbIndlYnBhY2s6Ly8vLi9mb250cy9wbGV4X3NhbnMuY3NzIiwid2VicGFjazovLy8uL2Nzcy9jc3MvYmFzZS5zY3NzIiwid2VicGFjazovLy8uL2Nzcy9jc3MvU2VudGVuY2VJbnB1dC5zY3NzIiwid2VicGFjazovLy8uL2Nzcy9jc3MvQXR0ZW50aW9uQ29ubmVjdG9yQ29udHJvbHMuc2NzcyIsIndlYnBhY2s6Ly8vLi9jc3MvY3NzL21haW4uc2NzcyJdLCJuYW1lcyI6W10sIm1hcHBpbmdzIjoiQUFDQSxXQUNFLDBCQUNBLGtCQUNBLGdCQUNBLDRHQUEySCxDQUc3SCxXQUNFLDBCQUNBLGtCQUNBLGdCQUNBLGdIQUFpSSxDQUduSSxXQUNFLDBCQUNBLGtCQUNBLGdCQUNBLGtIQUFvSSxDQUd0SSxXQUNFLDBCQUNBLGtCQUNBLGdCQUNBLDBHQUF3SCxDQUN6SCxnRDtBQzNCRCxLQUNFLHNCQUNBLHFDQUNBLGVBQWdCLENBR2xCLFFBQ0UsY0FBZSxDQUdqQixVQUNFLGVBQWdCLENBR2xCLFVBQ0UsZUFBZ0IsQ0FHbEIsV0FDRSxjQUNBLGNBQWUsQ0FHakIsYUFFSSxxQkFDQSxrQkFDQSxlQUNBLG1CQUFxQixDQUl6QixPQUNFLGdDQUNBLHdCQUNBLHVCQUNBLFlBQ0Esa0JBQ0Esd0JBQTJCLENBTzdCLHFDQUNFLHdCQUF5QixDQUczQixRQUNFLHlCQUNBLGtCQUNBLDZCQUNBLFlBQ0EsYUFDQSwwQ0FDQSxrQ0FDQSxrQkFDQSxTQUNBLFFBQ0EsWUFBYSxDQUlmLHdCQUNFLEdBQ0UsOEJBQStCLENBRWpDLEdBQ0UsK0JBQWlDLEVBSXJDLGdCQUNFLEdBQ0Usc0JBQXVCLENBRXpCLEdBQ0UsdUJBQXlCLEVBSTdCLElBQ0Usa0JBQW1CLENBR3JCLE9BQ0UsY0FDQSxnQkFHQSw2QkFLQSxnQkFNQSw4QkFDQSwyQkFDQSxzQkFDQSxrQkFDQSxTQUNBLFNBQVUsQ0FFWixRQUNFLGtCQUNBLE1BQ0EsT0FDQSxXQUNBLFlBQ0Esd0JBQThCLENBSWhDLGVBQ0UsZ0JBQWlCLENBU2xCLG9CQU5HLGlCQUFrQixDQUNuQixzQkFHQyxnQkFBaUIsQ0FJckIsYUFDRSxlQUVBLGVBQWlCLENBR25CLFlBQ0UsZUFDQSxTQUdBLGtCQUNBLGVBQWdCLENBR2xCLGtCQUNFLGFBQ0EsVUFBVyxDQUdiLFdBQ0UsV0FDQSxXQUNBLGtCQUNBLHFCQUNBLGVBQWdCLENBR2xCLGVBQ0UsWUFBYSxDQUdmLFNBQ0UsZ0JBQ0EsV0FBWSxDQUdkLFlBQ0UsVUFBVyxDQ3hLYixnQkFDSSxnQkFDQSxlQUNBLGlCQUNBLFVBQVcsQ0F3QmQscUJBckJPLGFBQ0EsbUJBQ0EsaUJBQ0EsNkJBQ0Esa0JBQW1CLENBZ0J0QixpQ0FiTyxXQUFZLENBUWYsdUNBSk8sVUFDQSxnQkFDQSxlQUFnQixDQUNuQiwwQkFJRCxXQUFZLENDMUJ4QixtQkFDQyxlQUNELENBRUEscUJBQ0MsWUFDRyxrQkFBbUIsQ0FHdkIsb0JBQ0MsYUFDQSwrQkFBa0MsQ0FHbkMsaUJBQ0Msb0JBQ0Esa0JBQ0EsaUJBQ0EsZUFDQSxZQUNBLGtCQUNBLFNBQVUsQ0FHWCxRQUNDLHdCQUNBLFdBQ0EsWUFDQSxrQkFDQSxtQkFDQSxhQUNBLFdBQ0EsdUJBQ0Esc0JBQXVCLENBR3hCLGNBQ0MsU0FBVSxDQUdYLDhCQUNDLHdCQUNBLGdCQUNBLFdBQ0EsWUFDQSxrQkFDQSxnQkFDQSxjQUFlLENBR2hCLGlCQUNDLG9CQUNBLGtCQUNBLGlCQUNBLGNBQWUsQ0FHaEIsY0FDQyxpQkFBa0IsQ0FHbkIsZUFDQyxhQUNBLG1CQUNBLGlCQUNBLHVCQUNBLGdCQUVBLGNBQ0EsV0FDQSxrQkFBbUIsQ0ErQm5CLCtCQTVCQyxRQUNBLHFCQUNBLGtCQUFtQixDQUNuQiw0QkFHQSxRQUNBLGlCQUNBLGtCQUFtQixDQUNuQiw0QkFJQSxRQUNBLGtCQUFtQixDQUNuQiw2QkFHQSxRQUNBLGdCQUNBLGtCQUFtQixDQUNuQixnQ0FHQSxRQUNBLGtCQUFtQixDQUtyQixVQUNDLG1CQUFxQixDQUd0QixPQUNDLGFBQWMsQ0FHZixXQUNDLFVBRUEsYUFBYyxDQUdmLGNBQ0Msb0JBQXNCLENBR3ZCLFlBQ0MsU0FBVSxDQUdYLGdCQUdDLHdCQUE4QixDQUkvQixRQUNDLGtCQUNBLHFCQUNBLFdBQ0EsV0FBWSxDQVFaLGNBSkMsVUFDQSxRQUNBLFFBQVMsQ0FLWCxjQUVDLGVBQ0EsTUFDQSxPQUNBLFFBQ0EsU0FDQSxxQkFBc0IsQ0FldEIsbUNBckJBLGtCQU9BLHVCQUNBLGNBQWUsQ0FZZCxxQkFSQSxXQUNBLFlBQ0EsV0FDQSxTQUNBLFdBQ0EscUJBQXVCLENBTXpCLDRCQUNDLHdCQUF5QixDQUcxQiwwQkFDQywwQkFBMkIsQ0FHNUIsbUNBQ0MsbUNBQ0EsK0JBQ0EsMEJBQTJCLENBSTVCLG9CQUNDLGtCQUFtQixDQUdwQiwyQkFDQyxpQkFBa0IsQ0FHbkIsa0JBQ0MsZ0JBQ0Esa0JBQW1CLENDN0xwQixLQUNFLDBCQUNBLGlCQUNBLGtCQUNBLFVBQ0EsZ0JBQWlCLENBR25CLGVBQ0UseUJBQ0EsaUJBQ0EsaUJBQWtCLENBTW5CLHNCQUhHLFdBQ0Esd0JBQXlCLENBSTdCLFdBQ0UsV0FDQSxhQUNBLDREQUNBLGNBQ0EsZ0JBQWlCLENBR25CLFdBQ0UsV0FBWSxDQUdkLE1BQ0UsZUFBZ0IsQ0FHbEIsUUFDRSxXQUNBLHlCQUNBLFlBQ0EsaUJBQWtCLENBNEJuQixxQkF6QkcsWUFDQSxxQkFDQSxpQkFDQSxlQUNBLGlCQUFrQixDQUNuQixxQkFFQyxjQUNBLFlBQ0EscUJBQ0EsWUFDQSxrQkFDQSxlQUFnQixDQUVqQixvQkFJQyxrQkFDQSxxQkFDQSxlQUNBLGdCQUNBLGVBQ0EsaUJBQWtCLENBSXRCLGFBQ0UsOEJBQW1DLENBR3JDLGdCQUNFLGlCQUFrQixDQUdwQiw4QkFDRSxxQkFDQSxpQkFBa0IsQ0FHcEIsdUNBR0ksb0JBQXFCLENBSXpCLFlBQ0UsZ0JBQ0EsY0FDQSxjQUFlLENBR2pCLE1BQ0UsY0FBZSxDQUdqQix3Q0FFSSxvQkFDQSxjQUNBLGtCQUNBLGtCQUNBLG9DQUNBLGNBQWUsQ0FLaEIsMENBSEcsc0JBQXVCLENBTTdCLG1CQUNJLDhCQUNBLGVBQWdCLENBR3BCLGtCQUNJLDhCQUNBLGdCQUFpQixDQUdyQixZQUNFLHVCQUNBLDZCQUNBLGdDQUNBLHVCQUF3QixDIiwiZmlsZSI6Im1haW4uY3NzIiwic291cmNlc0NvbnRlbnQiOlsiLyogY3lyaWxsaWMtZXh0ICovXG5AZm9udC1mYWNlIHtcbiAgZm9udC1mYW1pbHk6ICdJQk0gUGxleCBTYW5zJztcbiAgZm9udC1zdHlsZTogbm9ybWFsO1xuICBmb250LXdlaWdodDogMzAwO1xuICBzcmM6IGxvY2FsKCdJQk0gUGxleCBTYW5zIExpZ2h0JyksIGxvY2FsKCdJQk1QbGV4U2Fucy1MaWdodCcpLCB1cmwoSUJNX1BsZXhfU2Fucy9JQk1QbGV4U2Fucy1MaWdodC50dGYpIGZvcm1hdCgndHJ1ZXR5cGUnKTtcbn1cblxuQGZvbnQtZmFjZSB7XG4gIGZvbnQtZmFtaWx5OiAnSUJNIFBsZXggU2Fucyc7XG4gIGZvbnQtc3R5bGU6IG5vcm1hbDtcbiAgZm9udC13ZWlnaHQ6IDQwMDtcbiAgc3JjOiBsb2NhbCgnSUJNIFBsZXggU2FucyBSZWd1bGFyJyksIGxvY2FsKCdJQk1QbGV4U2Fucy1SZWd1bGFyJyksIHVybChJQk1fUGxleF9TYW5zL0lCTVBsZXhTYW5zLVJlZ3VsYXIudHRmKSBmb3JtYXQoJ3RydWV0eXBlJyk7XG59XG5cbkBmb250LWZhY2Uge1xuICBmb250LWZhbWlseTogJ0lCTSBQbGV4IFNhbnMnO1xuICBmb250LXN0eWxlOiBub3JtYWw7XG4gIGZvbnQtd2VpZ2h0OiA2MDA7XG4gIHNyYzogbG9jYWwoJ0lCTSBQbGV4IFNhbnMgU2VtaUJvbGQnKSwgbG9jYWwoJ0lCTVBsZXhTYW5zLVNlbWlCb2xkJyksIHVybChJQk1fUGxleF9TYW5zL0lCTVBsZXhTYW5zLVNlbWlCb2xkLnR0ZikgZm9ybWF0KCd0cnVldHlwZScpO1xufVxuXG5AZm9udC1mYWNlIHtcbiAgZm9udC1mYW1pbHk6ICdJQk0gUGxleCBTYW5zJztcbiAgZm9udC1zdHlsZTogbm9ybWFsO1xuICBmb250LXdlaWdodDogNzAwO1xuICBzcmM6IGxvY2FsKCdJQk0gUGxleCBTYW5zIEJvbGQnKSwgbG9jYWwoJ0lCTVBsZXhTYW5zLUJvbGQnKSwgdXJsKElCTV9QbGV4X1NhbnMvSUJNUGxleFNhbnMtQm9sZC50dGYpIGZvcm1hdCgndHJ1ZXR5cGUnKTtcbn1cbiIsImJvZHkge1xuICBiYWNrZ3JvdW5kLWNvbG9yOiByZ2IoMjU1LCAyNTUsIDI1NSk7XG4gIGZvbnQtZmFtaWx5OiAnSUJNIFBsZXggU2FucycsIHNhbnMtc2VyaWY7XG4gIGZvbnQtd2VpZ2h0OiA0MDA7XG59XG5cbi5zdGlja3kge1xuICBwb3NpdGlvbjogZml4ZWQ7XG59XG5cbi5ub3Njcm9sbCB7XG4gIG92ZXJmbG93OiBoaWRkZW47XG59XG5cbi52cGFydGlhbCB7XG4gIG1heC1oZWlnaHQ6IDkwdmg7XG59XG5cbi5zY3JvbGxpbmcge1xuICBvdmVyZmxvdzogYXV0bztcbiAgbWF4LWhlaWdodDogOTglO1xufVxuXG4uYnRuIHtcbiAgLmJ0bi14cyB7XG4gICAgcGFkZGluZyAgOiAuMjVyZW0gLjRyZW07XG4gICAgZm9udC1zaXplICA6IC44NzVyZW07XG4gICAgbGluZS1oZWlnaHQgIDogLjU7XG4gICAgYm9yZGVyLXJhZGl1cyA6IC4ycmVtO1xuICB9XG59XG5cbmJ1dHRvbiB7XG4gIC13ZWJraXQtdHJhbnNpdGlvbi1kdXJhdGlvbjogMC40czsgLyogU2FmYXJpICovXG4gIHRyYW5zaXRpb24tZHVyYXRpb246IDAuNHM7XG4gIGJhY2tncm91bmQ6IHRyYW5zcGFyZW50O1xuICBwYWRkaW5nOiA1cHg7XG4gIGJvcmRlci1yYWRpdXM6IDVweDtcbiAgYmFja2dyb3VuZC1jb2xvcjogbGlnaHRncmF5O1xuXG4gICYuc2VsZWN0ZWQge1xuICAgIGJhY2tncm91bmQtY29sb3I6ICM5OGI3ZDk7XG4gIH1cbn1cblxuYnV0dG9uOmFjdGl2ZSA6Zm9jdXMge1xuICBiYWNrZ3JvdW5kLWNvbG9yOiAjOThiN2Q5O1xufVxuXG4jbG9hZGVyIHtcbiAgYm9yZGVyOiA1cHggc29saWQgI2YzZjNmMztcbiAgYm9yZGVyLXJhZGl1czogNTAlO1xuICBib3JkZXItdG9wOiA1cHggc29saWQgIzM0OThkYjtcbiAgd2lkdGg6IDEwMHB4O1xuICBoZWlnaHQ6IDEwMHB4O1xuICAtd2Via2l0LWFuaW1hdGlvbjogc3BpbiAycyBsaW5lYXIgaW5maW5pdGU7IC8qIFNhZmFyaSAqL1xuICBhbmltYXRpb246IHNwaW4gMnMgbGluZWFyIGluZmluaXRlO1xuICBwb3NpdGlvbjogYWJzb2x1dGU7XG4gIGxlZnQ6IDUwJTtcbiAgdG9wOiAyMCU7XG4gIGRpc3BsYXk6IG5vbmU7XG59XG5cbi8qIFNhZmFyaSAqL1xuQC13ZWJraXQta2V5ZnJhbWVzIHNwaW4ge1xuICAwJSB7XG4gICAgLXdlYmtpdC10cmFuc2Zvcm06IHJvdGF0ZSgwZGVnKTtcbiAgfVxuICAxMDAlIHtcbiAgICAtd2Via2l0LXRyYW5zZm9ybTogcm90YXRlKDM2MGRlZyk7XG4gIH1cbn1cblxuQGtleWZyYW1lcyBzcGluIHtcbiAgMCUge1xuICAgIHRyYW5zZm9ybTogcm90YXRlKDBkZWcpO1xuICB9XG4gIDEwMCUge1xuICAgIHRyYW5zZm9ybTogcm90YXRlKDM2MGRlZyk7XG4gIH1cbn1cblxuc3ZnIHtcbiAgdmVydGljYWwtYWxpZ246IHRvcDtcbn1cblxuc2VsZWN0IHtcbiAgZm9udC1zaXplOiA5cHQ7XG4gIGZvbnQtd2VpZ2h0OiA2MDA7XG5cbiAgLy9iYWNrZ3JvdW5kOiB1cmwoXCJkYXRhOmltYWdlL3N2Zyt4bWw7dXRmOCw8c3ZnIHhtbG5zPSdodHRwOi8vd3d3LnczLm9yZy8yMDAwL3N2Zycgd2lkdGg9JzEwcHgnIGhlaWdodD0nMTBweCc+PHBvbHlsaW5lIHBvaW50cz0nMCwwIDEwLDAgNSwxMCcvPjwvc3ZnPlwiKTtcbiAgYmFja2dyb3VuZC1jb2xvcjogdHJhbnNwYXJlbnQ7XG4gIC8vYmFja2dyb3VuZC1yZXBlYXQ6IG5vLXJlcGVhdDtcbiAgLy9iYWNrZ3JvdW5kLXBvc2l0aW9uOiByaWdodCA1cHggdG9wIDlweDtcbiAgLy9iYWNrZ3JvdW5kLXNpemU6IDdweCA3cHg7XG4gIC8vcGFkZGluZzogNXB4IDE1cHggNXB4IDVweDtcbiAgcGFkZGluZzogOHB4IDZweDtcbiAgLy93aWR0aDogYXV0bztcbiAgLy9mb250LXNpemU6MTZweDtcbiAgLy9mb250LXdlaWdodDogYm9sZDtcbiAgLy90ZXh0LWFsaWduOmNlbnRlcjtcbiAgLy90ZXh0LXNoYWRvdzowIC0xcHggMCByZ2JhKDAsIDAsIDAsIDAuMjUpO1xuICAtd2Via2l0LWJveC1zaXppbmc6IGJvcmRlci1ib3g7XG4gIC1tb3otYm94LXNpemluZzogYm9yZGVyLWJveDtcbiAgYm94LXNpemluZzogYm9yZGVyLWJveDtcbiAgYm9yZGVyLXJhZGl1czogNHB4O1xuICBib3JkZXI6IDA7XG4gIG91dGxpbmU6IDA7XG59XG4ubmF2YmFyIHtcbiAgcG9zaXRpb246IGFic29sdXRlO1xuICB0b3A6IDA7XG4gIGxlZnQ6IDA7XG4gIHdpZHRoOiAxMDAlO1xuICBoZWlnaHQ6IDUwcHg7XG4gIGJhY2tncm91bmQtY29sb3I6IGFudGlxdWV3aGl0ZTtcbiAgLy9wYWRkaW5nOiAxMHB4IDEwcHggMTBweCAzMHB4O1xufVxuXG4ubmF2YmFyQ29udGVudCB7XG4gIG1hcmdpbjogMTBweCAyMHB4O1xuXG4gIHNwYW4ge1xuICAgIHBhZGRpbmctbGVmdDogMTBweDtcbiAgfVxuXG4gIGJ1dHRvbiB7XG4gICAgbWFyZ2luLWxlZnQ6IDEwcHg7XG4gIH1cbn1cblxuLm5hdmJhclRpdGxlIHtcbiAgZm9udC1zaXplOiAxMnB0O1xuICAvL21hcmdpbjogNXB0O1xuICBmb250LXdlaWdodDogYm9sZDtcbn1cblxuLm1haW5fZnJhbWUge1xuICBwb3NpdGlvbjogZml4ZWQ7XG4gIHRvcDogNTVweDtcbiAgLy9tYXJnaW46IDBweCA1MHB4IDBweCA1MHB4O1xuICAvL2JhY2tncm91bmQ6ICNmZmZmZmY7XG4gIG92ZXJmbG93LXg6IGhpZGRlbjtcbiAgb3ZlcmZsb3cteTogYXV0bztcbn1cblxuLmZsb2F0aW5nX2NvbnRlbnQge1xuICBwYWRkaW5nOiAxMHB4O1xuICBoZWlnaHQ6IDk0JTtcbn1cblxuLmNvbnRhaW5lciB7XG4gIHdpZHRoOiAxMDAlO1xuICBoZWlnaHQ6IDk1JTtcbiAgdGV4dC1hbGlnbjogY2VudGVyO1xuICBkaXNwbGF5OiBpbmxpbmUtYmxvY2s7XG4gIG1hcmdpbjogNXB4IGF1dG87XG59XG5cbiNib3R0b20tbWFyZ2luIHtcbiAgaGVpZ2h0OiAxMDBweDtcbn1cblxuLmNvbnRlbnQge1xuICBtYXgtd2lkdGg6IDk2MHB4O1xuICBtYXJnaW46IGF1dG87XG59XG5cbi53aGl0ZXNwYWNlIHtcbiAgaGVpZ2h0OiA4dmg7XG59IiwiXG4jc2VudGVuY2UtaW5wdXQge1xuICAgIG1hcmdpbi1ib3R0b206IDBweDtcbiAgICBtYXJnaW4tcmlnaHQ6IDBweDtcbiAgICBtYXJnaW4tbGVmdDogMTBweDtcbiAgICB3aWR0aDogMTAwJTtcblxuICAgIGZvcm0ge1xuICAgICAgICBkaXNwbGF5OiBmbGV4O1xuICAgICAgICBmbGV4LWRpcmVjdGlvbjogcm93O1xuICAgICAgICBmbGV4LXdyYXA6IG5vd3JhcDtcbiAgICAgICAganVzdGlmeS1jb250ZW50OiBzcGFjZS1ldmVubHk7XG4gICAgICAgIGFsaWduLWl0ZW1zOiBjZW50ZXI7XG5cbiAgICAgICAgLmZvcm0tZ3JvdXAge1xuICAgICAgICAgICAgZmxleC1ncm93OiAzO1xuXG4gICAgICAgICAgICBpbnB1dCB7XG4gICAgICAgICAgICAgICAgLy8gZmxleC1ncm93OiAzO1xuICAgICAgICAgICAgICAgIHdpZHRoOiA1MCU7XG4gICAgICAgICAgICAgICAgbWF4LXdpZHRoOiA3MDBweDtcbiAgICAgICAgICAgICAgICBtYXJnaW4tcmlnaHQ6IDUlO1xuICAgICAgICAgICAgfVxuICAgICAgICB9XG5cbiAgICAgICAgLmJ0biB7XG4gICAgICAgICAgICBmbGV4LWdyb3c6IDE7XG4gICAgICAgIH1cbiAgICB9XG59IiwiLmlucHV0LWRlc2NyaXB0aW9uIHtcblx0Zm9udC13ZWlnaHQ6IDgwMFxufVxuXG4jY29ubmVjdG9yLWNvbnRhaW5lciB7XG5cdG1hcmdpbjogNDBweCA0MHB4IDQwcHggNDBweDtcbiAgICBhbGlnbi1pdGVtczogY2VudGVyO1xufVxuXG4uY29ubmVjdG9yLWNvbnRyb2xzIHtcblx0ZGlzcGxheTogZ3JpZDtcblx0Z3JpZC10ZW1wbGF0ZS1jb2x1bW5zOiAwLjVmciAwLjVmcjtcbn1cblxuLnNsaWRlLWNvbnRhaW5lciB7XG5cdGdyaWQtY29sdW1uLXN0YXJ0OiAxO1xuXHRncmlkLWNvbHVtbi1lbmQ6IDI7XG5cdGdyaWQtcm93LXN0YXJ0OiAxO1xuXHRncmlkLXJvdy1lbmQ6IDI7XG5cdG1hcmdpbjogYXV0bztcblx0dGV4dC1hbGlnbjogY2VudGVyO1xuXHR3aWR0aDogNzUlOyBcbn1cblxuLnNsaWRlciB7XG5cdC13ZWJraXQtYXBwZWFyYW5jZTogbm9uZTtcblx0d2lkdGg6IDEwcHg7XG5cdGhlaWdodDogMTBweDtcblx0Ym9yZGVyLXJhZGl1czogNXB4O1xuXHRiYWNrZ3JvdW5kOiAjZDNkM2QzO1xuXHRvdXRsaW5lOiBub25lO1xuXHRvcGFjaXR5OiAwLjc7XG5cdC13ZWJraXQtdHJhbnNpdGlvbjogLjJzO1xuXHR0cmFuc2l0aW9uOiBvcGFjaXR5IC4ycztcbn1cblxuLnNsaWRlcjpob3ZlciB7XG5cdG9wYWNpdHk6IDE7XG59XG5cbi5zbGlkZXI6Oi13ZWJraXQtc2xpZGVyLXRodW1iIHtcblx0LXdlYmtpdC1hcHBlYXJhbmNlOiBub25lO1xuXHRhcHBlYXJhbmNlOiBub25lO1xuXHR3aWR0aDogMTVweDtcblx0aGVpZ2h0OiAxNXB4O1xuXHRib3JkZXItcmFkaXVzOiA1MCU7XG5cdGJhY2tncm91bmQ6ICM2NjY2NjY7XG5cdGN1cnNvcjogcG9pbnRlcjtcbn1cblxuI2xheWVyLXNlbGVjdGlvbiB7XG5cdGdyaWQtY29sdW1uLXN0YXJ0OiAxO1xuXHRncmlkLWNvbHVtbi1lbmQ6IDI7XG5cdGdyaWQtcm93LXN0YXJ0OiAyO1xuXHRncmlkLXJvdy1lbmQ6IDM7XG5cbn1cbi5sYXllci1zZWxlY3Qge1xuXHRtYXJnaW4tYm90dG9tOiAyZW07XG59XG5cbiNhdG4tY29udGFpbmVyIHtcblx0ZGlzcGxheTogZmxleDtcblx0ZmxleC1kaXJlY3Rpb246IHJvdztcblx0ZmxleC13cmFwOiBub3dyYXA7XG5cdGp1c3RpZnktY29udGVudDogY2VudGVyO1xuXHRhbGlnbi1pdGVtczogdG9wO1xuXG5cdG1hcmdpbjogMCBhdXRvO1xuXHR3aWR0aDogMTAwJTtcblx0dmVydGljYWwtYWxpZ246IHRvcDtcblxuXHQjbGVmdC1hdHQtaGVhZHMge1xuXHRcdG9yZGVyOjE7XG5cdFx0ZGlzcGxheTogaW5saW5lLWJsb2NrO1xuXHRcdHZlcnRpY2FsLWFsaWduOiB0b3A7XG5cdH1cblxuXHQjbGVmdC10b2tlbnMge1xuXHRcdG9yZGVyOiAyO1xuXHRcdHRleHQtYWxpZ246IHJpZ2h0O1xuXHRcdHZlcnRpY2FsLWFsaWduOiB0b3A7XG5cdH1cblxuXG5cdCNhdG4tZGlzcGxheSB7XG5cdFx0b3JkZXI6IDM7XG5cdFx0dmVydGljYWwtYWxpZ246IHRvcDtcblx0fVxuXG5cdCNyaWdodC10b2tlbnMge1xuXHRcdG9yZGVyOiA0O1xuXHRcdHRleHQtYWxpZ246IGxlZnQ7XG5cdFx0dmVydGljYWwtYWxpZ246IHRvcDtcblx0fVxuXG5cdCNyaWdodC1hdHQtaGVhZHMge1xuXHRcdG9yZGVyOiA1O1xuXHRcdHZlcnRpY2FsLWFsaWduOiB0b3A7XG5cdH1cblx0XG59XG5cbi5hdHQtcmVjdCB7XG5cdHRyYW5zaXRpb246IGZpbGwgMC4xcztcbn1cblxuLnRva2VuIHtcblx0ZGlzcGxheTogYmxvY2s7XG59XG5cbi5hdG4tY3VydmUge1xuXHRmaWxsOiBub25lO1xuXHQvLyBzdHJva2Utd2lkdGg6IDM7XG5cdHN0cm9rZTogcHVycGxlO1xufVxuXG4ubWFza2VkLXRva2VuIHtcblx0Y29sb3I6IHJnYmEoMCwwLDAsMC4yKVxufVxuXG4udW5zZWxlY3RlZCB7XG5cdGZpbGw6IGdyYXk7XG59XG5cbi5zZWxlY3RlZC10b2tlbiB7XG5cdGJvcmRlci1zdHlsZTogc29saWQ7XG5cdGJvcmRlci13aWR0aDogM3B4O1xuXHRib3JkZXItY29sb3I6IHJnYigxNTMsIDE5NiwgMCk7XG59XG5cbi8qIFRoZSBzd2l0Y2ggLSB0aGUgYm94IGFyb3VuZCB0aGUgc2xpZGVyICovXG4uc3dpdGNoIHtcblx0cG9zaXRpb246IHJlbGF0aXZlO1xuXHRkaXNwbGF5OiBpbmxpbmUtYmxvY2s7XG5cdHdpZHRoOiA2MHB4O1xuXHRoZWlnaHQ6IDM0cHg7XG5cbi8qIEhpZGUgZGVmYXVsdCBIVE1MIGNoZWNrYm94ICovXG5cdGlucHV0IHtcblx0XHRvcGFjaXR5OiAwO1xuXHRcdHdpZHRoOiAwO1xuXHRcdGhlaWdodDogMDtcblx0fVxufVxuXG4vKiBUaGUgc2xpZGVyICovXG4uc2hvcnQtc2xpZGVyIHtcblx0cG9zaXRpb246IGFic29sdXRlO1xuXHRjdXJzb3I6IHBvaW50ZXI7XG5cdHRvcDogMDtcblx0bGVmdDogMDtcblx0cmlnaHQ6IDA7XG5cdGJvdHRvbTogMDtcblx0YmFja2dyb3VuZC1jb2xvcjogI2NjYztcblx0LXdlYmtpdC10cmFuc2l0aW9uOiAuNHM7XG5cdHRyYW5zaXRpb246IC40cztcblxuXHQmOmJlZm9yZSB7XG5cdFx0cG9zaXRpb246IGFic29sdXRlO1xuXHRcdGNvbnRlbnQ6IFwiXCI7XG5cdFx0aGVpZ2h0OiAyNnB4O1xuXHRcdHdpZHRoOiAyNnB4O1xuXHRcdGxlZnQ6IDRweDtcblx0XHRib3R0b206IDRweDtcblx0XHRiYWNrZ3JvdW5kLWNvbG9yOiB3aGl0ZTtcblx0XHQtd2Via2l0LXRyYW5zaXRpb246IC40cztcblx0XHR0cmFuc2l0aW9uOiAuNHM7XG5cdH1cbn1cblxuaW5wdXQ6Y2hlY2tlZCArIC5zaG9ydC1zbGlkZXIge1xuXHRiYWNrZ3JvdW5kLWNvbG9yOiAjMjE5NkYzO1xufVxuXG5pbnB1dDpmb2N1cyArIC5zaG9ydC1zbGlkZXIge1xuXHRib3gtc2hhZG93OiAwIDAgMXB4ICMyMTk2RjM7XG59XG5cbmlucHV0OmNoZWNrZWQgKyAuc2hvcnQtc2xpZGVyOmJlZm9yZSB7XG5cdC13ZWJraXQtdHJhbnNmb3JtOiB0cmFuc2xhdGVYKDI2cHgpO1xuXHQtbXMtdHJhbnNmb3JtOiB0cmFuc2xhdGVYKDI2cHgpO1xuXHR0cmFuc2Zvcm06IHRyYW5zbGF0ZVgoMjZweCk7XG59XG5cbi8qIFJvdW5kZWQgc2xpZGVycyAqL1xuLnNob3J0LXNsaWRlci5yb3VuZCB7XG5cdGJvcmRlci1yYWRpdXM6IDM0cHg7XG59XG5cbi5zaG9ydC1zbGlkZXIucm91bmQ6YmVmb3JlIHtcblx0Ym9yZGVyLXJhZGl1czogNTAlO1xufVxuXG4jc2VsZWN0LWFsbC1oZWFkc3sgXG5cdG1hcmdpbi10b3A6IDIwcHg7XG5cdG1hcmdpbi1ib3R0b206IDIwcHg7XG59IiwiQGltcG9ydCBcInBhbGV0dGUuc2Nzc1wiO1xuLy9AaW1wb3J0IFwiTGF0b0xpZ2h0LnNjc3NcIjtcbkBpbXBvcnQgXCIuLi9mb250cy9wbGV4X3NhbnMuY3NzXCI7XG5AaW1wb3J0IFwiYmFzZVwiO1xuQGltcG9ydCBcIlNlbnRlbmNlSW5wdXRcIjtcbkBpbXBvcnQgXCJBdHRlbnRpb25Db25uZWN0b3JDb250cm9sc1wiO1xuXG5ib2R5IHtcbiAgZm9udC1mYW1pbHk6ICdJQk0gUGxleCBTYW5zJztcbiAgbWFyZ2luLWxlZnQ6IGF1dG87XG4gIG1hcmdpbi1yaWdodDogYXV0bztcbiAgd2lkdGg6IDgwJTtcbiAgbWF4LXdpZHRoOiAxNTAwcHg7XG59XG5cbi5sYXllckNoZWNrYm94IHtcbiAgYmFja2dyb3VuZC1jb2xvcjogbGlnaHRncmV5O1xuICBwYWRkaW5nLWxlZnQ6IDhweDtcbiAgcGFkZGluZy1yaWdodDogOHB4O1xuXG4gICYuYWN0aXZle1xuICAgIGNvbG9yOiAjZmZmO1xuICAgIGJhY2tncm91bmQtY29sb3I6ICM2YzcwNjc7XG4gIH1cbn1cblxuLm1haW4tZ3JpZCB7XG4gIHdpZHRoOiAxMDAlO1xuICBkaXNwbGF5OiBncmlkO1xuICBncmlkLXRlbXBsYXRlLWNvbHVtbnM6IDAuMThmciAwLjJmciAwLjJmciAwLjA0ZnIgMC4yZnIgMC4yZnIgMC4xOGZyO1xuICBvdmVyZmxvdzogYXV0bztcbiAgbWF4LWhlaWdodDogMTAwdmg7XG59XG5cbiN2aXMtYnJlYWsge1xuICBoZWlnaHQ6IDE1cHg7XG59XG5cbmxhYmVsIHtcbiAgbWFyZ2luLWxlZnQ6IDVweDtcbn1cblxuI2hlYWRlciB7XG4gIHdpZHRoOiAxMDAlO1xuICBiYWNrZ3JvdW5kLWNvbG9yOiBsaWdodGdyYXk7XG4gIGhlaWdodDogNDBweDtcbiAgbWFyZ2luLWJvdHRvbTogNXB4O1xuXG4gIC5oZWFkZXItbG9nb3tcbiAgICBoZWlnaHQ6IDIwcHg7XG4gICAgZGlzcGxheTppbmxpbmUtYmxvY2s7XG4gICAgbWFyZ2luLWxlZnQ6IDEwcHg7XG4gICAgbWFyZ2luLXRvcDogNXB4O1xuICAgIG1hcmdpbi1ib3R0b206IDVweDtcbiAgfVxuICAuaGVhZGVyLWluZm97XG4gICAgZm9udC1zaXplOiA5cHQ7XG4gICAgaGVpZ2h0OiAzMHB4O1xuICAgIGRpc3BsYXk6aW5saW5lLWJsb2NrO1xuICAgIGZsb2F0OnJpZ2h0O1xuICAgIG1hcmdpbi1yaWdodDogMTBweDtcbiAgICBtYXJnaW4tdG9wOiAxMHB4O1xuICAgIC8vbWFyZ2luLWJvdHRvbTogNXB4O1xuICB9XG5cblxuICAjaGVhZGVydGV4dHtcbiAgICB0ZXh0LWFsaWduOiBjZW50ZXIgO1xuICAgIGRpc3BsYXk6IGlubGluZS1ibG9jaztcbiAgICBmb250LXNpemU6IDE4cHg7XG4gICAgbWFyZ2luLWxlZnQ6IDMwJTtcbiAgICBtYXJnaW4tdG9wOiA1cHg7XG4gICAgbWFyZ2luLWJvdHRvbTogNXB4O1xuICB9XG59XG5cbi5oaWdobGlnaHRlZCB7XG4gIGJhY2tncm91bmQ6IHJnYmEoMTUyLCA4MywgMjE2LCAwLjgpO1xufVxuXG4jc2VsZWN0ZWQtaGVhZHMge1xuICBtYXJnaW4tYm90dG9tOiAxZW07XG59XG5cbiNjb3JwdXMtc2VsZWN0aW9uLWRlc2NyaXB0aW9uIHtcbiAgZGlzcGxheTogaW5saW5lLWJsb2NrO1xuICBtYXJnaW4tcmlnaHQ6IDE1cHg7XG59XG5cbiNjb3JwdXMtcXVlcnlpbmcge1xuICBkaXNwbGF5OiBpbmxpbmUtYmxvY2s7XG4gIC5idG4ge1xuICAgIGRpc3BsYXk6IGlubGluZS1ibG9jaztcbiAgfVxufVxuXG4jdXNhZ2UtaW5mbyB7XG4gIG1hcmdpbi10b3A6IDEwcHg7XG4gIGNvbG9yOiByZ2IoODcsIDg3LCA4Nyk7XG4gIGZvbnQtc2l6ZTogMTRweDtcbn1cblxuLnRpY2sge1xuICBmb250LXNpemU6IDE4cHg7XG59XG5cbiNjb25uZWN0b3ItY29udGFpbmVyIHtcbiAgLm1hdC1ob3Zlci1kaXNwbGF5e1xuICAgIHBvaW50ZXItZXZlbnRzOiBub25lO1xuICAgIGRpc3BsYXk6IGJsb2NrO1xuICAgIHBvc2l0aW9uOiBhYnNvbHV0ZTtcbiAgICB2aXNpYmlsaXR5OiBoaWRkZW47XG4gICAgYmFja2dyb3VuZC1jb2xvcjogcmdiYSgyMDAsIDIwMCwgMjAwLCAwLjkzKTtcbiAgICBmb250LXNpemU6IDE0cHg7XG4gICAgcCB7XG4gICAgICBtYXJnaW46IDRweCAxcHggMXB4IDRweDtcbiAgICAgIC8vIG1hcmdpbjogYXV0bztcbiAgICB9XG4gIH1cbn1cblxuLnJpZ2h0LXRva2VuLWhvdmVyIHtcbiAgICBib3JkZXItcmFkaXVzOiAxcHggOHB4IDhweCA4cHg7XG4gICAgdGV4dC1hbGlnbjogbGVmdDtcbn1cblxuLmxlZnQtdG9rZW4taG92ZXIge1xuICAgIGJvcmRlci1yYWRpdXM6IDhweCAxcHggOHB4IDhweDtcbiAgICB0ZXh0LWFsaWduOiByaWdodDtcbn1cblxuLm5leHQtdG9rZW4ge1xuICBjb2xvcjogcmdiYSgyMjgsIDEsIDEsIDAuOCk7XG4gIC1tb3otYm94LXNoYWRvdzogMCAwIDNweCAjY2NjO1xuICAtd2Via2l0LWJveC1zaGFkb3c6IDAgMCAzcHggI2NjYztcbiAgYm94LXNoYWRvdzogMCAwIDNweCAjY2NjO1xufSJdLCJzb3VyY2VSb290IjoiIn0=*/
client/dist/main.js CHANGED
The diff for this file is too large to render. See raw diff
 
client/src/css/AttentionConnectorControls.scss CHANGED
@@ -3,7 +3,8 @@
3
  }
4
 
5
  #connector-container {
6
- margin: 20px 20px 20px 20px;
 
7
  }
8
 
9
  .connector-controls {
 
3
  }
4
 
5
  #connector-container {
6
+ margin: 40px 40px 40px 40px;
7
+ align-items: center;
8
  }
9
 
10
  .connector-controls {
client/src/css/SentenceInput.scss CHANGED
@@ -1,9 +1,9 @@
1
 
2
  #sentence-input {
3
- margin-bottom: -30px;
4
- margin-right: -30px;
5
  margin-left: 10px;
6
- width: 90%;
7
 
8
  form {
9
  display: flex;
@@ -16,21 +16,15 @@
16
  flex-grow: 3;
17
 
18
  input {
19
- // flex-grow: 4;
20
- width: 100%;
21
- max-width: 200px;
22
  margin-right: 5%;
23
  }
24
  }
25
-
26
- .padding {
27
- flex-grow: 0.3;
28
- }
29
-
30
 
31
  .btn {
32
  flex-grow: 1;
33
- // display: inline-block;
34
  }
35
  }
36
  }
 
1
 
2
  #sentence-input {
3
+ margin-bottom: 0px;
4
+ margin-right: 0px;
5
  margin-left: 10px;
6
+ width: 100%;
7
 
8
  form {
9
  display: flex;
 
16
  flex-grow: 3;
17
 
18
  input {
19
+ // flex-grow: 3;
20
+ width: 50%;
21
+ max-width: 700px;
22
  margin-right: 5%;
23
  }
24
  }
 
 
 
 
 
25
 
26
  .btn {
27
  flex-grow: 1;
 
28
  }
29
  }
30
  }
client/src/css/main.scss CHANGED
@@ -4,11 +4,13 @@
4
  @import "base";
5
  @import "SentenceInput";
6
  @import "AttentionConnectorControls";
7
- @import "CorpusVis";
8
- @import "Histograms";
9
 
10
  body {
11
  font-family: 'IBM Plex Sans';
 
 
 
 
12
  }
13
 
14
  .layerCheckbox {
 
4
  @import "base";
5
  @import "SentenceInput";
6
  @import "AttentionConnectorControls";
 
 
7
 
8
  body {
9
  font-family: 'IBM Plex Sans';
10
+ margin-left: auto;
11
+ margin-right: auto;
12
+ width: 80%;
13
+ max-width: 1500px;
14
  }
15
 
16
  .layerCheckbox {
client/src/ts/main.ts CHANGED
@@ -1,19 +1,9 @@
1
  import { MainGraphic } from './vis/attentionVis'
2
- import * as d3 from 'd3'
3
- import { API, emptyTokenDisplay } from './api/mainApi'
4
- import * as _ from 'lodash'
5
- import { TokenWrapper } from './data/TokenWrapper'
6
- // import { Tester } from "../ts/test"
7
 
8
  import "!file-loader?name=exBERT.html!../exBERT.html";
9
  import "!file-loader?name=index.html!../index.html";
10
  import "../css/main.scss"
11
 
12
- function doMySvg() {
13
- const base = document.getElementById('static-init')
14
- return new MainGraphic(base)
15
- };
16
-
17
  window.onload = () => {
18
  const base = document.getElementById('attention-vis')
19
  //@ts-ignore
 
1
  import { MainGraphic } from './vis/attentionVis'
 
 
 
 
 
2
 
3
  import "!file-loader?name=exBERT.html!../exBERT.html";
4
  import "!file-loader?name=index.html!../index.html";
5
  import "../css/main.scss"
6
 
 
 
 
 
 
7
  window.onload = () => {
8
  const base = document.getElementById('attention-vis')
9
  //@ts-ignore
client/src/ts/vis/attentionVis.ts CHANGED
@@ -173,14 +173,14 @@ function createStaticSkeleton(base: D3Sel) {
173
  clsSwitch.append('span')
174
  .attr('class', 'short-slider round')
175
 
176
- const selectedHeads = rightControlHalf.append('div')
177
  .attr('id', 'selected-head-display')
178
 
179
- selectedHeads.append('div')
180
  .classed('input-description', true)
181
  .text('Selected heads:')
182
 
183
- selectedHeads.append('div').attr('id', 'selected-heads')
184
 
185
  const headButtons = rightControlHalf.append('div')
186
  .classed('select-input', true)
@@ -300,7 +300,12 @@ export class MainGraphic {
300
  this.sels.body.style("cursor", "progress")
301
  this.api.getModelDetails(this.uiConf.model()).then(md => {
302
  const val = md.payload
 
 
303
  this.uiConf.nLayers(val.nlayers).nHeads(val.nheads)
 
 
 
304
  this.initLayers(this.uiConf.nLayers())
305
 
306
  this.api.getMetaAttentions(this.uiConf.model(), this.uiConf.sentence(), this.uiConf.layer()).then(attention => {
@@ -568,13 +573,6 @@ export class MainGraphic {
568
  this.sels.form.sentenceA.attr('placeholder', "Enter new sentence to analyze")
569
  this.sels.form.sentenceA.attr('value', this.uiConf.sentence())
570
 
571
- const clearInspector = () => {
572
- self.vizs.corpusMatManager.clear();
573
- self.vizs.corpusInspector.clear();
574
- self.vizs.histograms.matchedWord.clear();
575
- self.vizs.histograms.maxAtt.clear();
576
- }
577
-
578
  const submitNewSentence = () => {
579
  // replace all occurences of '#' in sentence as this causes the API to break
580
  const sentence_a: string = this.sels.form.sentenceA.property("value").replace(/\#/g, '')
@@ -591,7 +589,6 @@ export class MainGraphic {
591
  this.tokCapsule.updateFromResponse(r);
592
  this._toggleTokenSel();
593
  this.update();
594
- clearInspector();
595
  this.sels.body.style("cursor", "default")
596
  })
597
  }
@@ -728,12 +725,17 @@ export class MainGraphic {
728
  const data = [
729
  { name: "bert-base-cased", kind: tp.ModelKind.Bidirectional },
730
  { name: "bert-base-uncased", kind: tp.ModelKind.Bidirectional },
 
 
731
  { name: "distilbert-base-uncased", kind: tp.ModelKind.Bidirectional },
732
  { name: "distilroberta-base", kind: tp.ModelKind.Bidirectional },
733
- // { name: "roberta-base", kind: tp.ModelKind.Bidirectional },
 
 
 
 
734
  { name: "gpt2", kind: tp.ModelKind.Autoregressive },
735
- // { name: "gpt2-medium", kind: tp.ModelKind.Autoregressive },
736
- // { name: "distilgpt2", kind: tp.ModelKind.Autoregressive },
737
  ]
738
 
739
  const names = R.map(R.prop('name'))(data)
 
173
  clsSwitch.append('span')
174
  .attr('class', 'short-slider round')
175
 
176
+ const selectedHeadDiv = rightControlHalf.append('div')
177
  .attr('id', 'selected-head-display')
178
 
179
+ selectedHeadDiv.append('div')
180
  .classed('input-description', true)
181
  .text('Selected heads:')
182
 
183
+ const selectedHeads = selectedHeadDiv.append('div').attr('id', 'selected-heads')
184
 
185
  const headButtons = rightControlHalf.append('div')
186
  .classed('select-input', true)
 
300
  this.sels.body.style("cursor", "progress")
301
  this.api.getModelDetails(this.uiConf.model()).then(md => {
302
  const val = md.payload
303
+
304
+ // If changing to model with fewer layers, cap accordingly
305
  this.uiConf.nLayers(val.nlayers).nHeads(val.nheads)
306
+ const currLayer = this.uiConf.layer()
307
+ const maxLayer = this.uiConf.nLayers() - 1
308
+ this.uiConf.layer(Math.min(currLayer, maxLayer))
309
  this.initLayers(this.uiConf.nLayers())
310
 
311
  this.api.getMetaAttentions(this.uiConf.model(), this.uiConf.sentence(), this.uiConf.layer()).then(attention => {
 
573
  this.sels.form.sentenceA.attr('placeholder', "Enter new sentence to analyze")
574
  this.sels.form.sentenceA.attr('value', this.uiConf.sentence())
575
 
 
 
 
 
 
 
 
576
  const submitNewSentence = () => {
577
  // replace all occurences of '#' in sentence as this causes the API to break
578
  const sentence_a: string = this.sels.form.sentenceA.property("value").replace(/\#/g, '')
 
589
  this.tokCapsule.updateFromResponse(r);
590
  this._toggleTokenSel();
591
  this.update();
 
592
  this.sels.body.style("cursor", "default")
593
  })
594
  }
 
725
  const data = [
726
  { name: "bert-base-cased", kind: tp.ModelKind.Bidirectional },
727
  { name: "bert-base-uncased", kind: tp.ModelKind.Bidirectional },
728
+ { name: "bert-base-german-cased", kind: tp.ModelKind.Bidirectional },
729
+ { name: "xlm-mlm-en-2048", kind: tp.ModelKind.Bidirectional },
730
  { name: "distilbert-base-uncased", kind: tp.ModelKind.Bidirectional },
731
  { name: "distilroberta-base", kind: tp.ModelKind.Bidirectional },
732
+ { name: "albert-base-v1", kind: tp.ModelKind.Bidirectional },
733
+ { name: "albert-xxlarge-v2", kind: tp.ModelKind.Bidirectional },
734
+ { name: "xlm-roberta-base", kind: tp.ModelKind.Bidirectional },
735
+ // { name: "t5-small", kind: tp.ModelKind.Autoregressive },
736
+ { name: "roberta-base", kind: tp.ModelKind.Bidirectional },
737
  { name: "gpt2", kind: tp.ModelKind.Autoregressive },
738
+ { name: "distilgpt2", kind: tp.ModelKind.Autoregressive },
 
739
  ]
740
 
741
  const names = R.map(R.prop('name'))(data)
server/main.py CHANGED
@@ -15,7 +15,7 @@ CORS(flask_app)
15
 
16
  parser = argparse.ArgumentParser(formatter_class=argparse.ArgumentDefaultsHelpFormatter)
17
  parser.add_argument("--debug", action="store_true", help=" Debug mode")
18
- parser.add_argument("--port", default=5050, help="Port to run the app. ")
19
 
20
  # Flask main routes
21
  @app.route("/")
 
15
 
16
  parser = argparse.ArgumentParser(formatter_class=argparse.ArgumentDefaultsHelpFormatter)
17
  parser.add_argument("--debug", action="store_true", help=" Debug mode")
18
+ parser.add_argument("--port", default=5051, help="Port to run the app. ")
19
 
20
  # Flask main routes
21
  @app.route("/")
server/model_api.py CHANGED
@@ -89,8 +89,6 @@ class ModelDetails:
89
  else:
90
  logits, atts = out
91
 
92
- print("Logits: ", logits)
93
- print("atts: ", atts[0].shape)
94
  return logits, atts
95
 
96
  def logits2words(self, logits, topk):
 
89
  else:
90
  logits, atts = out
91
 
 
 
92
  return logits, atts
93
 
94
  def logits2words(self, logits, topk):