Upload folder using huggingface_hub

.gitignore

@@ -8,7 +8,8 @@ template/
 *.json
 output/
 pdfs/
-static/full_images/
-static/sim_maps/
+colpalidemo/
+src/static/full_images/
+src/static/sim_maps/
 embeddings/
 hf_dataset/

README.md

@@ -1,19 +1,211 @@
----
-title: ColPali 🤝 Vespa - Visual Retrieval
-short_description: Visual Retrieval with ColPali and Vespa
-emoji: 👀
-colorFrom: purple
-colorTo: blue
-sdk: gradio
-sdk_version: 4.44.0
-app_file: main.py
-pinned: false
-license: apache-2.0
-suggested_hardware: t4-small
-models:
-  - vidore/colpaligemma-3b-pt-448-base
-  - vidore/colpali-v1.2
-preload_from_hub:
-  - vidore/colpaligemma-3b-pt-448-base config.json,model-00001-of-00002.safetensors,model-00002-of-00002.safetensors,model.safetensors.index.json,preprocessor_config.json,special_tokens_map.json,tokenizer.json,tokenizer_config.json 12c59eb7e23bc4c26876f7be7c17760d5d3a1ffa
-  - vidore/colpali-v1.2 adapter_config.json,adapter_model.safetensors,preprocessor_config.json,special_tokens_map.json,tokenizer.json,tokenizer_config.json 9912ce6f8a462d8cf2269f5606eabbd2784e764f
----
+<!-- Copyright Vespa.ai. Licensed under the terms of the Apache 2.0 license. See LICENSE in the project root. -->
+
+<picture>
+  <source media="(prefers-color-scheme: dark)" srcset="https://assets.vespa.ai/logos/Vespa-logo-green-RGB.svg">
+  <source media="(prefers-color-scheme: light)" srcset="https://assets.vespa.ai/logos/Vespa-logo-dark-RGB.svg">
+  <img alt="#Vespa" width="200" src="https://assets.vespa.ai/logos/Vespa-logo-dark-RGB.svg" style="margin-bottom: 25px;">
+</picture>
+
+# 🔍 Visual Retrieval ColPali 👀
+
+This readme contains the code for a web app including a frontend that can be set up as a user facing interface.
+
+## Why?
+
+To enable _you_ to showcase the power of ColPali and Vespa to your users, and to provide a starting point for your own projects.
+
+> "But I only know Python, how can I create a web app that's not Gradio or Streamlit?" 🤔
+
+No worries! This project uses [FastHTML](https://fastht.ml/) to create a beautiful web app - and it's all Python! 🐍
+
+Also, 👇
+
+<a href="https://imgflip.com/i/98mhch"><img src="https://i.imgflip.com/98mhch.jpg" title="made at imgflip.com" alt="Funny meme about json output in demo"/></a>
+
+As a prerequisite, you should run [this notebook](https://pyvespa.readthedocs.io/en/latest/examples/visual_pdf_rag_with_vespa_colpali_cloud.ipynb) to prepare the data and deploy the Vespa application.
+
+## Setting up your .env variables
+
+The following variables are required in your `.env` file for the application to be able to connect to the Vespa application and the Gemini API:
+
+You can rename the `.env.example` file to `.env` and fill in the required values.
+The other variables are optional, if you want to use mTLS authentication against the Vespa application.
+
+```bash
+VESPA_APP_TOKEN_URL=https://abcde.z.vespa-app.cloud
+VESPA_CLOUD_SECRET_TOKEN=vespa_cloud_xxxxxxxx
+GEMINI_API_KEY=asdf
+```
+
+If you want to deploy the application to Huggingface, you also need to set a `HF_TOKEN` variable, with write permissions.
+This is personal, and must be created at [huggingface](https://huggingface.co/settings/tokens).
+
+```bash
+HF_TOKEN=hf_xxxxxxxxxx
+```
+
+## Setting up python environment
+
+This application should work on Python 3.8 and above.
+
+You can install the dependencies with `pip`, but we recommend using `uv`. 
+Skip to [Installing dependencies using `uv`](#installing-dependencies-using-uv) if you want to use `uv`.
+
+### Installing dependencies using `pip`
+
+You can install the dependencies with `pip`:
+
+```bash
+pip install -r src/requirements.txt
+```
+
+### Installing dependencies using `uv`
+
+We recommend installing the amazing `uv` to manage your python environment:
+See also [installation - uv docs](https://docs.astral.sh/uv/getting-started/installation/) for other installation options.
+
+```bash
+curl -LsSf https://astral.sh/uv/install.sh | sh
+```
+
+Then, create a virtual environment:
+
+```bash
+uv venv 
+```
+
+Activate the virtual environment:
+
+```bash
+source .venv/bin/activate
+```
+
+Sync your virtual environment with the dependencies:
+
+```bash
+uv sync --extra dev
+```
+
+## Running the application locally
+
+To run the application locally, you can change into the `src` directory and run:
+
+```bash
+python main.py
+```
+
+This will start a local server, and you can access the application at `http://localhost:7860`.
+
+## Deploy to huggingface 🤗 spaces
+
+### Compiling dependencies
+
+Before a deploy, make sure to run this to compile the `uv` lock file to `requirements.txt` if you have made changes to the dependencies:
+
+```bash
+uv pip compile pyproject.toml -o src/requirements.txt
+```
+
+This will make sure that the dependencies in your `pyproject.toml` are compiled to the `requirements.txt` file, which is used by the huggingface space.
+
+### Deploying to huggingface
+
+Note that you need to set `HF_TOKEN` environment variable first.
+This is personal, and must be created at [huggingface](https://huggingface.co/settings/tokens).
+Make sure the token has `write` access.
+Be aware that this will not delete existing files, only modify or add,
+see [huggingface-cli](https://huggingface.co/docs/huggingface_hub/en/guides/upload#upload-from-the-cli) for more
+information.
+
+#### Update your space configuration
+
+The `src/README.md` file contains the configuration for the space.
+Feel free to update this file to match your own configuration - name, description, etc.
+
+Note that we can actually use the `gradio` SDK of spaces, to serve FastHTML apps as well, as long as we serve the app on port `7860`.
+See [Custom python spaces](https://huggingface.co/docs/hub/en/spaces-sdks-python) for more information.
+
+#### Upload the files
+
+To deploy, run
+
+(Replace `vespa-engine/colpali-vespa-visual-retrieval` with your own huggingface user/repo name, does not need to exist beforehand)
+
+```bash
+huggingface-cli upload vespa-engine/colpali-vespa-visual-retrieval src . --repo-type=space
+```
+
+Note that we upload only the `src` directory.
+
+## Development
+
+This section applies if you want to make changes to the web app.
+
+### Adding dependencies
+
+To add dependencies, you can add them to the `pyproject.toml` file and run:
+
+```bash
+uv compile
+```
+
+and then sync the dependencies:
+
+```bash
+uv sync --extra dev
+```
+
+### Making changes to CSS
+
+To make changes to output.css apply, run
+
+```bash
+shad4fast watch # watches all files passed through the tailwind.config.js content section
+
+shad4fast build # minifies the current output.css file to reduce bundle size in production.
+```
+
+### Instructions on creating and feeding the full dataset
+
+This section is only relevant if you want to create and feed the full dataset to Vespa.
+The notebook referenced in the beginning of this readme should be sufficient if you just want to spin up a scaled down version of the demo.
+
+#### Prepare data and Vespa application
+
+First, install `uv`:
+
+```bash
+curl -LsSf https://astral.sh/uv/install.sh | sh
+```
+
+Then, run:
+
+```bash
+uv sync --extra dev --extra feed
+```
+
+#### Converting to notebook
+
+If you want to run the `prepare_feed_deploy.py` as a notebook, you can convert it using `jupytext`:
+
+Convert the `prepare_feed_deploy.py` to notebook to:
+
+```bash
+jupytext --to notebook prepare_feed_deploy.py
+```
+
+And launch a Jupyter instance with:
+
+```bash
+uv run --with jupyter jupyter lab
+```
+
+## Credits
+
+Huge thanks to the amazing projects that made it a joy to create this demo 🙏🙌
+
+- Freeing us from python dependency hell - [uv](https://astral.sh/uv/)
+- Allowing us to build **beautiful** full stack web apps in Python [FastHTML](https://fastht.ml/)
+- Introducing the ColPali architecture - [ColPali](https://huggingface.co/vidore/colpali-v1.2)
+- Adding `shadcn` components to FastHTML - [Shad4Fast](https://www.shad4fasthtml.com/)
+  

prepare_feed_deploy.py

@@ -1,4 +1,3 @@
-# %% [markdown]
 # # Visual PDF Retrieval - demo application
 #
 # In this notebook, we will prepare the Vespa backend application for our visual retrieval demo.
@@ -23,11 +22,10 @@
 # We have tried to make it easy for others to run this notebook, to create your own PDF Enterprise Search application using Vespa.
 #
 
-# %% [markdown]
 # ## 0. Setup and Configuration
 #
 
-# %%
+# +
 import os
 import asyncio
 import json
@@ -80,8 +78,8 @@ load_dotenv()
 
 # Avoid warning from huggingface tokenizers
 os.environ["TOKENIZERS_PARALLELISM"] = "false"
+# -
 
-# %% [markdown]
 # ### Create a free trial in Vespa Cloud
 #
 # Create a tenant from [here](https://vespa.ai/free-trial/).
@@ -89,49 +87,39 @@ os.environ["TOKENIZERS_PARALLELISM"] = "false"
 # Take note of your tenant name.
 #
 
-# %%
 VESPA_TENANT_NAME = "vespa-team"
 
-# %% [markdown]
 # Here, set your desired application name. (Will be created in later steps)
 # Note that you can not have hyphen `-` or underscore `_` in the application name.
 #
 
-# %%
 VESPA_APPLICATION_NAME = "colpalidemo"
 VESPA_SCHEMA_NAME = "pdf_page"
 
-# %% [markdown]
 # Next, you need to create some tokens for feeding data, and querying the application.
 # We recommend separate tokens for feeding and querying, (the former with write permission, and the latter with read permission).
 # The tokens can be created from the [Vespa Cloud console](https://console.vespa-cloud.com/) in the 'Account' -> 'Tokens' section.
 #
 
-# %%
 VESPA_TOKEN_ID_WRITE = "colpalidemo_write"
-VESPA_TOKEN_ID_READ = "colpalidemo_read"
 
-# %% [markdown]
 # We also need to set the value of the write token to be able to feed data to the Vespa application.
 #
 
-# %%
 VESPA_CLOUD_SECRET_TOKEN = os.getenv("VESPA_CLOUD_SECRET_TOKEN") or input(
     "Enter Vespa cloud secret token: "
 )
 
-# %% [markdown]
 # We will also use the Gemini API to create sample queries for our images.
 # You can also use other VLM's to create these queries.
 # Create a Gemini API key from [here](https://aistudio.google.com/app/apikey).
 #
 
-# %%
 GEMINI_API_KEY = os.getenv("GEMINI_API_KEY") or input(
     "Enter Google Generative AI API key: "
 )
 
-# %%
+# +
 MODEL_NAME = "vidore/colpali-v1.2"
 
 # Configure Google Generative AI
@@ -149,8 +137,8 @@ model = ColPali.from_pretrained(
 ).eval()
 
 processor = ColPaliProcessor.from_pretrained(MODEL_NAME)
+# -
 
-# %% [markdown]
 # ## 1. Download PDFs
 #
 # We are going to use public reports from the Norwegian Government Pension Fund Global (also known as the Oil Fund).
@@ -163,12 +151,11 @@ processor = ColPaliProcessor.from_pretrained(MODEL_NAME)
 # ![Sample2](./static/img/gfpg-sample-2.png)
 #
 
-# %% [markdown]
 # As we can see, a lot of the information is in the form of tables, charts and numbers.
 # These are not easily extractable using pdf-readers or OCR tools.
 #
 
-# %%
+# +
 import requests
 
 url = "https://www.nbim.no/en/publications/reports/"
@@ -194,14 +181,14 @@ for year_div in soup.find_all("div", id=lambda x: x and x.startswith("year-")):
         links.append(full_url)
         url_to_year[full_url] = year
 links, url_to_year
+# -
 
-# %%
 # Limit the number of PDFs to download
 NUM_PDFS = 2  # Set to None to download all PDFs
 links = links[:NUM_PDFS] if NUM_PDFS else links
 links
 
-# %%
+# +
 from nest_asyncio import apply
 from typing import List
 
@@ -272,16 +259,15 @@ async def download_pdfs(links: List[str]) -> List[dict]:
 os.makedirs("pdfs", exist_ok=True)
 # Now run the download_pdfs function with the URL
 pdfs = asyncio.run(download_pdfs(links))
+# -
 
-# %%
 pdfs
 
-# %% [markdown]
 # ## 2. Convert PDFs to Images
 #
 
 
-# %%
+# +
 def get_pdf_images(pdf_path):
     reader = PdfReader(pdf_path)
     page_texts = []
@@ -313,11 +299,11 @@ for pdf in tqdm(pdfs):
                 "page_no": page_no,
             }
         )
+# -
 
-# %%
 len(pdf_pages)
 
-# %%
+# +
 from collections import Counter
 
 # Print the length of the text fields - mean, max and min
@@ -327,8 +313,8 @@ print(f"Max text length: {np.max(text_lengths)}")
 print(f"Min text length: {np.min(text_lengths)}")
 print(f"Median text length: {np.median(text_lengths)}")
 print(f"Number of text with length == 0: {Counter(text_lengths)[0]}")
+# -
 
-# %% [markdown]
 # ## 3. Generate Queries
 #
 # In this step, we want to generate queries for each page image.
@@ -342,7 +328,7 @@ print(f"Number of text with length == 0: {Counter(text_lengths)[0]}")
 # We will use the Gemini API to generate these queries, with `gemini-1.5-flash-8b` as the model.
 #
 
-# %%
+# +
 from pydantic import BaseModel
 
 
@@ -394,7 +380,7 @@ Only return JSON. Don't return any extra explanation text. """
 
 prompt_text, pydantic_model = get_retrieval_prompt()
 
-# %%
+# +
 gemini_model = genai.GenerativeModel("gemini-1.5-flash-8b")
 
 
@@ -420,18 +406,17 @@ def generate_queries(image, prompt_text, pydantic_model):
     return queries
 
 
-# %%
+# -
+
 for pdf in tqdm(pdf_pages):
     image = pdf.get("image")
     pdf["queries"] = generate_queries(image, prompt_text, pydantic_model)
 
-# %%
 pdf_pages[46]["image"]
 
-# %%
 pdf_pages[46]["queries"]
 
-# %%
+# +
 # Generate queries async - keeping for now as we probably need when applying to the full dataset
 # import asyncio
 # from tenacity import retry, stop_after_attempt, wait_exponential
@@ -482,7 +467,7 @@ pdf_pages[46]["queries"]
 
 # pdf_pages = asyncio.run(enrich_pdfs())
 
-# %%
+# +
 # write title, url, page_no, text, queries, not image to JSON
 with open("output/pdf_pages.json", "w") as f:
     to_write = [{k: v for k, v in pdf.items() if k != "image"} for pdf in pdf_pages]
@@ -492,15 +477,14 @@ with open("output/pdf_pages.json", "w") as f:
 #     saved_pdf_pages = json.load(f)
 # for pdf, saved_pdf in zip(pdf_pages, saved_pdf_pages):
 #     pdf.update(saved_pdf)
+# -
 
-# %% [markdown]
 # ## 4. Generate embeddings
 #
 # Now that we have the queries, we can use the ColPali model to generate embeddings for each page image.
 #
 
 
-# %%
 def generate_embeddings(images, model, processor, batch_size=2) -> np.ndarray:
     """
     Generate embeddings for a list of images.
@@ -539,22 +523,18 @@ def generate_embeddings(images, model, processor, batch_size=2) -> np.ndarray:
     return all_embeddings
 
 
-# %%
 # Generate embeddings for all images
 images = [pdf["image"] for pdf in pdf_pages]
 embeddings = generate_embeddings(images, model, processor)
 
-# %%
 embeddings.shape
 
-# %% [markdown]
 # ## 5. Prepare Data on Vespa Format
 #
 # Now, that we have all the data we need, all that remains is to make sure it is in the right format for Vespa.
 #
 
 
-# %%
 def float_to_binary_embedding(float_query_embedding: dict) -> dict:
     """Utility function to convert float query embeddings to binary query embeddings."""
     binary_query_embeddings = {}
@@ -566,7 +546,6 @@ def float_to_binary_embedding(float_query_embedding: dict) -> dict:
     return binary_query_embeddings
 
 
-# %%
 vespa_feed = []
 for pdf, embedding in zip(pdf_pages, embeddings):
     url = pdf["url"]
@@ -604,7 +583,7 @@ for pdf, embedding in zip(pdf_pages, embeddings):
     }
     vespa_feed.append(page)
 
-# %%
+# +
 # We will prepare the Vespa feed data, including the embeddings and the generated queries
 
 
@@ -618,20 +597,19 @@ with open("output/vespa_feed.json", "w") as f:
         vespa_feed_to_save.append({"put": put_id, "fields": page["fields"]})
     json.dump(vespa_feed_to_save, f)
 
-# %%
+# +
 # import json
 
 # with open("output/vespa_feed.json", "r") as f:
 #     vespa_feed = json.load(f)
+# -
 
-# %%
 len(vespa_feed)
 
-# %% [markdown]
 # ## 5. Prepare Vespa Application
 #
 
-# %%
+# +
 # Define the Vespa schema
 colpali_schema = Schema(
     name=VESPA_SCHEMA_NAME,
@@ -678,32 +656,15 @@ colpali_schema = Schema(
             Field(
                 name="questions",
                 type="array<string>",
-                indexing=["summary", "index", "attribute"],
-                index="enable-bm25",
-                stemming="best",
+                indexing=["summary", "attribute"],
+                summary=Summary(fields=["matched-elements-only"]),
             ),
             Field(
                 name="queries",
                 type="array<string>",
-                indexing=["summary", "index", "attribute"],
-                index="enable-bm25",
-                stemming="best",
+                indexing=["summary", "attribute"],
+                summary=Summary(fields=["matched-elements-only"]),
             ),
-            # Add synthetic fields for the questions and queries
-            # Field(
-            #     name="questions_exact",
-            #     type="array<string>",
-            #     indexing=["input questions", "index", "attribute"],
-            #     match=["word"],
-            #     is_document_field=False,
-            # ),
-            # Field(
-            #     name="queries_exact",
-            #     type="array<string>",
-            #     indexing=["input queries", "index"],
-            #     match=["word"],
-            #     is_document_field=False,
-            # ),
         ]
     ),
     fieldsets=[
@@ -868,7 +829,7 @@ colpali_retrieval_profile = RankProfile(
 colpali_schema.add_rank_profile(colpali_retrieval_profile)
 colpali_schema.add_rank_profile(with_quantized_similarity(colpali_retrieval_profile))
 
-# %%
+# +
 from vespa.configuration.services import (
     services,
     container,
@@ -908,11 +869,6 @@ service_config = ServicesConfiguration(
                     id="token_write",
                     permissions="read,write",
                 ),
-                client(
-                    token(id=f"{VESPA_TOKEN_ID_READ}"),
-                    id="token_read",
-                    permissions="read",
-                ),
             ),
             config(
                 vt("tag")(
@@ -944,8 +900,8 @@ service_config = ServicesConfiguration(
         version="1.0",
     ),
 )
+# -
 
-# %%
 # Create the Vespa application package
 vespa_application_package = ApplicationPackage(
     name=VESPA_APPLICATION_NAME,
@@ -953,16 +909,14 @@ vespa_application_package = ApplicationPackage(
     services_config=service_config,
 )
 
-# %% [markdown]
 # ## 6. Deploy Vespa Application
 #
 
-# %%
 VESPA_TEAM_API_KEY = os.getenv("VESPA_TEAM_API_KEY") or input(
     "Enter Vespa team API key: "
 )
 
-# %%
+# +
 vespa_cloud = VespaCloud(
     tenant=VESPA_TENANT_NAME,
     application=VESPA_APPLICATION_NAME,
@@ -976,23 +930,21 @@ vespa_cloud.deploy()
 # Output the endpoint URL
 endpoint_url = vespa_cloud.get_token_endpoint()
 print(f"Application deployed. Token endpoint URL: {endpoint_url}")
+# -
 
-# %% [markdown]
 # Make sure to take note of the token endpoint_url.
 # You need to put this in your `.env` file - `VESPA_APP_URL=https://abcd.vespa-app.cloud` - to access the Vespa application from your web application.
 #
 
-# %% [markdown]
 # ## 8. Feed Data to Vespa
 #
 
-# %%
 # Instantiate Vespa connection using token
 app = Vespa(url=endpoint_url, vespa_cloud_secret_token=VESPA_CLOUD_SECRET_TOKEN)
 app.get_application_status()
 
 
-# %%
+# +
 def callback(response: VespaResponse, id: str):
     if not response.is_successful():
         print(

pyproject.toml

@@ -3,7 +3,7 @@ name = "visual-retrieval-colpali"
 version = "0.1.0"
 description = "Visual retrieval with ColPali"
 readme = "README.md"
-requires-python = ">=3.10"
+requires-python = ">=3.10, <3.13" 
 license = { text = "Apache-2.0" }
 dependencies = [
     "python-fasthtml",
@@ -37,4 +37,82 @@ feed = [
     "beautifulsoup4",
     "pdf2image",
     "google-generativeai"
-]
+]
+[tool.ruff]
+# Exclude a variety of commonly ignored directories.
+exclude = [
+    ".bzr",
+    ".direnv",
+    ".eggs",
+    ".git",
+    ".git-rewrite",
+    ".hg",
+    ".ipynb_checkpoints",
+    ".mypy_cache",
+    ".nox",
+    ".pants.d",
+    ".pyenv",
+    ".pytest_cache",
+    ".pytype",
+    ".ruff_cache",
+    ".svn",
+    ".tox",
+    ".venv",
+    ".vscode",
+    "__pypackages__",
+    "_build",
+    "buck-out",
+    "build",
+    "dist",
+    "node_modules",
+    "site-packages",
+    "venv",
+]
+
+# Same as Black.
+line-length = 88
+indent-width = 4
+
+# Assume Python 3.8
+target-version = "py38"
+
+[tool.ruff.lint]
+# Enable Pyflakes (`F`) and a subset of the pycodestyle (`E`)  codes by default.
+# Unlike Flake8, Ruff doesn't enable pycodestyle warnings (`W`) or
+# McCabe complexity (`C901`) by default.
+select = ["E4", "E7", "E9", "F"]
+ignore = []
+
+# Allow fix for all enabled rules (when `--fix`) is provided.
+fixable = ["ALL"]
+unfixable = []
+
+# Allow unused variables when underscore-prefixed.
+dummy-variable-rgx = "^(_+|(_+[a-zA-Z0-9_]*[a-zA-Z0-9]+?))$"
+
+[tool.ruff.format]
+# Like Black, use double quotes for strings.
+quote-style = "double"
+
+# Like Black, indent with spaces, rather than tabs.
+indent-style = "space"
+
+# Like Black, respect magic trailing commas.
+skip-magic-trailing-comma = false
+
+# Like Black, automatically detect the appropriate line ending.
+line-ending = "auto"
+
+# Enable auto-formatting of code examples in docstrings. Markdown,
+# reStructuredText code/literal blocks and doctests are all supported.
+#
+# This is currently disabled by default, but it is planned for this
+# to be opt-out in the future.
+docstring-code-format = false
+
+# Set the line length limit used when formatting code snippets in
+# docstrings.
+#
+# This only has an effect when the `docstring-code-format` setting is
+# enabled.
+docstring-code-line-length = "dynamic"

src/README.md

@@ -0,0 +1,19 @@
+---
+title: ColPali 🤝 Vespa - Visual Retrieval
+short_description: Visual Retrieval with ColPali and Vespa
+emoji: 👀
+colorFrom: purple
+colorTo: blue
+sdk: gradio
+sdk_version: 4.44.0
+app_file: main.py
+pinned: false
+license: apache-2.0
+suggested_hardware: t4-small
+models:
+  - vidore/colpaligemma-3b-pt-448-base
+  - vidore/colpali-v1.2
+preload_from_hub:
+  - vidore/colpaligemma-3b-pt-448-base config.json,model-00001-of-00002.safetensors,model-00002-of-00002.safetensors,model.safetensors.index.json,preprocessor_config.json,special_tokens_map.json,tokenizer.json,tokenizer_config.json 12c59eb7e23bc4c26876f7be7c17760d5d3a1ffa
+  - vidore/colpali-v1.2 adapter_config.json,adapter_model.safetensors,preprocessor_config.json,special_tokens_map.json,tokenizer.json,tokenizer_config.json 9912ce6f8a462d8cf2269f5606eabbd2784e764f
+---

src/backend/cache.py

@@ -0,0 +1,26 @@
+from collections import OrderedDict
+
+
+# Initialize LRU Cache
+class LRUCache:
+    def __init__(self, max_size=20):
+        self.max_size = max_size
+        self.cache = OrderedDict()
+
+    def get(self, key):
+        if key in self.cache:
+            self.cache.move_to_end(key)
+            return self.cache[key]
+        return None
+
+    def set(self, key, value):
+        if key in self.cache:
+            self.cache.move_to_end(key)
+        else:
+            if len(self.cache) >= self.max_size:
+                self.cache.popitem(last=False)
+        self.cache[key] = value
+
+    def delete(self, key):
+        if key in self.cache:
+            del self.cache[key]

src/backend/colpali.py

@@ -0,0 +1,281 @@
+import torch
+from PIL import Image
+import numpy as np
+from typing import Generator, Tuple, List, Union, Dict
+from pathlib import Path
+import base64
+from io import BytesIO
+import re
+import io
+import matplotlib.cm as cm
+
+from colpali_engine.models import ColPali, ColPaliProcessor
+from colpali_engine.utils.torch_utils import get_torch_device
+from vidore_benchmark.interpretability.torch_utils import (
+    normalize_similarity_map_per_query_token,
+)
+from functools import lru_cache
+import logging
+
+
+class SimMapGenerator:
+    """
+    Generates similarity maps based on query embeddings and image patches using the ColPali model.
+    """
+
+    colormap = cm.get_cmap("viridis")  # Preload colormap for efficiency
+
+    def __init__(
+        self,
+        logger: logging.Logger,
+        model_name: str = "vidore/colpali-v1.2",
+        n_patch: int = 32,
+    ):
+        """
+        Initializes the SimMapGenerator class with a specified model and patch dimension.
+
+        Args:
+            model_name (str): The model name for loading the ColPali model.
+            n_patch (int): The number of patches per dimension.
+        """
+        self.model_name = model_name
+        self.n_patch = n_patch
+        self.device = get_torch_device("auto")
+        self.logger = logger
+        self.logger.info(f"Using device: {self.device}")
+        self.model, self.processor = self.load_model()
+
+    def load_model(self) -> Tuple[ColPali, ColPaliProcessor]:
+        """
+        Loads the ColPali model and processor.
+
+        Returns:
+            Tuple[ColPali, ColPaliProcessor]: Loaded model and processor.
+        """
+        model = ColPali.from_pretrained(
+            self.model_name,
+            torch_dtype=torch.bfloat16,  # Note that the embeddings created during feed were float32 -> binarized, yet setting this seem to produce the most similar results both locally (mps) and HF (Cuda)
+            device_map=self.device,
+        ).eval()
+
+        processor = ColPaliProcessor.from_pretrained(self.model_name)
+        return model, processor
+
+    def gen_similarity_maps(
+        self,
+        query: str,
+        query_embs: torch.Tensor,
+        token_idx_map: Dict[int, str],
+        images: List[Union[Path, str]],
+        vespa_sim_maps: List[Dict],
+    ) -> Generator[Tuple[int, str, str], None, None]:
+        """
+        Generates similarity maps for the provided images and query, and returns base64-encoded blended images.
+
+        Args:
+            query (str): The query string.
+            query_embs (torch.Tensor): Query embeddings tensor.
+            token_idx_map (dict): Mapping from indices to tokens.
+            images (List[Union[Path, str]]): List of image paths or base64-encoded strings.
+            vespa_sim_maps (List[Dict]): List of Vespa similarity maps.
+
+        Yields:
+            Tuple[int, str, str]: A tuple containing the image index, selected token, and base64-encoded image.
+        """
+        processed_images, original_images, original_sizes = [], [], []
+        for img in images:
+            img_pil = self._load_image(img)
+            original_images.append(img_pil.copy())
+            original_sizes.append(img_pil.size)
+            processed_images.append(img_pil)
+
+        vespa_sim_map_tensor = self._prepare_similarity_map_tensor(
+            query_embs, vespa_sim_maps
+        )
+        similarity_map_normalized = normalize_similarity_map_per_query_token(
+            vespa_sim_map_tensor
+        )
+
+        for idx, img in enumerate(original_images):
+            for token_idx, token in token_idx_map.items():
+                if self.should_filter_token(token):
+                    continue
+
+                sim_map = similarity_map_normalized[idx, token_idx, :, :]
+                blended_img_base64 = self._blend_image(
+                    img, sim_map, original_sizes[idx]
+                )
+                yield idx, token, token_idx, blended_img_base64
+
+    def _load_image(self, img: Union[Path, str]) -> Image:
+        """
+        Loads an image from a file path or a base64-encoded string.
+
+        Args:
+            img (Union[Path, str]): The image to load.
+
+        Returns:
+            Image: The loaded PIL image.
+        """
+        try:
+            if isinstance(img, Path):
+                return Image.open(img).convert("RGB")
+            elif isinstance(img, str):
+                return Image.open(BytesIO(base64.b64decode(img))).convert("RGB")
+        except Exception as e:
+            raise ValueError(f"Failed to load image: {e}")
+
+    def _prepare_similarity_map_tensor(
+        self, query_embs: torch.Tensor, vespa_sim_maps: List[Dict]
+    ) -> torch.Tensor:
+        """
+        Prepares a similarity map tensor from Vespa similarity maps.
+
+        Args:
+            query_embs (torch.Tensor): Query embeddings tensor.
+            vespa_sim_maps (List[Dict]): List of Vespa similarity maps.
+
+        Returns:
+            torch.Tensor: The prepared similarity map tensor.
+        """
+        vespa_sim_map_tensor = torch.zeros(
+            (len(vespa_sim_maps), query_embs.size(1), self.n_patch, self.n_patch)
+        )
+        for idx, vespa_sim_map in enumerate(vespa_sim_maps):
+            for cell in vespa_sim_map["quantized"]["cells"]:
+                patch = int(cell["address"]["patch"])
+                query_token = int(cell["address"]["querytoken"])
+                value = cell["value"]
+                if hasattr(self.processor, "image_seq_length"):
+                    image_seq_length = self.processor.image_seq_length
+                else:
+                    image_seq_length = 1024
+
+                if patch >= image_seq_length:
+                    continue
+                vespa_sim_map_tensor[
+                    idx,
+                    query_token,
+                    patch // self.n_patch,
+                    patch % self.n_patch,
+                ] = value
+        return vespa_sim_map_tensor
+
+    def _blend_image(
+        self, img: Image, sim_map: torch.Tensor, original_size: Tuple[int, int]
+    ) -> str:
+        """
+        Blends an image with a similarity map and encodes it to base64.
+
+        Args:
+            img (Image): The original image.
+            sim_map (torch.Tensor): The similarity map tensor.
+            original_size (Tuple[int, int]): The original size of the image.
+
+        Returns:
+            str: The base64-encoded blended image.
+        """
+        SCALING_FACTOR = 8
+        sim_map_resolution = (
+            max(32, int(original_size[0] / SCALING_FACTOR)),
+            max(32, int(original_size[1] / SCALING_FACTOR)),
+        )
+
+        sim_map_np = sim_map.cpu().float().numpy()
+        sim_map_img = Image.fromarray(sim_map_np).resize(
+            sim_map_resolution, resample=Image.BICUBIC
+        )
+        sim_map_resized_np = np.array(sim_map_img, dtype=np.float32)
+        sim_map_normalized = self._normalize_sim_map(sim_map_resized_np)
+
+        heatmap = self.colormap(sim_map_normalized)
+        heatmap_img = Image.fromarray((heatmap * 255).astype(np.uint8)).convert("RGBA")
+
+        buffer = io.BytesIO()
+        heatmap_img.save(buffer, format="PNG")
+        return base64.b64encode(buffer.getvalue()).decode("utf-8")
+
+    @staticmethod
+    def _normalize_sim_map(sim_map: np.ndarray) -> np.ndarray:
+        """
+        Normalizes a similarity map to range [0, 1].
+
+        Args:
+            sim_map (np.ndarray): The similarity map.
+
+        Returns:
+            np.ndarray: The normalized similarity map.
+        """
+        sim_map_min, sim_map_max = sim_map.min(), sim_map.max()
+        if sim_map_max - sim_map_min > 1e-6:
+            return (sim_map - sim_map_min) / (sim_map_max - sim_map_min)
+        return np.zeros_like(sim_map)
+
+    @staticmethod
+    def should_filter_token(token: str) -> bool:
+        """
+        Determines if a token should be filtered out based on predefined patterns.
+
+        The function filters out tokens that:
+
+            - Start with '<' (e.g., '<bos>')
+            - Consist entirely of whitespace
+            - Are purely punctuation (excluding tokens that contain digits or start with '▁')
+            - Start with an underscore '_'
+            - Exactly match the word 'Question'
+            - Are exactly the single character '▁'
+
+        Output of test:
+            Token: '2'         | False
+            Token: '0'         | False
+            Token: '2'         | False
+            Token: '3'         | False
+            Token: '▁2'        | False
+            Token: '▁hi'       | False
+            Token: 'norwegian' | False
+            Token: 'unlisted'  | False
+            Token: '<bos>'     | True
+            Token: 'Question'  | True
+            Token: ':'         | True
+            Token: '<pad>'     | True
+            Token: '\n'        | True
+            Token: '▁'         | True
+            Token: '?'         | True
+            Token: ')'         | True
+            Token: '%'         | True
+            Token: '/)'        | True
+
+
+        Args:
+            token (str): The token to check.
+
+        Returns:
+            bool: True if the token should be filtered out, False otherwise.
+        """
+        pattern = re.compile(
+            r"^<.*$|^\s+$|^(?!.*\d)(?!▁)[^\w\s]+$|^_.*$|^Question$|^▁$"
+        )
+        return bool(pattern.match(token))
+
+    @lru_cache(maxsize=128)
+    def get_query_embeddings_and_token_map(
+        self, query: str
+    ) -> Tuple[torch.Tensor, dict]:
+        """
+        Retrieves query embeddings and a token index map.
+
+        Args:
+            query (str): The query string.
+
+        Returns:
+            Tuple[torch.Tensor, dict]: Query embeddings and token index map.
+        """
+        inputs = self.processor.process_queries([query]).to(self.model.device)
+        with torch.no_grad():
+            q_emb = self.model(**inputs).to("cpu")[0]
+
+        query_tokens = self.processor.tokenizer.tokenize(
+            self.processor.decode(inputs.input_ids[0])
+        )
+        idx_to_token = {idx: token for idx, token in enumerate(query_tokens)}
+        return q_emb, idx_to_token

src/backend/stopwords.py

@@ -0,0 +1,18 @@
+import spacy
+import os
+
+# Download the model if it is not already present
+if not spacy.util.is_package("en_core_web_sm"):
+    spacy.cli.download("en_core_web_sm")
+nlp = spacy.load("en_core_web_sm")
+
+
+# It would be possible to remove bolding for stopwords without removing them from the query,
+# but that would require a java plugin which we didn't want to complicate this sample app with.
+def filter(text):
+    doc = nlp(text)
+    tokens = [token.text for token in doc if not token.is_stop]
+    if len(tokens) == 0:
+        # if we remove all the words we don't have a query at all, so use the original
+        return text
+    return " ".join(tokens)

src/backend/testquery.py

@@ -0,0 +1,3013 @@
+import torch
+
+token_to_idx = {
+    "<bos>": 0,
+    "Question": 1,
+    ":": 2,
+    "▁Percentage": 3,
+    "▁of": 4,
+    "▁non": 5,
+    "-": 6,
+    "fresh": 7,
+    "▁water": 8,
+    "▁as": 9,
+    "▁source": 10,
+    "?": 11,
+    "<pad>": 21,
+    "\n": 22,
+}
+idx_to_token = {v: k for k, v in token_to_idx.items()}
+q_embs = torch.tensor(
+    [
+        [
+            1.6547e-01,
+            -1.8838e-02,
+            1.0150e-01,
+            -2.2643e-02,
+            5.0652e-02,
+            3.2039e-02,
+            6.8322e-02,
+            2.7134e-02,
+            7.2197e-03,
+            -4.2341e-02,
+            -5.8006e-02,
+            -1.1389e-01,
+            7.0041e-02,
+            -6.8021e-02,
+            2.4681e-02,
+            5.3306e-02,
+            4.1714e-02,
+            6.2021e-02,
+            1.3488e-01,
+            3.4943e-02,
+            3.8032e-02,
+            -3.2724e-02,
+            -1.2960e-01,
+            1.1453e-02,
+            -2.6477e-02,
+            3.5219e-02,
+            -7.6606e-02,
+            2.2387e-01,
+            -3.4888e-02,
+            -4.0333e-02,
+            1.4128e-01,
+            4.2248e-02,
+            -1.2664e-01,
+            -7.8376e-02,
+            -2.0356e-02,
+            4.2198e-02,
+            -7.0776e-02,
+            1.3965e-02,
+            4.2442e-03,
+            7.1987e-02,
+            8.5172e-04,
+            -6.4878e-02,
+            -1.8954e-01,
+            -8.6171e-02,
+            9.1983e-02,
+            -9.3358e-02,
+            2.2704e-01,
+            1.3102e-02,
+            6.5327e-02,
+            2.4815e-02,
+            -1.4533e-01,
+            5.8823e-02,
+            -6.1434e-02,
+            5.2004e-02,
+            -8.4065e-02,
+            1.6298e-01,
+            8.1965e-02,
+            2.6553e-02,
+            -1.2377e-01,
+            -5.3495e-02,
+            -3.4537e-02,
+            5.1438e-02,
+            8.2665e-03,
+            7.9407e-02,
+            5.8799e-02,
+            -3.5538e-02,
+            1.9870e-01,
+            6.2459e-02,
+            1.6154e-01,
+            7.2921e-02,
+            -9.7275e-02,
+            3.0933e-02,
+            -1.0579e-02,
+            -1.4484e-01,
+            -4.8761e-02,
+            -5.3119e-02,
+            6.2644e-02,
+            2.2985e-02,
+            -2.1209e-01,
+            9.0963e-02,
+            -2.6955e-02,
+            -7.7520e-02,
+            1.2072e-01,
+            -1.9626e-02,
+            5.8813e-02,
+            -1.2730e-01,
+            1.5610e-01,
+            -1.6914e-01,
+            6.5033e-02,
+            8.5765e-02,
+            1.2701e-01,
+            6.5633e-02,
+            -1.0309e-01,
+            -8.0259e-02,
+            4.5913e-02,
+            -3.3277e-02,
+            1.9227e-01,
+            -2.3351e-02,
+            -8.0545e-02,
+            -9.8760e-03,
+            -4.1836e-02,
+            1.2041e-01,
+            8.1419e-02,
+            1.4848e-01,
+            7.2537e-02,
+            -4.7115e-03,
+            4.1489e-02,
+            4.3031e-02,
+            -1.3515e-01,
+            1.0383e-01,
+            -9.4411e-02,
+            2.8965e-02,
+            1.9185e-01,
+            -1.4600e-02,
+            -8.0910e-02,
+            -2.9022e-02,
+            -4.4347e-02,
+            -8.8980e-03,
+            2.8737e-03,
+            4.2124e-02,
+            -1.6609e-02,
+            4.2994e-02,
+            -7.2814e-02,
+            -2.9573e-02,
+            -1.2666e-01,
+            -4.3703e-02,
+            -7.2094e-02,
+            -2.7486e-02,
+        ],
+        [
+            -9.8454e-02,
+            -1.2954e-01,
+            6.5702e-02,
+            -9.0006e-03,
+            -1.0934e-01,
+            3.2155e-02,
+            -1.1444e-01,
+            -1.0309e-01,
+            5.7024e-02,
+            1.0124e-01,
+            2.0721e-02,
+            -5.2608e-03,
+            6.9916e-02,
+            1.8036e-02,
+            3.1653e-02,
+            2.1923e-02,
+            -9.2523e-02,
+            -1.8215e-02,
+            1.2974e-01,
+            -2.9632e-02,
+            -1.3854e-01,
+            2.5710e-02,
+            -1.1727e-03,
+            1.0245e-01,
+            -2.0731e-01,
+            4.3669e-02,
+            -7.0196e-02,
+            -1.6697e-01,
+            6.6050e-02,
+            9.9776e-02,
+            -1.2227e-01,
+            9.4000e-02,
+            1.1945e-01,
+            2.4611e-02,
+            -1.4073e-01,
+            9.3476e-02,
+            2.1170e-01,
+            -7.4522e-02,
+            -5.3362e-02,
+            -4.1198e-03,
+            8.3880e-02,
+            2.6590e-02,
+            -4.8489e-02,
+            -3.1279e-02,
+            -9.3401e-03,
+            -1.5945e-01,
+            -6.6368e-02,
+            7.5715e-02,
+            5.6884e-02,
+            1.2861e-01,
+            1.0073e-02,
+            -1.7185e-02,
+            1.1545e-01,
+            2.8725e-02,
+            -9.4969e-02,
+            -4.5517e-02,
+            3.1253e-02,
+            2.1135e-02,
+            -1.4505e-02,
+            9.0893e-02,
+            -6.2680e-02,
+            -7.2855e-02,
+            -1.1275e-01,
+            -1.8433e-01,
+            1.4693e-01,
+            4.0366e-02,
+            6.6879e-02,
+            -8.5653e-03,
+            1.0663e-01,
+            -1.2342e-01,
+            2.5350e-01,
+            -3.2227e-02,
+            9.9404e-02,
+            3.7340e-02,
+            4.5462e-04,
+            -2.3015e-01,
+            4.9006e-02,
+            1.0079e-01,
+            -4.7179e-02,
+            6.7642e-02,
+            -1.0833e-01,
+            1.0030e-01,
+            1.2838e-01,
+            -9.2911e-03,
+            1.2342e-01,
+            -4.8455e-02,
+            5.3904e-03,
+            4.5178e-02,
+            3.8961e-02,
+            1.3383e-01,
+            -1.2236e-02,
+            8.2026e-03,
+            4.3735e-03,
+            -7.1725e-02,
+            6.4360e-02,
+            1.0004e-01,
+            6.6840e-02,
+            6.5649e-02,
+            -1.3978e-02,
+            1.2810e-01,
+            4.4325e-03,
+            1.1136e-01,
+            -1.7329e-01,
+            -3.4472e-02,
+            -1.4066e-01,
+            1.5641e-02,
+            -3.3600e-02,
+            -7.6192e-02,
+            5.3085e-02,
+            -7.2859e-03,
+            2.8798e-02,
+            -3.3748e-02,
+            -7.7591e-02,
+            -4.0927e-02,
+            -3.6577e-02,
+            1.4012e-02,
+            -8.1780e-02,
+            -4.6315e-03,
+            -1.6508e-02,
+            -2.4506e-02,
+            1.5122e-01,
+            7.8270e-02,
+            8.6502e-02,
+            -2.4651e-02,
+            -1.0286e-01,
+            -1.2171e-02,
+            -7.9000e-02,
+            1.1161e-01,
+        ],
+        [
+            6.4320e-02,
+            -2.6815e-02,
+            1.2390e-01,
+            8.6642e-02,
+            5.3320e-02,
+            9.1074e-02,
+            -8.9753e-02,
+            1.6141e-02,
+            -5.0281e-02,
+            1.0177e-01,
+            4.5343e-02,
+            9.1281e-02,
+            -8.2592e-03,
+            -1.4100e-02,
+            -4.7048e-02,
+            -8.6034e-02,
+            -1.1608e-01,
+            -8.4754e-02,
+            1.0302e-01,
+            -1.2210e-02,
+            8.5147e-02,
+            1.3103e-01,
+            -3.3592e-03,
+            -1.4328e-02,
+            -4.6128e-03,
+            2.1401e-02,
+            -1.7464e-01,
+            -3.9111e-02,
+            2.0886e-02,
+            8.9284e-02,
+            1.3262e-01,
+            7.0918e-02,
+            -1.3693e-02,
+            -9.7673e-02,
+            -5.3411e-02,
+            -6.7563e-02,
+            2.3017e-02,
+            -3.4614e-02,
+            3.6464e-02,
+            -4.6408e-02,
+            1.4866e-01,
+            -2.1191e-01,
+            -6.4368e-02,
+            -3.0555e-02,
+            7.2177e-02,
+            2.4685e-02,
+            8.6115e-02,
+            -5.8688e-02,
+            -2.8230e-03,
+            1.1166e-01,
+            1.8380e-01,
+            3.6462e-02,
+            -1.4943e-02,
+            -1.4276e-01,
+            1.0795e-01,
+            1.9204e-02,
+            -6.5320e-02,
+            1.0561e-01,
+            -1.3642e-01,
+            -4.3444e-02,
+            -6.4725e-02,
+            -1.3094e-01,
+            1.9447e-02,
+            -1.3199e-01,
+            8.7880e-02,
+            5.8078e-02,
+            -2.5612e-02,
+            7.7620e-02,
+            -2.5044e-02,
+            1.0772e-02,
+            6.5417e-02,
+            8.2137e-02,
+            -2.8482e-02,
+            5.5003e-02,
+            -1.1163e-01,
+            1.7200e-03,
+            -1.0106e-01,
+            -1.8413e-02,
+            1.2838e-01,
+            -1.2991e-01,
+            -1.8546e-02,
+            1.0517e-01,
+            1.0279e-01,
+            -8.1887e-02,
+            1.0885e-01,
+            -1.0635e-01,
+            1.2035e-01,
+            1.1769e-01,
+            -2.8768e-02,
+            -3.3413e-02,
+            1.3779e-01,
+            1.4403e-02,
+            2.3429e-02,
+            -1.2761e-01,
+            7.2160e-02,
+            -1.0512e-01,
+            -1.7202e-02,
+            5.3549e-02,
+            5.5205e-02,
+            9.2863e-02,
+            -2.3728e-02,
+            -5.1368e-02,
+            -3.7719e-02,
+            -4.7308e-02,
+            -2.2489e-02,
+            4.5195e-02,
+            1.0398e-01,
+            -2.2197e-02,
+            -1.7208e-01,
+            7.4649e-02,
+            -7.7925e-02,
+            -6.4237e-02,
+            2.8195e-02,
+            2.2692e-01,
+            -9.7749e-02,
+            2.4283e-01,
+            -4.0124e-02,
+            1.8797e-02,
+            -6.1516e-02,
+            6.5331e-03,
+            1.3717e-01,
+            9.9761e-02,
+            5.4705e-02,
+            3.5325e-02,
+            1.9071e-01,
+            -6.1137e-02,
+            1.6656e-01,
+            3.4067e-02,
+        ],
+        [
+            1.0896e-01,
+            -9.4366e-03,
+            1.2956e-01,
+            7.8127e-02,
+            5.5422e-02,
+            3.9155e-02,
+            -5.8379e-03,
+            -4.4257e-02,
+            -7.5182e-02,
+            1.0452e-01,
+            4.4595e-02,
+            2.0972e-02,
+            1.1071e-01,
+            7.4710e-02,
+            -7.5500e-02,
+            -5.3393e-02,
+            -1.5478e-02,
+            -5.4455e-03,
+            5.6779e-02,
+            -6.3919e-02,
+            5.1792e-02,
+            1.2070e-01,
+            -5.3707e-02,
+            4.5715e-02,
+            -9.3062e-02,
+            3.0224e-02,
+            -1.5892e-01,
+            -2.1702e-02,
+            1.7942e-03,
+            1.4574e-01,
+            2.0721e-01,
+            -2.8224e-02,
+            -5.8104e-02,
+            -1.1645e-01,
+            -1.1515e-01,
+            -1.5202e-01,
+            -3.9751e-02,
+            6.0342e-02,
+            7.8182e-02,
+            -2.1132e-02,
+            9.6468e-02,
+            -5.3148e-02,
+            -3.0343e-02,
+            7.9363e-02,
+            1.0752e-01,
+            3.1086e-02,
+            1.9322e-02,
+            -1.1134e-01,
+            1.6342e-02,
+            3.0358e-02,
+            1.8543e-01,
+            5.5353e-02,
+            -8.6656e-02,
+            -1.5650e-01,
+            1.2087e-01,
+            -3.7852e-02,
+            -6.9116e-02,
+            5.9981e-03,
+            1.9205e-02,
+            -1.0314e-01,
+            -6.8082e-02,
+            -1.3078e-01,
+            3.8448e-02,
+            -9.2233e-02,
+            1.0965e-01,
+            6.6332e-02,
+            -2.5805e-02,
+            1.2299e-01,
+            2.8629e-02,
+            -4.4949e-02,
+            4.5560e-02,
+            1.0507e-01,
+            -1.0271e-01,
+            1.6237e-02,
+            -1.4555e-01,
+            -4.5335e-02,
+            -1.3477e-01,
+            1.0230e-02,
+            1.2380e-01,
+            -1.0681e-01,
+            1.4412e-02,
+            1.2396e-01,
+            8.5290e-02,
+            -2.5138e-02,
+            1.0191e-01,
+            -1.3413e-01,
+            8.5871e-02,
+            1.3389e-01,
+            -3.6357e-02,
+            -3.9740e-02,
+            2.1128e-01,
+            1.0263e-02,
+            2.5547e-02,
+            -7.0139e-02,
+            1.0178e-01,
+            -1.2729e-01,
+            -1.0717e-01,
+            -4.9394e-02,
+            7.7645e-02,
+            7.4589e-02,
+            -8.2835e-02,
+            -4.2227e-02,
+            -3.6417e-02,
+            -2.2900e-02,
+            -2.1010e-02,
+            2.7898e-02,
+            2.7314e-02,
+            2.2172e-02,
+            -7.1122e-02,
+            5.1570e-02,
+            2.1860e-02,
+            -3.5103e-03,
+            -5.4524e-02,
+            1.7485e-01,
+            -8.3810e-02,
+            2.3868e-01,
+            5.9468e-02,
+            -2.6706e-02,
+            -2.6617e-02,
+            3.3851e-02,
+            6.3651e-02,
+            1.0611e-01,
+            9.6252e-02,
+            -6.8701e-02,
+            1.8108e-01,
+            -1.0178e-01,
+            1.6935e-01,
+            5.9301e-02,
+        ],
+        [
+            1.3364e-01,
+            6.6797e-02,
+            1.0182e-01,
+            6.1569e-02,
+            -1.4169e-04,
+            1.1567e-01,
+            -3.1255e-03,
+            -8.9336e-02,
+            5.3206e-03,
+            1.7179e-01,
+            1.3974e-01,
+            -6.5797e-02,
+            1.2566e-01,
+            6.1290e-02,
+            -1.3671e-01,
+            -1.1113e-01,
+            1.6596e-01,
+            6.2694e-02,
+            -1.6573e-02,
+            -1.8648e-02,
+            2.1086e-02,
+            9.6320e-03,
+            -1.0017e-01,
+            2.3561e-02,
+            -6.2797e-02,
+            2.1202e-02,
+            -1.3333e-01,
+            1.4728e-01,
+            1.9824e-03,
+            1.6832e-01,
+            1.7138e-01,
+            4.6578e-02,
+            -1.2989e-01,
+            3.2167e-02,
+            -7.7753e-02,
+            -1.1548e-01,
+            4.3367e-02,
+            -4.5640e-02,
+            4.3583e-02,
+            -8.9393e-03,
+            5.3231e-02,
+            -4.8284e-02,
+            3.1841e-04,
+            6.6374e-02,
+            7.7363e-02,
+            4.0000e-02,
+            1.5414e-02,
+            -9.6156e-02,
+            1.1389e-01,
+            7.1118e-02,
+            3.0042e-02,
+            5.9752e-02,
+            -6.4565e-02,
+            -1.2914e-01,
+            1.1048e-01,
+            1.2409e-02,
+            -9.9385e-02,
+            1.8671e-02,
+            2.1383e-02,
+            3.7012e-03,
+            -1.1497e-01,
+            -6.8653e-02,
+            3.0582e-02,
+            -1.1567e-01,
+            1.4165e-01,
+            3.7493e-02,
+            -6.0779e-02,
+            1.0989e-01,
+            8.6001e-02,
+            -5.6139e-02,
+            2.0710e-02,
+            9.8577e-02,
+            -9.9427e-02,
+            5.8372e-02,
+            -1.3443e-01,
+            -1.3021e-02,
+            -1.3802e-01,
+            7.6053e-02,
+            1.2181e-01,
+            -8.7719e-02,
+            1.0967e-02,
+            1.3160e-01,
+            4.7032e-02,
+            -6.3351e-02,
+            7.1883e-02,
+            -9.7565e-02,
+            1.4424e-01,
+            1.2353e-01,
+            -6.1527e-02,
+            2.4263e-02,
+            2.9356e-01,
+            6.2813e-02,
+            -4.5265e-03,
+            -1.0213e-01,
+            1.4227e-02,
+            -7.9267e-02,
+            -1.0845e-01,
+            -2.0014e-02,
+            2.8542e-02,
+            9.7207e-02,
+            -2.5234e-02,
+            -7.3668e-02,
+            -3.0084e-02,
+            -1.2958e-02,
+            -3.9597e-02,
+            -7.2243e-02,
+            5.3054e-02,
+            3.1470e-03,
+            -1.9800e-02,
+            1.3476e-01,
+            -1.6873e-02,
+            5.2286e-02,
+            2.0254e-02,
+            1.0554e-01,
+            -3.0395e-02,
+            8.6349e-02,
+            7.6580e-02,
+            -3.0139e-02,
+            -4.8131e-02,
+            -4.5770e-02,
+            1.5154e-01,
+            1.1276e-01,
+            5.7244e-02,
+            8.0574e-02,
+            1.5610e-01,
+            -1.5523e-01,
+            1.0428e-01,
+            5.7947e-02,
+        ],
+        [
+            7.0440e-02,
+            1.4300e-01,
+            6.0559e-02,
+            1.9177e-02,
+            -9.0313e-02,
+            1.7104e-01,
+            -5.1137e-02,
+            -1.0229e-01,
+            -2.8831e-02,
+            1.5385e-01,
+            -8.4017e-03,
+            -4.9185e-03,
+            1.0820e-01,
+            1.0022e-01,
+            -1.9284e-01,
+            -2.7293e-02,
+            4.9526e-02,
+            5.5152e-02,
+            -6.7003e-02,
+            -7.0313e-03,
+            -3.3208e-02,
+            1.3815e-02,
+            -6.0694e-02,
+            6.2041e-02,
+            -3.2288e-02,
+            1.1629e-01,
+            -7.5270e-02,
+            2.1824e-01,
+            -2.5215e-03,
+            1.8179e-01,
+            1.5514e-01,
+            1.0494e-01,
+            -1.2390e-01,
+            -1.2241e-03,
+            6.1079e-04,
+            -5.8730e-02,
+            6.1313e-02,
+            -7.8853e-02,
+            6.0292e-02,
+            -9.1497e-04,
+            7.9087e-02,
+            -1.8246e-02,
+            5.0215e-03,
+            3.5083e-02,
+            5.9616e-02,
+            5.9520e-02,
+            6.0224e-02,
+            -1.3079e-01,
+            1.6500e-01,
+            4.4308e-03,
+            4.2712e-02,
+            5.5916e-02,
+            -5.4616e-02,
+            -8.5617e-02,
+            1.1235e-01,
+            6.5911e-03,
+            -6.1463e-02,
+            3.7832e-02,
+            3.4189e-02,
+            -1.1295e-02,
+            -8.0972e-02,
+            -1.0051e-02,
+            -2.6856e-02,
+            -7.9570e-02,
+            1.2776e-01,
+            6.5826e-02,
+            -3.1759e-02,
+            9.6016e-02,
+            6.7249e-02,
+            -4.5115e-02,
+            6.3695e-03,
+            1.2092e-01,
+            -1.3821e-01,
+            -9.7066e-02,
+            -1.5063e-02,
+            2.4618e-02,
+            -1.9589e-01,
+            5.8625e-02,
+            1.7886e-01,
+            -6.3740e-02,
+            -1.7241e-02,
+            7.3394e-02,
+            5.8903e-02,
+            -1.6557e-02,
+            -1.9226e-02,
+            -1.0912e-01,
+            8.7902e-02,
+            6.4426e-02,
+            4.8019e-02,
+            8.1223e-02,
+            2.9888e-01,
+            8.7458e-02,
+            4.4167e-02,
+            -1.3228e-01,
+            5.9629e-02,
+            -1.0696e-01,
+            -1.4102e-01,
+            -5.2509e-02,
+            -1.9981e-02,
+            1.6788e-01,
+            9.7499e-02,
+            -5.4125e-02,
+            -8.2383e-02,
+            -6.3908e-02,
+            -6.8830e-02,
+            -1.2622e-01,
+            3.1651e-02,
+            4.4592e-02,
+            -1.3325e-02,
+            1.1260e-01,
+            -3.9567e-02,
+            6.9631e-03,
+            1.4943e-01,
+            8.6930e-02,
+            -3.6171e-03,
+            -5.6886e-02,
+            -8.3102e-03,
+            -2.6001e-02,
+            -1.5187e-02,
+            -1.8835e-02,
+            2.3583e-02,
+            9.5520e-02,
+            -3.4944e-02,
+            4.5537e-02,
+            6.1444e-02,
+            -1.7165e-01,
+            1.0230e-01,
+            2.0319e-02,
+        ],
+        [
+            7.7065e-02,
+            1.4466e-01,
+            1.0796e-01,
+            9.7362e-03,
+            -9.3062e-02,
+            2.0065e-01,
+            -9.3982e-03,
+            -1.2871e-01,
+            -4.6724e-02,
+            1.6573e-01,
+            -1.7444e-02,
+            -3.1211e-02,
+            9.7404e-02,
+            9.6222e-02,
+            -1.4772e-01,
+            -5.6838e-02,
+            9.6276e-02,
+            7.7819e-02,
+            -1.1884e-01,
+            -4.5898e-02,
+            -7.3665e-02,
+            2.1005e-02,
+            -2.8032e-02,
+            7.0900e-02,
+            -7.7625e-02,
+            7.0269e-02,
+            -7.0747e-02,
+            2.5605e-01,
+            1.9427e-04,
+            1.4614e-01,
+            1.6723e-01,
+            1.0016e-01,
+            -7.8961e-02,
+            1.3307e-02,
+            -1.1207e-02,
+            -7.1492e-02,
+            7.5561e-02,
+            -1.3290e-02,
+            4.4527e-02,
+            -2.4224e-02,
+            8.7846e-02,
+            4.7492e-02,
+            -7.0398e-02,
+            -2.6663e-02,
+            4.9730e-02,
+            6.6743e-02,
+            3.1060e-02,
+            -7.8352e-02,
+            1.0100e-01,
+            6.4963e-02,
+            1.6746e-02,
+            3.0324e-02,
+            -2.6583e-02,
+            -7.8028e-02,
+            7.0180e-02,
+            3.8924e-02,
+            -8.5861e-02,
+            -3.3792e-02,
+            6.1542e-02,
+            1.6180e-02,
+            -7.7865e-02,
+            3.9551e-02,
+            2.9772e-02,
+            -7.0824e-02,
+            1.5235e-01,
+            4.8718e-02,
+            1.5973e-03,
+            8.7719e-02,
+            7.7414e-02,
+            -6.4385e-02,
+            -6.4330e-02,
+            1.3965e-01,
+            -1.6355e-01,
+            -6.5261e-02,
+            -6.2693e-02,
+            4.9435e-02,
+            -1.5245e-01,
+            6.6557e-02,
+            1.5213e-01,
+            -8.2073e-02,
+            1.4664e-02,
+            8.4507e-02,
+            3.0684e-02,
+            -8.7932e-02,
+            1.9927e-02,
+            -7.1788e-02,
+            9.4965e-02,
+            3.9220e-02,
+            4.5944e-02,
+            8.7249e-02,
+            3.3315e-01,
+            5.9872e-02,
+            2.6362e-02,
+            -1.7888e-01,
+            -1.6042e-02,
+            -9.4593e-02,
+            -1.7915e-01,
+            -2.9888e-02,
+            -4.3776e-02,
+            1.1388e-01,
+            2.3778e-02,
+            -4.0233e-02,
+            -4.7893e-02,
+            -4.4371e-02,
+            -2.7491e-02,
+            -9.6716e-02,
+            -2.0120e-02,
+            5.6864e-02,
+            1.8953e-02,
+            1.2741e-01,
+            -5.3045e-02,
+            3.2240e-02,
+            1.4479e-01,
+            9.5315e-02,
+            -2.7717e-02,
+            -5.7349e-02,
+            3.3824e-03,
+            -3.5642e-02,
+            -1.6905e-02,
+            -4.5765e-02,
+            1.1481e-02,
+            4.2545e-02,
+            1.2632e-02,
+            4.5401e-02,
+            7.7769e-02,
+            -1.7107e-01,
+            7.7265e-02,
+            1.3922e-02,
+        ],
+        [
+            -2.5666e-02,
+            9.8268e-02,
+            2.1571e-01,
+            6.8094e-02,
+            -1.0440e-01,
+            1.4299e-01,
+            6.5751e-02,
+            -5.0693e-02,
+            -5.3796e-02,
+            1.5239e-01,
+            2.9566e-02,
+            -7.9492e-02,
+            9.3274e-02,
+            7.6112e-02,
+            -1.8187e-02,
+            -1.1190e-01,
+            9.7962e-02,
+            -2.8204e-02,
+            -8.1216e-02,
+            -5.5618e-02,
+            -6.2378e-02,
+            4.4238e-02,
+            -1.6572e-02,
+            -3.4035e-02,
+            -8.8068e-02,
+            1.4164e-02,
+            -2.6908e-02,
+            1.9650e-01,
+            6.8845e-03,
+            8.7550e-02,
+            1.7410e-01,
+            1.0088e-01,
+            -1.1340e-02,
+            3.2057e-04,
+            -5.5130e-02,
+            -2.5234e-02,
+            8.2460e-02,
+            -6.0768e-02,
+            1.2448e-01,
+            6.8736e-02,
+            4.6176e-02,
+            1.0866e-01,
+            4.9560e-02,
+            -5.8322e-02,
+            4.4106e-02,
+            2.0739e-02,
+            -9.0032e-02,
+            -5.8815e-02,
+            7.8127e-03,
+            1.7999e-01,
+            1.2519e-01,
+            7.1377e-02,
+            9.3219e-02,
+            -1.3311e-01,
+            6.0305e-02,
+            5.9400e-02,
+            -1.6119e-01,
+            5.4173e-02,
+            -5.8663e-02,
+            -4.8149e-02,
+            1.6295e-02,
+            -6.9787e-02,
+            5.7512e-03,
+            -8.9745e-03,
+            1.3492e-01,
+            3.0659e-02,
+            -6.8611e-02,
+            2.1200e-02,
+            8.5522e-02,
+            -4.3482e-02,
+            -8.4601e-02,
+            1.4191e-01,
+            -1.5514e-01,
+            -5.8989e-03,
+            -4.5591e-02,
+            6.4905e-02,
+            -1.3198e-01,
+            1.3764e-01,
+            9.5549e-02,
+            -9.4689e-02,
+            -1.9705e-02,
+            2.1147e-01,
+            -9.8519e-03,
+            -7.7839e-02,
+            6.1447e-02,
+            -6.4708e-02,
+            3.1579e-03,
+            7.6588e-02,
+            -1.2452e-01,
+            -6.1076e-02,
+            2.5150e-01,
+            2.3101e-02,
+            -1.3632e-02,
+            -8.5695e-02,
+            -8.5841e-02,
+            -1.3152e-01,
+            -1.5294e-01,
+            -4.4509e-03,
+            8.6619e-02,
+            -1.0974e-02,
+            -3.9592e-02,
+            -3.0472e-02,
+            -1.4011e-01,
+            8.6485e-03,
+            -1.3633e-02,
+            -1.7940e-02,
+            3.3016e-02,
+            -5.7245e-02,
+            1.0200e-01,
+            1.2807e-01,
+            1.5249e-02,
+            -1.2197e-02,
+            -1.6867e-02,
+            3.4516e-02,
+            -9.0908e-02,
+            -2.6167e-02,
+            2.2975e-01,
+            4.2693e-02,
+            2.5415e-03,
+            7.1921e-03,
+            1.2855e-01,
+            5.5747e-03,
+            -2.7843e-02,
+            2.4283e-02,
+            -1.3484e-02,
+            -1.5948e-01,
+            2.1127e-02,
+            3.8017e-02,
+        ],
+        [
+            5.8410e-02,
+            3.7501e-02,
+            1.7189e-01,
+            4.5894e-02,
+            -6.7739e-02,
+            1.1421e-01,
+            4.6982e-02,
+            -1.2963e-01,
+            -4.2804e-02,
+            1.2137e-01,
+            1.0761e-01,
+            -7.2615e-02,
+            1.1811e-01,
+            1.1291e-01,
+            -1.6041e-01,
+            -6.6820e-02,
+            1.9071e-01,
+            -3.6201e-02,
+            -1.0659e-01,
+            -3.3226e-02,
+            -2.6535e-02,
+            7.8536e-02,
+            -3.2975e-02,
+            1.3015e-02,
+            -1.0903e-01,
+            -1.2502e-02,
+            -7.0142e-02,
+            1.6872e-01,
+            -3.7569e-02,
+            2.2090e-01,
+            1.5620e-01,
+            9.5620e-02,
+            -7.9306e-02,
+            7.8558e-02,
+            -6.6709e-02,
+            -6.6446e-02,
+            3.1198e-02,
+            -4.8808e-02,
+            6.7798e-02,
+            -4.9524e-02,
+            1.2496e-01,
+            3.1661e-02,
+            4.0690e-02,
+            -1.1341e-02,
+            2.9852e-03,
+            3.6166e-02,
+            -1.1723e-01,
+            -8.2746e-02,
+            1.2874e-01,
+            1.0894e-01,
+            7.6219e-02,
+            5.5564e-02,
+            4.3571e-02,
+            -1.4745e-01,
+            5.1090e-02,
+            -6.8233e-04,
+            -1.7107e-01,
+            -2.5612e-02,
+            1.9185e-02,
+            3.4466e-03,
+            -2.5362e-02,
+            -3.4807e-02,
+            8.1003e-02,
+            -2.1582e-02,
+            1.1581e-01,
+            -5.5891e-04,
+            4.2455e-02,
+            6.3277e-02,
+            7.9868e-02,
+            -2.0369e-02,
+            -7.6229e-02,
+            1.2525e-01,
+            -1.4795e-01,
+            5.8798e-03,
+            -2.8584e-02,
+            -3.2508e-04,
+            -5.5666e-02,
+            7.1217e-02,
+            1.3122e-01,
+            -1.8671e-02,
+            -6.6402e-02,
+            8.1978e-02,
+            -5.5194e-02,
+            -1.7259e-02,
+            7.1373e-02,
+            -2.4721e-02,
+            1.0176e-01,
+            1.7447e-02,
+            -8.2872e-02,
+            4.7707e-02,
+            2.9338e-01,
+            3.0481e-02,
+            1.3437e-02,
+            -1.1888e-01,
+            -6.1243e-02,
+            -8.7197e-02,
+            -1.1085e-01,
+            3.2847e-03,
+            1.0611e-02,
+            1.2908e-01,
+            -2.9064e-02,
+            4.5522e-03,
+            -7.8045e-02,
+            -1.4551e-02,
+            -3.3958e-02,
+            -1.3626e-01,
+            1.0859e-01,
+            -7.3438e-03,
+            9.5942e-02,
+            1.4176e-01,
+            7.3675e-02,
+            -2.3085e-03,
+            -1.1689e-02,
+            6.1119e-02,
+            -9.3085e-02,
+            -1.9003e-03,
+            1.9013e-01,
+            -2.5321e-02,
+            -7.0616e-02,
+            -3.7145e-02,
+            1.2449e-01,
+            5.3496e-02,
+            6.4021e-02,
+            2.2668e-02,
+            7.3348e-02,
+            -1.7717e-01,
+            8.7206e-02,
+            -9.0490e-03,
+        ],
+        [
+            1.0227e-01,
+            4.4796e-02,
+            4.0916e-02,
+            1.2557e-01,
+            6.2699e-02,
+            8.8194e-02,
+            1.0194e-02,
+            -1.8886e-01,
+            -2.6260e-02,
+            1.8107e-01,
+            1.1127e-01,
+            -4.9960e-03,
+            8.2291e-02,
+            6.0932e-02,
+            -1.3735e-01,
+            -8.1350e-02,
+            1.2948e-01,
+            1.0171e-01,
+            -7.5950e-02,
+            4.7169e-02,
+            3.5525e-03,
+            -1.4790e-02,
+            -3.9063e-02,
+            -1.9754e-02,
+            -4.6450e-02,
+            4.9071e-03,
+            -3.5914e-02,
+            1.7644e-01,
+            4.1860e-02,
+            1.0857e-01,
+            8.5257e-02,
+            1.0368e-01,
+            -1.7223e-01,
+            4.6316e-02,
+            -3.9480e-02,
+            -9.5817e-02,
+            1.5301e-03,
+            -4.5519e-02,
+            1.2380e-01,
+            -3.0402e-02,
+            4.9047e-02,
+            3.4955e-02,
+            -1.3018e-02,
+            7.4193e-02,
+            -3.0426e-02,
+            1.8414e-02,
+            -1.6606e-02,
+            -1.6301e-01,
+            1.5784e-01,
+            1.3759e-01,
+            3.1906e-02,
+            2.9389e-02,
+            -9.4501e-02,
+            -1.9930e-01,
+            1.3336e-01,
+            3.0685e-02,
+            -7.3809e-02,
+            6.2165e-02,
+            7.3050e-02,
+            3.2870e-02,
+            -1.2857e-01,
+            -7.5806e-04,
+            1.3985e-01,
+            -5.5108e-02,
+            9.2220e-02,
+            7.2490e-02,
+            -2.6251e-02,
+            3.4508e-02,
+            -3.1215e-02,
+            -8.1111e-02,
+            1.4316e-02,
+            1.2390e-01,
+            -9.6291e-03,
+            6.4214e-02,
+            -9.6013e-02,
+            7.5809e-02,
+            -1.5899e-01,
+            8.6961e-02,
+            1.5239e-03,
+            -5.6370e-02,
+            -4.3367e-02,
+            1.5813e-02,
+            9.7189e-04,
+            -5.2946e-02,
+            4.5950e-02,
+            -1.0028e-01,
+            1.1108e-01,
+            9.0491e-03,
+            -3.5540e-02,
+            -1.2020e-02,
+            2.2980e-01,
+            2.7125e-02,
+            -2.4191e-02,
+            -1.1363e-01,
+            -1.0109e-01,
+            -1.4781e-01,
+            -4.7656e-02,
+            3.9481e-02,
+            5.4198e-02,
+            8.2908e-02,
+            1.4034e-02,
+            -1.8492e-02,
+            -6.8612e-02,
+            -4.8741e-02,
+            1.1223e-02,
+            3.9220e-02,
+            5.4551e-04,
+            6.5554e-02,
+            4.3087e-02,
+            1.4678e-01,
+            -4.4496e-02,
+            6.2379e-02,
+            4.7876e-02,
+            7.0156e-02,
+            -6.4684e-02,
+            6.1076e-02,
+            1.4685e-01,
+            -6.3639e-02,
+            -8.7487e-02,
+            -1.3756e-02,
+            1.2724e-01,
+            1.7404e-01,
+            6.7980e-02,
+            6.8036e-02,
+            1.9786e-01,
+            -9.2910e-02,
+            1.9158e-01,
+            4.2686e-02,
+        ],
+        [
+            4.7626e-02,
+            9.3338e-02,
+            9.8020e-02,
+            9.2408e-02,
+            1.8267e-02,
+            1.9572e-02,
+            1.1056e-01,
+            -1.2639e-01,
+            -3.1999e-02,
+            1.3731e-01,
+            1.4826e-01,
+            -6.7136e-02,
+            8.9095e-02,
+            1.9683e-01,
+            -6.5839e-02,
+            -1.0708e-01,
+            1.4414e-01,
+            4.7389e-02,
+            -7.9921e-02,
+            2.7793e-02,
+            9.7240e-02,
+            3.8000e-03,
+            -4.2359e-02,
+            5.9870e-02,
+            -8.2957e-02,
+            -2.1429e-02,
+            -5.1302e-02,
+            7.6202e-02,
+            3.5426e-02,
+            8.1509e-02,
+            1.0849e-01,
+            2.1857e-01,
+            -9.1445e-02,
+            1.1869e-01,
+            -1.1225e-02,
+            -1.6530e-01,
+            2.9216e-02,
+            -7.2792e-02,
+            2.9544e-02,
+            5.3102e-02,
+            2.7746e-02,
+            1.8145e-01,
+            4.4050e-02,
+            8.2549e-02,
+            2.3603e-02,
+            1.1494e-02,
+            -9.1516e-02,
+            -6.2333e-02,
+            1.0970e-01,
+            1.4544e-01,
+            -2.3549e-02,
+            3.8348e-02,
+            -8.8504e-03,
+            -1.6986e-01,
+            5.3215e-02,
+            4.0085e-02,
+            -1.4667e-01,
+            8.6047e-02,
+            4.7751e-02,
+            -9.0753e-03,
+            -8.0938e-02,
+            7.1735e-02,
+            1.1711e-01,
+            -4.2525e-02,
+            9.4244e-02,
+            6.2260e-02,
+            -8.4798e-02,
+            -6.2766e-02,
+            6.1025e-02,
+            -7.7480e-02,
+            -5.3010e-02,
+            1.0182e-01,
+            -7.1081e-03,
+            1.4029e-01,
+            -8.2788e-02,
+            3.0182e-02,
+            -1.4279e-01,
+            4.7882e-02,
+            3.2736e-02,
+            1.0058e-02,
+            -1.2673e-02,
+            3.2723e-02,
+            5.7034e-02,
+            -2.0343e-02,
+            -6.3037e-03,
+            6.8914e-03,
+            2.8643e-02,
+            8.2739e-02,
+            -2.5124e-02,
+            -7.0611e-02,
+            2.7142e-01,
+            -1.6370e-02,
+            1.1240e-02,
+            -1.5776e-01,
+            -8.8755e-02,
+            -1.2389e-01,
+            -2.5785e-02,
+            -3.1258e-02,
+            2.2023e-02,
+            8.5497e-02,
+            6.8360e-02,
+            9.6662e-03,
+            -1.2843e-01,
+            -7.4122e-02,
+            7.1105e-02,
+            5.8334e-02,
+            -1.8609e-02,
+            7.2775e-02,
+            -1.1696e-03,
+            1.3165e-01,
+            -4.7326e-02,
+            6.8737e-02,
+            -2.3211e-02,
+            5.5425e-02,
+            -6.8077e-02,
+            -7.3743e-04,
+            1.6215e-01,
+            -4.9965e-02,
+            -6.8493e-02,
+            -6.8358e-03,
+            9.9518e-02,
+            1.5627e-01,
+            1.3100e-01,
+            9.0073e-03,
+            1.8023e-01,
+            -2.7992e-02,
+            1.3087e-01,
+            7.5672e-02,
+        ],
+        [
+            9.0390e-03,
+            1.3137e-01,
+            4.6586e-02,
+            1.1836e-01,
+            1.1406e-01,
+            -7.3655e-02,
+            -1.4340e-02,
+            -1.4285e-01,
+            2.0426e-02,
+            1.3532e-01,
+            1.3353e-01,
+            -4.7242e-02,
+            2.6449e-02,
+            2.0707e-02,
+            -7.5049e-02,
+            -4.4098e-02,
+            1.4599e-01,
+            1.1299e-01,
+            -2.2097e-02,
+            8.4679e-02,
+            5.8946e-02,
+            2.1213e-02,
+            -5.8343e-03,
+            -4.5902e-02,
+            -6.1018e-02,
+            4.4368e-02,
+            -5.7242e-02,
+            1.4734e-01,
+            -2.6191e-02,
+            8.6116e-02,
+            4.6004e-02,
+            9.4532e-02,
+            -1.7424e-01,
+            1.3697e-01,
+            4.6544e-02,
+            -1.1718e-01,
+            8.2567e-02,
+            -3.1494e-02,
+            6.2073e-02,
+            -4.6328e-02,
+            1.0782e-02,
+            6.6071e-02,
+            9.6953e-03,
+            2.0415e-02,
+            -7.0939e-02,
+            -3.1883e-02,
+            -4.9926e-02,
+            -1.2694e-01,
+            1.6351e-01,
+            1.1670e-01,
+            3.8149e-02,
+            7.2657e-02,
+            -1.3930e-01,
+            -1.6682e-01,
+            1.2471e-01,
+            1.9094e-02,
+            -6.1618e-02,
+            5.8628e-02,
+            1.8804e-03,
+            -9.8104e-03,
+            -1.8998e-01,
+            1.4179e-02,
+            1.4856e-01,
+            -4.2194e-02,
+            5.0934e-02,
+            7.4201e-02,
+            1.5546e-02,
+            2.3192e-02,
+            -5.5886e-02,
+            -4.3618e-02,
+            3.6677e-02,
+            1.2750e-01,
+            2.1240e-02,
+            9.5849e-02,
+            -1.2006e-01,
+            6.0424e-02,
+            -1.6516e-01,
+            7.8015e-02,
+            -7.6026e-02,
+            -1.6711e-02,
+            -3.3572e-02,
+            4.3704e-02,
+            1.2728e-02,
+            -6.9630e-02,
+            4.1065e-02,
+            -8.6589e-02,
+            1.1581e-01,
+            2.2666e-02,
+            -5.1476e-02,
+            2.2756e-02,
+            1.9309e-01,
+            7.0417e-02,
+            8.9253e-03,
+            -1.3546e-01,
+            -7.7783e-02,
+            -1.5058e-01,
+            -4.7874e-02,
+            3.3498e-02,
+            6.4585e-02,
+            7.8633e-02,
+            1.0162e-01,
+            4.5821e-02,
+            -2.8424e-02,
+            4.4524e-02,
+            4.6649e-02,
+            4.5805e-02,
+            8.9723e-02,
+            3.7597e-02,
+            -6.8016e-03,
+            1.1727e-01,
+            -6.6387e-02,
+            3.4958e-02,
+            4.0205e-02,
+            7.5854e-02,
+            -5.1322e-02,
+            6.0060e-02,
+            1.4631e-01,
+            -1.1550e-01,
+            -1.5388e-01,
+            6.0975e-03,
+            1.2013e-01,
+            2.1669e-01,
+            4.8245e-02,
+            8.4634e-02,
+            1.4934e-01,
+            -1.2099e-01,
+            1.6673e-01,
+            6.2539e-02,
+        ],
+        [
+            1.6222e-01,
+            7.5644e-03,
+            1.0667e-01,
+            8.3084e-02,
+            5.1888e-02,
+            8.7477e-02,
+            -1.1550e-01,
+            -4.7037e-02,
+            -3.9418e-02,
+            8.0987e-02,
+            1.2812e-01,
+            -6.6527e-02,
+            6.5405e-02,
+            5.2723e-03,
+            -6.2940e-02,
+            -5.8805e-02,
+            2.8526e-02,
+            4.0631e-02,
+            9.8513e-02,
+            -2.8448e-02,
+            9.2361e-02,
+            6.9724e-02,
+            -1.1792e-01,
+            -1.4806e-02,
+            -6.6172e-02,
+            5.9468e-02,
+            -1.8325e-01,
+            3.2851e-02,
+            -2.7042e-02,
+            1.7569e-01,
+            1.9061e-01,
+            4.1868e-02,
+            -1.4116e-01,
+            -1.6780e-02,
+            -6.2881e-02,
+            -9.4655e-02,
+            5.1488e-02,
+            -3.6501e-03,
+            5.6754e-02,
+            -6.3285e-03,
+            9.2234e-02,
+            -1.0761e-01,
+            -5.5392e-02,
+            7.5249e-02,
+            8.7539e-02,
+            4.3377e-02,
+            3.2473e-03,
+            -1.0990e-01,
+            5.2611e-02,
+            3.4955e-02,
+            1.1722e-01,
+            4.0339e-02,
+            -9.6605e-02,
+            -9.3660e-02,
+            9.6494e-02,
+            -1.4790e-02,
+            -5.7770e-02,
+            4.3192e-02,
+            -8.1741e-02,
+            -4.0909e-02,
+            -9.5212e-02,
+            -1.2459e-01,
+            3.6241e-02,
+            -1.2878e-01,
+            1.1544e-01,
+            3.6392e-03,
+            -7.7986e-03,
+            8.2339e-02,
+            1.4319e-01,
+            -5.8374e-02,
+            1.2483e-01,
+            5.6826e-02,
+            -6.2649e-02,
+            4.5884e-02,
+            -1.8261e-01,
+            -9.1633e-02,
+            -1.9414e-01,
+            2.8376e-02,
+            9.5654e-02,
+            -1.3532e-01,
+            2.1669e-03,
+            7.9960e-02,
+            5.0917e-02,
+            -5.4874e-02,
+            7.6823e-02,
+            -1.3932e-01,
+            1.2431e-01,
+            1.3001e-01,
+            -6.0069e-02,
+            2.6470e-02,
+            2.2378e-01,
+            2.7335e-02,
+            1.6487e-02,
+            -9.6473e-02,
+            8.3110e-02,
+            -8.8776e-02,
+            -6.2299e-02,
+            4.0821e-02,
+            6.5279e-02,
+            8.4030e-02,
+            -4.9298e-02,
+            -3.7441e-02,
+            -4.9233e-02,
+            -1.9428e-03,
+            -1.9763e-02,
+            -9.1249e-02,
+            1.1593e-01,
+            6.6291e-03,
+            -1.0686e-01,
+            5.9383e-02,
+            -3.1088e-02,
+            -1.9844e-03,
+            2.5891e-02,
+            1.3471e-01,
+            -3.5624e-02,
+            1.2647e-01,
+            6.7167e-02,
+            -1.8682e-02,
+            -2.4806e-02,
+            -1.1453e-02,
+            9.6992e-02,
+            1.2253e-01,
+            5.6707e-02,
+            1.0860e-02,
+            2.4775e-01,
+            -8.8641e-02,
+            1.1375e-01,
+            6.9383e-02,
+        ],
+        [
+            1.4724e-01,
+            3.7511e-02,
+            1.1238e-01,
+            6.3809e-02,
+            1.8174e-03,
+            8.4854e-02,
+            -7.8965e-02,
+            -3.1542e-02,
+            -3.7643e-02,
+            1.0136e-01,
+            1.5837e-01,
+            -7.5701e-02,
+            1.0313e-01,
+            2.2795e-02,
+            -1.1227e-01,
+            -4.3783e-02,
+            4.6561e-02,
+            4.1225e-02,
+            7.4273e-02,
+            -4.8200e-02,
+            2.7666e-02,
+            5.1417e-02,
+            -1.3928e-01,
+            2.0020e-02,
+            -9.3673e-02,
+            5.1440e-02,
+            -2.0076e-01,
+            1.0715e-01,
+            -3.0323e-02,
+            1.7241e-01,
+            1.9730e-01,
+            7.7685e-02,
+            -1.5949e-01,
+            4.8495e-02,
+            -8.0068e-02,
+            -7.1965e-02,
+            8.7222e-02,
+            -4.8383e-02,
+            7.0627e-02,
+            3.9791e-03,
+            7.0469e-02,
+            -8.6697e-02,
+            -3.7149e-02,
+            7.9965e-02,
+            8.8967e-02,
+            5.3325e-02,
+            -5.6073e-03,
+            -1.1336e-01,
+            1.0338e-01,
+            2.3824e-02,
+            6.9393e-02,
+            6.1018e-02,
+            -7.2880e-02,
+            -6.6328e-02,
+            8.9040e-02,
+            -8.8268e-03,
+            -7.5720e-02,
+            3.7544e-02,
+            -8.3740e-02,
+            -4.7977e-02,
+            -1.2425e-01,
+            -1.0304e-01,
+            -3.7850e-03,
+            -1.1540e-01,
+            1.0803e-01,
+            2.5964e-02,
+            -1.0915e-02,
+            1.1758e-01,
+            1.6561e-01,
+            -4.5171e-02,
+            1.1272e-01,
+            6.0721e-02,
+            -9.6027e-02,
+            6.0908e-02,
+            -1.6545e-01,
+            -6.5444e-02,
+            -1.6802e-01,
+            2.5850e-02,
+            1.2434e-01,
+            -1.2358e-01,
+            -5.2647e-04,
+            1.2329e-01,
+            6.3928e-02,
+            -5.5478e-02,
+            5.4642e-02,
+            -1.0372e-01,
+            1.0955e-01,
+            1.1810e-01,
+            -7.7028e-02,
+            5.0302e-02,
+            2.7576e-01,
+            6.4704e-02,
+            3.7824e-03,
+            -8.3016e-02,
+            6.7355e-02,
+            -4.9660e-02,
+            -1.2677e-01,
+            3.4498e-02,
+            2.7027e-02,
+            9.1476e-02,
+            -5.1170e-02,
+            -3.4786e-02,
+            -4.4356e-02,
+            6.2440e-03,
+            -3.5473e-02,
+            -1.1076e-01,
+            1.0014e-01,
+            -1.5927e-02,
+            -7.9539e-02,
+            1.1542e-01,
+            -3.6775e-03,
+            2.5437e-02,
+            2.1185e-02,
+            1.0472e-01,
+            -4.8937e-03,
+            4.5876e-02,
+            5.3122e-02,
+            -1.9815e-02,
+            -1.8126e-02,
+            -2.3358e-02,
+            1.2271e-01,
+            9.8860e-02,
+            4.5235e-02,
+            6.2841e-02,
+            1.6294e-01,
+            -1.0909e-01,
+            7.2012e-02,
+            5.3389e-02,
+        ],
+        [
+            1.2605e-01,
+            5.1723e-02,
+            1.2152e-01,
+            5.8291e-02,
+            -3.8019e-02,
+            8.8117e-02,
+            -4.1927e-02,
+            -2.3022e-02,
+            -3.1158e-02,
+            1.2518e-01,
+            1.4279e-01,
+            -7.1922e-02,
+            1.0867e-01,
+            3.3116e-02,
+            -1.3669e-01,
+            -3.2413e-02,
+            9.0301e-02,
+            5.9203e-02,
+            -7.5021e-03,
+            -6.9837e-02,
+            -1.2463e-03,
+            1.8891e-02,
+            -1.1878e-01,
+            6.1658e-02,
+            -1.2649e-01,
+            4.2450e-02,
+            -1.6298e-01,
+            1.5450e-01,
+            -2.6732e-02,
+            1.7891e-01,
+            2.1083e-01,
+            1.0432e-01,
+            -1.3396e-01,
+            6.9416e-02,
+            -7.3193e-02,
+            -6.8281e-02,
+            9.9454e-02,
+            -4.4528e-02,
+            7.7992e-02,
+            -2.6336e-03,
+            6.9279e-02,
+            -3.8836e-02,
+            -2.8872e-02,
+            5.6951e-02,
+            8.7154e-02,
+            6.1652e-02,
+            -1.8049e-02,
+            -1.2096e-01,
+            1.3820e-01,
+            5.1705e-02,
+            3.4052e-02,
+            1.1524e-01,
+            -4.1216e-02,
+            -8.5670e-02,
+            7.1571e-02,
+            -1.6001e-02,
+            -8.8427e-02,
+            3.1357e-02,
+            -5.4897e-02,
+            -3.1463e-02,
+            -1.2070e-01,
+            -5.7460e-02,
+            -2.1424e-02,
+            -1.2160e-01,
+            1.0026e-01,
+            4.7475e-02,
+            -1.4578e-02,
+            1.3247e-01,
+            1.5272e-01,
+            -2.9788e-02,
+            8.2947e-02,
+            7.9830e-02,
+            -1.1615e-01,
+            7.2949e-02,
+            -1.2386e-01,
+            -5.3969e-02,
+            -1.3578e-01,
+            4.0461e-02,
+            1.2467e-01,
+            -9.4575e-02,
+            6.2182e-04,
+            1.3108e-01,
+            6.5035e-02,
+            -5.7784e-02,
+            4.2513e-02,
+            -7.8118e-02,
+            1.1274e-01,
+            8.9333e-02,
+            -4.9991e-02,
+            7.4639e-02,
+            3.0876e-01,
+            7.3974e-02,
+            -1.4039e-02,
+            -7.4526e-02,
+            6.5200e-02,
+            -3.6421e-02,
+            -1.6730e-01,
+            4.1713e-02,
+            -1.5316e-02,
+            1.0056e-01,
+            -5.0370e-02,
+            -4.4531e-02,
+            -5.0233e-02,
+            3.2636e-02,
+            -1.7609e-02,
+            -1.1354e-01,
+            8.1922e-02,
+            -2.0907e-02,
+            -1.3264e-02,
+            1.5115e-01,
+            1.2777e-02,
+            3.8261e-02,
+            2.1829e-02,
+            5.5874e-02,
+            6.8772e-03,
+            -2.7772e-02,
+            6.7979e-02,
+            -3.9099e-02,
+            -2.8619e-02,
+            -5.6936e-02,
+            1.3366e-01,
+            9.4269e-02,
+            4.4852e-02,
+            7.6881e-02,
+            9.6787e-02,
+            -1.2885e-01,
+            7.9722e-02,
+            6.4991e-02,
+        ],
+        [
+            1.0575e-01,
+            6.4565e-02,
+            1.2479e-01,
+            5.5616e-02,
+            -5.5869e-02,
+            8.9005e-02,
+            -1.9612e-02,
+            -3.3032e-02,
+            -3.9719e-02,
+            1.3884e-01,
+            1.2010e-01,
+            -6.3224e-02,
+            1.0893e-01,
+            4.4172e-02,
+            -1.4283e-01,
+            -3.8972e-02,
+            1.1470e-01,
+            7.7830e-02,
+            -4.6450e-02,
+            -8.7246e-02,
+            -5.7215e-03,
+            1.7476e-02,
+            -9.0388e-02,
+            7.4607e-02,
+            -1.3105e-01,
+            2.9371e-02,
+            -1.2681e-01,
+            1.6014e-01,
+            -1.3655e-02,
+            1.8492e-01,
+            1.9841e-01,
+            1.0942e-01,
+            -1.1261e-01,
+            6.8326e-02,
+            -5.1130e-02,
+            -7.1296e-02,
+            9.3895e-02,
+            -3.1097e-02,
+            8.7043e-02,
+            -1.2087e-02,
+            7.3054e-02,
+            -1.0602e-02,
+            -3.6347e-02,
+            3.1324e-02,
+            7.5686e-02,
+            5.3221e-02,
+            -3.1793e-02,
+            -1.3818e-01,
+            1.4972e-01,
+            9.0217e-02,
+            2.6365e-02,
+            1.1733e-01,
+            -2.6107e-02,
+            -1.1933e-01,
+            6.5575e-02,
+            -1.6907e-02,
+            -1.0186e-01,
+            3.3719e-02,
+            -3.4021e-02,
+            -1.0597e-02,
+            -1.0478e-01,
+            -3.4765e-02,
+            -3.0666e-03,
+            -1.2035e-01,
+            1.1053e-01,
+            5.2212e-02,
+            -1.8638e-02,
+            1.2226e-01,
+            1.3614e-01,
+            -4.3806e-02,
+            4.7251e-02,
+            9.2144e-02,
+            -1.2505e-01,
+            8.3020e-02,
+            -1.1203e-01,
+            -4.9654e-02,
+            -1.1939e-01,
+            4.4126e-02,
+            1.1188e-01,
+            -7.8910e-02,
+            -4.1917e-03,
+            1.3279e-01,
+            5.0291e-02,
+            -6.1770e-02,
+            5.1914e-02,
+            -6.8796e-02,
+            1.2148e-01,
+            7.6837e-02,
+            -4.0098e-02,
+            8.3547e-02,
+            3.0367e-01,
+            6.9357e-02,
+            -2.5710e-02,
+            -7.2644e-02,
+            5.2612e-02,
+            -5.3110e-02,
+            -1.7360e-01,
+            5.2791e-02,
+            -1.6490e-02,
+            9.9930e-02,
+            -4.8174e-02,
+            -3.0230e-02,
+            -6.0898e-02,
+            3.4064e-02,
+            8.2446e-03,
+            -1.0747e-01,
+            6.9406e-02,
+            -9.2400e-03,
+            2.1804e-02,
+            1.5491e-01,
+            2.0964e-02,
+            3.4691e-02,
+            3.5648e-02,
+            4.4363e-02,
+            -3.2605e-03,
+            -5.9988e-02,
+            9.3354e-02,
+            -7.4183e-02,
+            -3.5824e-02,
+            -7.1163e-02,
+            1.4776e-01,
+            1.0179e-01,
+            4.1685e-02,
+            6.7698e-02,
+            8.4053e-02,
+            -1.4797e-01,
+            9.9115e-02,
+            7.2061e-02,
+        ],
+        [
+            8.3987e-02,
+            6.9951e-02,
+            1.3728e-01,
+            6.4616e-02,
+            -5.5591e-02,
+            8.8007e-02,
+            -1.7926e-02,
+            -4.8462e-02,
+            -4.8522e-02,
+            1.5932e-01,
+            1.0766e-01,
+            -4.9589e-02,
+            1.0511e-01,
+            4.4010e-02,
+            -1.3653e-01,
+            -4.1380e-02,
+            1.3629e-01,
+            9.2007e-02,
+            -5.2961e-02,
+            -7.1865e-02,
+            -2.8329e-03,
+            1.3417e-02,
+            -5.2565e-02,
+            6.2258e-02,
+            -1.2135e-01,
+            2.7531e-02,
+            -9.4902e-02,
+            1.6567e-01,
+            -1.6613e-02,
+            1.8443e-01,
+            1.6290e-01,
+            1.1109e-01,
+            -1.1476e-01,
+            6.5613e-02,
+            -1.7283e-02,
+            -8.7120e-02,
+            1.0862e-01,
+            -2.5325e-02,
+            8.9025e-02,
+            -1.8290e-02,
+            7.2979e-02,
+            1.1878e-04,
+            -4.1007e-02,
+            1.9679e-02,
+            6.1887e-02,
+            4.0949e-02,
+            -3.6016e-02,
+            -1.5569e-01,
+            1.4839e-01,
+            1.1372e-01,
+            1.8360e-02,
+            9.3030e-02,
+            -1.8070e-02,
+            -1.5578e-01,
+            6.1180e-02,
+            -1.9569e-02,
+            -1.1221e-01,
+            4.0037e-02,
+            -2.3712e-02,
+            -1.0311e-02,
+            -1.0530e-01,
+            -1.2916e-02,
+            3.1546e-02,
+            -1.1647e-01,
+            1.2109e-01,
+            5.8714e-02,
+            -1.9454e-02,
+            9.9438e-02,
+            1.1088e-01,
+            -7.4443e-02,
+            1.6456e-02,
+            8.7619e-02,
+            -1.1460e-01,
+            9.7142e-02,
+            -1.1083e-01,
+            -5.2367e-02,
+            -1.2157e-01,
+            4.6784e-02,
+            8.5968e-02,
+            -7.2488e-02,
+            -1.2658e-02,
+            1.4136e-01,
+            1.7934e-02,
+            -6.4075e-02,
+            5.3809e-02,
+            -5.8649e-02,
+            1.2410e-01,
+            6.7307e-02,
+            -5.3157e-02,
+            8.5616e-02,
+            2.8266e-01,
+            6.4775e-02,
+            -2.9330e-02,
+            -8.7733e-02,
+            1.3974e-02,
+            -7.9092e-02,
+            -1.6691e-01,
+            5.9037e-02,
+            4.1784e-03,
+            9.8219e-02,
+            -3.6970e-02,
+            8.6754e-03,
+            -5.5234e-02,
+            3.4627e-02,
+            3.5126e-02,
+            -9.5508e-02,
+            6.4539e-02,
+            -9.1506e-04,
+            2.9144e-02,
+            1.3975e-01,
+            1.5472e-02,
+            3.9015e-02,
+            4.6270e-02,
+            5.4053e-02,
+            -1.2525e-02,
+            -6.6168e-02,
+            1.2463e-01,
+            -1.0793e-01,
+            -4.0659e-02,
+            -8.1224e-02,
+            1.5702e-01,
+            1.2323e-01,
+            3.3473e-02,
+            6.1162e-02,
+            8.3375e-02,
+            -1.7863e-01,
+            1.1536e-01,
+            6.9906e-02,
+        ],
+        [
+            6.2508e-02,
+            8.5713e-02,
+            1.3566e-01,
+            8.5148e-02,
+            -2.2642e-02,
+            5.8889e-02,
+            -3.3654e-02,
+            -6.6948e-02,
+            -5.1541e-02,
+            1.7082e-01,
+            1.1639e-01,
+            -3.9750e-02,
+            8.5338e-02,
+            2.8182e-02,
+            -1.1108e-01,
+            -3.5316e-02,
+            1.4888e-01,
+            1.0210e-01,
+            -3.4537e-02,
+            -1.1950e-02,
+            5.0482e-03,
+            1.8051e-02,
+            -2.2067e-02,
+            1.8682e-02,
+            -9.7924e-02,
+            2.6326e-02,
+            -7.6128e-02,
+            1.7675e-01,
+            -1.6092e-02,
+            1.6355e-01,
+            1.1133e-01,
+            1.1036e-01,
+            -1.4070e-01,
+            6.9723e-02,
+            2.0482e-02,
+            -1.0421e-01,
+            1.2920e-01,
+            -3.1272e-02,
+            7.6070e-02,
+            -3.1384e-02,
+            6.7374e-02,
+            -8.3764e-05,
+            -2.1820e-02,
+            1.4192e-02,
+            2.3975e-02,
+            2.3384e-02,
+            -2.3589e-02,
+            -1.7196e-01,
+            1.4986e-01,
+            1.1465e-01,
+            2.0120e-02,
+            4.8034e-02,
+            -3.9982e-02,
+            -1.8704e-01,
+            6.2222e-02,
+            -1.4799e-02,
+            -1.0783e-01,
+            5.4098e-02,
+            -1.2046e-02,
+            -1.5444e-02,
+            -1.4001e-01,
+            1.5944e-02,
+            7.9476e-02,
+            -9.7107e-02,
+            1.0629e-01,
+            7.1731e-02,
+            -8.1614e-03,
+            6.2800e-02,
+            5.5151e-02,
+            -1.0514e-01,
+            1.7916e-02,
+            8.1229e-02,
+            -7.8761e-02,
+            1.1222e-01,
+            -1.1032e-01,
+            -4.8039e-02,
+            -1.5340e-01,
+            6.0481e-02,
+            3.2276e-02,
+            -6.2797e-02,
+            -3.3934e-02,
+            1.3062e-01,
+            -6.3068e-03,
+            -6.5936e-02,
+            4.2361e-02,
+            -4.6102e-02,
+            1.2669e-01,
+            6.1909e-02,
+            -5.7771e-02,
+            7.8385e-02,
+            2.4836e-01,
+            7.5433e-02,
+            -2.0151e-02,
+            -1.2117e-01,
+            -4.1874e-02,
+            -1.1751e-01,
+            -1.4471e-01,
+            6.3096e-02,
+            2.9419e-02,
+            1.0021e-01,
+            -1.2180e-02,
+            5.0896e-02,
+            -4.0094e-02,
+            4.1059e-02,
+            8.0853e-02,
+            -7.4614e-02,
+            7.5243e-02,
+            1.4928e-02,
+            1.1477e-02,
+            1.2385e-01,
+            -1.4719e-02,
+            5.3751e-02,
+            5.2591e-02,
+            7.2013e-02,
+            -1.6333e-02,
+            -5.0256e-02,
+            1.4199e-01,
+            -1.3433e-01,
+            -7.1574e-02,
+            -7.4449e-02,
+            1.6136e-01,
+            1.5659e-01,
+            2.1466e-02,
+            6.9775e-02,
+            1.0352e-01,
+            -1.9641e-01,
+            1.3156e-01,
+            5.5903e-02,
+        ],
+        [
+            4.4988e-02,
+            1.0390e-01,
+            1.1266e-01,
+            1.1661e-01,
+            2.1212e-02,
+            1.4641e-02,
+            -3.1484e-02,
+            -8.3443e-02,
+            -4.4991e-02,
+            1.5687e-01,
+            1.3158e-01,
+            -3.3434e-02,
+            6.5104e-02,
+            2.0808e-02,
+            -7.0680e-02,
+            -4.2508e-02,
+            1.4304e-01,
+            9.8483e-02,
+            -2.6904e-02,
+            3.2902e-02,
+            1.1152e-02,
+            2.1118e-02,
+            -1.4842e-02,
+            -2.2356e-02,
+            -8.6942e-02,
+            2.6609e-02,
+            -6.2533e-02,
+            1.7495e-01,
+            -1.0246e-02,
+            1.2697e-01,
+            7.9345e-02,
+            1.0189e-01,
+            -1.7178e-01,
+            7.5006e-02,
+            4.5051e-02,
+            -1.0753e-01,
+            1.2829e-01,
+            -3.3422e-02,
+            7.8522e-02,
+            -4.5604e-02,
+            5.2822e-02,
+            8.3934e-03,
+            -1.4676e-02,
+            1.0482e-02,
+            -6.9389e-03,
+            2.2131e-03,
+            -2.0089e-02,
+            -1.7261e-01,
+            1.5468e-01,
+            1.1537e-01,
+            2.7489e-02,
+            2.9948e-02,
+            -7.4234e-02,
+            -1.9946e-01,
+            7.4632e-02,
+            2.2249e-03,
+            -9.7061e-02,
+            6.4988e-02,
+            -1.1239e-02,
+            -2.6152e-02,
+            -1.6496e-01,
+            3.0305e-02,
+            1.0491e-01,
+            -6.7692e-02,
+            7.3323e-02,
+            7.0258e-02,
+            1.2020e-02,
+            4.1457e-02,
+            3.7126e-03,
+            -1.0465e-01,
+            2.7035e-02,
+            8.1376e-02,
+            -4.0890e-02,
+            1.0791e-01,
+            -1.2141e-01,
+            -1.6070e-02,
+            -1.7111e-01,
+            7.4218e-02,
+            -2.4698e-02,
+            -3.7496e-02,
+            -4.5666e-02,
+            1.0478e-01,
+            -1.7289e-03,
+            -7.1823e-02,
+            2.7480e-02,
+            -5.5305e-02,
+            1.2323e-01,
+            5.3008e-02,
+            -5.6903e-02,
+            6.6087e-02,
+            2.1523e-01,
+            8.2657e-02,
+            -9.3275e-03,
+            -1.3791e-01,
+            -6.7856e-02,
+            -1.4959e-01,
+            -1.1916e-01,
+            6.2014e-02,
+            3.8735e-02,
+            9.7171e-02,
+            2.6820e-02,
+            7.4336e-02,
+            -2.9922e-02,
+            5.3645e-02,
+            1.0981e-01,
+            -3.7215e-02,
+            9.4254e-02,
+            4.2902e-02,
+            -2.0969e-03,
+            1.1838e-01,
+            -5.4015e-02,
+            5.3799e-02,
+            4.8568e-02,
+            8.0494e-02,
+            -2.1410e-02,
+            -2.0629e-02,
+            1.3477e-01,
+            -1.4177e-01,
+            -1.1144e-01,
+            -5.1781e-02,
+            1.5780e-01,
+            1.9357e-01,
+            2.5627e-02,
+            7.5402e-02,
+            1.1982e-01,
+            -1.8961e-01,
+            1.4646e-01,
+            4.2665e-02,
+        ],
+        [
+            5.1689e-02,
+            1.0737e-01,
+            1.1035e-01,
+            1.1308e-01,
+            2.0363e-02,
+            1.9703e-02,
+            -3.2107e-02,
+            -9.0838e-02,
+            -3.7066e-02,
+            1.5839e-01,
+            1.3202e-01,
+            -3.9661e-02,
+            6.3263e-02,
+            1.4509e-02,
+            -6.0145e-02,
+            -4.1459e-02,
+            1.4670e-01,
+            9.4701e-02,
+            -2.7710e-02,
+            3.4281e-02,
+            1.2373e-02,
+            2.0087e-02,
+            -2.0821e-02,
+            -1.6274e-02,
+            -7.9908e-02,
+            2.6209e-02,
+            -7.0731e-02,
+            1.7365e-01,
+            -8.5357e-03,
+            1.2784e-01,
+            7.9591e-02,
+            9.7291e-02,
+            -1.6958e-01,
+            7.5774e-02,
+            4.4993e-02,
+            -1.0499e-01,
+            1.2133e-01,
+            -4.2564e-02,
+            7.7296e-02,
+            -3.9049e-02,
+            5.4639e-02,
+            3.7831e-03,
+            -1.2108e-02,
+            1.7782e-02,
+            -1.8517e-03,
+            1.1160e-02,
+            -1.9819e-02,
+            -1.7390e-01,
+            1.5853e-01,
+            1.1225e-01,
+            2.6839e-02,
+            3.1746e-02,
+            -8.1013e-02,
+            -1.9950e-01,
+            7.7933e-02,
+            4.3883e-03,
+            -9.1775e-02,
+            6.3761e-02,
+            -2.0220e-02,
+            -2.0873e-02,
+            -1.6981e-01,
+            3.2587e-02,
+            1.0188e-01,
+            -7.2338e-02,
+            7.9739e-02,
+            7.2336e-02,
+            1.2712e-02,
+            4.6304e-02,
+            1.1977e-02,
+            -9.9069e-02,
+            3.2361e-02,
+            7.4647e-02,
+            -3.2075e-02,
+            1.0834e-01,
+            -1.2421e-01,
+            -1.4408e-02,
+            -1.7591e-01,
+            7.6520e-02,
+            -2.1893e-02,
+            -4.0591e-02,
+            -3.9790e-02,
+            1.0072e-01,
+            2.1907e-03,
+            -7.5756e-02,
+            3.4002e-02,
+            -6.2571e-02,
+            1.2714e-01,
+            5.2011e-02,
+            -5.6154e-02,
+            6.2876e-02,
+            2.0992e-01,
+            8.9547e-02,
+            -1.2875e-02,
+            -1.3528e-01,
+            -6.6275e-02,
+            -1.4322e-01,
+            -1.0560e-01,
+            5.9555e-02,
+            4.4426e-02,
+            1.0047e-01,
+            3.3182e-02,
+            7.2001e-02,
+            -3.6514e-02,
+            5.0708e-02,
+            1.0564e-01,
+            -4.1174e-02,
+            1.0378e-01,
+            4.2651e-02,
+            -2.6353e-03,
+            1.1964e-01,
+            -6.2808e-02,
+            5.9555e-02,
+            5.4234e-02,
+            8.3802e-02,
+            -1.2534e-02,
+            -1.7949e-02,
+            1.3403e-01,
+            -1.3682e-01,
+            -1.1048e-01,
+            -5.1154e-02,
+            1.5967e-01,
+            1.9743e-01,
+            3.2240e-02,
+            7.4049e-02,
+            1.2060e-01,
+            -1.9087e-01,
+            1.3942e-01,
+            4.1168e-02,
+        ],
+        [
+            7.2669e-02,
+            1.0343e-01,
+            1.1966e-01,
+            9.3777e-02,
+            -4.3358e-03,
+            5.0720e-02,
+            -3.8923e-02,
+            -9.1626e-02,
+            -3.0056e-02,
+            1.6863e-01,
+            1.2676e-01,
+            -5.3184e-02,
+            7.4056e-02,
+            1.5517e-02,
+            -7.5657e-02,
+            -3.7712e-02,
+            1.5280e-01,
+            9.0719e-02,
+            -3.1311e-02,
+            1.7038e-02,
+            1.0062e-02,
+            1.4759e-02,
+            -3.4438e-02,
+            1.5206e-02,
+            -7.7897e-02,
+            2.7431e-02,
+            -9.0602e-02,
+            1.7164e-01,
+            -9.9721e-03,
+            1.4776e-01,
+            1.0475e-01,
+            9.0160e-02,
+            -1.5270e-01,
+            7.4838e-02,
+            2.4463e-02,
+            -1.0180e-01,
+            1.1501e-01,
+            -5.0178e-02,
+            7.2532e-02,
+            -1.8656e-02,
+            6.9202e-02,
+            -9.6694e-03,
+            -1.8219e-02,
+            3.5159e-02,
+            2.5262e-02,
+            3.4003e-02,
+            -1.4053e-02,
+            -1.7146e-01,
+            1.6299e-01,
+            1.0628e-01,
+            2.3901e-02,
+            4.2174e-02,
+            -7.0690e-02,
+            -1.8996e-01,
+            7.4249e-02,
+            -2.3634e-03,
+            -8.9371e-02,
+            5.7919e-02,
+            -3.2949e-02,
+            -2.4951e-03,
+            -1.6144e-01,
+            3.1264e-02,
+            8.4885e-02,
+            -9.7903e-02,
+            1.0806e-01,
+            7.3583e-02,
+            1.4389e-03,
+            6.4343e-02,
+            5.4305e-02,
+            -9.2823e-02,
+            3.4699e-02,
+            6.5887e-02,
+            -4.1142e-02,
+            1.1057e-01,
+            -1.2077e-01,
+            -3.4178e-02,
+            -1.7040e-01,
+            7.2546e-02,
+            1.9399e-02,
+            -6.3051e-02,
+            -3.0156e-02,
+            1.1501e-01,
+            3.9456e-03,
+            -7.8346e-02,
+            5.0548e-02,
+            -6.3681e-02,
+            1.3261e-01,
+            6.1531e-02,
+            -5.1743e-02,
+            6.4762e-02,
+            2.3264e-01,
+            9.4896e-02,
+            -2.0536e-02,
+            -1.1807e-01,
+            -4.9545e-02,
+            -1.1460e-01,
+            -1.0079e-01,
+            5.7836e-02,
+            4.4144e-02,
+            1.1039e-01,
+            2.1311e-02,
+            4.8694e-02,
+            -4.7126e-02,
+            3.7200e-02,
+            8.3108e-02,
+            -7.0069e-02,
+            9.7451e-02,
+            2.0983e-02,
+            -4.1628e-04,
+            1.2463e-01,
+            -5.0752e-02,
+            7.0680e-02,
+            6.3588e-02,
+            8.6767e-02,
+            6.3361e-04,
+            -2.5236e-02,
+            1.3658e-01,
+            -1.1925e-01,
+            -8.3861e-02,
+            -6.3728e-02,
+            1.6767e-01,
+            1.7967e-01,
+            3.3894e-02,
+            7.2830e-02,
+            1.1590e-01,
+            -1.9359e-01,
+            1.2254e-01,
+            4.7767e-02,
+        ],
+        [
+            8.4189e-02,
+            9.3299e-02,
+            1.1532e-01,
+            8.4670e-02,
+            -9.7533e-03,
+            6.4423e-02,
+            -4.3742e-02,
+            -9.0334e-02,
+            -1.9307e-02,
+            1.7434e-01,
+            1.2522e-01,
+            -6.4064e-02,
+            7.7841e-02,
+            2.5594e-02,
+            -9.4764e-02,
+            -3.8088e-02,
+            1.5148e-01,
+            8.7002e-02,
+            -3.8634e-02,
+            1.6073e-02,
+            1.0152e-02,
+            8.9035e-03,
+            -3.9583e-02,
+            3.3614e-02,
+            -7.4457e-02,
+            2.6379e-02,
+            -9.8885e-02,
+            1.6510e-01,
+            -1.1651e-02,
+            1.5700e-01,
+            1.3055e-01,
+            7.7680e-02,
+            -1.3690e-01,
+            7.0143e-02,
+            5.4565e-03,
+            -1.0524e-01,
+            1.1096e-01,
+            -4.6091e-02,
+            6.8167e-02,
+            -5.6453e-03,
+            7.2094e-02,
+            -1.8229e-02,
+            -2.5539e-02,
+            3.9328e-02,
+            4.3699e-02,
+            4.4686e-02,
+            -1.2072e-02,
+            -1.6738e-01,
+            1.6301e-01,
+            1.0474e-01,
+            1.4918e-02,
+            5.4164e-02,
+            -7.2489e-02,
+            -1.7993e-01,
+            7.7292e-02,
+            -2.8187e-03,
+            -8.9506e-02,
+            5.6049e-02,
+            -3.1474e-02,
+            4.7455e-03,
+            -1.5338e-01,
+            2.2827e-02,
+            6.7546e-02,
+            -1.1578e-01,
+            1.2026e-01,
+            8.2049e-02,
+            -1.1262e-02,
+            7.4682e-02,
+            7.3023e-02,
+            -8.6490e-02,
+            3.1955e-02,
+            6.6658e-02,
+            -4.6417e-02,
+            1.0408e-01,
+            -1.1210e-01,
+            -3.3793e-02,
+            -1.6235e-01,
+            7.3353e-02,
+            4.5024e-02,
+            -7.6526e-02,
+            -3.0443e-02,
+            1.2222e-01,
+            1.1513e-02,
+            -8.5835e-02,
+            5.6084e-02,
+            -6.5380e-02,
+            1.3535e-01,
+            7.2861e-02,
+            -4.8121e-02,
+            6.6781e-02,
+            2.5041e-01,
+            9.3076e-02,
+            -2.0334e-02,
+            -1.0416e-01,
+            -3.9805e-02,
+            -1.0051e-01,
+            -9.2133e-02,
+            6.3271e-02,
+            3.4768e-02,
+            1.1286e-01,
+            1.3493e-02,
+            3.0643e-02,
+            -5.5867e-02,
+            2.4630e-02,
+            7.8038e-02,
+            -7.5769e-02,
+            9.0636e-02,
+            1.8840e-02,
+            1.3688e-02,
+            1.2780e-01,
+            -4.3306e-02,
+            7.6513e-02,
+            5.6990e-02,
+            8.7927e-02,
+            1.6438e-03,
+            -1.0833e-02,
+            1.3722e-01,
+            -9.4365e-02,
+            -7.4534e-02,
+            -6.2697e-02,
+            1.6868e-01,
+            1.6850e-01,
+            4.3229e-02,
+            7.4762e-02,
+            1.1225e-01,
+            -1.9559e-01,
+            1.1981e-01,
+            5.0025e-02,
+        ],
+        [
+            1.0233e-01,
+            6.7397e-02,
+            1.0132e-01,
+            1.1631e-01,
+            4.3957e-02,
+            5.7017e-02,
+            -4.0769e-02,
+            -1.2329e-01,
+            -6.1235e-03,
+            1.3821e-01,
+            1.3135e-01,
+            -7.2640e-02,
+            6.7380e-02,
+            4.7518e-02,
+            -1.0261e-01,
+            -8.4497e-02,
+            1.1074e-01,
+            7.9965e-02,
+            4.3208e-03,
+            -7.9881e-03,
+            3.0558e-02,
+            3.8130e-02,
+            -7.0863e-02,
+            2.6484e-02,
+            -8.1795e-02,
+            3.9067e-02,
+            -1.5670e-01,
+            1.2963e-01,
+            4.3868e-03,
+            1.3081e-01,
+            1.7308e-01,
+            5.3891e-02,
+            -1.2683e-01,
+            6.0787e-02,
+            -7.8336e-02,
+            -1.0347e-01,
+            5.8472e-02,
+            -2.7212e-02,
+            7.1385e-02,
+            -6.8297e-03,
+            8.7485e-02,
+            -7.1364e-02,
+            -1.9182e-02,
+            8.7217e-02,
+            8.2944e-02,
+            3.4400e-02,
+            -8.5778e-03,
+            -1.1191e-01,
+            1.4871e-01,
+            1.0602e-01,
+            5.5060e-02,
+            4.0554e-02,
+            -1.0835e-01,
+            -1.4749e-01,
+            1.1336e-01,
+            8.1897e-03,
+            -5.1693e-02,
+            4.9600e-02,
+            -3.6377e-02,
+            -1.6864e-03,
+            -1.4149e-01,
+            -3.8906e-02,
+            5.3481e-02,
+            -1.1160e-01,
+            1.3861e-01,
+            6.3040e-02,
+            -2.2296e-02,
+            8.1680e-02,
+            7.9567e-02,
+            -6.1083e-02,
+            6.7573e-02,
+            9.8196e-02,
+            -7.0956e-02,
+            8.7717e-02,
+            -1.3439e-01,
+            -4.4087e-02,
+            -1.7677e-01,
+            5.1971e-02,
+            1.1013e-01,
+            -1.2838e-01,
+            -1.8450e-02,
+            9.7373e-02,
+            1.5415e-02,
+            -6.8535e-02,
+            5.8374e-02,
+            -1.0450e-01,
+            1.3363e-01,
+            1.2089e-01,
+            -4.1817e-02,
+            3.1015e-02,
+            2.7185e-01,
+            6.9890e-02,
+            -3.8259e-03,
+            -7.7094e-02,
+            2.4651e-02,
+            -1.0086e-01,
+            -8.4380e-02,
+            4.9062e-02,
+            4.7470e-02,
+            1.0739e-01,
+            -2.4693e-03,
+            -5.9990e-02,
+            -6.2990e-02,
+            1.2398e-03,
+            4.8100e-03,
+            -6.0338e-02,
+            6.4579e-02,
+            4.2505e-04,
+            -2.9926e-02,
+            1.3627e-01,
+            -3.0724e-02,
+            4.2972e-02,
+            4.6971e-02,
+            1.2441e-01,
+            -2.4336e-02,
+            6.9954e-02,
+            1.0403e-01,
+            -3.2450e-02,
+            -4.3154e-02,
+            -4.9959e-02,
+            1.5666e-01,
+            1.3688e-01,
+            5.3450e-02,
+            7.9968e-02,
+            1.3858e-01,
+            -1.6817e-01,
+            1.2637e-01,
+            7.3937e-02,
+        ],
+    ]
+)

src/backend/vespa_app.py

@@ -0,0 +1,496 @@
+import os
+import time
+from typing import Any, Dict, Tuple
+import asyncio
+import numpy as np
+import torch
+from dotenv import load_dotenv
+from vespa.application import Vespa
+from vespa.io import VespaQueryResponse
+from .colpali import SimMapGenerator
+import backend.stopwords
+import logging
+
+
+class VespaQueryClient:
+    MAX_QUERY_TERMS = 64
+    VESPA_SCHEMA_NAME = "pdf_page"
+    SELECT_FIELDS = "id,title,url,blur_image,page_number,snippet,text"
+
+    def __init__(self, logger: logging.Logger):
+        """
+        Initialize the VespaQueryClient by loading environment variables and establishing a connection to the Vespa application.
+        """
+        load_dotenv()
+        self.logger = logger
+
+        if os.environ.get("USE_MTLS") == "true":
+            self.logger.info("Connected using mTLS")
+            mtls_key = os.environ.get("VESPA_CLOUD_MTLS_KEY")
+            mtls_cert = os.environ.get("VESPA_CLOUD_MTLS_CERT")
+
+            self.vespa_app_url = os.environ.get("VESPA_APP_MTLS_URL")
+            if not self.vespa_app_url:
+                raise ValueError(
+                    "Please set the VESPA_APP_MTLS_URL environment variable"
+                )
+
+            if not mtls_cert or not mtls_key:
+                raise ValueError(
+                    "USE_MTLS was true, but VESPA_CLOUD_MTLS_KEY and VESPA_CLOUD_MTLS_CERT were not set"
+                )
+
+            # write the key and cert to a file
+            mtls_key_path = "/tmp/vespa-data-plane-private-key.pem"
+            with open(mtls_key_path, "w") as f:
+                f.write(mtls_key)
+
+            mtls_cert_path = "/tmp/vespa-data-plane-public-cert.pem"
+            with open(mtls_cert_path, "w") as f:
+                f.write(mtls_cert)
+
+            # Instantiate Vespa connection
+            self.app = Vespa(
+                url=self.vespa_app_url, key=mtls_key_path, cert=mtls_cert_path
+            )
+        else:
+            self.logger.info("Connected using token")
+            self.vespa_app_url = os.environ.get("VESPA_APP_TOKEN_URL")
+            if not self.vespa_app_url:
+                raise ValueError(
+                    "Please set the VESPA_APP_TOKEN_URL environment variable"
+                )
+
+            self.vespa_cloud_secret_token = os.environ.get("VESPA_CLOUD_SECRET_TOKEN")
+
+            if not self.vespa_cloud_secret_token:
+                raise ValueError(
+                    "Please set the VESPA_CLOUD_SECRET_TOKEN environment variable"
+                )
+
+            # Instantiate Vespa connection
+            self.app = Vespa(
+                url=self.vespa_app_url,
+                vespa_cloud_secret_token=self.vespa_cloud_secret_token,
+            )
+
+        self.app.wait_for_application_up()
+        self.logger.info(f"Connected to Vespa at {self.vespa_app_url}")
+
+    def get_fields(self, sim_map: bool = False):
+        if not sim_map:
+            return self.SELECT_FIELDS
+        else:
+            return "summaryfeatures"
+
+    def format_query_results(
+        self, query: str, response: VespaQueryResponse, hits: int = 5
+    ) -> dict:
+        """
+        Format the Vespa query results.
+
+        Args:
+            query (str): The query text.
+            response (VespaQueryResponse): The response from Vespa.
+            hits (int, optional): Number of hits to display. Defaults to 5.
+
+        Returns:
+            dict: The JSON content of the response.
+        """
+        query_time = response.json.get("timing", {}).get("searchtime", -1)
+        query_time = round(query_time, 2)
+        count = response.json.get("root", {}).get("fields", {}).get("totalCount", 0)
+        result_text = f"Query text: '{query}', query time {query_time}s, count={count}, top results:\n"
+        self.logger.debug(result_text)
+        return response.json
+
+    async def query_vespa_default(
+        self,
+        query: str,
+        q_emb: torch.Tensor,
+        hits: int = 3,
+        timeout: str = "10s",
+        sim_map: bool = False,
+        **kwargs,
+    ) -> dict:
+        """
+        Query Vespa using the default ranking profile.
+
+        Args:
+            query (str): The query text.
+            q_emb (torch.Tensor): Query embeddings.
+            hits (int, optional): Number of hits to retrieve. Defaults to 3.
+            timeout (str, optional): Query timeout. Defaults to "10s".
+
+        Returns:
+            dict: The formatted query results.
+        """
+        async with self.app.asyncio(connections=1) as session:
+            query_embedding = self.format_q_embs(q_emb)
+
+            start = time.perf_counter()
+            response: VespaQueryResponse = await session.query(
+                body={
+                    "yql": (
+                        f"select {self.get_fields(sim_map=sim_map)} from {self.VESPA_SCHEMA_NAME} where userQuery();"
+                    ),
+                    "ranking": self.get_rank_profile("default", sim_map),
+                    "query": query,
+                    "timeout": timeout,
+                    "hits": hits,
+                    "input.query(qt)": query_embedding,
+                    "presentation.timing": True,
+                    **kwargs,
+                },
+            )
+            assert response.is_successful(), response.json
+            stop = time.perf_counter()
+            self.logger.debug(
+                f"Query time + data transfer took: {stop - start} s, Vespa reported searchtime was "
+                f"{response.json.get('timing', {}).get('searchtime', -1)} s"
+            )
+        return self.format_query_results(query, response)
+
+    async def query_vespa_bm25(
+        self,
+        query: str,
+        q_emb: torch.Tensor,
+        hits: int = 3,
+        timeout: str = "10s",
+        sim_map: bool = False,
+        **kwargs,
+    ) -> dict:
+        """
+        Query Vespa using the BM25 ranking profile.
+
+        Args:
+            query (str): The query text.
+            q_emb (torch.Tensor): Query embeddings.
+            hits (int, optional): Number of hits to retrieve. Defaults to 3.
+            timeout (str, optional): Query timeout. Defaults to "10s".
+
+        Returns:
+            dict: The formatted query results.
+        """
+        async with self.app.asyncio(connections=1) as session:
+            query_embedding = self.format_q_embs(q_emb)
+
+            start = time.perf_counter()
+            response: VespaQueryResponse = await session.query(
+                body={
+                    "yql": (
+                        f"select {self.get_fields(sim_map=sim_map)} from {self.VESPA_SCHEMA_NAME} where userQuery();"
+                    ),
+                    "ranking": self.get_rank_profile("bm25", sim_map),
+                    "query": query,
+                    "timeout": timeout,
+                    "hits": hits,
+                    "input.query(qt)": query_embedding,
+                    "presentation.timing": True,
+                    **kwargs,
+                },
+            )
+            assert response.is_successful(), response.json
+            stop = time.perf_counter()
+            self.logger.debug(
+                f"Query time + data transfer took: {stop - start} s, Vespa reported searchtime was "
+                f"{response.json.get('timing', {}).get('searchtime', -1)} s"
+            )
+        return self.format_query_results(query, response)
+
+    def float_to_binary_embedding(self, float_query_embedding: dict) -> dict:
+        """
+        Convert float query embeddings to binary embeddings.
+
+        Args:
+            float_query_embedding (dict): Dictionary of float embeddings.
+
+        Returns:
+            dict: Dictionary of binary embeddings.
+        """
+        binary_query_embeddings = {}
+        for key, vector in float_query_embedding.items():
+            binary_vector = (
+                np.packbits(np.where(np.array(vector) > 0, 1, 0))
+                .astype(np.int8)
+                .tolist()
+            )
+            binary_query_embeddings[key] = binary_vector
+            if len(binary_query_embeddings) >= self.MAX_QUERY_TERMS:
+                self.logger.warning(
+                    f"Warning: Query has more than {self.MAX_QUERY_TERMS} terms. Truncating."
+                )
+                break
+        return binary_query_embeddings
+
+    def create_nn_query_strings(
+        self, binary_query_embeddings: dict, target_hits_per_query_tensor: int = 20
+    ) -> Tuple[str, dict]:
+        """
+        Create nearest neighbor query strings for Vespa.
+
+        Args:
+            binary_query_embeddings (dict): Binary query embeddings.
+            target_hits_per_query_tensor (int, optional): Target hits per query tensor. Defaults to 20.
+
+        Returns:
+            Tuple[str, dict]: Nearest neighbor query string and query tensor dictionary.
+        """
+        nn_query_dict = {}
+        for i in range(len(binary_query_embeddings)):
+            nn_query_dict[f"input.query(rq{i})"] = binary_query_embeddings[i]
+        nn = " OR ".join(
+            [
+                f"({{targetHits:{target_hits_per_query_tensor}}}nearestNeighbor(embedding,rq{i}))"
+                for i in range(len(binary_query_embeddings))
+            ]
+        )
+        return nn, nn_query_dict
+
+    def format_q_embs(self, q_embs: torch.Tensor) -> dict:
+        """
+        Convert query embeddings to a dictionary of lists.
+
+        Args:
+            q_embs (torch.Tensor): Query embeddings tensor.
+
+        Returns:
+            dict: Dictionary where each key is an index and value is the embedding list.
+        """
+        return {idx: emb.tolist() for idx, emb in enumerate(q_embs)}
+
+    async def get_result_from_query(
+        self,
+        query: str,
+        q_embs: torch.Tensor,
+        ranking: str,
+        idx_to_token: dict,
+    ) -> Dict[str, Any]:
+        """
+        Get query results from Vespa based on the ranking method.
+
+        Args:
+            query (str): The query text.
+            q_embs (torch.Tensor): Query embeddings.
+            ranking (str): The ranking method to use.
+            idx_to_token (dict): Index to token mapping.
+
+        Returns:
+            Dict[str, Any]: The query results.
+        """
+
+        # Remove stopwords from the query to avoid visual emphasis on irrelevant words (e.g., "the", "and", "of")
+        query = backend.stopwords.filter(query)
+
+        rank_method = ranking.split("_")[0]
+        sim_map: bool = len(ranking.split("_")) > 1 and ranking.split("_")[1] == "sim"
+        if rank_method == "nn+colpali":
+            result = await self.query_vespa_nearest_neighbor(
+                query, q_embs, sim_map=sim_map
+            )
+        elif rank_method == "bm25+colpali":
+            result = await self.query_vespa_default(query, q_embs, sim_map=sim_map)
+        elif rank_method == "bm25":
+            result = await self.query_vespa_bm25(query, q_embs, sim_map=sim_map)
+        else:
+            raise ValueError(f"Unsupported ranking: {rank_method}")
+        if "root" not in result or "children" not in result["root"]:
+            result["root"] = {"children": []}
+            return result
+        for single_result in result["root"]["children"]:
+            self.logger.debug(single_result["fields"].keys())
+        return result
+
+    def get_sim_maps_from_query(
+        self, query: str, q_embs: torch.Tensor, ranking: str, idx_to_token: dict
+    ):
+        """
+        Get similarity maps from Vespa based on the ranking method.
+
+        Args:
+            query (str): The query text.
+            q_embs (torch.Tensor): Query embeddings.
+            ranking (str): The ranking method to use.
+            idx_to_token (dict): Index to token mapping.
+
+        Returns:
+            Dict[str, Any]: The query results.
+        """
+        # Get the result by calling asyncio.run
+        result = asyncio.run(
+            self.get_result_from_query(query, q_embs, ranking, idx_to_token)
+        )
+        vespa_sim_maps = []
+        for single_result in result["root"]["children"]:
+            vespa_sim_map = single_result["fields"].get("summaryfeatures", None)
+            if vespa_sim_map is not None:
+                vespa_sim_maps.append(vespa_sim_map)
+            else:
+                raise ValueError("No sim_map found in Vespa response")
+        return vespa_sim_maps
+
+    async def get_full_image_from_vespa(self, doc_id: str) -> str:
+        """
+        Retrieve the full image from Vespa for a given document ID.
+
+        Args:
+            doc_id (str): The document ID.
+
+        Returns:
+            str: The full image data.
+        """
+        async with self.app.asyncio(connections=1) as session:
+            start = time.perf_counter()
+            response: VespaQueryResponse = await session.query(
+                body={
+                    "yql": f'select full_image from {self.VESPA_SCHEMA_NAME} where id contains "{doc_id}"',
+                    "ranking": "unranked",
+                    "presentation.timing": True,
+                },
+            )
+            assert response.is_successful(), response.json
+            stop = time.perf_counter()
+            self.logger.debug(
+                f"Getting image from Vespa took: {stop - start} s, Vespa reported searchtime was "
+                f"{response.json.get('timing', {}).get('searchtime', -1)} s"
+            )
+        return response.json["root"]["children"][0]["fields"]["full_image"]
+
+    def get_results_children(self, result: VespaQueryResponse) -> list:
+        return result["root"]["children"]
+
+    def results_to_search_results(
+        self, result: VespaQueryResponse, idx_to_token: dict
+    ) -> list:
+        # Initialize sim_map_ fields in the result
+        fields_to_add = [
+            f"sim_map_{token}_{idx}"
+            for idx, token in idx_to_token.items()
+            if not SimMapGenerator.should_filter_token(token)
+        ]
+        for child in result["root"]["children"]:
+            for sim_map_key in fields_to_add:
+                child["fields"][sim_map_key] = None
+        return self.get_results_children(result)
+
+    async def get_suggestions(self, query: str) -> list:
+        async with self.app.asyncio(connections=1) as session:
+            start = time.perf_counter()
+            yql = f'select questions from {self.VESPA_SCHEMA_NAME} where questions matches (".*{query}.*")'
+            response: VespaQueryResponse = await session.query(
+                body={
+                    "yql": yql,
+                    "query": query,
+                    "ranking": "unranked",
+                    "presentation.timing": True,
+                    "presentation.summary": "suggestions",
+                },
+            )
+            assert response.is_successful(), response.json
+            stop = time.perf_counter()
+            self.logger.debug(
+                f"Getting suggestions from Vespa took: {stop - start} s, Vespa reported searchtime was "
+                f"{response.json.get('timing', {}).get('searchtime', -1)} s"
+            )
+            search_results = (
+                response.json["root"]["children"]
+                if "root" in response.json and "children" in response.json["root"]
+                else []
+            )
+            questions = [
+                result["fields"]["questions"]
+                for result in search_results
+                if "questions" in result["fields"]
+            ]
+            for q in questions:
+                print(q)
+            unique_questions = set([item for sublist in questions for item in sublist])
+
+            # remove an artifact from our data generation
+            if "string" in unique_questions:
+                unique_questions.remove("string")
+
+            return list(unique_questions)
+
+    def get_rank_profile(self, ranking: str, sim_map: bool) -> str:
+        if sim_map:
+            return f"{ranking}_sim"
+        else:
+            return ranking
+
+    async def query_vespa_nearest_neighbor(
+        self,
+        query: str,
+        q_emb: torch.Tensor,
+        target_hits_per_query_tensor: int = 20,
+        hits: int = 3,
+        timeout: str = "10s",
+        sim_map: bool = False,
+        **kwargs,
+    ) -> dict:
+        """
+        Query Vespa using nearest neighbor search with mixed tensors for MaxSim calculations.
+
+        Args:
+            query (str): The query text.
+            q_emb (torch.Tensor): Query embeddings.
+            target_hits_per_query_tensor (int, optional): Target hits per query tensor. Defaults to 20.
+            hits (int, optional): Number of hits to retrieve. Defaults to 3.
+            timeout (str, optional): Query timeout. Defaults to "10s".
+
+        Returns:
+            dict: The formatted query results.
+        """
+        async with self.app.asyncio(connections=1) as session:
+            float_query_embedding = self.format_q_embs(q_emb)
+            binary_query_embeddings = self.float_to_binary_embedding(
+                float_query_embedding
+            )
+
+            # Mixed tensors for MaxSim calculations
+            query_tensors = {
+                "input.query(qtb)": binary_query_embeddings,
+                "input.query(qt)": float_query_embedding,
+            }
+            nn_string, nn_query_dict = self.create_nn_query_strings(
+                binary_query_embeddings, target_hits_per_query_tensor
+            )
+            query_tensors.update(nn_query_dict)
+            response: VespaQueryResponse = await session.query(
+                body={
+                    **query_tensors,
+                    "presentation.timing": True,
+                    "yql": (
+                        f"select {self.get_fields(sim_map=sim_map)} from {self.VESPA_SCHEMA_NAME} where {nn_string} or userQuery()"
+                    ),
+                    "ranking.profile": self.get_rank_profile(
+                        "retrieval-and-rerank", sim_map
+                    ),
+                    "timeout": timeout,
+                    "hits": hits,
+                    "query": query,
+                    **kwargs,
+                },
+            )
+            assert response.is_successful(), response.json
+        return self.format_query_results(query, response)
+
+    async def keepalive(self) -> bool:
+        """
+        Query Vespa to keep the connection alive.
+
+        Returns:
+            bool: True if the connection is alive.
+        """
+        async with self.app.asyncio(connections=1) as session:
+            response: VespaQueryResponse = await session.query(
+                body={
+                    "yql": f"select title from {self.VESPA_SCHEMA_NAME} where true limit 1;",
+                    "ranking": "unranked",
+                    "query": "keepalive",
+                    "timeout": "3s",
+                    "hits": 1,
+                },
+            )
+            assert response.is_successful(), response.json
+        return True

src/frontend/app.py

@@ -0,0 +1,644 @@
+from typing import Optional
+from urllib.parse import quote_plus
+
+from fasthtml.components import H1, H2, H3, Br, Div, Form, Img, NotStr, P, Span, Strong
+from fasthtml.xtend import A, Script
+from lucide_fasthtml import Lucide
+from shad4fast import Badge, Button, Input, Label, RadioGroup, RadioGroupItem, Separator
+
+# JavaScript to check the input value and enable/disable the search button and radio buttons
+check_input_script = Script(
+    """
+        window.onload = function() {
+            const input = document.getElementById('search-input');
+            const button = document.querySelector('[data-button="search-button"]');
+            const radioGroupItems = document.querySelectorAll('button[data-ref="radio-item"]');  // Get all radio buttons
+            
+            function checkInputValue() {
+                const isInputEmpty = input.value.trim() === "";
+                button.disabled = isInputEmpty;  // Disable the submit button
+                radioGroupItems.forEach(item => {
+                    item.disabled = isInputEmpty;  // Disable/enable the radio buttons
+                });
+            }
+
+            input.addEventListener('input', checkInputValue);  // Listen for input changes
+            checkInputValue();  // Initial check when the page loads
+        };
+    """
+)
+
+# JavaScript to handle the image swapping, reset button, and active class toggling
+image_swapping = Script(
+    """
+    document.addEventListener('click', function (e) {
+        if (e.target.classList.contains('sim-map-button') || e.target.classList.contains('reset-button')) {
+            const imgContainer = e.target.closest('.relative'); 
+            const overlayContainer = imgContainer.querySelector('.overlay-container');
+            const newSrc = e.target.getAttribute('data-image-src');
+    
+            // If it's a reset button, remove the overlay image
+            if (e.target.classList.contains('reset-button')) {
+                overlayContainer.innerHTML = '';  // Clear the overlay container, showing only the full image
+            } else {
+                // Create a new overlay image
+                const img = document.createElement('img');
+                img.src = newSrc;
+                img.classList.add('overlay-image', 'absolute', 'top-0', 'left-0', 'w-full', 'h-full');
+                overlayContainer.innerHTML = '';  // Clear any previous overlay
+                overlayContainer.appendChild(img);  // Add the new overlay image
+            }
+    
+            // Toggle active class on buttons
+            const activeButton = document.querySelector('.sim-map-button.active');
+            if (activeButton) {
+                activeButton.classList.remove('active');
+            }
+            if (e.target.classList.contains('sim-map-button')) {
+                e.target.classList.add('active');
+            }
+        }
+    });
+    """
+)
+
+toggle_text_content = Script(
+    """
+    function toggleTextContent(idx) {
+        const textColumn = document.getElementById(`text-column-${idx}`);
+        const imageTextColumns = document.getElementById(`image-text-columns-${idx}`);
+        const toggleButton = document.getElementById(`toggle-button-${idx}`);
+    
+        if (textColumn.classList.contains('md-grid-text-column')) {
+          // Hide the text column
+          textColumn.classList.remove('md-grid-text-column');
+          imageTextColumns.classList.remove('grid-image-text-columns');
+          toggleButton.innerText = `Show Text`;
+        } else {
+          // Show the text column
+          textColumn.classList.add('md-grid-text-column');
+          imageTextColumns.classList.add('grid-image-text-columns');
+          toggleButton.innerText = `Hide Text`;
+        }
+    }
+    """
+)
+
+autocomplete_script = Script(
+    """
+    document.addEventListener('DOMContentLoaded', function() {
+        const input = document.querySelector('#search-input');
+        const awesomplete = new Awesomplete(input, { minChars: 1, maxItems: 5 });
+
+        input.addEventListener('input', function() {
+            if (this.value.length >= 1) {
+                // Use template literals to insert the input value dynamically in the query parameter
+                fetch(`/suggestions?query=${encodeURIComponent(this.value)}`)
+                    .then(response => response.json())
+                    .then(data => {
+                        // Update the Awesomplete list dynamically with fetched suggestions
+                        awesomplete.list = data.suggestions;
+                    })
+                    .catch(err => console.error('Error fetching suggestions:', err));
+            }
+        });
+    });
+    """
+)
+
+dynamic_elements_scrollbars = Script(
+    """
+    (function () {
+        const { applyOverlayScrollbars, getScrollbarTheme } = OverlayScrollbarsManager;
+
+        function applyScrollbarsToDynamicElements() {
+            const scrollbarTheme = getScrollbarTheme();
+
+            // Apply scrollbars to dynamically loaded result-text-full and result-text-snippet elements
+            const resultTextFullElements = document.querySelectorAll('[id^="result-text-full"]');
+            const resultTextSnippetElements = document.querySelectorAll('[id^="result-text-snippet"]');
+
+            resultTextFullElements.forEach(element => {
+                applyOverlayScrollbars(element, scrollbarTheme);
+            });
+
+            resultTextSnippetElements.forEach(element => {
+                applyOverlayScrollbars(element, scrollbarTheme);
+            });
+        }
+
+        // Apply scrollbars after dynamic content is loaded (e.g., after search results)
+        applyScrollbarsToDynamicElements();
+
+        // Observe changes in the 'dark' class to adjust the theme dynamically if needed
+        const observer = new MutationObserver(applyScrollbarsToDynamicElements);
+        observer.observe(document.documentElement, { attributes: true, attributeFilter: ['class'] });
+    })();
+    """
+)
+
+submit_form_on_radio_change = Script(
+    """
+    document.addEventListener('click', function (e) {
+        // if target has data-ref="radio-item" and type is button
+        if (e.target.getAttribute('data-ref') === 'radio-item' && e.target.type === 'button') {
+            console.log('Radio button clicked');
+            const form = e.target.closest('form');
+            form.submit();
+        }
+    });
+    """
+)
+
+
+def SearchBox(with_border=False, query_value="", ranking_value="nn+colpali"):
+    grid_cls = "grid gap-2 items-center p-3 bg-muted w-full"
+
+    if with_border:
+        grid_cls = "grid gap-2 p-3 rounded-md border border-input bg-muted w-full ring-offset-background focus-within:outline-none focus-within:ring-2 focus-within:ring-ring focus-within:ring-offset-2 focus-within:border-input"
+
+    return Form(
+        Div(
+            Lucide(
+                icon="search", cls="absolute left-2 top-2 text-muted-foreground z-10"
+            ),
+            Input(
+                placeholder="Enter your search query...",
+                name="query",
+                value=query_value,
+                id="search-input",
+                cls="text-base pl-10 border-transparent ring-offset-transparent ring-0 focus-visible:ring-transparent bg-white dark:bg-background awesomplete",
+                data_list="#suggestions",
+                style="font-size: 1rem",
+                autofocus=True,
+            ),
+            cls="relative",
+        ),
+        Div(
+            Div(
+                Span("Ranking by:", cls="text-muted-foreground text-xs font-semibold"),
+                RadioGroup(
+                    Div(
+                        RadioGroupItem(value="nn+colpali", id="nn+colpali"),
+                        Label("ColPali", htmlFor="ColPali"),
+                        cls="flex items-center space-x-2",
+                    ),
+                    Div(
+                        RadioGroupItem(value="bm25", id="bm25"),
+                        Label("BM25", htmlFor="BM25"),
+                        cls="flex items-center space-x-2",
+                    ),
+                    Div(
+                        RadioGroupItem(value="bm25+colpali", id="bm25+colpali"),
+                        Label("Hybrid ColPali + BM25", htmlFor="Hybrid ColPali + BM25"),
+                        cls="flex items-center space-x-2",
+                    ),
+                    name="ranking",
+                    default_value=ranking_value,
+                    cls="grid-flow-col gap-x-5 text-muted-foreground",
+                    # Submit form when radio button is clicked
+                ),
+                cls="grid grid-flow-col items-center gap-x-3 border border-input px-3 rounded-sm",
+            ),
+            Button(
+                Lucide(icon="arrow-right", size="21"),
+                size="sm",
+                type="submit",
+                data_button="search-button",
+                disabled=True,
+            ),
+            cls="flex justify-between",
+        ),
+        check_input_script,
+        autocomplete_script,
+        submit_form_on_radio_change,
+        action=f"/search?query={quote_plus(query_value)}&ranking={quote_plus(ranking_value)}",
+        method="GET",
+        hx_get="/fetch_results",  # As the component is a form, input components query and ranking are sent as query parameters automatically, see https://htmx.org/docs/#parameters
+        hx_trigger="load",
+        hx_target="#search-results",
+        hx_swap="outerHTML",
+        hx_indicator="#loading-indicator",
+        cls=grid_cls,
+    )
+
+
+def SampleQueries():
+    sample_queries = [
+        "Total amount of fixed salaries paid in 2023?",
+        "Proportion of female new hires 2021-2023?",
+        "Number of internship applications trend 2021-2023",
+        "Gender balance at level 4 or above in NY office 2023?",
+        "What percentage of the funds unlisted real estate investments were in Switzerland 2023?",
+        "child jumping over puddle",
+        "hula hoop kid",
+    ]
+
+    query_badges = []
+    for query in sample_queries:
+        query_badges.append(
+            A(
+                Badge(
+                    Div(
+                        Lucide(
+                            icon="text-search", size="18", cls="text-muted-foreground"
+                        ),
+                        Span(query, cls="text-base font-normal"),
+                        cls="flex gap-2 items-center",
+                    ),
+                    variant="outline",
+                    cls="text-base font-normal text-muted-foreground hover:border-black dark:hover:border-white",
+                ),
+                href=f"/search?query={quote_plus(query)}",
+                cls="no-underline",
+            )
+        )
+
+    return Div(*query_badges, cls="grid gap-2 justify-items-center")
+
+
+def Hero():
+    return Div(
+        H1(
+            "Vespa.ai + ColPali",
+            cls="text-5xl md:text-7xl font-bold tracking-wide md:tracking-wider bg-clip-text text-transparent bg-gradient-to-r from-black to-slate-700 dark:from-white dark:to-slate-300 animate-fade-in",
+        ),
+        P(
+            "Efficient Document Retrieval with Vision Language Models",
+            cls="text-lg md:text-2xl text-muted-foreground md:tracking-wide",
+        ),
+        cls="grid gap-5 text-center",
+    )
+
+
+def Home():
+    return Div(
+        Div(
+            Hero(),
+            SearchBox(with_border=True),
+            SampleQueries(),
+            cls="grid gap-8 content-start mt-[13vh]",
+        ),
+        cls="grid w-full h-full max-w-screen-md gap-4 mx-auto",
+    )
+
+
+def AboutThisDemo():
+    return Div(
+        Div(
+            Div(
+                H1(
+                    "Vespa.ai + ColPali",
+                    cls="text-5xl font-bold tracking-wide md:tracking-wider",
+                ),
+                P(
+                    "Efficient Document Retrieval with Vision Language Models",
+                    cls="text-lg text-muted-foreground md:tracking-wide",
+                ),
+                Div(
+                    Img(
+                        src="/static/img/vespa-colpali.png",
+                        alt="Vespa and ColPali",
+                        cls="object-contain h-[377px]",
+                    ),
+                    cls="grid justify-center",
+                ),
+                Div(
+                    P(
+                        "This is a demo application showcasing the integration of Vespa.ai and ColPali for visual retrieval of documents.",
+                        cls="text-base",
+                    ),
+                    P(
+                        "The application uses a combination of neural networks and traditional search algorithms to retrieve relevant documents based on visual and textual queries.",
+                        cls="text-base",
+                    ),
+                    cls="grid gap-2 text-center",
+                ),
+                cls="grid gap-5 text-center",
+            ),
+            cls="grid gap-8 content-start mt-[8vh]",
+        ),
+        cls="grid w-full h-full max-w-screen-md gap-4 mx-auto",
+    )
+
+
+def Search(request, search_results=[]):
+    query_value = request.query_params.get("query", "").strip()
+    ranking_value = request.query_params.get("ranking", "nn+colpali")
+    return Div(
+        Div(
+            Div(
+                SearchBox(query_value=query_value, ranking_value=ranking_value),
+                Div(
+                    LoadingMessage(),
+                    id="search-results",  # This will be replaced by the search results
+                ),
+                cls="grid",
+            ),
+            cls="grid",
+        ),
+    )
+
+
+def LoadingMessage(display_text="Retrieving search results"):
+    return Div(
+        Lucide(icon="loader-circle", cls="size-5 mr-1.5 animate-spin"),
+        Span(display_text, cls="text-base text-center"),
+        cls="p-10 text-muted-foreground flex items-center justify-center",
+        id="loading-indicator",
+    )
+
+
+def LoadingSkeleton():
+    return Div(
+        Div(cls="h-5 bg-muted"),
+        Div(cls="h-5 bg-muted"),
+        Div(cls="h-5 bg-muted"),
+        cls="grid gap-2 animate-pulse",
+    )
+
+
+def SimMapButtonReady(query_id, idx, token, token_idx, img_src):
+    return Button(
+        token.replace("\u2581", ""),
+        size="sm",
+        data_image_src=img_src,
+        id=f"sim-map-button-{query_id}-{idx}-{token_idx}-{token}",
+        cls="sim-map-button pointer-events-auto font-mono text-xs h-5 rounded-none px-2",
+    )
+
+
+def SimMapButtonPoll(query_id, idx, token, token_idx):
+    return Button(
+        Lucide(icon="loader-circle", size="15", cls="animate-spin"),
+        size="sm",
+        disabled=True,
+        hx_get=f"/get_sim_map?query_id={query_id}&idx={idx}&token={token}&token_idx={token_idx}",
+        hx_trigger="every 0.5s",
+        hx_swap="outerHTML",
+        cls="pointer-events-auto text-xs h-5 rounded-none px-2",
+    )
+
+
+def SearchInfo(search_time, total_count):
+    return (
+        Div(
+            Span(
+                "Retrieved ",
+                Strong(total_count),
+                Span(" results"),
+                Span(" in "),
+                Strong(f"{search_time:.3f}"),  # 3 significant digits
+                Span(" seconds."),
+            ),
+            cls="grid bg-background border-t text-sm text-center p-3",
+        ),
+    )
+
+
+def SearchResult(
+    results: list,
+    query: str,
+    query_id: Optional[str] = None,
+    search_time: float = 0,
+    total_count: int = 0,
+):
+    if not results:
+        return Div(
+            P(
+                "No results found for your query.",
+                cls="text-muted-foreground text-base text-center",
+            ),
+            cls="grid p-10",
+        )
+
+    doc_ids = []
+    # Otherwise, display the search results
+    result_items = []
+    for idx, result in enumerate(results):
+        fields = result["fields"]  # Extract the 'fields' part of each result
+        doc_id = fields["id"]
+        doc_ids.append(doc_id)
+        blur_image_base64 = f"data:image/jpeg;base64,{fields['blur_image']}"
+
+        sim_map_fields = {
+            key: value
+            for key, value in fields.items()
+            if key.startswith(
+                "sim_map_"
+            )  # filtering is done before creating with 'should_filter_token'-function
+        }
+
+        # Generate buttons for the sim_map fields
+        sim_map_buttons = []
+        for key, value in sim_map_fields.items():
+            token = key.split("_")[-2]
+            token_idx = int(key.split("_")[-1])
+            if value is not None:
+                sim_map_base64 = f"data:image/jpeg;base64,{value}"
+                sim_map_buttons.append(
+                    SimMapButtonReady(
+                        query_id=query_id,
+                        idx=idx,
+                        token=token,
+                        token_idx=token_idx,
+                        img_src=sim_map_base64,
+                    )
+                )
+            else:
+                sim_map_buttons.append(
+                    SimMapButtonPoll(
+                        query_id=query_id,
+                        idx=idx,
+                        token=token,
+                        token_idx=token_idx,
+                    )
+                )
+
+        # Add "Reset Image" button to restore the full image
+        reset_button = Button(
+            "Reset",
+            variant="outline",
+            size="sm",
+            data_image_src=blur_image_base64,
+            cls="reset-button pointer-events-auto font-mono text-xs h-5 rounded-none px-2",
+        )
+
+        tokens_icon = Lucide(icon="images", size="15")
+
+        # Add "Tokens" button - this has no action, just a placeholder
+        tokens_button = Button(
+            tokens_icon,
+            "Tokens",
+            size="sm",
+            cls="tokens-button flex gap-[3px] font-bold pointer-events-none font-mono text-xs h-5 rounded-none px-2",
+        )
+
+        result_items.append(
+            Div(
+                Div(
+                    Div(
+                        Lucide(icon="file-text"),
+                        H2(fields["title"], cls="text-xl md:text-2xl font-semibold"),
+                        Separator(orientation="vertical"),
+                        Badge(
+                            f"Relevance score: {result['relevance']:.4f}",
+                            cls="flex gap-1.5 items-center justify-center",
+                        ),
+                        cls="flex items-center gap-2",
+                    ),
+                    Div(
+                        Button(
+                            "Hide Text",
+                            size="sm",
+                            id=f"toggle-button-{idx}",
+                            onclick=f"toggleTextContent({idx})",
+                            cls="hidden md:block",
+                        ),
+                    ),
+                    cls="flex flex-wrap items-center justify-between bg-background px-3 py-4",
+                ),
+                Div(
+                    Div(
+                        Div(
+                            tokens_button,
+                            *sim_map_buttons,
+                            reset_button,
+                            cls="flex flex-wrap gap-px w-full pointer-events-none",
+                        ),
+                        Div(
+                            Div(
+                                Div(
+                                    Img(
+                                        src=blur_image_base64,
+                                        hx_get=f"/full_image?doc_id={doc_id}",
+                                        style="backdrop-filter: blur(5px);",
+                                        hx_trigger="load",
+                                        hx_swap="outerHTML",
+                                        alt=fields["title"],
+                                        cls="result-image w-full h-full object-contain",
+                                    ),
+                                    Div(
+                                        cls="overlay-container absolute top-0 left-0 w-full h-full pointer-events-none"
+                                    ),
+                                    cls="relative w-full h-full",
+                                ),
+                                cls="grid bg-muted p-2",
+                            ),
+                            cls="block",
+                        ),
+                        id=f"image-column-{idx}",
+                        cls="image-column relative bg-background px-3 py-5 grid-image-column",
+                    ),
+                    Div(
+                        Div(
+                            A(
+                                Lucide(icon="external-link", size="18"),
+                                f"PDF Source (Page {fields['page_number'] + 1})",
+                                href=f"{fields['url']}#page={fields['page_number'] + 1}",
+                                target="_blank",
+                                cls="flex items-center gap-1.5 font-mono bold text-sm",
+                            ),
+                            cls="flex items-center justify-end",
+                        ),
+                        Div(
+                            Div(
+                                Div(
+                                    Div(
+                                        Div(
+                                            H3(
+                                                "Dynamic summary",
+                                                cls="text-base font-semibold",
+                                            ),
+                                            P(
+                                                NotStr(fields.get("snippet", "")),
+                                                cls="text-highlight text-muted-foreground",
+                                            ),
+                                            cls="grid grid-rows-[auto_0px] content-start gap-y-3",
+                                        ),
+                                        id=f"result-text-snippet-{idx}",
+                                        cls="grid gap-y-3 p-8 border border-dashed",
+                                    ),
+                                    Div(
+                                        Div(
+                                            Div(
+                                                H3(
+                                                    "Full text",
+                                                    cls="text-base font-semibold",
+                                                ),
+                                                Div(
+                                                    P(
+                                                        NotStr(fields.get("text", "")),
+                                                        cls="text-highlight text-muted-foreground",
+                                                    ),
+                                                    Br(),
+                                                ),
+                                                cls="grid grid-rows-[auto_0px] content-start gap-y-3",
+                                            ),
+                                            id=f"result-text-full-{idx}",
+                                            cls="grid gap-y-3 p-8 border border-dashed",
+                                        ),
+                                        Div(
+                                            cls="absolute inset-x-0 bottom-0 bg-gradient-to-t from-[#fcfcfd] dark:from-[#1c2024] pt-[7%]"
+                                        ),
+                                        cls="relative grid",
+                                    ),
+                                    cls="grid grid-rows-[1fr_1fr] xl:grid-rows-[1fr_2fr] gap-y-8 p-8 text-sm",
+                                ),
+                                cls="grid bg-background",
+                            ),
+                            cls="grid bg-muted p-2",
+                        ),
+                        id=f"text-column-{idx}",
+                        cls="text-column relative bg-background px-3 py-5 hidden md-grid-text-column",
+                    ),
+                    id=f"image-text-columns-{idx}",
+                    cls="relative grid grid-cols-1 border-t grid-image-text-columns",
+                ),
+                cls="grid grid-cols-1 grid-rows-[auto_auto_1fr]",
+            ),
+        )
+
+    return [
+        Div(
+            SearchInfo(search_time, total_count),
+            *result_items,
+            image_swapping,
+            toggle_text_content,
+            dynamic_elements_scrollbars,
+            id="search-results",
+            cls="grid grid-cols-1 gap-px bg-border min-h-0",
+        ),
+        Div(
+            ChatResult(query_id=query_id, query=query, doc_ids=doc_ids),
+            hx_swap_oob="true",
+            id="chat_messages",
+        ),
+    ]
+
+
+def ChatResult(query_id: str, query: str, doc_ids: Optional[list] = None):
+    messages = Div(LoadingSkeleton())
+
+    if doc_ids:
+        messages = Div(
+            LoadingSkeleton(),
+            hx_ext="sse",
+            sse_connect=f"/get-message?query_id={query_id}&doc_ids={','.join(doc_ids)}&query={quote_plus(query)}",
+            sse_swap="message",
+            sse_close="close",
+            hx_swap="innerHTML",
+        )
+
+    return Div(
+        Div("AI-response (Gemini-8B)", cls="text-xl font-semibold p-5"),
+        Div(
+            Div(
+                messages,
+            ),
+            id="chat-messages",
+            cls="overflow-auto min-h-0 grid items-end px-5",
+        ),
+        id="chat_messages",
+        cls="h-full grid grid-rows-[auto_1fr_auto] min-h-0 gap-3",
+    )

src/frontend/layout.py

@@ -0,0 +1,171 @@
+from fasthtml.components import Body, Div, Header, Img, Nav, Title
+from fasthtml.xtend import A, Script
+from lucide_fasthtml import Lucide
+from shad4fast import Button, Separator
+
+layout_script = Script(
+    """
+    document.addEventListener("DOMContentLoaded", function () {
+          const main = document.querySelector('main');
+          const aside = document.querySelector('aside');
+          const body = document.body;
+        
+          if (main && aside && main.nextElementSibling === aside) {
+            // If we have both main and aside, adjust the layout for larger screens
+            body.classList.remove('grid-cols-1'); // Remove single-column layout
+            body.classList.add('md:grid-cols-[minmax(0,_45fr)_minmax(0,_15fr)]'); // Two-column layout on larger screens
+          } else if (main) {
+            // If only main, keep it full width
+            body.classList.add('grid-cols-1');
+          }
+    });
+    """
+)
+
+overlay_scrollbars_manager = Script(
+    """
+    (function () {
+        const { OverlayScrollbars } = OverlayScrollbarsGlobal;
+
+        function getPreferredTheme() {
+            return localStorage.theme === 'dark' || (!('theme' in localStorage) && window.matchMedia('(prefers-color-scheme: dark)').matches)
+                ? 'dark'
+                : 'light';
+        }
+
+        function applyOverlayScrollbars(element, scrollbarTheme) {
+            // Destroy existing OverlayScrollbars instance if it exists
+            const instance = OverlayScrollbars(element);
+            if (instance) {
+                instance.destroy();
+            }
+
+            // Reinitialize OverlayScrollbars with the correct theme and settings
+            OverlayScrollbars(element, {
+                overflow: {
+                    x: 'hidden',
+                    y: 'scroll'
+                },
+                scrollbars: {
+                    theme: scrollbarTheme,
+                    visibility: 'auto',
+                    autoHide: 'leave',
+                    autoHideDelay: 800
+                }
+            });
+        }
+
+        // Function to get the current scrollbar theme (light or dark)
+        function getScrollbarTheme() {
+            const isDarkMode = getPreferredTheme() === 'dark';
+            return isDarkMode ? 'os-theme-light' : 'os-theme-dark';  // Light theme in dark mode, dark theme in light mode
+        }
+
+        // Expose the common functions globally for reuse
+        window.OverlayScrollbarsManager = {
+            applyOverlayScrollbars: applyOverlayScrollbars,
+            getScrollbarTheme: getScrollbarTheme
+        };
+    })();
+    """
+)
+
+static_elements_scrollbars = Script(
+    """
+    (function () {
+        const { applyOverlayScrollbars, getScrollbarTheme } = OverlayScrollbarsManager;
+
+        function applyScrollbarsToStaticElements() {
+            const mainElement = document.querySelector('main');
+            const chatMessagesElement = document.querySelector('#chat-messages');
+
+            const scrollbarTheme = getScrollbarTheme();
+
+            if (mainElement) {
+                applyOverlayScrollbars(mainElement, scrollbarTheme);
+            }
+
+            if (chatMessagesElement) {
+                applyOverlayScrollbars(chatMessagesElement, scrollbarTheme);
+            }
+        }
+
+        // Apply the scrollbars on page load
+        applyScrollbarsToStaticElements();
+
+        // Observe changes in the 'dark' class on the <html> element to adjust the theme dynamically
+        const observer = new MutationObserver(applyScrollbarsToStaticElements);
+        observer.observe(document.documentElement, { attributes: true, attributeFilter: ['class'] });
+    })();
+    """
+)
+
+
+def Logo():
+    return Div(
+        Img(
+            src="https://assets.vespa.ai/logos/vespa-logo-black.svg",
+            alt="Vespa Logo",
+            cls="h-full dark:hidden",
+        ),
+        Img(
+            src="https://assets.vespa.ai/logos/vespa-logo-white.svg",
+            alt="Vespa Logo Dark Mode",
+            cls="h-full hidden dark:block",
+        ),
+        cls="h-[27px]",
+    )
+
+
+def ThemeToggle(variant="ghost", cls=None, **kwargs):
+    return Button(
+        Lucide("sun", cls="dark:flex hidden"),
+        Lucide("moon", cls="dark:hidden"),
+        variant=variant,
+        size="icon",
+        cls=f"theme-toggle {cls}",
+        **kwargs,
+    )
+
+
+def Links():
+    return Nav(
+        A(
+            Button("About this demo?", variant="link"),
+            href="/about-this-demo",
+        ),
+        Separator(orientation="vertical"),
+        A(
+            Button(Lucide(icon="github"), size="icon", variant="ghost"),
+            href="https://github.com/vespa-engine/vespa",
+            target="_blank",
+        ),
+        A(
+            Button(Lucide(icon="slack"), size="icon", variant="ghost"),
+            href="https://slack.vespa.ai",
+            target="_blank",
+        ),
+        Separator(orientation="vertical"),
+        ThemeToggle(),
+        cls="flex items-center space-x-2",
+    )
+
+
+def Layout(*c, is_home=False, **kwargs):
+    return (
+        Title("Visual Retrieval ColPali"),
+        Body(
+            Header(
+                A(Logo(), href="/"),
+                Links(),
+                cls="min-h-[55px] h-[55px] w-full flex items-center justify-between px-4",
+            ),
+            *c,
+            **kwargs,
+            data_is_home=str(is_home).lower(),
+            cls="grid grid-rows-[minmax(0,55px)_minmax(0,1fr)] min-h-0",
+        ),
+        layout_script,
+        overlay_scrollbars_manager,
+        static_elements_scrollbars,
+    )

src/globals.css

@@ -0,0 +1,293 @@
+@tailwind base;
+@tailwind components;
+@tailwind utilities;
+
+
+@layer base {
+    :root {
+        --background: 240 20% 99%; /* 1 */
+        --foreground: 210 13% 13%; /* 12 */
+        --card: 240 20% 99%; /* 1 */
+        --card-foreground: 210 13% 13%; /* 12 */
+        --popover: 240 20% 99%; /* 1 */
+        --popover-foreground: 210 13% 13%; /* 12 */
+        --primary: 210 13% 13%; /* 12 */
+        --primary-foreground: 240 20% 98%; /* 2 */
+        --secondary: 240 11% 95%; /* 3 */
+        --secondary-foreground: 210 13% 13%; /* 12 */
+        --muted: 240 11% 95%; /* 3 */
+        --muted-foreground: 220 6% 40%; /* 11 */
+        --accent: 240 11% 95%; /* 3 */
+        --accent-foreground: 210 13% 13%; /* 12 */
+        --destructive: 358 75% 59%; /* 9 - red */
+        --destructive-foreground: 240 20% 98%; /* 2 */
+        --border: 240 10% 86%; /* 6 */
+        --input: 240 10% 86%; /* 6 */
+        --ring: 210 13% 13%; /* 12 */
+        --chart-1: 10 78% 54%; /* 9 - tomato */
+        --chart-2: 173 80% 36%; /* 9 - teal */
+        --chart-3: 206 100% 50%; /* 9 - blue */
+        --chart-4: 42 100% 62%; /* 9 - amber */
+        --chart-5: 23 93% 53%; /* 9 - orange */
+    }
+
+    .dark {
+        --background: 240 6% 7%; /* 1 */
+        --foreground: 220 9% 94%; /* 12 */
+        --card: 240 6% 7%; /* 1 */
+        --card-foreground: 220 9% 94%; /* 12 */
+        --popover: 240 6% 7%; /* 1 */
+        --popover-foreground: 220 9% 94%; /* 12 */
+        --primary: 220 9% 94%; /* 12 */
+        --primary-foreground: 220 6% 10%; /* 2 */
+        --secondary: 225 6% 14%; /* 3 */
+        --secondary-foreground: 220 9% 94%; /* 12 */
+        --muted: 225 6% 14%; /* 3 */
+        --muted-foreground: 216 7% 71%; /* 11 */
+        --accent: 225 6% 14%; /* 3 */
+        --accent-foreground: 220 9% 94%; /* 12 */
+        --destructive: 358 75% 59%; /* 9 - red */
+        --destructive-foreground: 220 9% 94%; /* 12 */
+        --border: 213 8% 23%; /* 6 */
+        --input: 213 8% 23%; /* 6 */
+        --ring: 220 9% 94%; /* 12 */
+        --chart-1: 10 78% 54%; /* 9 - tomato */
+        --chart-2: 173 80% 36%; /* 9 - teal */
+        --chart-3: 206 100% 50%; /* 9 - blue */
+        --chart-4: 42 100% 62%; /* 9 - amber */
+        --chart-5: 23 93% 53%; /* 9 - orange */
+    }
+}
+
+@layer base {
+    :root:has(.no-bg-scroll) {
+        overflow: hidden;
+    }
+
+    * {
+        @apply border-border;
+    }
+
+    body {
+        @apply bg-background text-foreground antialiased min-h-screen;
+        font-feature-settings: "rlig" 1, "calt" 1;
+    }
+}
+
+@layer utilities {
+
+    /* Hide scrollbar for Chrome, Safari and Opera */
+    .no-scrollbar::-webkit-scrollbar {
+        display: none;
+    }
+
+    /* Hide scrollbar for IE, Edge and Firefox */
+    .no-scrollbar {
+        -webkit-overflow-scrolling: touch;
+        -ms-overflow-style: none;
+        /* IE and Edge */
+        scrollbar-width: none;
+        /* Firefox */
+    }
+}
+
+@keyframes slideInFromTop {
+    from {
+        transform: translateY(-100%);
+    }
+
+    to {
+        transform: translateY(0);
+    }
+}
+
+@keyframes slideInFromBottom {
+    from {
+        transform: translateY(100%);
+    }
+
+    to {
+        transform: translateY(0);
+    }
+}
+
+.toast {
+    animation-duration: 0.2s;
+    animation-fill-mode: forwards;
+}
+
+@media (max-width: 640px) {
+    .toast {
+        animation-name: slideInFromTop;
+    }
+}
+
+@media (min-width: 641px) {
+    .toast {
+        animation-name: slideInFromBottom;
+    }
+}
+
+@keyframes fade-in {
+    from {
+        opacity: 0;
+    }
+    to {
+        opacity: 1;
+    }
+}
+
+@keyframes slide-up {
+    from {
+        transform: translateY(20px);
+        opacity: 0;
+    }
+    to {
+        transform: translateY(0);
+        opacity: 1;
+    }
+}
+
+.animate-fade-in {
+    animation: fade-in 1s ease-out forwards;
+}
+
+.animate-slide-up {
+    animation: slide-up 1s ease-out forwards;
+}
+
+.sim-map-button.active {
+    background-color: #61D790;
+    color: #2E2F27;
+
+    &:hover {
+        background-color: #61D790;
+    }
+}
+
+.text-highlight strong {
+    color: black;
+
+    .dark & {
+        color: white;
+    }
+}
+
+.tokens-button {
+    background-color: #B7E2F1;
+    color: #2E2F27;
+}
+
+.overlay-image {
+    opacity: 0.5;
+    position: absolute;
+    top: 0;
+    left: 0;
+    width: 100%;
+    height: 100%;
+    z-index: 10;
+}
+
+header {
+    grid-column: 1/-1;
+}
+
+body {
+    &[data-is-home="true"] {
+        background: radial-gradient(circle at 50% 100%, #fcfcfd, #fcfcfd, #fdfdfe, #fdfdfe, #fefefe, #fefefe, #ffffff, #ffffff);
+
+        .dark & {
+            background: radial-gradient(circle at 50% 50%, #272a2d, #242629, #212326, #1e1f22, #1b1c1e, #18181b, #151517, #111113);
+        }
+    }
+}
+
+main {
+    overflow: auto;
+}
+
+aside {
+    overflow: auto;
+}
+
+.scroll-container {
+    padding-right: 10px;
+}
+
+.question-message {
+    background-color: #61D790;
+    color: #2E2F27;
+}
+
+.grid-image-text-columns {
+    @apply md:grid-cols-2 md:col-span-2
+}
+
+.grid-image-column {
+    @apply grid grid-rows-subgrid row-span-2 content-start;
+}
+
+.md-grid-text-column {
+    @apply md:grid md:grid-rows-subgrid md:row-span-2 md:content-start;
+}
+
+#search-input[aria-expanded="true"] {
+    border-top: 1px solid hsl(var(--input));
+    border-left: 1px solid hsl(var(--input));
+    border-right: 1px solid hsl(var(--input));
+    border-bottom: none;
+    border-bottom-left-radius: 0;
+    border-bottom-right-radius: 0;
+}
+
+.awesomplete {
+    width: 100%;
+}
+
+.awesomplete > ul {
+    @apply text-sm space-y-1;
+    margin: 0;
+    border-top: none;
+    border-left: 1px solid hsl(var(--input));
+    border-right: 1px solid hsl(var(--input));
+    border-bottom: 1px solid hsl(var(--input));
+    border-radius: 0 0 calc(var(--radius) - 2px) calc(var(--radius) - 2px);
+    background: white;
+
+    .dark & {
+        background: hsl(var(--background));
+    }
+
+    box-shadow: none;
+    text-shadow: none;
+}
+
+.awesomplete > ul:before {
+    display: none;
+}
+
+.awesomplete > ul > li:hover {
+    background-color: #B7E2F1;
+    color: #2E2F27;
+}
+
+.awesomplete > ul > li[aria-selected="true"] {
+    background-color: #B7E2F1;
+    color: #2E2F27;
+}
+
+.awesomplete mark {
+    background-color: #61D790;
+    color: #2E2F27;
+}
+
+.awesomplete li:hover mark {
+    background-color: #61D790;
+    color: #2E2F27;
+}
+
+.awesomplete li[aria-selected="true"] mark {
+    background-color: #61D790;
+    color: #2E2F27;
+}
+

src/icons.py

@@ -0,0 +1 @@
+ICONS = {"chevrons-right": "<path d=\"m6 17 5-5-5-5\"></path><path d=\"m13 17 5-5-5-5\"></path>", "moon": "<path d=\"M12 3a6 6 0 0 0 9 9 9 9 0 1 1-9-9Z\"></path>", "sun": "<circle cx=\"12\" cy=\"12\" r=\"4\"></circle><path d=\"M12 2v2\"></path><path d=\"M12 20v2\"></path><path d=\"m4.93 4.93 1.41 1.41\"></path><path d=\"m17.66 17.66 1.41 1.41\"></path><path d=\"M2 12h2\"></path><path d=\"M20 12h2\"></path><path d=\"m6.34 17.66-1.41 1.41\"></path><path d=\"m19.07 4.93-1.41 1.41\"></path>", "github": "<path d=\"M15 22v-4a4.8 4.8 0 0 0-1-3.5c3 0 6-2 6-5.5.08-1.25-.27-2.48-1-3.5.28-1.15.28-2.35 0-3.5 0 0-1 0-3 1.5-2.64-.5-5.36-.5-8 0C6 2 5 2 5 2c-.3 1.15-.3 2.35 0 3.5A5.403 5.403 0 0 0 4 9c0 3.5 3 5.5 6 5.5-.39.49-.68 1.05-.85 1.65-.17.6-.22 1.23-.15 1.85v4\"></path><path d=\"M9 18c-4.51 2-5-2-7-2\"></path>", "slack": "<rect height=\"8\" rx=\"1.5\" width=\"3\" x=\"13\" y=\"2\"></rect><path d=\"M19 8.5V10h1.5A1.5 1.5 0 1 0 19 8.5\"></path><rect height=\"8\" rx=\"1.5\" width=\"3\" x=\"8\" y=\"14\"></rect><path d=\"M5 15.5V14H3.5A1.5 1.5 0 1 0 5 15.5\"></path><rect height=\"3\" rx=\"1.5\" width=\"8\" x=\"14\" y=\"13\"></rect><path d=\"M15.5 19H14v1.5a1.5 1.5 0 1 0 1.5-1.5\"></path><rect height=\"3\" rx=\"1.5\" width=\"8\" x=\"2\" y=\"8\"></rect><path d=\"M8.5 5H10V3.5A1.5 1.5 0 1 0 8.5 5\"></path>", "settings": "<path d=\"M12.22 2h-.44a2 2 0 0 0-2 2v.18a2 2 0 0 1-1 1.73l-.43.25a2 2 0 0 1-2 0l-.15-.08a2 2 0 0 0-2.73.73l-.22.38a2 2 0 0 0 .73 2.73l.15.1a2 2 0 0 1 1 1.72v.51a2 2 0 0 1-1 1.74l-.15.09a2 2 0 0 0-.73 2.73l.22.38a2 2 0 0 0 2.73.73l.15-.08a2 2 0 0 1 2 0l.43.25a2 2 0 0 1 1 1.73V20a2 2 0 0 0 2 2h.44a2 2 0 0 0 2-2v-.18a2 2 0 0 1 1-1.73l.43-.25a2 2 0 0 1 2 0l.15.08a2 2 0 0 0 2.73-.73l.22-.39a2 2 0 0 0-.73-2.73l-.15-.08a2 2 0 0 1-1-1.74v-.5a2 2 0 0 1 1-1.74l.15-.09a2 2 0 0 0 .73-2.73l-.22-.38a2 2 0 0 0-2.73-.73l-.15.08a2 2 0 0 1-2 0l-.43-.25a2 2 0 0 1-1-1.73V4a2 2 0 0 0-2-2z\"></path><circle cx=\"12\" cy=\"12\" r=\"3\"></circle>", "arrow-right": "<path d=\"M5 12h14\"></path><path d=\"m12 5 7 7-7 7\"></path>", "search": "<circle cx=\"11\" cy=\"11\" r=\"8\"></circle><path d=\"m21 21-4.3-4.3\"></path>", "file-search": "<path d=\"M14 2v4a2 2 0 0 0 2 2h4\"></path><path d=\"M4.268 21a2 2 0 0 0 1.727 1H18a2 2 0 0 0 2-2V7l-5-5H6a2 2 0 0 0-2 2v3\"></path><path d=\"m9 18-1.5-1.5\"></path><circle cx=\"5\" cy=\"14\" r=\"3\"></circle>", "message-circle-question": "<path d=\"M7.9 20A9 9 0 1 0 4 16.1L2 22Z\"></path><path d=\"M9.09 9a3 3 0 0 1 5.83 1c0 2-3 3-3 3\"></path><path d=\"M12 17h.01\"></path>", "text-search": "<path d=\"M21 6H3\"></path><path d=\"M10 12H3\"></path><path d=\"M10 18H3\"></path><circle cx=\"17\" cy=\"15\" r=\"3\"></circle><path d=\"m21 19-1.9-1.9\"></path>", "maximize": "<path d=\"M8 3H5a2 2 0 0 0-2 2v3\"></path><path d=\"M21 8V5a2 2 0 0 0-2-2h-3\"></path><path d=\"M3 16v3a2 2 0 0 0 2 2h3\"></path><path d=\"M16 21h3a2 2 0 0 0 2-2v-3\"></path>", "expand": "<path d=\"m21 21-6-6m6 6v-4.8m0 4.8h-4.8\"></path><path d=\"M3 16.2V21m0 0h4.8M3 21l6-6\"></path><path d=\"M21 7.8V3m0 0h-4.8M21 3l-6 6\"></path><path d=\"M3 7.8V3m0 0h4.8M3 3l6 6\"></path>", "fullscreen": "<path d=\"M3 7V5a2 2 0 0 1 2-2h2\"></path><path d=\"M17 3h2a2 2 0 0 1 2 2v2\"></path><path d=\"M21 17v2a2 2 0 0 1-2 2h-2\"></path><path d=\"M7 21H5a2 2 0 0 1-2-2v-2\"></path><rect height=\"8\" rx=\"1\" width=\"10\" x=\"7\" y=\"8\"></rect>", "images": "<path d=\"M18 22H4a2 2 0 0 1-2-2V6\"></path><path d=\"m22 13-1.296-1.296a2.41 2.41 0 0 0-3.408 0L11 18\"></path><circle cx=\"12\" cy=\"8\" r=\"2\"></circle><rect height=\"16\" rx=\"2\" width=\"16\" x=\"6\" y=\"2\"></rect>", "circle": "<circle cx=\"12\" cy=\"12\" r=\"10\"></circle>", "loader-circle": "<path d=\"M21 12a9 9 0 1 1-6.219-8.56\"></path>", "file-text": "<path d=\"M15 2H6a2 2 0 0 0-2 2v16a2 2 0 0 0 2 2h12a2 2 0 0 0 2-2V7Z\"></path><path d=\"M14 2v4a2 2 0 0 0 2 2h4\"></path><path d=\"M10 9H8\"></path><path d=\"M16 13H8\"></path><path d=\"M16 17H8\"></path>", "file-question": "<path d=\"M12 17h.01\"></path><path d=\"M15 2H6a2 2 0 0 0-2 2v16a2 2 0 0 0 2 2h12a2 2 0 0 0 2-2V7z\"></path><path d=\"M9.1 9a3 3 0 0 1 5.82 1c0 2-3 3-3 3\"></path>", "external-link": "<path d=\"M15 3h6v6\"></path><path d=\"M10 14 21 3\"></path><path d=\"M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6\"></path>"}

src/main.py

@@ -0,0 +1,420 @@
+import asyncio
+import base64
+import os
+import time
+import uuid
+import logging
+import sys
+from concurrent.futures import ThreadPoolExecutor
+from pathlib import Path
+
+import google.generativeai as genai
+from fastcore.parallel import threaded
+from fasthtml.common import (
+    Aside,
+    Div,
+    FileResponse,
+    HighlightJS,
+    Img,
+    JSONResponse,
+    Link,
+    Main,
+    P,
+    RedirectResponse,
+    Script,
+    StreamingResponse,
+    fast_app,
+    serve,
+)
+from PIL import Image
+from shad4fast import ShadHead
+from vespa.application import Vespa
+
+from backend.colpali import SimMapGenerator
+from backend.vespa_app import VespaQueryClient
+from frontend.app import (
+    AboutThisDemo,
+    ChatResult,
+    Home,
+    Search,
+    SearchBox,
+    SearchResult,
+    SimMapButtonPoll,
+    SimMapButtonReady,
+)
+from frontend.layout import Layout
+
+highlight_js_theme_link = Link(id="highlight-theme", rel="stylesheet", href="")
+highlight_js_theme = Script(src="/static/js/highlightjs-theme.js")
+highlight_js = HighlightJS(
+    langs=["python", "javascript", "java", "json", "xml"],
+    dark="github-dark",
+    light="github",
+)
+
+overlayscrollbars_link = Link(
+    rel="stylesheet",
+    href="https://cdnjs.cloudflare.com/ajax/libs/overlayscrollbars/2.10.0/styles/overlayscrollbars.min.css",
+    type="text/css",
+)
+overlayscrollbars_js = Script(
+    src="https://cdnjs.cloudflare.com/ajax/libs/overlayscrollbars/2.10.0/browser/overlayscrollbars.browser.es5.min.js"
+)
+awesomplete_link = Link(
+    rel="stylesheet",
+    href="https://cdnjs.cloudflare.com/ajax/libs/awesomplete/1.1.7/awesomplete.min.css",
+    type="text/css",
+)
+awesomplete_js = Script(
+    src="https://cdnjs.cloudflare.com/ajax/libs/awesomplete/1.1.7/awesomplete.min.js"
+)
+sselink = Script(src="https://unpkg.com/htmx-ext-sse@2.2.1/sse.js")
+
+# Get log level from environment variable, default to INFO
+LOG_LEVEL = os.getenv("LOG_LEVEL", "INFO").upper()
+# Configure logger
+logger = logging.getLogger("vespa_app")
+handler = logging.StreamHandler(sys.stdout)
+handler.setFormatter(
+    logging.Formatter(
+        "%(levelname)s: \t %(asctime)s \t %(message)s",
+        datefmt="%Y-%m-%d %H:%M:%S",
+    )
+)
+logger.addHandler(handler)
+logger.setLevel(getattr(logging, LOG_LEVEL))
+
+app, rt = fast_app(
+    htmlkw={"cls": "grid h-full"},
+    pico=False,
+    hdrs=(
+        highlight_js,
+        highlight_js_theme_link,
+        highlight_js_theme,
+        overlayscrollbars_link,
+        overlayscrollbars_js,
+        awesomplete_link,
+        awesomplete_js,
+        sselink,
+        ShadHead(tw_cdn=False, theme_handle=True),
+    ),
+)
+vespa_app: Vespa = VespaQueryClient(logger=logger)
+thread_pool = ThreadPoolExecutor()
+# Gemini config
+
+genai.configure(api_key=os.getenv("GEMINI_API_KEY"))
+GEMINI_SYSTEM_PROMPT = """If the user query is a question, try your best to answer it based on the provided images. 
+If the user query can not be interpreted as a question, or if the answer to the query can not be inferred from the images,
+answer with the exact phrase "I am sorry, I can't find enough relevant information on these pages to answer your question.".
+Your response should be HTML formatted, but only simple tags, such as <b>. <p>, <i>, <br> <ul> and <li> are allowed. No HTML tables.
+This means that newlines will be replaced with <br> tags, bold text will be enclosed in <b> tags, and so on.
+Do NOT include backticks (`) in your response. Only simple HTML tags and text.
+"""
+gemini_model = genai.GenerativeModel(
+    "gemini-1.5-flash-8b", system_instruction=GEMINI_SYSTEM_PROMPT
+)
+STATIC_DIR = Path("static")
+IMG_DIR = STATIC_DIR / "full_images"
+SIM_MAP_DIR = STATIC_DIR / "sim_maps"
+os.makedirs(IMG_DIR, exist_ok=True)
+os.makedirs(SIM_MAP_DIR, exist_ok=True)
+
+
+@app.on_event("startup")
+def load_model_on_startup():
+    app.sim_map_generator = SimMapGenerator(logger=logger)
+    return
+
+
+@app.on_event("startup")
+async def keepalive():
+    asyncio.create_task(poll_vespa_keepalive())
+    return
+
+
+def generate_query_id(query, ranking_value):
+    hash_input = (query + ranking_value).encode("utf-8")
+    return hash(hash_input)
+
+
+@rt("/static/{filepath:path}")
+def serve_static(filepath: str):
+    return FileResponse(STATIC_DIR / filepath)
+
+
+@rt("/")
+def get(session):
+    if "session_id" not in session:
+        session["session_id"] = str(uuid.uuid4())
+    return Layout(Main(Home()), is_home=True)
+
+
+@rt("/about-this-demo")
+def get():
+    return Layout(Main(AboutThisDemo()))
+
+
+@rt("/search")
+def get(request, query: str = "", ranking: str = "nn+colpali"):
+    logger.info(f"/search: Fetching results for query: {query}, ranking: {ranking}")
+
+    # Always render the SearchBox first
+    if not query:
+        # Show SearchBox and a message for missing query
+        return Layout(
+            Main(
+                Div(
+                    SearchBox(query_value=query, ranking_value=ranking),
+                    Div(
+                        P(
+                            "No query provided. Please enter a query.",
+                            cls="text-center text-muted-foreground",
+                        ),
+                        cls="p-10",
+                    ),
+                    cls="grid",
+                )
+            )
+        )
+    # Generate a unique query_id based on the query and ranking value
+    query_id = generate_query_id(query, ranking)
+    # Show the loading message if a query is provided
+    return Layout(
+        Main(Search(request), data_overlayscrollbars_initialize=True, cls="border-t"),
+        Aside(
+            ChatResult(query_id=query_id, query=query),
+            cls="border-t border-l hidden md:block",
+        ),
+    )  # Show SearchBox and Loading message initially
+
+
+@rt("/fetch_results")
+async def get(session, request, query: str, ranking: str):
+    if "hx-request" not in request.headers:
+        return RedirectResponse("/search")
+
+    # Get the hash of the query and ranking value
+    query_id = generate_query_id(query, ranking)
+    logger.info(f"Query id in /fetch_results: {query_id}")
+    # Run the embedding and query against Vespa app
+    start_inference = time.perf_counter()
+    q_embs, idx_to_token = app.sim_map_generator.get_query_embeddings_and_token_map(
+        query
+    )
+    end_inference = time.perf_counter()
+    logger.info(
+        f"Inference time for query_id: {query_id} \t {end_inference - start_inference:.2f} seconds"
+    )
+
+    start = time.perf_counter()
+    # Fetch real search results from Vespa
+    result = await vespa_app.get_result_from_query(
+        query=query,
+        q_embs=q_embs,
+        ranking=ranking,
+        idx_to_token=idx_to_token,
+    )
+    end = time.perf_counter()
+    logger.info(
+        f"Search results fetched in {end - start:.2f} seconds. Vespa search time: {result['timing']['searchtime']}"
+    )
+    search_time = result["timing"]["searchtime"]
+    # Safely get total_count with a default of 0
+    total_count = result.get("root", {}).get("fields", {}).get("totalCount", 0)
+
+    search_results = vespa_app.results_to_search_results(result, idx_to_token)
+
+    get_and_store_sim_maps(
+        query_id=query_id,
+        query=query,
+        q_embs=q_embs,
+        ranking=ranking,
+        idx_to_token=idx_to_token,
+        doc_ids=[result["fields"]["id"] for result in search_results],
+    )
+    return SearchResult(search_results, query, query_id, search_time, total_count)
+
+
+def get_results_children(result):
+    search_results = (
+        result["root"]["children"]
+        if "root" in result and "children" in result["root"]
+        else []
+    )
+    return search_results
+
+
+async def poll_vespa_keepalive():
+    while True:
+        await asyncio.sleep(5)
+        await vespa_app.keepalive()
+        logger.debug(f"Vespa keepalive: {time.time()}")
+
+
+@threaded
+def get_and_store_sim_maps(
+    query_id, query: str, q_embs, ranking, idx_to_token, doc_ids
+):
+    ranking_sim = ranking + "_sim"
+    vespa_sim_maps = vespa_app.get_sim_maps_from_query(
+        query=query,
+        q_embs=q_embs,
+        ranking=ranking_sim,
+        idx_to_token=idx_to_token,
+    )
+    img_paths = [IMG_DIR / f"{doc_id}.jpg" for doc_id in doc_ids]
+    # All images should be downloaded, but best to wait 5 secs
+    max_wait = 5
+    start_time = time.time()
+    while (
+        not all([os.path.exists(img_path) for img_path in img_paths])
+        and time.time() - start_time < max_wait
+    ):
+        time.sleep(0.2)
+    if not all([os.path.exists(img_path) for img_path in img_paths]):
+        logger.warning(f"Images not ready in 5 seconds for query_id: {query_id}")
+        return False
+    sim_map_generator = app.sim_map_generator.gen_similarity_maps(
+        query=query,
+        query_embs=q_embs,
+        token_idx_map=idx_to_token,
+        images=img_paths,
+        vespa_sim_maps=vespa_sim_maps,
+    )
+    for idx, token, token_idx, blended_img_base64 in sim_map_generator:
+        with open(SIM_MAP_DIR / f"{query_id}_{idx}_{token_idx}.png", "wb") as f:
+            f.write(base64.b64decode(blended_img_base64))
+        logger.debug(
+            f"Sim map saved to disk for query_id: {query_id}, idx: {idx}, token: {token}"
+        )
+    return True
+
+
+@app.get("/get_sim_map")
+async def get_sim_map(query_id: str, idx: int, token: str, token_idx: int):
+    """
+    Endpoint that each of the sim map button polls to get the sim map image
+    when it is ready. If it is not ready, returns a SimMapButtonPoll, that
+    continues to poll every 1 second.
+    """
+    sim_map_path = SIM_MAP_DIR / f"{query_id}_{idx}_{token_idx}.png"
+    if not os.path.exists(sim_map_path):
+        logger.debug(
+            f"Sim map not ready for query_id: {query_id}, idx: {idx}, token: {token}"
+        )
+        return SimMapButtonPoll(
+            query_id=query_id, idx=idx, token=token, token_idx=token_idx
+        )
+    else:
+        return SimMapButtonReady(
+            query_id=query_id,
+            idx=idx,
+            token=token,
+            token_idx=token_idx,
+            img_src=sim_map_path,
+        )
+
+
+@app.get("/full_image")
+async def full_image(doc_id: str):
+    """
+    Endpoint to get the full quality image for a given result id.
+    """
+    img_path = IMG_DIR / f"{doc_id}.jpg"
+    if not os.path.exists(img_path):
+        image_data = await vespa_app.get_full_image_from_vespa(doc_id)
+        # image data is base 64 encoded string. Save it to disk as jpg.
+        with open(img_path, "wb") as f:
+            f.write(base64.b64decode(image_data))
+        logger.debug(f"Full image saved to disk for doc_id: {doc_id}")
+    else:
+        with open(img_path, "rb") as f:
+            image_data = base64.b64encode(f.read()).decode("utf-8")
+    return Img(
+        src=f"data:image/jpeg;base64,{image_data}",
+        alt="something",
+        cls="result-image w-full h-full object-contain",
+    )
+
+
+@rt("/suggestions")
+async def get_suggestions(query: str = ""):
+    """Endpoint to get suggestions as user types in the search box"""
+    query = query.lower().strip()
+
+    if query:
+        suggestions = await vespa_app.get_suggestions(query)
+        if len(suggestions) > 0:
+            return JSONResponse({"suggestions": suggestions})
+
+    return JSONResponse({"suggestions": []})
+
+
+async def message_generator(query_id: str, query: str, doc_ids: list):
+    """Generator function to yield SSE messages for chat response"""
+    images = []
+    num_images = 3  # Number of images before firing chat request
+    max_wait = 10  # seconds
+    start_time = time.time()
+    # Check if full images are ready on disk
+    while (
+        len(images) < min(num_images, len(doc_ids))
+        and time.time() - start_time < max_wait
+    ):
+        images = []
+        for idx in range(num_images):
+            image_filename = IMG_DIR / f"{doc_ids[idx]}.jpg"
+            if not os.path.exists(image_filename):
+                logger.debug(
+                    f"Message generator: Full image not ready for query_id: {query_id}, idx: {idx}"
+                )
+                continue
+            else:
+                logger.debug(
+                    f"Message generator: image ready for query_id: {query_id}, idx: {idx}"
+                )
+                images.append(Image.open(image_filename))
+        if len(images) < num_images:
+            await asyncio.sleep(0.2)
+
+    # yield message with number of images ready
+    yield f"event: message\ndata: Generating response based on {len(images)} images...\n\n"
+    if not images:
+        yield "event: message\ndata: Failed to send images to Gemini-8B!\n\n"
+        yield "event: close\ndata: \n\n"
+        return
+
+    # If newlines are present in the response, the connection will be closed.
+    def replace_newline_with_br(text):
+        return text.replace("\n", "<br>")
+
+    response_text = ""
+    async for chunk in await gemini_model.generate_content_async(
+        images + ["\n\n Query: ", query], stream=True
+    ):
+        if chunk.text:
+            response_text += chunk.text
+            response_text = replace_newline_with_br(response_text)
+            yield f"event: message\ndata: {response_text}\n\n"
+            await asyncio.sleep(0.1)
+    yield "event: close\ndata: \n\n"
+
+
+@app.get("/get-message")
+async def get_message(query_id: str, query: str, doc_ids: str):
+    return StreamingResponse(
+        message_generator(query_id=query_id, query=query, doc_ids=doc_ids.split(",")),
+        media_type="text/event-stream",
+    )
+
+
+@rt("/app")
+def get():
+    return Layout(Main(Div(P(f"Connected to Vespa at {vespa_app.url}"), cls="p-4")))
+
+
+if __name__ == "__main__":
+    HOT_RELOAD = os.getenv("HOT_RELOAD", "False").lower() == "true"
+    logger.info(f"Starting app with hot reload: {HOT_RELOAD}")
+    serve(port=7860, reload=HOT_RELOAD)

src/output.css

@@ -0,0 +1,2893 @@
+*, ::before, ::after {
+  --tw-border-spacing-x: 0;
+  --tw-border-spacing-y: 0;
+  --tw-translate-x: 0;
+  --tw-translate-y: 0;
+  --tw-rotate: 0;
+  --tw-skew-x: 0;
+  --tw-skew-y: 0;
+  --tw-scale-x: 1;
+  --tw-scale-y: 1;
+  --tw-pan-x:  ;
+  --tw-pan-y:  ;
+  --tw-pinch-zoom:  ;
+  --tw-scroll-snap-strictness: proximity;
+  --tw-gradient-from-position:  ;
+  --tw-gradient-via-position:  ;
+  --tw-gradient-to-position:  ;
+  --tw-ordinal:  ;
+  --tw-slashed-zero:  ;
+  --tw-numeric-figure:  ;
+  --tw-numeric-spacing:  ;
+  --tw-numeric-fraction:  ;
+  --tw-ring-inset:  ;
+  --tw-ring-offset-width: 0px;
+  --tw-ring-offset-color: #fff;
+  --tw-ring-color: rgb(59 130 246 / 0.5);
+  --tw-ring-offset-shadow: 0 0 #0000;
+  --tw-ring-shadow: 0 0 #0000;
+  --tw-shadow: 0 0 #0000;
+  --tw-shadow-colored: 0 0 #0000;
+  --tw-blur:  ;
+  --tw-brightness:  ;
+  --tw-contrast:  ;
+  --tw-grayscale:  ;
+  --tw-hue-rotate:  ;
+  --tw-invert:  ;
+  --tw-saturate:  ;
+  --tw-sepia:  ;
+  --tw-drop-shadow:  ;
+  --tw-backdrop-blur:  ;
+  --tw-backdrop-brightness:  ;
+  --tw-backdrop-contrast:  ;
+  --tw-backdrop-grayscale:  ;
+  --tw-backdrop-hue-rotate:  ;
+  --tw-backdrop-invert:  ;
+  --tw-backdrop-opacity:  ;
+  --tw-backdrop-saturate:  ;
+  --tw-backdrop-sepia:  ;
+  --tw-contain-size:  ;
+  --tw-contain-layout:  ;
+  --tw-contain-paint:  ;
+  --tw-contain-style:  ;
+}
+
+::backdrop {
+  --tw-border-spacing-x: 0;
+  --tw-border-spacing-y: 0;
+  --tw-translate-x: 0;
+  --tw-translate-y: 0;
+  --tw-rotate: 0;
+  --tw-skew-x: 0;
+  --tw-skew-y: 0;
+  --tw-scale-x: 1;
+  --tw-scale-y: 1;
+  --tw-pan-x:  ;
+  --tw-pan-y:  ;
+  --tw-pinch-zoom:  ;
+  --tw-scroll-snap-strictness: proximity;
+  --tw-gradient-from-position:  ;
+  --tw-gradient-via-position:  ;
+  --tw-gradient-to-position:  ;
+  --tw-ordinal:  ;
+  --tw-slashed-zero:  ;
+  --tw-numeric-figure:  ;
+  --tw-numeric-spacing:  ;
+  --tw-numeric-fraction:  ;
+  --tw-ring-inset:  ;
+  --tw-ring-offset-width: 0px;
+  --tw-ring-offset-color: #fff;
+  --tw-ring-color: rgb(59 130 246 / 0.5);
+  --tw-ring-offset-shadow: 0 0 #0000;
+  --tw-ring-shadow: 0 0 #0000;
+  --tw-shadow: 0 0 #0000;
+  --tw-shadow-colored: 0 0 #0000;
+  --tw-blur:  ;
+  --tw-brightness:  ;
+  --tw-contrast:  ;
+  --tw-grayscale:  ;
+  --tw-hue-rotate:  ;
+  --tw-invert:  ;
+  --tw-saturate:  ;
+  --tw-sepia:  ;
+  --tw-drop-shadow:  ;
+  --tw-backdrop-blur:  ;
+  --tw-backdrop-brightness:  ;
+  --tw-backdrop-contrast:  ;
+  --tw-backdrop-grayscale:  ;
+  --tw-backdrop-hue-rotate:  ;
+  --tw-backdrop-invert:  ;
+  --tw-backdrop-opacity:  ;
+  --tw-backdrop-saturate:  ;
+  --tw-backdrop-sepia:  ;
+  --tw-contain-size:  ;
+  --tw-contain-layout:  ;
+  --tw-contain-paint:  ;
+  --tw-contain-style:  ;
+}
+
+/*
+! tailwindcss v3.4.13 | MIT License | https://tailwindcss.com
+*/
+
+/*
+1. Prevent padding and border from affecting element width. (https://github.com/mozdevs/cssremedy/issues/4)
+2. Allow adding a border to an element by just adding a border-width. (https://github.com/tailwindcss/tailwindcss/pull/116)
+*/
+
+*,
+::before,
+::after {
+  box-sizing: border-box;
+  /* 1 */
+  border-width: 0;
+  /* 2 */
+  border-style: solid;
+  /* 2 */
+  border-color: #e5e7eb;
+  /* 2 */
+}
+
+::before,
+::after {
+  --tw-content: '';
+}
+
+/*
+1. Use a consistent sensible line-height in all browsers.
+2. Prevent adjustments of font size after orientation changes in iOS.
+3. Use a more readable tab size.
+4. Use the user's configured `sans` font-family by default.
+5. Use the user's configured `sans` font-feature-settings by default.
+6. Use the user's configured `sans` font-variation-settings by default.
+7. Disable tap highlights on iOS
+*/
+
+html,
+:host {
+  line-height: 1.5;
+  /* 1 */
+  -webkit-text-size-adjust: 100%;
+  /* 2 */
+  -moz-tab-size: 4;
+  /* 3 */
+  -o-tab-size: 4;
+     tab-size: 4;
+  /* 3 */
+  font-family: ui-sans-serif, system-ui, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol", "Noto Color Emoji";
+  /* 4 */
+  font-feature-settings: normal;
+  /* 5 */
+  font-variation-settings: normal;
+  /* 6 */
+  -webkit-tap-highlight-color: transparent;
+  /* 7 */
+}
+
+/*
+1. Remove the margin in all browsers.
+2. Inherit line-height from `html` so users can set them as a class directly on the `html` element.
+*/
+
+body {
+  margin: 0;
+  /* 1 */
+  line-height: inherit;
+  /* 2 */
+}
+
+/*
+1. Add the correct height in Firefox.
+2. Correct the inheritance of border color in Firefox. (https://bugzilla.mozilla.org/show_bug.cgi?id=190655)
+3. Ensure horizontal rules are visible by default.
+*/
+
+hr {
+  height: 0;
+  /* 1 */
+  color: inherit;
+  /* 2 */
+  border-top-width: 1px;
+  /* 3 */
+}
+
+/*
+Add the correct text decoration in Chrome, Edge, and Safari.
+*/
+
+abbr:where([title]) {
+  -webkit-text-decoration: underline dotted;
+          text-decoration: underline dotted;
+}
+
+/*
+Remove the default font size and weight for headings.
+*/
+
+h1,
+h2,
+h3,
+h4,
+h5,
+h6 {
+  font-size: inherit;
+  font-weight: inherit;
+}
+
+/*
+Reset links to optimize for opt-in styling instead of opt-out.
+*/
+
+a {
+  color: inherit;
+  text-decoration: inherit;
+}
+
+/*
+Add the correct font weight in Edge and Safari.
+*/
+
+b,
+strong {
+  font-weight: bolder;
+}
+
+/*
+1. Use the user's configured `mono` font-family by default.
+2. Use the user's configured `mono` font-feature-settings by default.
+3. Use the user's configured `mono` font-variation-settings by default.
+4. Correct the odd `em` font sizing in all browsers.
+*/
+
+code,
+kbd,
+samp,
+pre {
+  font-family: ui-monospace, SFMono-Regular, Menlo, Monaco, Consolas, "Liberation Mono", "Courier New", monospace;
+  /* 1 */
+  font-feature-settings: normal;
+  /* 2 */
+  font-variation-settings: normal;
+  /* 3 */
+  font-size: 1em;
+  /* 4 */
+}
+
+/*
+Add the correct font size in all browsers.
+*/
+
+small {
+  font-size: 80%;
+}
+
+/*
+Prevent `sub` and `sup` elements from affecting the line height in all browsers.
+*/
+
+sub,
+sup {
+  font-size: 75%;
+  line-height: 0;
+  position: relative;
+  vertical-align: baseline;
+}
+
+sub {
+  bottom: -0.25em;
+}
+
+sup {
+  top: -0.5em;
+}
+
+/*
+1. Remove text indentation from table contents in Chrome and Safari. (https://bugs.chromium.org/p/chromium/issues/detail?id=999088, https://bugs.webkit.org/show_bug.cgi?id=201297)
+2. Correct table border color inheritance in all Chrome and Safari. (https://bugs.chromium.org/p/chromium/issues/detail?id=935729, https://bugs.webkit.org/show_bug.cgi?id=195016)
+3. Remove gaps between table borders by default.
+*/
+
+table {
+  text-indent: 0;
+  /* 1 */
+  border-color: inherit;
+  /* 2 */
+  border-collapse: collapse;
+  /* 3 */
+}
+
+/*
+1. Change the font styles in all browsers.
+2. Remove the margin in Firefox and Safari.
+3. Remove default padding in all browsers.
+*/
+
+button,
+input,
+optgroup,
+select,
+textarea {
+  font-family: inherit;
+  /* 1 */
+  font-feature-settings: inherit;
+  /* 1 */
+  font-variation-settings: inherit;
+  /* 1 */
+  font-size: 100%;
+  /* 1 */
+  font-weight: inherit;
+  /* 1 */
+  line-height: inherit;
+  /* 1 */
+  letter-spacing: inherit;
+  /* 1 */
+  color: inherit;
+  /* 1 */
+  margin: 0;
+  /* 2 */
+  padding: 0;
+  /* 3 */
+}
+
+/*
+Remove the inheritance of text transform in Edge and Firefox.
+*/
+
+button,
+select {
+  text-transform: none;
+}
+
+/*
+1. Correct the inability to style clickable types in iOS and Safari.
+2. Remove default button styles.
+*/
+
+button,
+input:where([type='button']),
+input:where([type='reset']),
+input:where([type='submit']) {
+  -webkit-appearance: button;
+  /* 1 */
+  background-color: transparent;
+  /* 2 */
+  background-image: none;
+  /* 2 */
+}
+
+/*
+Use the modern Firefox focus style for all focusable elements.
+*/
+
+:-moz-focusring {
+  outline: auto;
+}
+
+/*
+Remove the additional `:invalid` styles in Firefox. (https://github.com/mozilla/gecko-dev/blob/2f9eacd9d3d995c937b4251a5557d95d494c9be1/layout/style/res/forms.css#L728-L737)
+*/
+
+:-moz-ui-invalid {
+  box-shadow: none;
+}
+
+/*
+Add the correct vertical alignment in Chrome and Firefox.
+*/
+
+progress {
+  vertical-align: baseline;
+}
+
+/*
+Correct the cursor style of increment and decrement buttons in Safari.
+*/
+
+::-webkit-inner-spin-button,
+::-webkit-outer-spin-button {
+  height: auto;
+}
+
+/*
+1. Correct the odd appearance in Chrome and Safari.
+2. Correct the outline style in Safari.
+*/
+
+[type='search'] {
+  -webkit-appearance: textfield;
+  /* 1 */
+  outline-offset: -2px;
+  /* 2 */
+}
+
+/*
+Remove the inner padding in Chrome and Safari on macOS.
+*/
+
+::-webkit-search-decoration {
+  -webkit-appearance: none;
+}
+
+/*
+1. Correct the inability to style clickable types in iOS and Safari.
+2. Change font properties to `inherit` in Safari.
+*/
+
+::-webkit-file-upload-button {
+  -webkit-appearance: button;
+  /* 1 */
+  font: inherit;
+  /* 2 */
+}
+
+/*
+Add the correct display in Chrome and Safari.
+*/
+
+summary {
+  display: list-item;
+}
+
+/*
+Removes the default spacing and border for appropriate elements.
+*/
+
+blockquote,
+dl,
+dd,
+h1,
+h2,
+h3,
+h4,
+h5,
+h6,
+hr,
+figure,
+p,
+pre {
+  margin: 0;
+}
+
+fieldset {
+  margin: 0;
+  padding: 0;
+}
+
+legend {
+  padding: 0;
+}
+
+ol,
+ul,
+menu {
+  list-style: none;
+  margin: 0;
+  padding: 0;
+}
+
+/*
+Reset default styling for dialogs.
+*/
+
+dialog {
+  padding: 0;
+}
+
+/*
+Prevent resizing textareas horizontally by default.
+*/
+
+textarea {
+  resize: vertical;
+}
+
+/*
+1. Reset the default placeholder opacity in Firefox. (https://github.com/tailwindlabs/tailwindcss/issues/3300)
+2. Set the default placeholder color to the user's configured gray 400 color.
+*/
+
+input::-moz-placeholder, textarea::-moz-placeholder {
+  opacity: 1;
+  /* 1 */
+  color: #9ca3af;
+  /* 2 */
+}
+
+input::placeholder,
+textarea::placeholder {
+  opacity: 1;
+  /* 1 */
+  color: #9ca3af;
+  /* 2 */
+}
+
+/*
+Set the default cursor for buttons.
+*/
+
+button,
+[role="button"] {
+  cursor: pointer;
+}
+
+/*
+Make sure disabled buttons don't get the pointer cursor.
+*/
+
+:disabled {
+  cursor: default;
+}
+
+/*
+1. Make replaced elements `display: block` by default. (https://github.com/mozdevs/cssremedy/issues/14)
+2. Add `vertical-align: middle` to align replaced elements more sensibly by default. (https://github.com/jensimmons/cssremedy/issues/14#issuecomment-634934210)
+   This can trigger a poorly considered lint error in some tools but is included by design.
+*/
+
+img,
+svg,
+video,
+canvas,
+audio,
+iframe,
+embed,
+object {
+  display: block;
+  /* 1 */
+  vertical-align: middle;
+  /* 2 */
+}
+
+/*
+Constrain images and videos to the parent width and preserve their intrinsic aspect ratio. (https://github.com/mozdevs/cssremedy/issues/14)
+*/
+
+img,
+video {
+  max-width: 100%;
+  height: auto;
+}
+
+/* Make elements with the HTML hidden attribute stay hidden by default */
+
+[hidden] {
+  display: none;
+}
+
+:root {
+  --background: 240 20% 99%;
+  /* 1 */
+  --foreground: 210 13% 13%;
+  /* 12 */
+  --card: 240 20% 99%;
+  /* 1 */
+  --card-foreground: 210 13% 13%;
+  /* 12 */
+  --popover: 240 20% 99%;
+  /* 1 */
+  --popover-foreground: 210 13% 13%;
+  /* 12 */
+  --primary: 210 13% 13%;
+  /* 12 */
+  --primary-foreground: 240 20% 98%;
+  /* 2 */
+  --secondary: 240 11% 95%;
+  /* 3 */
+  --secondary-foreground: 210 13% 13%;
+  /* 12 */
+  --muted: 240 11% 95%;
+  /* 3 */
+  --muted-foreground: 220 6% 40%;
+  /* 11 */
+  --accent: 240 11% 95%;
+  /* 3 */
+  --accent-foreground: 210 13% 13%;
+  /* 12 */
+  --destructive: 358 75% 59%;
+  /* 9 - red */
+  --destructive-foreground: 240 20% 98%;
+  /* 2 */
+  --border: 240 10% 86%;
+  /* 6 */
+  --input: 240 10% 86%;
+  /* 6 */
+  --ring: 210 13% 13%;
+  /* 12 */
+  --chart-1: 10 78% 54%;
+  /* 9 - tomato */
+  --chart-2: 173 80% 36%;
+  /* 9 - teal */
+  --chart-3: 206 100% 50%;
+  /* 9 - blue */
+  --chart-4: 42 100% 62%;
+  /* 9 - amber */
+  --chart-5: 23 93% 53%;
+  /* 9 - orange */
+}
+
+.dark {
+  --background: 240 6% 7%;
+  /* 1 */
+  --foreground: 220 9% 94%;
+  /* 12 */
+  --card: 240 6% 7%;
+  /* 1 */
+  --card-foreground: 220 9% 94%;
+  /* 12 */
+  --popover: 240 6% 7%;
+  /* 1 */
+  --popover-foreground: 220 9% 94%;
+  /* 12 */
+  --primary: 220 9% 94%;
+  /* 12 */
+  --primary-foreground: 220 6% 10%;
+  /* 2 */
+  --secondary: 225 6% 14%;
+  /* 3 */
+  --secondary-foreground: 220 9% 94%;
+  /* 12 */
+  --muted: 225 6% 14%;
+  /* 3 */
+  --muted-foreground: 216 7% 71%;
+  /* 11 */
+  --accent: 225 6% 14%;
+  /* 3 */
+  --accent-foreground: 220 9% 94%;
+  /* 12 */
+  --destructive: 358 75% 59%;
+  /* 9 - red */
+  --destructive-foreground: 220 9% 94%;
+  /* 12 */
+  --border: 213 8% 23%;
+  /* 6 */
+  --input: 213 8% 23%;
+  /* 6 */
+  --ring: 220 9% 94%;
+  /* 12 */
+  --chart-1: 10 78% 54%;
+  /* 9 - tomato */
+  --chart-2: 173 80% 36%;
+  /* 9 - teal */
+  --chart-3: 206 100% 50%;
+  /* 9 - blue */
+  --chart-4: 42 100% 62%;
+  /* 9 - amber */
+  --chart-5: 23 93% 53%;
+  /* 9 - orange */
+}
+
+:root:has(.no-bg-scroll) {
+  overflow: hidden;
+}
+
+* {
+  border-color: hsl(var(--border));
+}
+
+body {
+  min-height: 100vh;
+  background-color: hsl(var(--background));
+  color: hsl(var(--foreground));
+  -webkit-font-smoothing: antialiased;
+  -moz-osx-font-smoothing: grayscale;
+  font-feature-settings: "rlig" 1, "calt" 1;
+}
+
+.container {
+  width: 100%;
+  margin-right: auto;
+  margin-left: auto;
+  padding-right: 2rem;
+  padding-left: 2rem;
+}
+
+@media (min-width: 1400px) {
+  .container {
+    max-width: 1400px;
+  }
+}
+
+.sr-only {
+  position: absolute;
+  width: 1px;
+  height: 1px;
+  padding: 0;
+  margin: -1px;
+  overflow: hidden;
+  clip: rect(0, 0, 0, 0);
+  white-space: nowrap;
+  border-width: 0;
+}
+
+.pointer-events-none {
+  pointer-events: none;
+}
+
+.pointer-events-auto {
+  pointer-events: auto;
+}
+
+.static {
+  position: static;
+}
+
+.fixed {
+  position: fixed;
+}
+
+.absolute {
+  position: absolute;
+}
+
+.relative {
+  position: relative;
+}
+
+.inset-0 {
+  inset: 0px;
+}
+
+.inset-x-0 {
+  left: 0px;
+  right: 0px;
+}
+
+.inset-y-0 {
+  top: 0px;
+  bottom: 0px;
+}
+
+.-bottom-12 {
+  bottom: -3rem;
+}
+
+.-left-12 {
+  left: -3rem;
+}
+
+.-right-12 {
+  right: -3rem;
+}
+
+.-top-12 {
+  top: -3rem;
+}
+
+.bottom-0 {
+  bottom: 0px;
+}
+
+.left-0 {
+  left: 0px;
+}
+
+.left-1\/2 {
+  left: 50%;
+}
+
+.left-2 {
+  left: 0.5rem;
+}
+
+.left-\[50\%\] {
+  left: 50%;
+}
+
+.right-0 {
+  right: 0px;
+}
+
+.right-2 {
+  right: 0.5rem;
+}
+
+.right-4 {
+  right: 1rem;
+}
+
+.top-0 {
+  top: 0px;
+}
+
+.top-1\/2 {
+  top: 50%;
+}
+
+.top-2 {
+  top: 0.5rem;
+}
+
+.top-4 {
+  top: 1rem;
+}
+
+.top-\[50\%\] {
+  top: 50%;
+}
+
+.z-10 {
+  z-index: 10;
+}
+
+.z-50 {
+  z-index: 50;
+}
+
+.z-\[100\] {
+  z-index: 100;
+}
+
+.-mx-1 {
+  margin-left: -0.25rem;
+  margin-right: -0.25rem;
+}
+
+.mx-auto {
+  margin-left: auto;
+  margin-right: auto;
+}
+
+.my-1 {
+  margin-top: 0.25rem;
+  margin-bottom: 0.25rem;
+}
+
+.-ml-4 {
+  margin-left: -1rem;
+}
+
+.-mt-4 {
+  margin-top: -1rem;
+}
+
+.mb-1 {
+  margin-bottom: 0.25rem;
+}
+
+.mr-1\.5 {
+  margin-right: 0.375rem;
+}
+
+.mt-2 {
+  margin-top: 0.5rem;
+}
+
+.mt-\[13vh\] {
+  margin-top: 13vh;
+}
+
+.mt-\[8vh\] {
+  margin-top: 8vh;
+}
+
+.block {
+  display: block;
+}
+
+.flex {
+  display: flex;
+}
+
+.inline-flex {
+  display: inline-flex;
+}
+
+.table {
+  display: table;
+}
+
+.grid {
+  display: grid;
+}
+
+.contents {
+  display: contents;
+}
+
+.hidden {
+  display: none;
+}
+
+.aspect-square {
+  aspect-ratio: 1 / 1;
+}
+
+.size-4 {
+  width: 1rem;
+  height: 1rem;
+}
+
+.size-5 {
+  width: 1.25rem;
+  height: 1.25rem;
+}
+
+.h-10 {
+  height: 2.5rem;
+}
+
+.h-11 {
+  height: 2.75rem;
+}
+
+.h-12 {
+  height: 3rem;
+}
+
+.h-2 {
+  height: 0.5rem;
+}
+
+.h-2\.5 {
+  height: 0.625rem;
+}
+
+.h-3\.5 {
+  height: 0.875rem;
+}
+
+.h-4 {
+  height: 1rem;
+}
+
+.h-5 {
+  height: 1.25rem;
+}
+
+.h-6 {
+  height: 1.5rem;
+}
+
+.h-8 {
+  height: 2rem;
+}
+
+.h-9 {
+  height: 2.25rem;
+}
+
+.h-\[1\.5px\] {
+  height: 1.5px;
+}
+
+.h-\[27px\] {
+  height: 27px;
+}
+
+.h-\[377px\] {
+  height: 377px;
+}
+
+.h-\[55px\] {
+  height: 55px;
+}
+
+.h-\[var\(--radix-select-trigger-height\)\] {
+  height: var(--radix-select-trigger-height);
+}
+
+.h-full {
+  height: 100%;
+}
+
+.h-px {
+  height: 1px;
+}
+
+.max-h-96 {
+  max-height: 24rem;
+}
+
+.max-h-screen {
+  max-height: 100vh;
+}
+
+.min-h-0 {
+  min-height: 0px;
+}
+
+.min-h-\[55px\] {
+  min-height: 55px;
+}
+
+.min-h-\[80px\] {
+  min-height: 80px;
+}
+
+.min-h-screen {
+  min-height: 100vh;
+}
+
+.w-10 {
+  width: 2.5rem;
+}
+
+.w-11 {
+  width: 2.75rem;
+}
+
+.w-2\.5 {
+  width: 0.625rem;
+}
+
+.w-3\.5 {
+  width: 0.875rem;
+}
+
+.w-3\/4 {
+  width: 75%;
+}
+
+.w-4 {
+  width: 1rem;
+}
+
+.w-5 {
+  width: 1.25rem;
+}
+
+.w-8 {
+  width: 2rem;
+}
+
+.w-\[1\.5px\] {
+  width: 1.5px;
+}
+
+.w-full {
+  width: 100%;
+}
+
+.min-w-0 {
+  min-width: 0px;
+}
+
+.min-w-\[8rem\] {
+  min-width: 8rem;
+}
+
+.min-w-\[var\(--radix-select-trigger-width\)\] {
+  min-width: var(--radix-select-trigger-width);
+}
+
+.max-w-lg {
+  max-width: 32rem;
+}
+
+.max-w-screen-md {
+  max-width: 768px;
+}
+
+.flex-1 {
+  flex: 1 1 0%;
+}
+
+.shrink-0 {
+  flex-shrink: 0;
+}
+
+.grow {
+  flex-grow: 1;
+}
+
+.grow-0 {
+  flex-grow: 0;
+}
+
+.basis-full {
+  flex-basis: 100%;
+}
+
+.caption-bottom {
+  caption-side: bottom;
+}
+
+.-translate-x-1\/2 {
+  --tw-translate-x: -50%;
+  transform: translate(var(--tw-translate-x), var(--tw-translate-y)) rotate(var(--tw-rotate)) skewX(var(--tw-skew-x)) skewY(var(--tw-skew-y)) scaleX(var(--tw-scale-x)) scaleY(var(--tw-scale-y));
+}
+
+.-translate-y-1\/2 {
+  --tw-translate-y: -50%;
+  transform: translate(var(--tw-translate-x), var(--tw-translate-y)) rotate(var(--tw-rotate)) skewX(var(--tw-skew-x)) skewY(var(--tw-skew-y)) scaleX(var(--tw-scale-x)) scaleY(var(--tw-scale-y));
+}
+
+.translate-x-\[-50\%\] {
+  --tw-translate-x: -50%;
+  transform: translate(var(--tw-translate-x), var(--tw-translate-y)) rotate(var(--tw-rotate)) skewX(var(--tw-skew-x)) skewY(var(--tw-skew-y)) scaleX(var(--tw-scale-x)) scaleY(var(--tw-scale-y));
+}
+
+.translate-y-\[-50\%\] {
+  --tw-translate-y: -50%;
+  transform: translate(var(--tw-translate-x), var(--tw-translate-y)) rotate(var(--tw-rotate)) skewX(var(--tw-skew-x)) skewY(var(--tw-skew-y)) scaleX(var(--tw-scale-x)) scaleY(var(--tw-scale-y));
+}
+
+.rotate-90 {
+  --tw-rotate: 90deg;
+  transform: translate(var(--tw-translate-x), var(--tw-translate-y)) rotate(var(--tw-rotate)) skewX(var(--tw-skew-x)) skewY(var(--tw-skew-y)) scaleX(var(--tw-scale-x)) scaleY(var(--tw-scale-y));
+}
+
+.transform {
+  transform: translate(var(--tw-translate-x), var(--tw-translate-y)) rotate(var(--tw-rotate)) skewX(var(--tw-skew-x)) skewY(var(--tw-skew-y)) scaleX(var(--tw-scale-x)) scaleY(var(--tw-scale-y));
+}
+
+@keyframes pulse {
+  50% {
+    opacity: .5;
+  }
+}
+
+.animate-pulse {
+  animation: pulse 2s cubic-bezier(0.4, 0, 0.6, 1) infinite;
+}
+
+@keyframes spin {
+  to {
+    transform: rotate(360deg);
+  }
+}
+
+.animate-spin {
+  animation: spin 1s linear infinite;
+}
+
+.cursor-default {
+  cursor: default;
+}
+
+.cursor-pointer {
+  cursor: pointer;
+}
+
+.touch-none {
+  touch-action: none;
+}
+
+.select-none {
+  -webkit-user-select: none;
+     -moz-user-select: none;
+          user-select: none;
+}
+
+.resize {
+  resize: both;
+}
+
+.grid-flow-col {
+  grid-auto-flow: column;
+}
+
+.grid-cols-1 {
+  grid-template-columns: repeat(1, minmax(0, 1fr));
+}
+
+.grid-rows-\[1fr_1fr\] {
+  grid-template-rows: 1fr 1fr;
+}
+
+.grid-rows-\[auto_0px\] {
+  grid-template-rows: auto 0px;
+}
+
+.grid-rows-\[auto_1fr\] {
+  grid-template-rows: auto 1fr;
+}
+
+.grid-rows-\[auto_1fr_auto\] {
+  grid-template-rows: auto 1fr auto;
+}
+
+.grid-rows-\[minmax\(0\2c 55px\)_minmax\(0\2c 1fr\)\] {
+  grid-template-rows: minmax(0,55px) minmax(0,1fr);
+}
+
+.grid-rows-\[auto_auto_1fr\] {
+  grid-template-rows: auto auto 1fr;
+}
+
+.flex-col {
+  flex-direction: column;
+}
+
+.flex-col-reverse {
+  flex-direction: column-reverse;
+}
+
+.flex-wrap {
+  flex-wrap: wrap;
+}
+
+.content-start {
+  align-content: flex-start;
+}
+
+.items-end {
+  align-items: flex-end;
+}
+
+.items-center {
+  align-items: center;
+}
+
+.justify-end {
+  justify-content: flex-end;
+}
+
+.justify-center {
+  justify-content: center;
+}
+
+.justify-between {
+  justify-content: space-between;
+}
+
+.justify-items-center {
+  justify-items: center;
+}
+
+.gap-1\.5 {
+  gap: 0.375rem;
+}
+
+.gap-2 {
+  gap: 0.5rem;
+}
+
+.gap-3 {
+  gap: 0.75rem;
+}
+
+.gap-4 {
+  gap: 1rem;
+}
+
+.gap-5 {
+  gap: 1.25rem;
+}
+
+.gap-8 {
+  gap: 2rem;
+}
+
+.gap-\[3px\] {
+  gap: 3px;
+}
+
+.gap-px {
+  gap: 1px;
+}
+
+.gap-x-3 {
+  -moz-column-gap: 0.75rem;
+       column-gap: 0.75rem;
+}
+
+.gap-x-5 {
+  -moz-column-gap: 1.25rem;
+       column-gap: 1.25rem;
+}
+
+.gap-y-3 {
+  row-gap: 0.75rem;
+}
+
+.gap-y-8 {
+  row-gap: 2rem;
+}
+
+.space-x-2 > :not([hidden]) ~ :not([hidden]) {
+  --tw-space-x-reverse: 0;
+  margin-right: calc(0.5rem * var(--tw-space-x-reverse));
+  margin-left: calc(0.5rem * calc(1 - var(--tw-space-x-reverse)));
+}
+
+.space-x-4 > :not([hidden]) ~ :not([hidden]) {
+  --tw-space-x-reverse: 0;
+  margin-right: calc(1rem * var(--tw-space-x-reverse));
+  margin-left: calc(1rem * calc(1 - var(--tw-space-x-reverse)));
+}
+
+.space-y-1\.5 > :not([hidden]) ~ :not([hidden]) {
+  --tw-space-y-reverse: 0;
+  margin-top: calc(0.375rem * calc(1 - var(--tw-space-y-reverse)));
+  margin-bottom: calc(0.375rem * var(--tw-space-y-reverse));
+}
+
+.space-y-2 > :not([hidden]) ~ :not([hidden]) {
+  --tw-space-y-reverse: 0;
+  margin-top: calc(0.5rem * calc(1 - var(--tw-space-y-reverse)));
+  margin-bottom: calc(0.5rem * var(--tw-space-y-reverse));
+}
+
+.space-x-1 > :not([hidden]) ~ :not([hidden]) {
+  --tw-space-x-reverse: 0;
+  margin-right: calc(0.25rem * var(--tw-space-x-reverse));
+  margin-left: calc(0.25rem * calc(1 - var(--tw-space-x-reverse)));
+}
+
+.self-stretch {
+  align-self: stretch;
+}
+
+.overflow-auto {
+  overflow: auto;
+}
+
+.overflow-hidden {
+  overflow: hidden;
+}
+
+.whitespace-nowrap {
+  white-space: nowrap;
+}
+
+.\!rounded-full {
+  border-radius: 9999px !important;
+}
+
+.rounded-\[inherit\] {
+  border-radius: inherit;
+}
+
+.rounded-full {
+  border-radius: 9999px;
+}
+
+.rounded-lg {
+  border-radius: var(--radius);
+}
+
+.rounded-md {
+  border-radius: calc(var(--radius) - 2px);
+}
+
+.rounded-none {
+  border-radius: 0px;
+}
+
+.rounded-sm {
+  border-radius: calc(var(--radius) - 4px);
+}
+
+.border {
+  border-width: 1px;
+}
+
+.border-2 {
+  border-width: 2px;
+}
+
+.border-b {
+  border-bottom-width: 1px;
+}
+
+.border-l {
+  border-left-width: 1px;
+}
+
+.border-r {
+  border-right-width: 1px;
+}
+
+.border-t {
+  border-top-width: 1px;
+}
+
+.border-dashed {
+  border-style: dashed;
+}
+
+.border-destructive {
+  border-color: hsl(var(--destructive));
+}
+
+.border-destructive\/50 {
+  border-color: hsl(var(--destructive) / 0.5);
+}
+
+.border-input {
+  border-color: hsl(var(--input));
+}
+
+.border-primary {
+  border-color: hsl(var(--primary));
+}
+
+.border-transparent {
+  border-color: transparent;
+}
+
+.border-l-transparent {
+  border-left-color: transparent;
+}
+
+.border-t-transparent {
+  border-top-color: transparent;
+}
+
+.bg-background {
+  background-color: hsl(var(--background));
+}
+
+.bg-black\/80 {
+  background-color: rgb(0 0 0 / 0.8);
+}
+
+.bg-blue-500 {
+  --tw-bg-opacity: 1;
+  background-color: rgb(59 130 246 / var(--tw-bg-opacity));
+}
+
+.bg-border {
+  background-color: hsl(var(--border));
+}
+
+.bg-card {
+  background-color: hsl(var(--card));
+}
+
+.bg-destructive {
+  background-color: hsl(var(--destructive));
+}
+
+.bg-input {
+  background-color: hsl(var(--input));
+}
+
+.bg-muted {
+  background-color: hsl(var(--muted));
+}
+
+.bg-muted\/50 {
+  background-color: hsl(var(--muted) / 0.5);
+}
+
+.bg-popover {
+  background-color: hsl(var(--popover));
+}
+
+.bg-primary {
+  background-color: hsl(var(--primary));
+}
+
+.bg-red-300 {
+  --tw-bg-opacity: 1;
+  background-color: rgb(252 165 165 / var(--tw-bg-opacity));
+}
+
+.bg-red-500 {
+  --tw-bg-opacity: 1;
+  background-color: rgb(239 68 68 / var(--tw-bg-opacity));
+}
+
+.bg-secondary {
+  background-color: hsl(var(--secondary));
+}
+
+.bg-white {
+  --tw-bg-opacity: 1;
+  background-color: rgb(255 255 255 / var(--tw-bg-opacity));
+}
+
+.bg-gradient-to-r {
+  background-image: linear-gradient(to right, var(--tw-gradient-stops));
+}
+
+.bg-gradient-to-t {
+  background-image: linear-gradient(to top, var(--tw-gradient-stops));
+}
+
+.from-\[\#fcfcfd\] {
+  --tw-gradient-from: #fcfcfd var(--tw-gradient-from-position);
+  --tw-gradient-to: rgb(252 252 253 / 0) var(--tw-gradient-to-position);
+  --tw-gradient-stops: var(--tw-gradient-from), var(--tw-gradient-to);
+}
+
+.from-black {
+  --tw-gradient-from: #000 var(--tw-gradient-from-position);
+  --tw-gradient-to: rgb(0 0 0 / 0) var(--tw-gradient-to-position);
+  --tw-gradient-stops: var(--tw-gradient-from), var(--tw-gradient-to);
+}
+
+.to-slate-700 {
+  --tw-gradient-to: #334155 var(--tw-gradient-to-position);
+}
+
+.bg-clip-text {
+  -webkit-background-clip: text;
+          background-clip: text;
+}
+
+.fill-current {
+  fill: currentColor;
+}
+
+.object-contain {
+  -o-object-fit: contain;
+     object-fit: contain;
+}
+
+.p-1 {
+  padding: 0.25rem;
+}
+
+.p-10 {
+  padding: 2.5rem;
+}
+
+.p-2 {
+  padding: 0.5rem;
+}
+
+.p-3 {
+  padding: 0.75rem;
+}
+
+.p-4 {
+  padding: 1rem;
+}
+
+.p-5 {
+  padding: 1.25rem;
+}
+
+.p-6 {
+  padding: 1.5rem;
+}
+
+.p-8 {
+  padding: 2rem;
+}
+
+.p-\[1px\] {
+  padding: 1px;
+}
+
+.px-2 {
+  padding-left: 0.5rem;
+  padding-right: 0.5rem;
+}
+
+.px-2\.5 {
+  padding-left: 0.625rem;
+  padding-right: 0.625rem;
+}
+
+.px-3 {
+  padding-left: 0.75rem;
+  padding-right: 0.75rem;
+}
+
+.px-4 {
+  padding-left: 1rem;
+  padding-right: 1rem;
+}
+
+.px-5 {
+  padding-left: 1.25rem;
+  padding-right: 1.25rem;
+}
+
+.px-8 {
+  padding-left: 2rem;
+  padding-right: 2rem;
+}
+
+.py-0\.5 {
+  padding-top: 0.125rem;
+  padding-bottom: 0.125rem;
+}
+
+.py-1 {
+  padding-top: 0.25rem;
+  padding-bottom: 0.25rem;
+}
+
+.py-1\.5 {
+  padding-top: 0.375rem;
+  padding-bottom: 0.375rem;
+}
+
+.py-2 {
+  padding-top: 0.5rem;
+  padding-bottom: 0.5rem;
+}
+
+.py-4 {
+  padding-top: 1rem;
+  padding-bottom: 1rem;
+}
+
+.py-5 {
+  padding-top: 1.25rem;
+  padding-bottom: 1.25rem;
+}
+
+.pl-10 {
+  padding-left: 2.5rem;
+}
+
+.pl-4 {
+  padding-left: 1rem;
+}
+
+.pl-8 {
+  padding-left: 2rem;
+}
+
+.pr-2 {
+  padding-right: 0.5rem;
+}
+
+.pr-8 {
+  padding-right: 2rem;
+}
+
+.pt-0 {
+  padding-top: 0px;
+}
+
+.pt-4 {
+  padding-top: 1rem;
+}
+
+.pt-\[7\%\] {
+  padding-top: 7%;
+}
+
+.text-left {
+  text-align: left;
+}
+
+.text-center {
+  text-align: center;
+}
+
+.align-middle {
+  vertical-align: middle;
+}
+
+.font-mono {
+  font-family: ui-monospace, SFMono-Regular, Menlo, Monaco, Consolas, "Liberation Mono", "Courier New", monospace;
+}
+
+.text-2xl {
+  font-size: 1.5rem;
+  line-height: 2rem;
+}
+
+.text-3xl {
+  font-size: 1.875rem;
+  line-height: 2.25rem;
+}
+
+.text-5xl {
+  font-size: 3rem;
+  line-height: 1;
+}
+
+.text-base {
+  font-size: 1rem;
+  line-height: 1.5rem;
+}
+
+.text-lg {
+  font-size: 1.125rem;
+  line-height: 1.75rem;
+}
+
+.text-sm {
+  font-size: 0.875rem;
+  line-height: 1.25rem;
+}
+
+.text-xl {
+  font-size: 1.25rem;
+  line-height: 1.75rem;
+}
+
+.text-xs {
+  font-size: 0.75rem;
+  line-height: 1rem;
+}
+
+.font-bold {
+  font-weight: 700;
+}
+
+.font-medium {
+  font-weight: 500;
+}
+
+.font-normal {
+  font-weight: 400;
+}
+
+.font-semibold {
+  font-weight: 600;
+}
+
+.leading-none {
+  line-height: 1;
+}
+
+.tracking-tight {
+  letter-spacing: -0.025em;
+}
+
+.tracking-wide {
+  letter-spacing: 0.025em;
+}
+
+.text-card-foreground {
+  color: hsl(var(--card-foreground));
+}
+
+.text-current {
+  color: currentColor;
+}
+
+.text-destructive {
+  color: hsl(var(--destructive));
+}
+
+.text-destructive-foreground {
+  color: hsl(var(--destructive-foreground));
+}
+
+.text-foreground {
+  color: hsl(var(--foreground));
+}
+
+.text-foreground\/50 {
+  color: hsl(var(--foreground) / 0.5);
+}
+
+.text-gray-800 {
+  --tw-text-opacity: 1;
+  color: rgb(31 41 55 / var(--tw-text-opacity));
+}
+
+.text-gray-900 {
+  --tw-text-opacity: 1;
+  color: rgb(17 24 39 / var(--tw-text-opacity));
+}
+
+.text-muted-foreground {
+  color: hsl(var(--muted-foreground));
+}
+
+.text-popover-foreground {
+  color: hsl(var(--popover-foreground));
+}
+
+.text-primary {
+  color: hsl(var(--primary));
+}
+
+.text-primary-foreground {
+  color: hsl(var(--primary-foreground));
+}
+
+.text-secondary-foreground {
+  color: hsl(var(--secondary-foreground));
+}
+
+.text-transparent {
+  color: transparent;
+}
+
+.no-underline {
+  text-decoration-line: none;
+}
+
+.underline-offset-4 {
+  text-underline-offset: 4px;
+}
+
+.antialiased {
+  -webkit-font-smoothing: antialiased;
+  -moz-osx-font-smoothing: grayscale;
+}
+
+.opacity-0 {
+  opacity: 0;
+}
+
+.opacity-50 {
+  opacity: 0.5;
+}
+
+.opacity-70 {
+  opacity: 0.7;
+}
+
+.opacity-90 {
+  opacity: 0.9;
+}
+
+.shadow-lg {
+  --tw-shadow: 0 10px 15px -3px rgb(0 0 0 / 0.1), 0 4px 6px -4px rgb(0 0 0 / 0.1);
+  --tw-shadow-colored: 0 10px 15px -3px var(--tw-shadow-color), 0 4px 6px -4px var(--tw-shadow-color);
+  box-shadow: var(--tw-ring-offset-shadow, 0 0 #0000), var(--tw-ring-shadow, 0 0 #0000), var(--tw-shadow);
+}
+
+.shadow-md {
+  --tw-shadow: 0 4px 6px -1px rgb(0 0 0 / 0.1), 0 2px 4px -2px rgb(0 0 0 / 0.1);
+  --tw-shadow-colored: 0 4px 6px -1px var(--tw-shadow-color), 0 2px 4px -2px var(--tw-shadow-color);
+  box-shadow: var(--tw-ring-offset-shadow, 0 0 #0000), var(--tw-ring-shadow, 0 0 #0000), var(--tw-shadow);
+}
+
+.shadow-sm {
+  --tw-shadow: 0 1px 2px 0 rgb(0 0 0 / 0.05);
+  --tw-shadow-colored: 0 1px 2px 0 var(--tw-shadow-color);
+  box-shadow: var(--tw-ring-offset-shadow, 0 0 #0000), var(--tw-ring-shadow, 0 0 #0000), var(--tw-shadow);
+}
+
+.outline-none {
+  outline: 2px solid transparent;
+  outline-offset: 2px;
+}
+
+.outline {
+  outline-style: solid;
+}
+
+.ring {
+  --tw-ring-offset-shadow: var(--tw-ring-inset) 0 0 0 var(--tw-ring-offset-width) var(--tw-ring-offset-color);
+  --tw-ring-shadow: var(--tw-ring-inset) 0 0 0 calc(3px + var(--tw-ring-offset-width)) var(--tw-ring-color);
+  box-shadow: var(--tw-ring-offset-shadow), var(--tw-ring-shadow), var(--tw-shadow, 0 0 #0000);
+}
+
+.ring-0 {
+  --tw-ring-offset-shadow: var(--tw-ring-inset) 0 0 0 var(--tw-ring-offset-width) var(--tw-ring-offset-color);
+  --tw-ring-shadow: var(--tw-ring-inset) 0 0 0 calc(0px + var(--tw-ring-offset-width)) var(--tw-ring-color);
+  box-shadow: var(--tw-ring-offset-shadow), var(--tw-ring-shadow), var(--tw-shadow, 0 0 #0000);
+}
+
+.ring-offset-background {
+  --tw-ring-offset-color: hsl(var(--background));
+}
+
+.ring-offset-transparent {
+  --tw-ring-offset-color: transparent;
+}
+
+.blur {
+  --tw-blur: blur(8px);
+  filter: var(--tw-blur) var(--tw-brightness) var(--tw-contrast) var(--tw-grayscale) var(--tw-hue-rotate) var(--tw-invert) var(--tw-saturate) var(--tw-sepia) var(--tw-drop-shadow);
+}
+
+.filter {
+  filter: var(--tw-blur) var(--tw-brightness) var(--tw-contrast) var(--tw-grayscale) var(--tw-hue-rotate) var(--tw-invert) var(--tw-saturate) var(--tw-sepia) var(--tw-drop-shadow);
+}
+
+.backdrop-filter {
+  -webkit-backdrop-filter: var(--tw-backdrop-blur) var(--tw-backdrop-brightness) var(--tw-backdrop-contrast) var(--tw-backdrop-grayscale) var(--tw-backdrop-hue-rotate) var(--tw-backdrop-invert) var(--tw-backdrop-opacity) var(--tw-backdrop-saturate) var(--tw-backdrop-sepia);
+  backdrop-filter: var(--tw-backdrop-blur) var(--tw-backdrop-brightness) var(--tw-backdrop-contrast) var(--tw-backdrop-grayscale) var(--tw-backdrop-hue-rotate) var(--tw-backdrop-invert) var(--tw-backdrop-opacity) var(--tw-backdrop-saturate) var(--tw-backdrop-sepia);
+}
+
+.transition {
+  transition-property: color, background-color, border-color, text-decoration-color, fill, stroke, opacity, box-shadow, transform, filter, -webkit-backdrop-filter;
+  transition-property: color, background-color, border-color, text-decoration-color, fill, stroke, opacity, box-shadow, transform, filter, backdrop-filter;
+  transition-property: color, background-color, border-color, text-decoration-color, fill, stroke, opacity, box-shadow, transform, filter, backdrop-filter, -webkit-backdrop-filter;
+  transition-timing-function: cubic-bezier(0.4, 0, 0.2, 1);
+  transition-duration: 150ms;
+}
+
+.transition-all {
+  transition-property: all;
+  transition-timing-function: cubic-bezier(0.4, 0, 0.2, 1);
+  transition-duration: 150ms;
+}
+
+.transition-colors {
+  transition-property: color, background-color, border-color, text-decoration-color, fill, stroke;
+  transition-timing-function: cubic-bezier(0.4, 0, 0.2, 1);
+  transition-duration: 150ms;
+}
+
+.transition-opacity {
+  transition-property: opacity;
+  transition-timing-function: cubic-bezier(0.4, 0, 0.2, 1);
+  transition-duration: 150ms;
+}
+
+.transition-transform {
+  transition-property: transform;
+  transition-timing-function: cubic-bezier(0.4, 0, 0.2, 1);
+  transition-duration: 150ms;
+}
+
+.duration-200 {
+  transition-duration: 200ms;
+}
+
+.duration-300 {
+  transition-duration: 300ms;
+}
+
+.ease-in-out {
+  transition-timing-function: cubic-bezier(0.4, 0, 0.2, 1);
+}
+
+.ease-out {
+  transition-timing-function: cubic-bezier(0, 0, 0.2, 1);
+}
+
+@keyframes enter {
+  from {
+    opacity: var(--tw-enter-opacity, 1);
+    transform: translate3d(var(--tw-enter-translate-x, 0), var(--tw-enter-translate-y, 0), 0) scale3d(var(--tw-enter-scale, 1), var(--tw-enter-scale, 1), var(--tw-enter-scale, 1)) rotate(var(--tw-enter-rotate, 0));
+  }
+}
+
+@keyframes exit {
+  to {
+    opacity: var(--tw-exit-opacity, 1);
+    transform: translate3d(var(--tw-exit-translate-x, 0), var(--tw-exit-translate-y, 0), 0) scale3d(var(--tw-exit-scale, 1), var(--tw-exit-scale, 1), var(--tw-exit-scale, 1)) rotate(var(--tw-exit-rotate, 0));
+  }
+}
+
+.animate-in {
+  animation-name: enter;
+  animation-duration: 150ms;
+  --tw-enter-opacity: initial;
+  --tw-enter-scale: initial;
+  --tw-enter-rotate: initial;
+  --tw-enter-translate-x: initial;
+  --tw-enter-translate-y: initial;
+}
+
+.animate-out {
+  animation-name: exit;
+  animation-duration: 150ms;
+  --tw-exit-opacity: initial;
+  --tw-exit-scale: initial;
+  --tw-exit-rotate: initial;
+  --tw-exit-translate-x: initial;
+  --tw-exit-translate-y: initial;
+}
+
+.fade-in {
+  --tw-enter-opacity: 0;
+}
+
+.fade-out {
+  --tw-exit-opacity: 0;
+}
+
+.zoom-in {
+  --tw-enter-scale: 0;
+}
+
+.zoom-out {
+  --tw-exit-scale: 0;
+}
+
+.spin-in {
+  --tw-enter-rotate: 30deg;
+}
+
+.spin-out {
+  --tw-exit-rotate: 30deg;
+}
+
+.slide-in-from-bottom {
+  --tw-enter-translate-y: 100%;
+}
+
+.slide-in-from-left {
+  --tw-enter-translate-x: -100%;
+}
+
+.slide-in-from-right {
+  --tw-enter-translate-x: 100%;
+}
+
+.slide-in-from-top {
+  --tw-enter-translate-y: -100%;
+}
+
+.slide-out-to-bottom {
+  --tw-exit-translate-y: 100%;
+}
+
+.slide-out-to-left {
+  --tw-exit-translate-x: -100%;
+}
+
+.slide-out-to-right {
+  --tw-exit-translate-x: 100%;
+}
+
+.slide-out-to-top {
+  --tw-exit-translate-y: -100%;
+}
+
+.duration-200 {
+  animation-duration: 200ms;
+}
+
+.duration-300 {
+  animation-duration: 300ms;
+}
+
+.ease-in-out {
+  animation-timing-function: cubic-bezier(0.4, 0, 0.2, 1);
+}
+
+.ease-out {
+  animation-timing-function: cubic-bezier(0, 0, 0.2, 1);
+}
+
+.running {
+  animation-play-state: running;
+}
+
+.paused {
+  animation-play-state: paused;
+}
+
+/* Hide scrollbar for Chrome, Safari and Opera */
+
+.no-scrollbar::-webkit-scrollbar {
+  display: none;
+}
+
+/* Hide scrollbar for IE, Edge and Firefox */
+
+.no-scrollbar {
+  -webkit-overflow-scrolling: touch;
+  -ms-overflow-style: none;
+  /* IE and Edge */
+  scrollbar-width: none;
+  /* Firefox */
+}
+
+@keyframes slideInFromTop {
+  from {
+    transform: translateY(-100%);
+  }
+
+  to {
+    transform: translateY(0);
+  }
+}
+
+@keyframes slideInFromBottom {
+  from {
+    transform: translateY(100%);
+  }
+
+  to {
+    transform: translateY(0);
+  }
+}
+
+.toast {
+  animation-duration: 0.2s;
+  animation-fill-mode: forwards;
+}
+
+@media (max-width: 640px) {
+  .toast {
+    animation-name: slideInFromTop;
+  }
+}
+
+@media (min-width: 641px) {
+  .toast {
+    animation-name: slideInFromBottom;
+  }
+}
+
+@keyframes fade-in {
+  from {
+    opacity: 0;
+  }
+
+  to {
+    opacity: 1;
+  }
+}
+
+@keyframes slide-up {
+  from {
+    transform: translateY(20px);
+    opacity: 0;
+  }
+
+  to {
+    transform: translateY(0);
+    opacity: 1;
+  }
+}
+
+.animate-fade-in {
+  animation: fade-in 1s ease-out forwards;
+}
+
+.animate-slide-up {
+  animation: slide-up 1s ease-out forwards;
+}
+
+.sim-map-button.active {
+  background-color: #61D790;
+  color: #2E2F27;
+  &:hover {
+    background-color: #61D790;
+  }
+}
+
+.text-highlight strong {
+  color: black;
+  .dark & {
+    color: white;
+  }
+}
+
+.tokens-button {
+  background-color: #B7E2F1;
+  color: #2E2F27;
+}
+
+.overlay-image {
+  opacity: 0.5;
+  position: absolute;
+  top: 0;
+  left: 0;
+  width: 100%;
+  height: 100%;
+  z-index: 10;
+}
+
+header {
+  grid-column: 1/-1;
+}
+
+body {
+  &[data-is-home="true"] {
+    background: radial-gradient(circle at 50% 100%, #fcfcfd, #fcfcfd, #fdfdfe, #fdfdfe, #fefefe, #fefefe, #ffffff, #ffffff);
+    .dark & {
+      background: radial-gradient(circle at 50% 50%, #272a2d, #242629, #212326, #1e1f22, #1b1c1e, #18181b, #151517, #111113);
+    }
+  }
+}
+
+main {
+  overflow: auto;
+}
+
+aside {
+  overflow: auto;
+}
+
+.scroll-container {
+  padding-right: 10px;
+}
+
+.question-message {
+  background-color: #61D790;
+  color: #2E2F27;
+}
+
+@media (min-width: 768px) {
+  .grid-image-text-columns {
+    grid-column: span 2 / span 2;
+    grid-template-columns: repeat(2, minmax(0, 1fr));
+  }
+}
+
+.grid-image-column {
+  grid-row: span 2 / span 2;
+  display: grid;
+  grid-template-rows: subgrid;
+  align-content: flex-start;
+}
+
+@media (min-width: 768px) {
+  .md-grid-text-column {
+    grid-row: span 2 / span 2;
+    display: grid;
+    grid-template-rows: subgrid;
+    align-content: flex-start;
+  }
+}
+
+#search-input[aria-expanded="true"] {
+  border-top: 1px solid hsl(var(--input));
+  border-left: 1px solid hsl(var(--input));
+  border-right: 1px solid hsl(var(--input));
+  border-bottom: none;
+  border-bottom-left-radius: 0;
+  border-bottom-right-radius: 0;
+}
+
+.awesomplete {
+  width: 100%;
+}
+
+.awesomplete > ul > :not([hidden]) ~ :not([hidden]) {
+  --tw-space-y-reverse: 0;
+  margin-top: calc(0.25rem * calc(1 - var(--tw-space-y-reverse)));
+  margin-bottom: calc(0.25rem * var(--tw-space-y-reverse));
+}
+
+.awesomplete > ul {
+  font-size: 0.875rem;
+  line-height: 1.25rem;
+  margin: 0;
+  border-top: none;
+  border-left: 1px solid hsl(var(--input));
+  border-right: 1px solid hsl(var(--input));
+  border-bottom: 1px solid hsl(var(--input));
+  border-radius: 0 0 calc(var(--radius) - 2px) calc(var(--radius) - 2px);
+  background: white;
+  .dark & {
+    background: hsl(var(--background));
+  }
+  box-shadow: none;
+  text-shadow: none;
+}
+
+.awesomplete > ul:before {
+  display: none;
+}
+
+.awesomplete > ul > li:hover {
+  background-color: #B7E2F1;
+  color: #2E2F27;
+}
+
+.awesomplete > ul > li[aria-selected="true"] {
+  background-color: #B7E2F1;
+  color: #2E2F27;
+}
+
+.awesomplete mark {
+  background-color: #61D790;
+  color: #2E2F27;
+}
+
+.awesomplete li:hover mark {
+  background-color: #61D790;
+  color: #2E2F27;
+}
+
+.awesomplete li[aria-selected="true"] mark {
+  background-color: #61D790;
+  color: #2E2F27;
+}
+
+:root:has(.data-\[state\=open\]\:no-bg-scroll[data-state="open"]) {
+  overflow: hidden;
+}
+
+:root:has(.group[data-state="open"] .group-data-\[state\=open\]\:no-bg-scroll) {
+  overflow: hidden;
+}
+
+.file\:border-0::file-selector-button {
+  border-width: 0px;
+}
+
+.file\:bg-transparent::file-selector-button {
+  background-color: transparent;
+}
+
+.file\:text-sm::file-selector-button {
+  font-size: 0.875rem;
+  line-height: 1.25rem;
+}
+
+.file\:font-medium::file-selector-button {
+  font-weight: 500;
+}
+
+.placeholder\:text-muted-foreground::-moz-placeholder {
+  color: hsl(var(--muted-foreground));
+}
+
+.placeholder\:text-muted-foreground::placeholder {
+  color: hsl(var(--muted-foreground));
+}
+
+.focus-within\:border-input:focus-within {
+  border-color: hsl(var(--input));
+}
+
+.focus-within\:outline-none:focus-within {
+  outline: 2px solid transparent;
+  outline-offset: 2px;
+}
+
+.focus-within\:ring-2:focus-within {
+  --tw-ring-offset-shadow: var(--tw-ring-inset) 0 0 0 var(--tw-ring-offset-width) var(--tw-ring-offset-color);
+  --tw-ring-shadow: var(--tw-ring-inset) 0 0 0 calc(2px + var(--tw-ring-offset-width)) var(--tw-ring-color);
+  box-shadow: var(--tw-ring-offset-shadow), var(--tw-ring-shadow), var(--tw-shadow, 0 0 #0000);
+}
+
+.focus-within\:ring-ring:focus-within {
+  --tw-ring-color: hsl(var(--ring));
+}
+
+.focus-within\:ring-offset-2:focus-within {
+  --tw-ring-offset-width: 2px;
+}
+
+.hover\:border-black:hover {
+  --tw-border-opacity: 1;
+  border-color: rgb(0 0 0 / var(--tw-border-opacity));
+}
+
+.hover\:bg-accent:hover {
+  background-color: hsl(var(--accent));
+}
+
+.hover\:bg-destructive\/80:hover {
+  background-color: hsl(var(--destructive) / 0.8);
+}
+
+.hover\:bg-destructive\/90:hover {
+  background-color: hsl(var(--destructive) / 0.9);
+}
+
+.hover\:bg-muted\/50:hover {
+  background-color: hsl(var(--muted) / 0.5);
+}
+
+.hover\:bg-primary\/80:hover {
+  background-color: hsl(var(--primary) / 0.8);
+}
+
+.hover\:bg-primary\/90:hover {
+  background-color: hsl(var(--primary) / 0.9);
+}
+
+.hover\:bg-secondary\/80:hover {
+  background-color: hsl(var(--secondary) / 0.8);
+}
+
+.hover\:text-accent-foreground:hover {
+  color: hsl(var(--accent-foreground));
+}
+
+.hover\:text-foreground:hover {
+  color: hsl(var(--foreground));
+}
+
+.hover\:underline:hover {
+  text-decoration-line: underline;
+}
+
+.hover\:opacity-100:hover {
+  opacity: 1;
+}
+
+.focus\:bg-accent:focus {
+  background-color: hsl(var(--accent));
+}
+
+.focus\:text-accent-foreground:focus {
+  color: hsl(var(--accent-foreground));
+}
+
+.focus\:opacity-100:focus {
+  opacity: 1;
+}
+
+.focus\:outline-none:focus {
+  outline: 2px solid transparent;
+  outline-offset: 2px;
+}
+
+.focus\:ring-2:focus {
+  --tw-ring-offset-shadow: var(--tw-ring-inset) 0 0 0 var(--tw-ring-offset-width) var(--tw-ring-offset-color);
+  --tw-ring-shadow: var(--tw-ring-inset) 0 0 0 calc(2px + var(--tw-ring-offset-width)) var(--tw-ring-color);
+  box-shadow: var(--tw-ring-offset-shadow), var(--tw-ring-shadow), var(--tw-shadow, 0 0 #0000);
+}
+
+.focus\:ring-ring:focus {
+  --tw-ring-color: hsl(var(--ring));
+}
+
+.focus\:ring-offset-2:focus {
+  --tw-ring-offset-width: 2px;
+}
+
+.focus-visible\:outline-none:focus-visible {
+  outline: 2px solid transparent;
+  outline-offset: 2px;
+}
+
+.focus-visible\:ring-2:focus-visible {
+  --tw-ring-offset-shadow: var(--tw-ring-inset) 0 0 0 var(--tw-ring-offset-width) var(--tw-ring-offset-color);
+  --tw-ring-shadow: var(--tw-ring-inset) 0 0 0 calc(2px + var(--tw-ring-offset-width)) var(--tw-ring-color);
+  box-shadow: var(--tw-ring-offset-shadow), var(--tw-ring-shadow), var(--tw-shadow, 0 0 #0000);
+}
+
+.focus-visible\:ring-ring:focus-visible {
+  --tw-ring-color: hsl(var(--ring));
+}
+
+.focus-visible\:ring-transparent:focus-visible {
+  --tw-ring-color: transparent;
+}
+
+.focus-visible\:ring-offset-2:focus-visible {
+  --tw-ring-offset-width: 2px;
+}
+
+.active\:ring:active {
+  --tw-ring-offset-shadow: var(--tw-ring-inset) 0 0 0 var(--tw-ring-offset-width) var(--tw-ring-offset-color);
+  --tw-ring-shadow: var(--tw-ring-inset) 0 0 0 calc(3px + var(--tw-ring-offset-width)) var(--tw-ring-color);
+  box-shadow: var(--tw-ring-offset-shadow), var(--tw-ring-shadow), var(--tw-shadow, 0 0 #0000);
+}
+
+.disabled\:pointer-events-none:disabled {
+  pointer-events: none;
+}
+
+.disabled\:cursor-not-allowed:disabled {
+  cursor: not-allowed;
+}
+
+.disabled\:opacity-50:disabled {
+  opacity: 0.5;
+}
+
+.group:hover .group-hover\:opacity-100 {
+  opacity: 1;
+}
+
+.group.destructive .group-\[\.destructive\]\:text-red-300 {
+  --tw-text-opacity: 1;
+  color: rgb(252 165 165 / var(--tw-text-opacity));
+}
+
+.group.destructive .group-\[\.destructive\]\:hover\:text-red-50:hover {
+  --tw-text-opacity: 1;
+  color: rgb(254 242 242 / var(--tw-text-opacity));
+}
+
+.group.destructive .group-\[\.destructive\]\:focus\:ring-red-400:focus {
+  --tw-ring-opacity: 1;
+  --tw-ring-color: rgb(248 113 113 / var(--tw-ring-opacity));
+}
+
+.group.destructive .group-\[\.destructive\]\:focus\:ring-offset-red-600:focus {
+  --tw-ring-offset-color: #dc2626;
+}
+
+.peer:checked ~ .peer-checked\:bg-primary {
+  background-color: hsl(var(--primary));
+}
+
+.peer:checked ~ .peer-checked\:text-primary-foreground {
+  color: hsl(var(--primary-foreground));
+}
+
+.peer:disabled ~ .peer-disabled\:cursor-not-allowed {
+  cursor: not-allowed;
+}
+
+.peer:disabled ~ .peer-disabled\:opacity-50 {
+  opacity: 0.5;
+}
+
+.peer:disabled ~ .peer-disabled\:opacity-70 {
+  opacity: 0.7;
+}
+
+.data-\[disabled\]\:pointer-events-none[data-disabled] {
+  pointer-events: none;
+}
+
+.data-\[side\=bottom\]\:translate-y-1[data-side="bottom"] {
+  --tw-translate-y: 0.25rem;
+  transform: translate(var(--tw-translate-x), var(--tw-translate-y)) rotate(var(--tw-rotate)) skewX(var(--tw-skew-x)) skewY(var(--tw-skew-y)) scaleX(var(--tw-scale-x)) scaleY(var(--tw-scale-y));
+}
+
+.data-\[side\=left\]\:-translate-x-1[data-side="left"] {
+  --tw-translate-x: -0.25rem;
+  transform: translate(var(--tw-translate-x), var(--tw-translate-y)) rotate(var(--tw-rotate)) skewX(var(--tw-skew-x)) skewY(var(--tw-skew-y)) scaleX(var(--tw-scale-x)) scaleY(var(--tw-scale-y));
+}
+
+.data-\[side\=right\]\:translate-x-1[data-side="right"] {
+  --tw-translate-x: 0.25rem;
+  transform: translate(var(--tw-translate-x), var(--tw-translate-y)) rotate(var(--tw-rotate)) skewX(var(--tw-skew-x)) skewY(var(--tw-skew-y)) scaleX(var(--tw-scale-x)) scaleY(var(--tw-scale-y));
+}
+
+.data-\[side\=top\]\:-translate-y-1[data-side="top"] {
+  --tw-translate-y: -0.25rem;
+  transform: translate(var(--tw-translate-x), var(--tw-translate-y)) rotate(var(--tw-rotate)) skewX(var(--tw-skew-x)) skewY(var(--tw-skew-y)) scaleX(var(--tw-scale-x)) scaleY(var(--tw-scale-y));
+}
+
+.data-\[state\=active\]\:bg-background[data-state="active"] {
+  background-color: hsl(var(--background));
+}
+
+.data-\[state\=selected\]\:bg-muted[data-state="selected"] {
+  background-color: hsl(var(--muted));
+}
+
+.data-\[state\=active\]\:text-foreground[data-state="active"] {
+  color: hsl(var(--foreground));
+}
+
+.data-\[disabled\]\:opacity-50[data-disabled] {
+  opacity: 0.5;
+}
+
+.data-\[state\=active\]\:shadow-sm[data-state="active"] {
+  --tw-shadow: 0 1px 2px 0 rgb(0 0 0 / 0.05);
+  --tw-shadow-colored: 0 1px 2px 0 var(--tw-shadow-color);
+  box-shadow: var(--tw-ring-offset-shadow, 0 0 #0000), var(--tw-ring-shadow, 0 0 #0000), var(--tw-shadow);
+}
+
+.data-\[state\=open\]\:animate-in[data-state="open"] {
+  animation-name: enter;
+  animation-duration: 150ms;
+  --tw-enter-opacity: initial;
+  --tw-enter-scale: initial;
+  --tw-enter-rotate: initial;
+  --tw-enter-translate-x: initial;
+  --tw-enter-translate-y: initial;
+}
+
+.data-\[state\=closed\]\:animate-out[data-state="closed"] {
+  animation-name: exit;
+  animation-duration: 150ms;
+  --tw-exit-opacity: initial;
+  --tw-exit-scale: initial;
+  --tw-exit-rotate: initial;
+  --tw-exit-translate-x: initial;
+  --tw-exit-translate-y: initial;
+}
+
+.data-\[state\=closed\]\:fade-out-0[data-state="closed"] {
+  --tw-exit-opacity: 0;
+}
+
+.data-\[state\=open\]\:fade-in-0[data-state="open"] {
+  --tw-enter-opacity: 0;
+}
+
+.data-\[state\=closed\]\:zoom-out-95[data-state="closed"] {
+  --tw-exit-scale: .95;
+}
+
+.data-\[state\=open\]\:zoom-in-95[data-state="open"] {
+  --tw-enter-scale: .95;
+}
+
+.data-\[side\=bottom\]\:slide-in-from-top-2[data-side="bottom"] {
+  --tw-enter-translate-y: -0.5rem;
+}
+
+.data-\[side\=left\]\:slide-in-from-right-2[data-side="left"] {
+  --tw-enter-translate-x: 0.5rem;
+}
+
+.data-\[side\=right\]\:slide-in-from-left-2[data-side="right"] {
+  --tw-enter-translate-x: -0.5rem;
+}
+
+.data-\[side\=top\]\:slide-in-from-bottom-2[data-side="top"] {
+  --tw-enter-translate-y: 0.5rem;
+}
+
+.group[data-checked="true"] .group-data-\[checked\=true\]\:flex {
+  display: flex;
+}
+
+.group[data-state="checked"] .group-data-\[state\=checked\]\:flex {
+  display: flex;
+}
+
+.group[data-state="open"] .group-data-\[state\=open\]\:bg-accent {
+  background-color: hsl(var(--accent));
+}
+
+.group[data-state="open"] .group-data-\[state\=open\]\:text-muted-foreground {
+  color: hsl(var(--muted-foreground));
+}
+
+.group[data-state="closed"] .group-data-\[state\=closed\]\:duration-300 {
+  transition-duration: 300ms;
+}
+
+.group[data-state="open"] .group-data-\[state\=open\]\:duration-500 {
+  transition-duration: 500ms;
+}
+
+.group[data-state="open"] .group-data-\[state\=open\]\:animate-in {
+  animation-name: enter;
+  animation-duration: 150ms;
+  --tw-enter-opacity: initial;
+  --tw-enter-scale: initial;
+  --tw-enter-rotate: initial;
+  --tw-enter-translate-x: initial;
+  --tw-enter-translate-y: initial;
+}
+
+.group[data-state="closed"] .group-data-\[state\=closed\]\:animate-out {
+  animation-name: exit;
+  animation-duration: 150ms;
+  --tw-exit-opacity: initial;
+  --tw-exit-scale: initial;
+  --tw-exit-rotate: initial;
+  --tw-exit-translate-x: initial;
+  --tw-exit-translate-y: initial;
+}
+
+.group[data-state="closed"] .group-data-\[state\=closed\]\:fade-out-0 {
+  --tw-exit-opacity: 0;
+}
+
+.group[data-state="open"] .group-data-\[state\=open\]\:fade-in-0 {
+  --tw-enter-opacity: 0;
+}
+
+.group[data-state="closed"] .group-data-\[state\=closed\]\:zoom-out-95 {
+  --tw-exit-scale: .95;
+}
+
+.group[data-state="open"] .group-data-\[state\=open\]\:zoom-in-95 {
+  --tw-enter-scale: .95;
+}
+
+.group[data-state="closed"] .group-data-\[state\=closed\]\:slide-out-to-bottom {
+  --tw-exit-translate-y: 100%;
+}
+
+.group[data-state="closed"] .group-data-\[state\=closed\]\:slide-out-to-left {
+  --tw-exit-translate-x: -100%;
+}
+
+.group[data-state="closed"] .group-data-\[state\=closed\]\:slide-out-to-left-1\/2 {
+  --tw-exit-translate-x: -50%;
+}
+
+.group[data-state="closed"] .group-data-\[state\=closed\]\:slide-out-to-right {
+  --tw-exit-translate-x: 100%;
+}
+
+.group[data-state="closed"] .group-data-\[state\=closed\]\:slide-out-to-top {
+  --tw-exit-translate-y: -100%;
+}
+
+.group[data-state="closed"] .group-data-\[state\=closed\]\:slide-out-to-top-\[48\%\] {
+  --tw-exit-translate-y: -48%;
+}
+
+.group[data-state="open"] .group-data-\[state\=open\]\:slide-in-from-bottom {
+  --tw-enter-translate-y: 100%;
+}
+
+.group[data-state="open"] .group-data-\[state\=open\]\:slide-in-from-left {
+  --tw-enter-translate-x: -100%;
+}
+
+.group[data-state="open"] .group-data-\[state\=open\]\:slide-in-from-left-1\/2 {
+  --tw-enter-translate-x: -50%;
+}
+
+.group[data-state="open"] .group-data-\[state\=open\]\:slide-in-from-right {
+  --tw-enter-translate-x: 100%;
+}
+
+.group[data-state="open"] .group-data-\[state\=open\]\:slide-in-from-top {
+  --tw-enter-translate-y: -100%;
+}
+
+.group[data-state="open"] .group-data-\[state\=open\]\:slide-in-from-top-\[48\%\] {
+  --tw-enter-translate-y: -48%;
+}
+
+.group[data-state="closed"] .group-data-\[state\=closed\]\:duration-300 {
+  animation-duration: 300ms;
+}
+
+.group[data-state="open"] .group-data-\[state\=open\]\:duration-500 {
+  animation-duration: 500ms;
+}
+
+@media (min-width: 640px) {
+  .sm\:bottom-0 {
+    bottom: 0px;
+  }
+
+  .sm\:right-0 {
+    right: 0px;
+  }
+
+  .sm\:top-auto {
+    top: auto;
+  }
+
+  .sm\:flex {
+    display: flex;
+  }
+
+  .sm\:max-w-sm {
+    max-width: 24rem;
+  }
+
+  .sm\:flex-row {
+    flex-direction: row;
+  }
+
+  .sm\:flex-col {
+    flex-direction: column;
+  }
+
+  .sm\:justify-end {
+    justify-content: flex-end;
+  }
+
+  .sm\:space-x-2 > :not([hidden]) ~ :not([hidden]) {
+    --tw-space-x-reverse: 0;
+    margin-right: calc(0.5rem * var(--tw-space-x-reverse));
+    margin-left: calc(0.5rem * calc(1 - var(--tw-space-x-reverse)));
+  }
+
+  .sm\:rounded-lg {
+    border-radius: var(--radius);
+  }
+
+  .sm\:text-left {
+    text-align: left;
+  }
+}
+
+@media (min-width: 768px) {
+  .md\:block {
+    display: block;
+  }
+
+  .md\:max-w-\[420px\] {
+    max-width: 420px;
+  }
+
+  .md\:grid-cols-\[minmax\(0\2c _45fr\)_minmax\(0\2c _15fr\)\] {
+    grid-template-columns: minmax(0, 45fr) minmax(0, 15fr);
+  }
+
+  .md\:text-2xl {
+    font-size: 1.5rem;
+    line-height: 2rem;
+  }
+
+  .md\:text-7xl {
+    font-size: 4.5rem;
+    line-height: 1;
+  }
+
+  .md\:tracking-wide {
+    letter-spacing: 0.025em;
+  }
+
+  .md\:tracking-wider {
+    letter-spacing: 0.05em;
+  }
+}
+
+@media (min-width: 1280px) {
+  .xl\:grid-rows-\[1fr_2fr\] {
+    grid-template-rows: 1fr 2fr;
+  }
+}
+
+.dark\:block:where(.dark, .dark *) {
+  display: block;
+}
+
+.dark\:flex:where(.dark, .dark *) {
+  display: flex;
+}
+
+.dark\:hidden:where(.dark, .dark *) {
+  display: none;
+}
+
+.dark\:border-destructive:where(.dark, .dark *) {
+  border-color: hsl(var(--destructive));
+}
+
+.dark\:bg-background:where(.dark, .dark *) {
+  background-color: hsl(var(--background));
+}
+
+.dark\:from-\[\#1c2024\]:where(.dark, .dark *) {
+  --tw-gradient-from: #1c2024 var(--tw-gradient-from-position);
+  --tw-gradient-to: rgb(28 32 36 / 0) var(--tw-gradient-to-position);
+  --tw-gradient-stops: var(--tw-gradient-from), var(--tw-gradient-to);
+}
+
+.dark\:from-white:where(.dark, .dark *) {
+  --tw-gradient-from: #fff var(--tw-gradient-from-position);
+  --tw-gradient-to: rgb(255 255 255 / 0) var(--tw-gradient-to-position);
+  --tw-gradient-stops: var(--tw-gradient-from), var(--tw-gradient-to);
+}
+
+.dark\:to-slate-300:where(.dark, .dark *) {
+  --tw-gradient-to: #cbd5e1 var(--tw-gradient-to-position);
+}
+
+.dark\:hover\:border-white:hover:where(.dark, .dark *) {
+  --tw-border-opacity: 1;
+  border-color: rgb(255 255 255 / var(--tw-border-opacity));
+}
+
+.\[\&\:has\(\[role\=checkbox\]\)\]\:pr-0:has([role=checkbox]) {
+  padding-right: 0px;
+}
+
+.\[\&\>span\]\:line-clamp-1>span {
+  overflow: hidden;
+  display: -webkit-box;
+  -webkit-box-orient: vertical;
+  -webkit-line-clamp: 1;
+}
+
+.\[\&\>span\]\:translate-x-0>span {
+  --tw-translate-x: 0px;
+  transform: translate(var(--tw-translate-x), var(--tw-translate-y)) rotate(var(--tw-rotate)) skewX(var(--tw-skew-x)) skewY(var(--tw-skew-y)) scaleX(var(--tw-scale-x)) scaleY(var(--tw-scale-y));
+}
+
+.peer:checked ~ .peer-checked\:\[\&\>span\]\:flex>span {
+  display: flex;
+}
+
+.peer:checked ~ .peer-checked\:\[\&\>span\]\:translate-x-5>span {
+  --tw-translate-x: 1.25rem;
+  transform: translate(var(--tw-translate-x), var(--tw-translate-y)) rotate(var(--tw-rotate)) skewX(var(--tw-skew-x)) skewY(var(--tw-skew-y)) scaleX(var(--tw-scale-x)) scaleY(var(--tw-scale-y));
+}
+
+.\[\&\>svg\+div\]\:translate-y-\[-3px\]>svg+div {
+  --tw-translate-y: -3px;
+  transform: translate(var(--tw-translate-x), var(--tw-translate-y)) rotate(var(--tw-rotate)) skewX(var(--tw-skew-x)) skewY(var(--tw-skew-y)) scaleX(var(--tw-scale-x)) scaleY(var(--tw-scale-y));
+}
+
+.\[\&\>svg\]\:absolute>svg {
+  position: absolute;
+}
+
+.\[\&\>svg\]\:left-4>svg {
+  left: 1rem;
+}
+
+.\[\&\>svg\]\:top-4>svg {
+  top: 1rem;
+}
+
+.\[\&\>svg\]\:text-destructive>svg {
+  color: hsl(var(--destructive));
+}
+
+.\[\&\>svg\]\:text-foreground>svg {
+  color: hsl(var(--foreground));
+}
+
+.\[\&\>svg\~\*\]\:pl-7>svg~* {
+  padding-left: 1.75rem;
+}
+
+.\[\&\>tr\]\:last\:border-b-0:last-child>tr {
+  border-bottom-width: 0px;
+}
+
+.\[\&_p\]\:leading-relaxed p {
+  line-height: 1.625;
+}
+
+.\[\&_tr\:last-child\]\:border-0 tr:last-child {
+  border-width: 0px;
+}
+
+.\[\&_tr\]\:border-b tr {
+  border-bottom-width: 1px;
+}
+

src/requirements.txt

@@ -0,0 +1,540 @@
+# This file was autogenerated by uv via the following command:
+#    uv pip compile pyproject.toml -o src/requirements.txt
+accelerate==0.34.2
+    # via peft
+aiohappyeyeballs==2.4.3
+    # via aiohttp
+aiohttp==3.10.9
+    # via
+    #   datasets
+    #   fsspec
+    #   pyvespa
+aiosignal==1.3.1
+    # via aiohttp
+annotated-types==0.7.0
+    # via pydantic
+anyio==4.6.0
+    # via
+    #   httpx
+    #   starlette
+    #   watchfiles
+async-timeout==4.0.3
+    # via aiohttp
+attrs==24.2.0
+    # via aiohttp
+beautifulsoup4==4.12.3
+    # via python-fasthtml
+blis==0.7.11
+    # via thinc
+cachetools==5.5.0
+    # via google-auth
+catalogue==2.0.10
+    # via
+    #   spacy
+    #   srsly
+    #   thinc
+certifi==2024.8.30
+    # via
+    #   httpcore
+    #   httpx
+    #   requests
+cffi==1.17.1
+    # via cryptography
+charset-normalizer==3.3.2
+    # via requests
+click==8.1.7
+    # via
+    #   typer
+    #   uvicorn
+cloudpathlib==0.20.0
+    # via weasel
+colpali-engine==0.3.1
+    # via
+    #   visual-retrieval-colpali (pyproject.toml)
+    #   vidore-benchmark
+confection==0.1.5
+    # via
+    #   thinc
+    #   weasel
+contourpy==1.3.0
+    # via matplotlib
+cryptography==43.0.1
+    # via pyvespa
+cycler==0.12.1
+    # via matplotlib
+cymem==2.0.8
+    # via
+    #   preshed
+    #   spacy
+    #   thinc
+datasets==2.21.0
+    # via
+    #   mteb
+    #   vidore-benchmark
+dill==0.3.8
+    # via
+    #   datasets
+    #   multiprocess
+docker==7.1.0
+    # via pyvespa
+einops==0.8.0
+    # via
+    #   visual-retrieval-colpali (pyproject.toml)
+    #   vidore-benchmark
+eval-type-backport==0.2.0
+    # via mteb
+exceptiongroup==1.2.2
+    # via anyio
+fastcore==1.7.11
+    # via
+    #   fastlite
+    #   python-fasthtml
+    #   pyvespa
+    #   sqlite-minutils
+fastlite==0.0.11
+    # via python-fasthtml
+filelock==3.16.1
+    # via
+    #   datasets
+    #   huggingface-hub
+    #   torch
+    #   transformers
+fonttools==4.54.1
+    # via matplotlib
+frozenlist==1.4.1
+    # via
+    #   aiohttp
+    #   aiosignal
+fsspec==2024.6.1
+    # via
+    #   datasets
+    #   huggingface-hub
+    #   torch
+google-ai-generativelanguage==0.6.10
+    # via google-generativeai
+google-api-core==2.21.0
+    # via
+    #   google-ai-generativelanguage
+    #   google-api-python-client
+    #   google-generativeai
+google-api-python-client==2.149.0
+    # via google-generativeai
+google-auth==2.35.0
+    # via
+    #   google-ai-generativelanguage
+    #   google-api-core
+    #   google-api-python-client
+    #   google-auth-httplib2
+    #   google-generativeai
+google-auth-httplib2==0.2.0
+    # via google-api-python-client
+google-generativeai==0.8.3
+    # via visual-retrieval-colpali (pyproject.toml)
+googleapis-common-protos==1.65.0
+    # via
+    #   google-api-core
+    #   grpcio-status
+gputil==1.4.0
+    # via
+    #   colpali-engine
+    #   vidore-benchmark
+grpcio==1.67.0
+    # via
+    #   google-api-core
+    #   grpcio-status
+grpcio-status==1.67.0
+    # via google-api-core
+h11==0.14.0
+    # via
+    #   httpcore
+    #   uvicorn
+h2==4.1.0
+    # via httpx
+hpack==4.0.0
+    # via h2
+httpcore==1.0.6
+    # via httpx
+httplib2==0.22.0
+    # via
+    #   google-api-python-client
+    #   google-auth-httplib2
+httptools==0.6.1
+    # via uvicorn
+httpx==0.27.2
+    # via
+    #   python-fasthtml
+    #   pyvespa
+huggingface-hub==0.25.1
+    # via
+    #   visual-retrieval-colpali (pyproject.toml)
+    #   accelerate
+    #   datasets
+    #   peft
+    #   sentence-transformers
+    #   tokenizers
+    #   transformers
+hyperframe==6.0.1
+    # via h2
+idna==3.10
+    # via
+    #   anyio
+    #   httpx
+    #   requests
+    #   yarl
+itsdangerous==2.2.0
+    # via python-fasthtml
+jinja2==3.1.4
+    # via
+    #   pyvespa
+    #   spacy
+    #   torch
+joblib==1.4.2
+    # via scikit-learn
+kiwisolver==1.4.7
+    # via matplotlib
+langcodes==3.4.1
+    # via spacy
+language-data==1.2.0
+    # via langcodes
+loguru==0.7.2
+    # via vidore-benchmark
+lucide-fasthtml==0.0.9
+    # via shad4fast
+lxml==5.3.0
+    # via
+    #   lucide-fasthtml
+    #   pyvespa
+marisa-trie==1.2.1
+    # via language-data
+markdown-it-py==3.0.0
+    # via rich
+markupsafe==2.1.5
+    # via jinja2
+matplotlib==3.9.2
+    # via
+    #   seaborn
+    #   vidore-benchmark
+mdurl==0.1.2
+    # via markdown-it-py
+mpmath==1.3.0
+    # via sympy
+mteb==1.15.3
+    # via vidore-benchmark
+multidict==6.1.0
+    # via
+    #   aiohttp
+    #   yarl
+multiprocess==0.70.16
+    # via datasets
+murmurhash==1.0.10
+    # via
+    #   preshed
+    #   spacy
+    #   thinc
+networkx==3.3
+    # via torch
+numpy==1.26.4
+    # via
+    #   accelerate
+    #   blis
+    #   colpali-engine
+    #   contourpy
+    #   datasets
+    #   matplotlib
+    #   mteb
+    #   pandas
+    #   peft
+    #   pyarrow
+    #   scikit-learn
+    #   scipy
+    #   seaborn
+    #   spacy
+    #   thinc
+    #   transformers
+    #   vidore-benchmark
+oauthlib==3.2.2
+    # via python-fasthtml
+packaging==24.1
+    # via
+    #   accelerate
+    #   datasets
+    #   fastcore
+    #   huggingface-hub
+    #   matplotlib
+    #   peft
+    #   spacy
+    #   thinc
+    #   transformers
+    #   weasel
+pandas==2.2.3
+    # via
+    #   datasets
+    #   seaborn
+pdf2image==1.17.0
+    # via vidore-benchmark
+peft==0.11.1
+    # via
+    #   colpali-engine
+    #   vidore-benchmark
+pillow==10.4.0
+    # via
+    #   colpali-engine
+    #   matplotlib
+    #   pdf2image
+    #   sentence-transformers
+    #   vidore-benchmark
+pip==24.3.1
+    # via visual-retrieval-colpali (pyproject.toml)
+polars==1.9.0
+    # via mteb
+preshed==3.0.9
+    # via
+    #   spacy
+    #   thinc
+proto-plus==1.24.0
+    # via
+    #   google-ai-generativelanguage
+    #   google-api-core
+protobuf==5.28.3
+    # via
+    #   google-ai-generativelanguage
+    #   google-api-core
+    #   google-generativeai
+    #   googleapis-common-protos
+    #   grpcio-status
+    #   proto-plus
+psutil==6.0.0
+    # via
+    #   accelerate
+    #   peft
+pyarrow==17.0.0
+    # via datasets
+pyasn1==0.6.1
+    # via
+    #   pyasn1-modules
+    #   rsa
+pyasn1-modules==0.4.1
+    # via google-auth
+pycparser==2.22
+    # via cffi
+pydantic==2.9.2
+    # via
+    #   confection
+    #   google-generativeai
+    #   mteb
+    #   spacy
+    #   thinc
+    #   weasel
+pydantic-core==2.23.4
+    # via pydantic
+pygments==2.18.0
+    # via rich
+pyparsing==3.1.4
+    # via
+    #   httplib2
+    #   matplotlib
+pypdf==5.0.1
+    # via visual-retrieval-colpali (pyproject.toml)
+python-dateutil==2.9.0.post0
+    # via
+    #   matplotlib
+    #   pandas
+    #   python-fasthtml
+    #   pyvespa
+python-dotenv==1.0.1
+    # via
+    #   visual-retrieval-colpali (pyproject.toml)
+    #   uvicorn
+    #   vidore-benchmark
+python-fasthtml==0.6.9
+    # via
+    #   visual-retrieval-colpali (pyproject.toml)
+    #   lucide-fasthtml
+    #   shad4fast
+python-multipart==0.0.12
+    # via python-fasthtml
+pytrec-eval-terrier==0.5.6
+    # via mteb
+pytz==2024.2
+    # via pandas
+pyvespa==0.50.0
+    # via visual-retrieval-colpali (pyproject.toml)
+pyyaml==6.0.2
+    # via
+    #   accelerate
+    #   datasets
+    #   huggingface-hub
+    #   peft
+    #   transformers
+    #   uvicorn
+regex==2024.9.11
+    # via transformers
+requests==2.32.3
+    # via
+    #   colpali-engine
+    #   datasets
+    #   docker
+    #   google-api-core
+    #   huggingface-hub
+    #   lucide-fasthtml
+    #   mteb
+    #   pyvespa
+    #   requests-toolbelt
+    #   spacy
+    #   transformers
+    #   weasel
+requests-toolbelt==1.0.0
+    # via pyvespa
+rich==13.9.2
+    # via
+    #   mteb
+    #   typer
+rsa==4.9
+    # via google-auth
+safetensors==0.4.5
+    # via
+    #   accelerate
+    #   peft
+    #   transformers
+scikit-learn==1.5.2
+    # via
+    #   mteb
+    #   sentence-transformers
+scipy==1.14.1
+    # via
+    #   mteb
+    #   scikit-learn
+    #   sentence-transformers
+seaborn==0.13.2
+    # via vidore-benchmark
+sentence-transformers==3.1.1
+    # via
+    #   mteb
+    #   vidore-benchmark
+sentencepiece==0.2.0
+    # via vidore-benchmark
+setuptools==75.1.0
+    # via
+    #   visual-retrieval-colpali (pyproject.toml)
+    #   marisa-trie
+    #   spacy
+    #   thinc
+shad4fast==1.2.1
+    # via visual-retrieval-colpali (pyproject.toml)
+shellingham==1.5.4
+    # via typer
+six==1.16.0
+    # via python-dateutil
+smart-open==7.0.5
+    # via weasel
+sniffio==1.3.1
+    # via
+    #   anyio
+    #   httpx
+soupsieve==2.6
+    # via beautifulsoup4
+spacy==3.7.5
+    # via visual-retrieval-colpali (pyproject.toml)
+spacy-legacy==3.0.12
+    # via spacy
+spacy-loggers==1.0.5
+    # via spacy
+sqlite-minutils==3.37.0.post3
+    # via fastlite
+srsly==2.4.8
+    # via
+    #   confection
+    #   spacy
+    #   thinc
+    #   weasel
+starlette==0.39.2
+    # via python-fasthtml
+sympy==1.13.3
+    # via torch
+tenacity==9.0.0
+    # via pyvespa
+thinc==8.2.5
+    # via spacy
+threadpoolctl==3.5.0
+    # via scikit-learn
+tokenizers==0.20.0
+    # via transformers
+torch==2.4.1
+    # via
+    #   visual-retrieval-colpali (pyproject.toml)
+    #   accelerate
+    #   colpali-engine
+    #   mteb
+    #   peft
+    #   sentence-transformers
+    #   vidore-benchmark
+tqdm==4.66.5
+    # via
+    #   datasets
+    #   google-generativeai
+    #   huggingface-hub
+    #   mteb
+    #   peft
+    #   sentence-transformers
+    #   spacy
+    #   transformers
+transformers==4.45.1
+    # via
+    #   colpali-engine
+    #   peft
+    #   sentence-transformers
+    #   vidore-benchmark
+typer==0.12.5
+    # via
+    #   spacy
+    #   vidore-benchmark
+    #   weasel
+typing-extensions==4.12.2
+    # via
+    #   anyio
+    #   cloudpathlib
+    #   google-generativeai
+    #   huggingface-hub
+    #   mteb
+    #   multidict
+    #   pydantic
+    #   pydantic-core
+    #   pypdf
+    #   pyvespa
+    #   rich
+    #   torch
+    #   typer
+    #   uvicorn
+tzdata==2024.2
+    # via pandas
+uritemplate==4.1.1
+    # via google-api-python-client
+urllib3==2.2.3
+    # via
+    #   docker
+    #   requests
+uvicorn==0.31.0
+    # via python-fasthtml
+uvloop==0.20.0
+    # via uvicorn
+vespacli==8.391.23
+    # via visual-retrieval-colpali (pyproject.toml)
+vidore-benchmark==4.0.0
+    # via visual-retrieval-colpali (pyproject.toml)
+wasabi==1.1.3
+    # via
+    #   spacy
+    #   thinc
+    #   weasel
+watchfiles==0.24.0
+    # via uvicorn
+weasel==0.4.1
+    # via spacy
+websockets==13.1
+    # via uvicorn
+wrapt==1.16.0
+    # via smart-open
+xxhash==3.5.0
+    # via datasets
+yarl==1.13.1
+    # via aiohttp

src/static/js/highlightjs-theme.js

@@ -0,0 +1,23 @@
+(function () {
+    function getPreferredTheme() {
+        if (localStorage.theme === 'dark' || (!('theme' in localStorage) && window.matchMedia('(prefers-color-scheme: dark)').matches)) {
+            return 'dark';
+        }
+        return 'light';
+    }
+
+    function syncHighlightTheme() {
+        const link = document.getElementById('highlight-theme');
+        const preferredTheme = getPreferredTheme();
+        link.href = preferredTheme === 'dark' ?
+            'https://cdnjs.cloudflare.com/ajax/libs/highlight.js/11.4.0/styles/github-dark.min.css' :
+            'https://cdnjs.cloudflare.com/ajax/libs/highlight.js/11.4.0/styles/github.min.css';
+    }
+
+    // Apply the correct theme immediately
+    syncHighlightTheme();
+
+    // Observe changes in the 'dark' class on the <html> element
+    const observer = new MutationObserver(syncHighlightTheme);
+    observer.observe(document.documentElement, {attributes: true, attributeFilter: ['class']});
+})();

src/tailwind.config.js

@@ -0,0 +1,243 @@
+function filterDefault(values) {
+    return Object.fromEntries(
+        Object.entries(values).filter(([key]) => key !== "DEFAULT"),
+    );
+}
+
+/** @type {import('tailwindcss').Config} */
+export default {
+    darkMode: ["selector"],
+    content: [
+        "./**/*.py",
+        "./.venv/lib/python3.12/site-packages/shad4fast/**/*.{py,js}",
+    ],
+    theme: {
+        container: {
+            center: true,
+            padding: "2rem",
+            screens: {
+                "2xl": "1400px",
+            },
+        },
+        extend: {
+            animation: {
+                "accordion-down": "accordion-down 0.2s ease-out",
+                "accordion-up": "accordion-up 0.2s ease-out",
+            },
+            animationDelay: ({theme}) => ({
+                ...theme("transitionDelay"),
+            }),
+            animationDuration: ({theme}) => ({
+                0: "0ms",
+                ...theme("transitionDuration"),
+            }),
+            animationTimingFunction: ({theme}) => ({
+                ...theme("transitionTimingFunction"),
+            }),
+            animationFillMode: {
+                none: "none",
+                forwards: "forwards",
+                backwards: "backwards",
+                both: "both",
+            },
+            animationDirection: {
+                normal: "normal",
+                reverse: "reverse",
+                alternate: "alternate",
+                "alternate-reverse": "alternate-reverse",
+            },
+            animationOpacity: ({theme}) => ({
+                DEFAULT: 0,
+                ...theme("opacity"),
+            }),
+            animationTranslate: ({theme}) => ({
+                DEFAULT: "100%",
+                ...theme("translate"),
+            }),
+            animationScale: ({theme}) => ({
+                DEFAULT: 0,
+                ...theme("scale"),
+            }),
+            animationRotate: ({theme}) => ({
+                DEFAULT: "30deg",
+                ...theme("rotate"),
+            }),
+            animationRepeat: {
+                0: "0",
+                1: "1",
+                infinite: "infinite",
+            },
+            keyframes: {
+                enter: {
+                    from: {
+                        opacity: "var(--tw-enter-opacity, 1)",
+                        transform:
+                            "translate3d(var(--tw-enter-translate-x, 0), var(--tw-enter-translate-y, 0), 0) scale3d(var(--tw-enter-scale, 1), var(--tw-enter-scale, 1), var(--tw-enter-scale, 1)) rotate(var(--tw-enter-rotate, 0))",
+                    },
+                },
+                exit: {
+                    to: {
+                        opacity: "var(--tw-exit-opacity, 1)",
+                        transform:
+                            "translate3d(var(--tw-exit-translate-x, 0), var(--tw-exit-translate-y, 0), 0) scale3d(var(--tw-exit-scale, 1), var(--tw-exit-scale, 1), var(--tw-exit-scale, 1)) rotate(var(--tw-exit-rotate, 0))",
+                    },
+                },
+            },
+            colors: {
+                border: "hsl(var(--border))",
+                input: "hsl(var(--input))",
+                ring: "hsl(var(--ring))",
+                background: "hsl(var(--background))",
+                foreground: "hsl(var(--foreground))",
+                primary: {
+                    DEFAULT: "hsl(var(--primary))",
+                    foreground: "hsl(var(--primary-foreground))",
+                },
+                secondary: {
+                    DEFAULT: "hsl(var(--secondary))",
+                    foreground: "hsl(var(--secondary-foreground))",
+                },
+                destructive: {
+                    DEFAULT: "hsl(var(--destructive))",
+                    foreground: "hsl(var(--destructive-foreground))",
+                },
+                muted: {
+                    DEFAULT: "hsl(var(--muted))",
+                    foreground: "hsl(var(--muted-foreground))",
+                },
+                accent: {
+                    DEFAULT: "hsl(var(--accent))",
+                    foreground: "hsl(var(--accent-foreground))",
+                },
+                popover: {
+                    DEFAULT: "hsl(var(--popover))",
+                    foreground: "hsl(var(--popover-foreground))",
+                },
+                card: {
+                    DEFAULT: "hsl(var(--card))",
+                    foreground: "hsl(var(--card-foreground))",
+                },
+            },
+            borderRadius: {
+                lg: `var(--radius)`,
+                md: `calc(var(--radius) - 2px)`,
+                sm: "calc(var(--radius) - 4px)",
+            },
+        },
+    },
+    plugins: [
+        function ({addUtilities, matchUtilities, theme}) {
+            addUtilities({
+                "@keyframes enter": theme("keyframes.enter"),
+                "@keyframes exit": theme("keyframes.exit"),
+                ".animate-in": {
+                    animationName: "enter",
+                    animationDuration: theme("animationDuration.DEFAULT"),
+                    "--tw-enter-opacity": "initial",
+                    "--tw-enter-scale": "initial",
+                    "--tw-enter-rotate": "initial",
+                    "--tw-enter-translate-x": "initial",
+                    "--tw-enter-translate-y": "initial",
+                },
+                ".animate-out": {
+                    animationName: "exit",
+                    animationDuration: theme("animationDuration.DEFAULT"),
+                    "--tw-exit-opacity": "initial",
+                    "--tw-exit-scale": "initial",
+                    "--tw-exit-rotate": "initial",
+                    "--tw-exit-translate-x": "initial",
+                    "--tw-exit-translate-y": "initial",
+                },
+            });
+
+            matchUtilities(
+                {
+                    "fade-in": (value) => ({"--tw-enter-opacity": value}),
+                    "fade-out": (value) => ({"--tw-exit-opacity": value}),
+                },
+                {values: theme("animationOpacity")},
+            );
+
+            matchUtilities(
+                {
+                    "zoom-in": (value) => ({"--tw-enter-scale": value}),
+                    "zoom-out": (value) => ({"--tw-exit-scale": value}),
+                },
+                {values: theme("animationScale")},
+            );
+
+            matchUtilities(
+                {
+                    "spin-in": (value) => ({"--tw-enter-rotate": value}),
+                    "spin-out": (value) => ({"--tw-exit-rotate": value}),
+                },
+                {values: theme("animationRotate")},
+            );
+
+            matchUtilities(
+                {
+                    "slide-in-from-top": (value) => ({
+                        "--tw-enter-translate-y": `-${value}`,
+                    }),
+                    "slide-in-from-bottom": (value) => ({
+                        "--tw-enter-translate-y": value,
+                    }),
+                    "slide-in-from-left": (value) => ({
+                        "--tw-enter-translate-x": `-${value}`,
+                    }),
+                    "slide-in-from-right": (value) => ({
+                        "--tw-enter-translate-x": value,
+                    }),
+                    "slide-out-to-top": (value) => ({
+                        "--tw-exit-translate-y": `-${value}`,
+                    }),
+                    "slide-out-to-bottom": (value) => ({
+                        "--tw-exit-translate-y": value,
+                    }),
+                    "slide-out-to-left": (value) => ({
+                        "--tw-exit-translate-x": `-${value}`,
+                    }),
+                    "slide-out-to-right": (value) => ({
+                        "--tw-exit-translate-x": value,
+                    }),
+                },
+                {values: theme("animationTranslate")},
+            );
+
+            matchUtilities(
+                {duration: (value) => ({animationDuration: value})},
+                {values: filterDefault(theme("animationDuration"))},
+            );
+
+            matchUtilities(
+                {delay: (value) => ({animationDelay: value})},
+                {values: theme("animationDelay")},
+            );
+
+            matchUtilities(
+                {ease: (value) => ({animationTimingFunction: value})},
+                {values: filterDefault(theme("animationTimingFunction"))},
+            );
+
+            addUtilities({
+                ".running": {animationPlayState: "running"},
+                ".paused": {animationPlayState: "paused"},
+            });
+
+            matchUtilities(
+                {"fill-mode": (value) => ({animationFillMode: value})},
+                {values: theme("animationFillMode")},
+            );
+
+            matchUtilities(
+                {direction: (value) => ({animationDirection: value})},
+                {values: theme("animationDirection")},
+            );
+
+            matchUtilities(
+                {repeat: (value) => ({animationIterationCount: value})},
+                {values: theme("animationRepeat")},
+            );
+        },
+    ],
+};

src/tailwindcss

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:327703a4646081906e11d116ff4e8e43076466c3d269282bbe612555b9fe0c58
+size 47351504

uv.lock

@@ -1,10 +1,10 @@
 version = 1
-requires-python = ">=3.10"
+requires-python = ">=3.10, <3.13"
 resolution-markers = [
     "python_full_version < '3.11'",
     "python_full_version == '3.11.*'",
-    "python_full_version == '3.12.*'",
-    "python_full_version >= '3.13'",
+    "python_full_version >= '3.12'",
+    "python_full_version < '0'",
 ]
 
 [[package]]
@@ -3693,7 +3693,7 @@ dependencies = [
     { name = "nvidia-nvtx-cu12", marker = "platform_machine == 'x86_64' and platform_system == 'Linux'" },
     { name = "setuptools", marker = "python_full_version >= '3.12'" },
     { name = "sympy" },
-    { name = "triton", marker = "python_full_version < '3.13' and platform_machine == 'x86_64' and platform_system == 'Linux'" },
+    { name = "triton", marker = "platform_machine == 'x86_64' and platform_system == 'Linux'" },
     { name = "typing-extensions" },
 ]
 wheels = [
@@ -3777,7 +3777,7 @@ name = "triton"
 version = "3.1.0"
 source = { registry = "https://pypi.org/simple" }
 dependencies = [
-    { name = "filelock", marker = "python_full_version < '3.13'" },
+    { name = "filelock" },
 ]
 wheels = [
     { url = "https://files.pythonhosted.org/packages/98/29/69aa56dc0b2eb2602b553881e34243475ea2afd9699be042316842788ff5/triton-3.1.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl", hash = "sha256:6b0dd10a925263abbe9fa37dcde67a5e9b2383fc269fdf59f5657cac38c5d1d8", size = 209460013 },