| --- |
| title: Htrflow Mcp |
| emoji: 🔥 |
| colorFrom: green |
| colorTo: gray |
| sdk: gradio |
| sdk_version: 5.33.0 |
| app_file: app.py |
| tags: |
| - mcp-server-track |
| - htrflow |
| - htr |
| - ocr |
| - api |
| pinned: false |
| license: apache-2.0 |
| short_description: Image to text, alto- or page-xml |
| --- |
| |
| Video showcase: |
|
|
| <video controls autoplay src="https://cdn-uploads.huggingface.co/production/uploads/60a4e677917119d38f6bbff8/tMp-t2pV3t3HABW0YLbMy.mp4"></video> |
|
|
|
|
| ## MCP tooling |
|
|
| - htr_text: Extract plain text from handwritten documents |
| |
| Parameters: image_path (string), document_type (string, default: "letter_swedish"), custom_settings (optional JSON string) |
| Returns: Extracted text as string |
| |
| |
| - htrflow_file: Process HTR and return formatted files |
|
|
| Parameters: image_path (string), document_type (string), output_format (string, default: "alto"), custom_settings (optional JSON), server_name (string) |
| Returns: Downloadable file in specified format |
| Supported formats: txt, alto, page, json |
| |
| |
| - htrflow_visualizer: Visualize HTR results on original image |
|
|
| Parameters: image_path (string), htr_document_path (string), server_name (string) |
| Returns: Visualization image with text regions highlighted |
|
|
|
|
|  |
|
|
| Claude Desktop |
|
|
| ```json |
| { |
| "mcpServers": { |
| "htrflow": { |
| "command": "npx", |
| "args": [ |
| "mcp-remote", |
| "https://[YOUR-USERNAME].hf.space/gradio_api/mcp/sse", |
| "--transport", |
| "sse-only" |
| ] |
| } |
| } |
| } |
| ``` |
|
|
| ## Usage Examples |
| - Can you extract the text from this handwritten Swedish letter? [upload image] |
| - Process this handwritten document and return the results in ALTO XML format for archival purposes. |
| - Show me the HTR results overlaid on the original image so I can see how accurate the text detection was. |
|
|
|
|
| ### Standard Letter Processing |
| Segmentation: Detect text lines using YOLO |
| Text Recognition: Extract text using TrOCR |
| Line Ordering: Organize text in reading order |
|
|
| ### Spread Processing |
| Region Segmentation: Detect page regions |
| Line Segmentation: Detect text lines within regions |
| Text Recognition: Extract text using TrOCR |
| Reading Order: Handle marginalia and two-page layout |
|
|
| Custom Settings |
| You can provide custom pipeline settings as JSON: |
|
|
| ```json |
| { |
| "steps": [ |
| { |
| "step": "Segmentation", |
| "settings": { |
| "model": "yolo", |
| "model_settings": { |
| "model": "Riksarkivet/yolov9-lines-within-regions-1" |
| }, |
| "generation_settings": {"batch_size": 8} |
| } |
| }, |
| { |
| "step": "TextRecognition", |
| "settings": { |
| "model": "TrOCR", |
| "model_settings": { |
| "model": "microsoft/trocr-base-handwritten" |
| }, |
| "generation_settings": {"batch_size": 16} |
| } |
| } |
| ] |
| } |
| ``` |
|
|
| Not enough time but would also integrate the iiif part aswell: |
| https://github.com/AI-Riksarkivet/oxenstierna |
| https://huggingface.co/collections/Riksarkivet/mcps-68447208f9eddd623a83fbc9 |
|
|
