multimodal-translation 1.0.1
AI based translation from one language to many 
Requires Python: <4.0,>=3.9
Keywords: Multimodal Translator, AI Translation

| |build| |release_version| |wheel| 
| |docs| |pylint| |supported_versions|
| |ruff| |gh-lic| |commits_since_specific_tag_on_main|
| |coverage_badge| |codacy|

|logo|

|translator_gif|
|translator_gif_2|


What is multimodal translation?
-------------------------------

| Multimodal translation is an advanced form of communication and translation that integrates and interprets information
  from various sources, such as text, images, audio, and video, to convey a message accurately.

  Simply put, it's translating content across various types of media.

Why is multimodality important?
-------------------------------

|  When translating information that is in different formats and media types, it's hard to effectively grasp the context,
|  and truly understand the meaning behind them. 

|  That's where multimodal translation comes in handy. It helps in understanding the context correctly and translate them accurately
|  by using multiple modals like text, audio, video, etc... This technology is very important in systems where context awareness is required.

Types of multimodal translation:
--------------------------------

- **Text-to-text:** This is the simplest form where you can translate text from one language to another language.
- **Audio-to-text:** Here the audio is transcribed and then translated also into several languages.
- **Audio-to-audio:** May be implemented in the future. It's the same concept as audio to text but the output remains in audio format.
- **Video-to-text:** May be implemented in the future. Also similar to the audio to text.
- **Live-video-to-text:** May be implemented in the future.
- **video-to-video:** May be implemented in the future.

All the above work from one language to many languages. For example you could translate one video (english) to several videos (italian, french, and dutch).

Technology used:
----------------

- **Speech recognition:** Important to recognize spoken language for interpretation and translation. Output can then be in text or audio format.


Limitations:
------------

- **language support:** Hard to support all languages, since every language has its own modal that has to be trained and installed into the application.
- **Maintaining context:** The context may change across different media. So it's a must to ensure the context remains correct.


Improvements:
-------------

* As mentioned above, audio to audio will be implemented in the future. Other media types can also be implemented like videos and images.

References:
-----------

* `The Era of Multimodal Translation <https://www.kantanai.io/localization-now-the-era-of-multimodal-translation/>`_
* `What is Multimodal Translation <https://www.educative.io/answers/what-is-multimodal-translation>`_

Quickstart
==========
`Usage <https://github.com/Issamricin/multimodal-translation/blob/main/docs/source/contents/usage.rst>`_

Developer Guide
===============
`Development <https://github.com/Issamricin/multimodal-translation/blob/main/docs/source/contents/developer_guide.rst>`_

Technical Debt
==============
`Technical Debt <https://github.com/Issamricin/multimodal-translation/blob/main/TECHNICALDEBT.rst>`_

Change Log
==========
`Change Log <https://github.com/Issamricin/multimodal-translation/blob/main/CHANGELOG.rst>`_.

License
=======
`GNU Affero General Public License v3.0`_



.. LINKS

.. _GNU Affero General Public License v3.0: https://github.com/Issamricin/multimodal-translation/blob/main/LICENSE

 

.. |build| image:: https://github.com/Issamricin/multimodal-translation/actions/workflows/ci_cd.yaml/badge.svg
    :alt: GitHub Workflow Status (branch)
    :target: https://github.com/Issamricin/multimodal-translation/actions/


.. Documentation

.. |docs| image:: https://img.shields.io/readthedocs/multimodal-translation/latest?logo=readthedocs&logoColor=lightblue
    :alt: Read the Docs (version)
    :target: https://dmc-view.readthedocs.io/en/latest/

.. |pylint| image:: https://img.shields.io/badge/linting-pylint-yellowgreen
    :target: https://github.com/pylint-dev/pylint

.. PyPI

.. |release_version| image:: https://img.shields.io/pypi/v/multimodal-translation
    :alt: Production Version
    :target: https://pypi.org/project/multimodal-translation

.. |wheel| image:: https://img.shields.io/pypi/wheel/multimodal-translation?color=green&label=wheel
    :alt: PyPI - Wheel
    :target: https://pypi.org/project/multimodal-translation

.. |supported_versions| image:: https://img.shields.io/pypi/pyversions/multimodal-translation?color=blue&label=python&logo=python&logoColor=%23ccccff
    :alt: Supported Python versions
    :target: https://pypi.org/project/multimodal-translation

.. Github Releases & Tags

.. |commits_since_specific_tag_on_main| image:: https://img.shields.io/github/commits-since/Issamricin/multimodal-translation/release-1.0.0/main?color=blue&logo=github
    :alt: GitHub commits since tagged version (branch)
    :target: https://github.com/Issamricin/multimodal-translation/compare/release-1.0.0..main

.. LICENSE (eg AGPL, MIT)
.. Github License

.. |gh-lic| image:: https://img.shields.io/badge/license-GNU_Affero-orange
    :alt: GitHub
    :target: https://github.com/Issamricin/multimodal-translation/blob/main/LICENSE


.. Ruff linter for Fast Python Linting

.. |ruff| image:: https://img.shields.io/badge/codestyle-ruff-000000.svg
    :alt: Ruff
    :target: https://docs.astral.sh/ruff/

.. |codacy| image:: https://app.codacy.com/project/badge/Grade/04edc13d49214d2f9a27cf6a91c0185b
    :alt: codacy
    :target: https://app.codacy.com/gh/Issamricin/multimodal-translation/dashboard?utm_source=gh&utm_medium=referral&utm_content=&utm_campaign=Badge_grade


.. |logo| image:: https://raw.githubusercontent.com/Issamricin/multimodal-translation/main/media/muiltimodal-translation-small.jpg
                :alt: multimodal translator

.. |translator_gif| image:: https://raw.githubusercontent.com/Issamricin/multimodal-translation/main/media/translator.gif
   :alt: Demo Preview
   :width: 800
   :height: 300

.. |translator_gif_2| image:: https://raw.githubusercontent.com/Issamricin/multimodal-translation/main/media/translator_audio.gif
   :alt: Demo Preview
   :width: 800
   :height: 280

.. |coverage_badge| image:: https://coveralls.io/repos/github/Issamricin/multimodal-translation/badge.svg?branch=main
   :target: https://coveralls.io/github/Issamricin/multimodal-translation?branch=main
   :alt: Coverage Status