[refactor] first working stage for huggingface docker container with fastapi and loguru

.idea/misc.xml

@@ -3,5 +3,5 @@
   <component name="Black">
     <option name="sdkName" value="Python 3.11 (samgis)" />
   </component>
-  <component name="ProjectRootManager" version="2" project-jdk-name="Pipenv (samgis)" project-jdk-type="Python SDK" />
+  <component name="ProjectRootManager" version="2" project-jdk-name="Poetry (samgis)" project-jdk-type="Python SDK" />
 </project>

Dockerfile

@@ -0,0 +1,38 @@
+FROM localhost/samgis-base-fastapi:latest
+
+# Include global arg in this stage of the build
+ARG LAMBDA_TASK_ROOT="/var/task"
+ARG PYTHONPATH="${LAMBDA_TASK_ROOT}:${PYTHONPATH}:/usr/local/lib/python3/dist-packages"
+ENV VIRTUAL_ENV=${LAMBDA_TASK_ROOT}/.venv \
+    PATH="${LAMBDA_TASK_ROOT}/.venv/bin:$PATH"
+
+# Set working directory to function root directory
+WORKDIR ${LAMBDA_TASK_ROOT}
+COPY ./samgis ${LAMBDA_TASK_ROOT}/samgis
+COPY ./src ${LAMBDA_TASK_ROOT}/src
+COPY ./static ${LAMBDA_TASK_ROOT}/static
+COPY ./machine_learning_models ${LAMBDA_TASK_ROOT}/machine_learning_models
+
+RUN ls -l /usr/bin/which
+RUN /usr/bin/which python
+RUN python -v
+RUN echo "PYTHONPATH: ${PYTHONPATH}."
+RUN echo "PATH: ${PATH}."
+RUN echo "LAMBDA_TASK_ROOT: ${LAMBDA_TASK_ROOT}."
+RUN ls -l ${LAMBDA_TASK_ROOT}
+RUN ls -ld ${LAMBDA_TASK_ROOT}
+RUN ls -l ${LAMBDA_TASK_ROOT}/machine_learning_models
+RUN python -c "import sys; print(sys.path)"
+RUN python -c "import cv2"
+RUN python -c "import fastapi"
+RUN python -c "import geopandas"
+RUN python -c "import loguru"
+RUN python -c "import onnxruntime"
+RUN python -c "import rasterio"
+RUN python -c "import uvicorn"
+RUN df -h
+RUN ls -l ${LAMBDA_TASK_ROOT}/samgis/
+RUN ls -l ${LAMBDA_TASK_ROOT}/src/
+RUN ls -l ${LAMBDA_TASK_ROOT}/static/
+
+CMD ["uvicorn", "src.fastapi_wrapper:app", "--host", "0.0.0.0", "--port", "7860"]

README.md

@@ -1,36 +1,64 @@
-# SamGIS
+---
+title: SamGIS
+emoji: 📉
+colorFrom: red
+colorTo: blue
+sdk: docker
+pinned: false
+---
 
-## todo
+## SamGIS - HuggingFace version
 
-1. export output to mask: OK local, OK aws lambda
-2. resolve model paths: OK local
-3. inference: 
-4. from mask to json (rasterio + geopandas, check for re-projection to EPSG_4326)
-5. check mandatory dependencies
-6. check for alternative python interpreters
+Build the docker image this way:
 
-## Build instructions
+```bash
+# clean any old active containers
+docker stop $(docker ps -a -q); docker rm $(docker ps -a -q)
+
+# build the base docker image with the ARG DEPENDENCY_GROUP=fastapi used by poetry
+docker build . -f dockerfiles/dockerfile-samgis-base --build-arg DEPENDENCY_GROUP=fastapi --tag localhost/samgis-base-fastapi --progress=plain
 
-Build the docker image:
+# build the image, use the tag "samgis-huggingface"
+docker build . --tag samgis-huggingface --progress=plain
+```
+
+Run the container (keep it on background) and show logs
+
+```bash
+docker run  -d --name samgis-huggingface -p 7860:7860 samgis-huggingface; docker logs -f samgis-huggingface
+```
+
+Test it with curl:
+
+```bash
+curl -X 'POST' \
+  'http://localhost:7860/infer_samgeo' \
+  -H 'accept: application/json' \
+  -d '{}'
+```
+
+or better visiting the swagger page on http://localhost:7860/docs 
+
+
+## SamGIS - lambda AWS version
+
+Build the docker image this way:
 
 ```bash
 # clean any old active containers
 docker stop $(docker ps -a -q); docker rm $(docker ps -a -q)
 
 # build the base docker image with the docker aws repository tag
-docker build . -f dockerfiles/dockerfile-lambda-gdal-runner --tag 686901913580.dkr.ecr.eu-west-1.amazonaws.com/lambda-gdal-runner
-
-# OPTIONAL: to build the lambda-gdal-runner image on a x86 machine use the build arg `RIE="https://github.com/aws/aws-lambda-runtime-interface-emulator/releases/latest/download/aws-lambda-rie"`:
-docker build . -f dockerfiles/dockerfile-lambda-gdal-runner --build-arg RIE="https://github.com/aws/aws-lambda-runtime-interface-emulator/releases/latest/download/aws-lambda-rie" --tag 686901913580.dkr.ecr.eu-west-1.amazonaws.com/lambda-gdal-runner --progress=plain
+docker build . -f dockerfiles/dockerfile-samgis-base --build-arg DEPENDENCY_GROUP=aws_lambda --tag localhost/samgis-base-aws-lambda --progress=plain
 
 # build the final docker image
-docker build . -f dockerfiles/dockerfile-lambda-fastsam-api --tag 686901913580.dkr.ecr.eu-west-1.amazonaws.com/lambda-fastsam-api
+docker build . -f dockerfiles/dockerfile-lambda-fastsam-api --tag localhost/lambda-fastsam-api --progress=plain
 ```
 
 Run the container (keep it on background) and show logs
 
 ```bash
-docker tag 686901913580.dkr.ecr.eu-west-1.amazonaws.com/lambda-fastsam-api:latest lambda-fastsam-api;docker run  -d --name lambda-fastsam-api -p 8080:8080 lambda-fastsam-api; docker logs -f lambda-fastsam-api
+docker tag localhost/lambda-fastsam-api:latest localhost/lambda-fastsam-api;docker run  -d --name lambda-fastsam-api -p 8080:8080 lambda-fastsam-api; docker logs -f lambda-fastsam-api
 ```
 
 Test it with curl:
@@ -43,25 +71,15 @@ curl -X 'POST' \
   -d '{}'
 ```
 
-## Publish the aws lambda
-1. Login on aws ECR with the correct aws profile (details on [ECR page](https://eu-west-1.console.aws.amazon.com/ecr/repositories/private/686901913580/surferdtm-prediction-api?region=eu-west-1))
-    ```
-    aws --profile alessandrotrinca_hotmail_aws_console_ec2_lambda ecr get-login-password --region eu-west-1 | docker login --username AWS --password-stdin 686901913580.dkr.ecr.eu-west-1.amazonaws.com
-    ```
-2. Build and tag the docker images, then push them:
-    ```
-    docker push 686901913580.dkr.ecr.eu-west-1.amazonaws.com/lambda-gdal-runner:latest
-    docker push 686901913580.dkr.ecr.eu-west-1.amazonaws.com/lambda-fastsam-api:latest
-    ```
-3. It's possible to publish a new aws lambda version from cmd or from lambda page
-
-
-## Dependencies installation and local tests
-The docker build process needs only the classic requirements.txt (here renamed to `requirements_dockerfile.txt`), instead for local development and sphinx-docs build 
-there is `Pipfile` (sphinx docs is hosted on Cloudflare Pages).
+### Publish the aws lambda docker image
+Login on aws ECR with the correct aws profile (change the example `localhost/` repository url with the one from
+the [ECR push command instructions page](https://eu-west-1.console.aws.amazon.com/ecr/repositories/)).
 
+### Dependencies installation and local tests
+The docker build process needs only the base dependency group plus the `aws_lambda` or `fastapi` optional one.
+Install also the `test` and/or `docs` groups if needed.
 
-## Tests
+### Tests
 
 Tests are defined in the `tests` folder in this project. Use PIP to install the test dependencies and run tests.
 
@@ -69,7 +87,7 @@ Tests are defined in the `tests` folder in this project. Use PIP to install the
 python -m pytest --cov=samgis --cov-report=term-missing && coverage html
 ```
 
-## Update the static documentation with sphinx
+### How to update the static documentation with sphinx
 
 Run the sphinx-apidoc: it's a tool for automatic generation of Sphinx sources that, using the autodoc
 extension, document a whole package in the style of other automatic API documentation tools. See the 
@@ -78,7 +96,7 @@ Run the command from the project root:
 
 ```bash
 # missing docs folder (run from project root)
-cd docs && sphinx-quickstart -p SamGIS -a "alessandro trinca tornidor" -r 1.0.0 -l python --master index
+cd docs && sphinx-quickstart -p SamGIS -r 1.0.0 -l python --master index
 
 # update docs folder (from project root)
 sphinx-apidoc -f -o docs samgis

dockerfiles/dockerfile-fastapi-fastsam-api

@@ -0,0 +1 @@
+Dockerfile

dockerfiles/dockerfile-lambda-fastsam-api

@@ -1,4 +1,4 @@
-FROM 686901913580.dkr.ecr.eu-west-1.amazonaws.com/lambda-gdal-runner:latest
+FROM localhost/samgis-base-aws-lambda:latest
 
 # Include global arg in this stage of the build
 ARG LAMBDA_TASK_ROOT="/var/task"
@@ -22,15 +22,15 @@ RUN ls -l ${LAMBDA_TASK_ROOT}
 RUN ls -ld ${LAMBDA_TASK_ROOT}
 RUN ls -l ${LAMBDA_TASK_ROOT}/machine_learning_models
 RUN python -c "import sys; print(sys.path)"
+RUN python -c "import awslambdaric"
+RUN python -c "import cv2"
 RUN python -c "import geopandas"
 RUN python -c "import onnxruntime"
 RUN python -c "import rasterio"
-RUN python -c "import awslambdaric"
-RUN python -c "import cv2"
 RUN df -h
 RUN ls -l /lambda-entrypoint.sh
 RUN ls -l ${LAMBDA_TASK_ROOT}/samgis/
 RUN ls -l ${LAMBDA_TASK_ROOT}/src/
 
-# ENTRYPOINT  ["/lambda-entrypoint.sh"]
+ENTRYPOINT  ["/lambda-entrypoint.sh"]
 CMD [ "src.lambda_wrapper.lambda_handler" ]

dockerfiles/{dockerfile-lambda-gdal-runner → dockerfile-samgis-base}

@@ -19,12 +19,15 @@ ARG POETRY_VIRTUALENVS_IN_PROJECT
 ARG POETRY_VIRTUALENVS_CREATE
 ARG POETRY_CACHE_DIR
 ARG RIE
+ARG DEPENDENCY_GROUP
 
 RUN echo "ARCH: $ARCH ..."
 
 RUN echo "ARG RIE: $RIE ..."
 RUN echo "ARG POETRY_CACHE_DIR: ${POETRY_CACHE_DIR} ..."
 RUN echo "ARG PYTHONPATH: $PYTHONPATH ..."
+RUN test -n ${DEPENDENCY_GROUP:?}
+RUN echo "python DEPENDENCY_GROUP: ${DEPENDENCY_GROUP} ..."
 
 # Set working directory to function root directory
 WORKDIR ${LAMBDA_TASK_ROOT}
@@ -44,7 +47,7 @@ RUN python -m pip install -r ${LAMBDA_TASK_ROOT}/requirements_poetry.txt
 RUN which poetry && poetry --version && poetry config --list
 RUN poetry config virtualenvs.path ${LAMBDA_TASK_ROOT}
 RUN echo "# poetry config --list #" && poetry config --list
-RUN poetry install --with aws_lambda --no-root
+RUN poetry install --with ${DEPENDENCY_GROUP} --no-root
 
 RUN curl -Lo /usr/local/bin/aws-lambda-rie ${RIE}
 
@@ -62,7 +65,6 @@ ARG LAMBDA_TASK_ROOT
 ENV VIRTUAL_ENV=${LAMBDA_TASK_ROOT}/.venv \
     PATH="${LAMBDA_TASK_ROOT}/.venv/bin:$PATH"
 
-COPY --from=builder /usr/local/bin/aws-lambda-rie /usr/local/bin/aws-lambda-rie
 RUN echo "COPY --from=builder /usr/lib/${ARCH}-linux-gnu/libGL.so* /usr/lib/${ARCH}-linux-gnu/"
 COPY --from=builder /usr/lib/${ARCH}-linux-gnu/libGL.so* /usr/lib/${ARCH}-linux-gnu/
 COPY --from=builder ${LAMBDA_TASK_ROOT}/.venv ${LAMBDA_TASK_ROOT}/.venv
@@ -71,10 +73,9 @@ RUN echo "new LAMBDA_TASK_ROOT after hidden venv copy => ${LAMBDA_TASK_ROOT}"
 RUN ls -ld ${LAMBDA_TASK_ROOT}/
 RUN ls -lA ${LAMBDA_TASK_ROOT}/
 
+# only used by AWS lambda docker image
+COPY --from=builder /usr/local/bin/aws-lambda-rie /usr/local/bin/aws-lambda-rie
 RUN chmod +x /usr/local/bin/aws-lambda-rie
-
 COPY ./scripts/lambda-entrypoint.sh /lambda-entrypoint.sh
 RUN chmod +x /lambda-entrypoint.sh
 RUN ls -l /lambda-entrypoint.sh
-
-ENTRYPOINT  ["/lambda-entrypoint.sh"]

events/payload_point.json

@@ -9,6 +9,6 @@
     "label": 0
   }],
   "zoom": 6,
-  "source_type": "Satellite",
+  "source_type": "OpenStreetMap",
   "debug": true
 }

events/payload_point2.json

@@ -9,6 +9,6 @@
     "label": 0
   }],
   "zoom": 10,
-  "source_type": "Satellite",
+  "source_type": "OpenStreetMap",
   "debug": true
 }

events/payload_point_eolie.json

@@ -20,5 +20,5 @@
     }
   ],
   "zoom": 10,
-  "source_type": "Satellite"
+  "source_type": "OpenStreetMap"
 }

poetry.lock

@@ -37,6 +37,26 @@ files = [
     {file = "annotated_types-0.6.0.tar.gz", hash = "sha256:563339e807e53ffd9c267e99fc6d9ea23eb8443c08f112651963e24e22f84a5d"},
 ]
 
+[[package]]
+name = "anyio"
+version = "4.2.0"
+description = "High level compatibility layer for multiple asynchronous event loop implementations"
+optional = false
+python-versions = ">=3.8"
+files = [
+    {file = "anyio-4.2.0-py3-none-any.whl", hash = "sha256:745843b39e829e108e518c489b31dc757de7d2131d53fac32bd8df268227bfee"},
+    {file = "anyio-4.2.0.tar.gz", hash = "sha256:e1875bb4b4e2de1669f4bc7869b6d3f54231cdced71605e6e64c9be77e3be50f"},
+]
+
+[package.dependencies]
+idna = ">=2.8"
+sniffio = ">=1.1"
+
+[package.extras]
+doc = ["Sphinx (>=7)", "packaging", "sphinx-autodoc-typehints (>=1.2.0)", "sphinx-rtd-theme"]
+test = ["anyio[trio]", "coverage[toml] (>=7)", "exceptiongroup (>=1.2.0)", "hypothesis (>=4.0)", "psutil (>=5.9)", "pytest (>=7.0)", "pytest-mock (>=3.6.1)", "trustme", "uvloop (>=0.17)"]
+trio = ["trio (>=0.23)"]
+
 [[package]]
 name = "attrs"
 version = "23.1.0"
@@ -512,6 +532,25 @@ files = [
     {file = "docutils-0.20.1.tar.gz", hash = "sha256:f08a4e276c3a1583a86dce3e34aba3fe04d02bba2dd51ed16106244e8a923e3b"},
 ]
 
+[[package]]
+name = "fastapi"
+version = "0.108.0"
+description = "FastAPI framework, high performance, easy to learn, fast to code, ready for production"
+optional = false
+python-versions = ">=3.8"
+files = [
+    {file = "fastapi-0.108.0-py3-none-any.whl", hash = "sha256:8c7bc6d315da963ee4cdb605557827071a9a7f95aeb8fcdd3bde48cdc8764dd7"},
+    {file = "fastapi-0.108.0.tar.gz", hash = "sha256:5056e504ac6395bf68493d71fcfc5352fdbd5fda6f88c21f6420d80d81163296"},
+]
+
+[package.dependencies]
+pydantic = ">=1.7.4,<1.8 || >1.8,<1.8.1 || >1.8.1,<2.0.0 || >2.0.0,<2.0.1 || >2.0.1,<2.1.0 || >2.1.0,<3.0.0"
+starlette = ">=0.29.0,<0.33.0"
+typing-extensions = ">=4.8.0"
+
+[package.extras]
+all = ["email-validator (>=2.0.0)", "httpx (>=0.23.0)", "itsdangerous (>=1.1.0)", "jinja2 (>=2.11.2)", "orjson (>=3.2.1)", "pydantic-extra-types (>=2.0.0)", "pydantic-settings (>=2.0.0)", "python-multipart (>=0.0.5)", "pyyaml (>=5.3.1)", "ujson (>=4.0.1,!=4.0.2,!=4.1.0,!=4.2.0,!=4.3.0,!=5.0.0,!=5.1.0)", "uvicorn[standard] (>=0.12.0)"]
+
 [[package]]
 name = "fiona"
 version = "1.9.5"
@@ -688,6 +727,17 @@ dev-test = ["coverage", "pytest (>=3.10)", "pytest-asyncio (>=0.17)", "sphinx (<
 requests = ["requests (>=2.16.2)", "urllib3 (>=1.24.2)"]
 timezone = ["pytz"]
 
+[[package]]
+name = "h11"
+version = "0.14.0"
+description = "A pure-Python, bring-your-own-I/O implementation of HTTP/1.1"
+optional = false
+python-versions = ">=3.7"
+files = [
+    {file = "h11-0.14.0-py3-none-any.whl", hash = "sha256:e3fe4ac4b851c468cc8363d500db52c2ead036020723024a109d37346efaa761"},
+    {file = "h11-0.14.0.tar.gz", hash = "sha256:8f19fbbe99e72420ff35c00b27a34cb9937e902a8b810e2c88300c6f0a3b699d"},
+]
+
 [[package]]
 name = "humanfriendly"
 version = "10.0"
@@ -922,6 +972,24 @@ files = [
     {file = "kiwisolver-1.4.5.tar.gz", hash = "sha256:e57e563a57fb22a142da34f38acc2fc1a5c864bc29ca1517a88abc963e60d6ec"},
 ]
 
+[[package]]
+name = "loguru"
+version = "0.7.2"
+description = "Python logging made (stupidly) simple"
+optional = false
+python-versions = ">=3.5"
+files = [
+    {file = "loguru-0.7.2-py3-none-any.whl", hash = "sha256:003d71e3d3ed35f0f8984898359d65b79e5b21943f78af86aa5491210429b8eb"},
+    {file = "loguru-0.7.2.tar.gz", hash = "sha256:e671a53522515f34fd406340ee968cb9ecafbc4b36c679da03c18fd8d0bd51ac"},
+]
+
+[package.dependencies]
+colorama = {version = ">=0.3.4", markers = "sys_platform == \"win32\""}
+win32-setctime = {version = ">=1.0.0", markers = "sys_platform == \"win32\""}
+
+[package.extras]
+dev = ["Sphinx (==7.2.5)", "colorama (==0.4.5)", "colorama (==0.4.6)", "exceptiongroup (==1.1.3)", "freezegun (==1.1.0)", "freezegun (==1.2.2)", "mypy (==v0.910)", "mypy (==v0.971)", "mypy (==v1.4.1)", "mypy (==v1.5.1)", "pre-commit (==3.4.0)", "pytest (==6.1.2)", "pytest (==7.4.0)", "pytest-cov (==2.12.1)", "pytest-cov (==4.1.0)", "pytest-mypy-plugins (==1.9.3)", "pytest-mypy-plugins (==3.0.0)", "sphinx-autobuild (==2021.3.14)", "sphinx-rtd-theme (==1.3.0)", "tox (==3.27.1)", "tox (==4.11.0)"]
+
 [[package]]
 name = "markdown-it-py"
 version = "3.0.0"
@@ -2143,6 +2211,17 @@ files = [
     {file = "six-1.16.0.tar.gz", hash = "sha256:1e61c37477a1626458e36f7b1d82aa5c9b094fa4802892072e49de9c60c4c926"},
 ]
 
+[[package]]
+name = "sniffio"
+version = "1.3.0"
+description = "Sniff out which async library your code is running under"
+optional = false
+python-versions = ">=3.7"
+files = [
+    {file = "sniffio-1.3.0-py3-none-any.whl", hash = "sha256:eecefdce1e5bbfb7ad2eeaabf7c1eeb404d7757c379bd1f7e5cce9d8bf425384"},
+    {file = "sniffio-1.3.0.tar.gz", hash = "sha256:e60305c5e5d314f5389259b7f22aaa33d8f7dee49763119234af3755c55b9101"},
+]
+
 [[package]]
 name = "snowballstemmer"
 version = "2.2.0"
@@ -2380,6 +2459,23 @@ Sphinx = ">=5"
 lint = ["docutils-stubs", "flake8", "mypy"]
 test = ["pytest"]
 
+[[package]]
+name = "starlette"
+version = "0.32.0.post1"
+description = "The little ASGI library that shines."
+optional = false
+python-versions = ">=3.8"
+files = [
+    {file = "starlette-0.32.0.post1-py3-none-any.whl", hash = "sha256:cd0cb10ddb49313f609cedfac62c8c12e56c7314b66d89bb077ba228bada1b09"},
+    {file = "starlette-0.32.0.post1.tar.gz", hash = "sha256:e54e2b7e2fb06dff9eac40133583f10dfa05913f5a85bf26f427c7a40a9a3d02"},
+]
+
+[package.dependencies]
+anyio = ">=3.4.0,<5"
+
+[package.extras]
+full = ["httpx (>=0.22.0)", "itsdangerous", "jinja2", "python-multipart", "pyyaml"]
+
 [[package]]
 name = "sympy"
 version = "1.12"
@@ -2432,6 +2528,38 @@ brotli = ["brotli (>=1.0.9)", "brotlicffi (>=0.8.0)"]
 socks = ["pysocks (>=1.5.6,!=1.5.7,<2.0)"]
 zstd = ["zstandard (>=0.18.0)"]
 
+[[package]]
+name = "uvicorn"
+version = "0.25.0"
+description = "The lightning-fast ASGI server."
+optional = false
+python-versions = ">=3.8"
+files = [
+    {file = "uvicorn-0.25.0-py3-none-any.whl", hash = "sha256:ce107f5d9bd02b4636001a77a4e74aab5e1e2b146868ebbad565237145af444c"},
+    {file = "uvicorn-0.25.0.tar.gz", hash = "sha256:6dddbad1d7ee0f5140aba5ec138ddc9612c5109399903828b4874c9937f009c2"},
+]
+
+[package.dependencies]
+click = ">=7.0"
+h11 = ">=0.8"
+
+[package.extras]
+standard = ["colorama (>=0.4)", "httptools (>=0.5.0)", "python-dotenv (>=0.13)", "pyyaml (>=5.1)", "uvloop (>=0.14.0,!=0.15.0,!=0.15.1)", "watchfiles (>=0.13)", "websockets (>=10.4)"]
+
+[[package]]
+name = "win32-setctime"
+version = "1.1.0"
+description = "A small Python utility to set file creation time on Windows"
+optional = false
+python-versions = ">=3.5"
+files = [
+    {file = "win32_setctime-1.1.0-py3-none-any.whl", hash = "sha256:231db239e959c2fe7eb1d7dc129f11172354f98361c4fa2d6d2d7e278baa8aad"},
+    {file = "win32_setctime-1.1.0.tar.gz", hash = "sha256:15cf5750465118d6929ae4de4eb46e8edae9a5634350c01ba582df868e932cb2"},
+]
+
+[package.extras]
+dev = ["black (>=19.3b0)", "pytest (>=4.6.2)"]
+
 [[package]]
 name = "xyzservices"
 version = "2023.10.1"
@@ -2446,4 +2574,4 @@ files = [
 [metadata]
 lock-version = "2.0"
 python-versions = "^3.11"
-content-hash = "02681a973e50683328473fff27fa817d69380d075831de85da66fb238fe90866"
+content-hash = "61953101662fbd1d752c6beb1b60c5ee803794c4ecb9f2484bdc28c884cd077e"

pyproject.toml

@@ -18,6 +18,7 @@ python-dotenv = "^1.0.0"
 rasterio = "^1.3.9"
 requests = "^2.31.0"
 pillow = "^10.1.0"
+loguru = "^0.7.2"
 
 [tool.poetry.group.aws_lambda]
 optional = true
@@ -26,7 +27,7 @@ optional = true
 aws-lambda-powertools = "^2.30.2"
 awslambdaric = "^2.0.8"
 jmespath = "^1.0.1"
-pydantic = ">=2.0.3"
+pydantic = "^2.5.3"
 
 [tool.poetry.group.test]
 optional = true
@@ -45,6 +46,15 @@ sphinx-autodoc-typehints = "^1.25.2"
 sphinxcontrib-openapi = "^0.8.3"
 myst-parser = "^2.0.0"
 
+[tool.poetry.group.fastapi]
+optional = true
+
+[tool.poetry.group.fastapi.dependencies]
+fastapi = "^0.108.0"
+loguru = "^0.7.2"
+pydantic = "^2.5.3"
+uvicorn = "^0.25.0"
+
 [build-system]
 requires = ["poetry-core"]
 build-backend = "poetry.core.masonry.api"

samgis/__init__.py

@@ -1,5 +1,4 @@
 """Get machine learning predictions from geodata raster images"""
-from aws_lambda_powertools import Logger
 # not used here but contextily_tile is imported in samgis.io.tms2geotiff
 from contextily import tile as contextily_tile
 from pathlib import Path
@@ -9,4 +8,34 @@ from samgis.utilities.constants import SERVICE_NAME
 
 PROJECT_ROOT_FOLDER = Path(globals().get("__file__", "./_")).absolute().parent.parent
 MODEL_FOLDER = Path(PROJECT_ROOT_FOLDER / "machine_learning_models")
-app_logger = Logger(service=SERVICE_NAME)
+try:
+    from aws_lambda_powertools import Logger
+
+    app_logger = Logger(service=SERVICE_NAME)
+except ModuleNotFoundError:
+    import loguru
+
+    def setup_logging(debug: bool = False, formatter: str = "{time} - {level} - ({extra[request_id]}) {message} "
+                      ) -> loguru.logger:
+        """
+        Create a logging instance with log string formatter.
+
+        Args:
+            debug: logging debug argument
+            formatter: log string formatter
+
+        Returns:
+            Logger
+
+        """
+        import sys
+
+        logger = loguru.logger
+        logger.remove()
+        level_logger = "DEBUG" if debug else "INFO"
+        logger.add(sys.stdout, format=formatter, level=level_logger)
+        logger.info(f"type_logger:{type(logger)}, logger:{logger}.")
+        return logger
+
+
+    app_logger = setup_logging(debug=True)

samgis/io/lambda_helpers.py

@@ -1,12 +1,11 @@
 """lambda helper functions"""
 from typing import Dict
 from xyzservices import providers
-from aws_lambda_powertools.event_handler import content_types
 
 from samgis import app_logger
 from samgis.io.coordinates_pixel_conversion import get_latlng_to_pixel_coordinates
 from samgis.utilities.constants import CUSTOM_RESPONSE_MESSAGES
-from samgis.utilities.type_hints import ApiRequestBody
+from samgis.utilities.type_hints import ApiRequestBody, ContentTypes
 from samgis.utilities.utilities import base64_decode
 
 
@@ -34,7 +33,7 @@ def get_response(status: int, start_time: float, request_id: str, response_body:
 
     response = {
         "statusCode": status,
-        "header": {"Content-Type": content_types.APPLICATION_JSON},
+        "header": {"Content-Type": ContentTypes.APPLICATION_JSON},
         "body": dumps(response_body),
         "isBase64Encoded": False
     }

samgis/utilities/type_hints.py

@@ -31,6 +31,13 @@ class LatLngDict(BaseModel):
     lng: float
 
 
+class ContentTypes(str, Enum):
+    """Segment Anything: validation point prompt type"""
+    APPLICATION_JSON = "application/json"
+    TEXT_PLAIN = "text/plain"
+    TEXT_HTML = "text/html"
+
+
 class PromptPointType(str, Enum):
     """Segment Anything: validation point prompt type"""
     point = "point"

src/fastapi_wrapper.py

@@ -0,0 +1,122 @@
+import json
+import uuid
+
+from fastapi import FastAPI, HTTPException, Request, status
+from fastapi.exceptions import RequestValidationError
+from fastapi.responses import FileResponse, JSONResponse
+from fastapi.staticfiles import StaticFiles
+
+from samgis import app_logger
+from samgis.io.lambda_helpers import get_parsed_bbox_points
+from samgis.utilities.type_hints import ApiRequestBody
+
+app = FastAPI()
+
+
+@app.middleware("http")
+async def request_middleware(request, call_next):
+    request_id = str(uuid.uuid4())
+    with app_logger.contextualize(request_id=request_id):
+        app_logger.info("Request started")
+
+        try:
+            response = await call_next(request)
+
+        except Exception as ex:
+            app_logger.error(f"Request failed: {ex}")
+            response = JSONResponse(content={"success": False}, status_code=500)
+
+        finally:
+            response.headers["X-Request-ID"] = request_id
+            app_logger.info(f"Request ended")
+            return response
+
+
+@app.post("/post_test")
+async def post_test(request_input: ApiRequestBody) -> JSONResponse:
+    request_body = get_parsed_bbox_points(request_input)
+    app_logger.info(f"request_body:{request_body}.")
+    return JSONResponse(
+        status_code=200,
+        content=get_parsed_bbox_points(request_input)
+    )
+
+
+@app.get("/hello")
+async def hello() -> JSONResponse:
+    app_logger.info(f"hello")
+    return JSONResponse(status_code=200, content={"msg": "hello"})
+
+
+@app.post("/infer_samgis")
+def samgis(request_input: ApiRequestBody):
+    import subprocess
+
+    from samgis.prediction_api.predictors import samexporter_predict
+    app_logger.info("starting inference request...")
+
+    try:
+        import time
+
+        time_start_run = time.time()
+        body_request = get_parsed_bbox_points(request_input)
+        app_logger.info(f"body_request:{body_request}.")
+        try:
+            output = samexporter_predict(
+                bbox=body_request["bbox"], prompt=body_request["prompt"], zoom=body_request["zoom"],
+                source=body_request["source"]
+            )
+            duration_run = time.time() - time_start_run
+            app_logger.info(f"duration_run:{duration_run}.")
+            body = {
+                "duration_run": duration_run,
+                "output": output
+            }
+            return JSONResponse(status_code=200, content={"body": json.dumps(body)})
+        except Exception as inference_exception:
+            home_content = subprocess.run(
+                "ls -l /var/task", shell=True, universal_newlines=True, stdout=subprocess.PIPE
+            )
+            app_logger.error(f"/home/user ls -l: {home_content.stdout}.")
+            app_logger.error(f"inference error:{inference_exception}.")
+            return HTTPException(status_code=500, detail="Internal server error on inference")
+    except Exception as generic_exception:
+        app_logger.error(f"generic error:{generic_exception}.")
+        return HTTPException(status_code=500, detail="Generic internal server error")
+
+
+@app.exception_handler(RequestValidationError)
+async def request_validation_exception_handler(request: Request, exc: RequestValidationError) -> JSONResponse:
+    app_logger.error(f"exception errors: {exc.errors()}.")
+    app_logger.error(f"exception body: {exc.body}.")
+    headers = request.headers.items()
+    app_logger.error(f'request header: {dict(headers)}.' )
+    params = request.query_params.items()
+    app_logger.error(f'request query params: {dict(params)}.')
+    return JSONResponse(
+        status_code=status.HTTP_422_UNPROCESSABLE_ENTITY,
+        content={"msg": "Error - Unprocessable Entity"}
+    )
+
+
+@app.exception_handler(HTTPException)
+async def http_exception_handler(request: Request, exc: HTTPException) -> JSONResponse:
+    app_logger.error(f"exception: {str(exc)}.")
+    headers = request.headers.items()
+    app_logger.error(f'request header: {dict(headers)}.' )
+    params = request.query_params.items()
+    app_logger.error(f'request query params: {dict(params)}.')
+    return JSONResponse(
+        status_code=status.HTTP_500_INTERNAL_SERVER_ERROR,
+        content={"msg": "Error - Internal Server Error"}
+    )
+
+
+# important: the index() function and the app.mount MUST be at the end
+app.mount("/", StaticFiles(directory="static", html=True), name="static")
+
+
+@app.get("/")
+def index() -> FileResponse:
+    return FileResponse(path="/app/static/index.html", media_type="text/html")
+

static/app.js

@@ -0,0 +1,35 @@
+const jsonBtn = document.getElementById("getJson");
+const apiBtn = document.getElementById("getApi");
+const output = document.getElementById("output");
+const coordsForm = document.getElementById("coords-form");
+
+function formData2json(dataId, newObj={}) {
+    const formData = new FormData(dataId);
+    formData.forEach(function(value, key){
+        console.log(`formData2json:: key=${key}, value=${value}.`)
+        newObj[key] = value;
+    });
+    return JSON.stringify(newObj);
+}
+
+coordsForm.addEventListener('submit', event => {
+    event.preventDefault();
+    console.log("coordsForm::", coordsForm, "#")
+    const inputJson = formData2json(coordsForm)
+    console.log("inputJson", inputJson, "#");
+
+    fetch('/infer_samgis', {
+        method: 'POST', // or 'PUT'
+        body: inputJson,  // a FormData will automatically set the 'Content-Type',
+        headers: {"Content-Type": "application/json"},
+    }).then(function (response) {
+        return response.json();
+    }).then(function (data) {
+        console.log("data:", data, "#")
+        output.innerHTML = JSON.stringify(data)
+    }).catch(function (err) {
+        console.log("err:", err, "#")
+        output.innerHTML = `err:${JSON.stringify(err)}.`;
+    });
+    event.preventDefault();
+});

static/index.html

@@ -0,0 +1,44 @@
+<!DOCTYPE html>
+<html lang="en">
+<head>
+    <meta charset="UTF-8">
+    <meta name="viewport" content="width=device-width, initial-scale=1.0">
+    <meta http-equiv="X-UA-Compatible" content="ie=edge">
+    <link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/skeleton/2.0.4/skeleton.min.css" />
+    <title>Fetch API</title>
+</head>
+<body>
+    <div class="container">
+        <h1>Fetch API</h1>
+        <form id="coords-form">
+            <label>
+                bbox: x1 <input type="number" id="x-center-form" name="x1" value="-122.1497"/>
+            </label>
+            <label>
+                bbox: x2 <input type="number" id="y-center-form" name="x2" value="37.6311"/>
+            </label>
+            <label>
+                bbox: y1 <input type="number" id="y-center-form" name="y1" value="-122.1203"/>
+            </label>
+            <label>
+                bbox: y2 <input type="number" id="y-center-form" name="y2" value="37.6458"/>
+            </label>
+            <br/><br/>
+            <label>
+                x point: <input type="number" id="x-form" name="x" value="-122.1419"/>
+            </label>
+            <label>
+                y point: <input type="number" id="y-form" name="y" value="37.6383"/>
+            </label>
+            <label>
+                zoom: <input type="number" id="zoom" name="y" value="6"/>
+            </label>
+            <br/><br/>
+            <button type="submit" id="submit-btn">submit form</button>
+          </form>
+        <br><br>
+        <div id="output"></div>     
+    </div>
+    <script src="app.js"></script>
+</body>
+</html>