Improvements with embeddings load and file save

added a few more requirements for aws load

Added transformers to requirements for AWS

Updated Dockerfile and requirements files to create a smaller container

Minor bug fix to connections parameter function

Fixed Dockerfile curl install line

Explicitly installing curl and exposing port in Dockerfile

Cognito authorisation option added to app, some other minor changes.

When running on cloud now checks for relevant header details on load

Now accepts .zip file as inputs. Moved semantic search option bar. Minor API mode changes.

Changed embedding model to MiniLM-L6 as faster. Compressed embeddings are now int8. General improvements to API mode

Minor changes to function outputs. Attempted Python downgrade to 3.10 to address xlsx output issues

General code improvements and refinements.

Set bm25 in functions explicitly. Some API updates. Now can get connection params on startup.

Some package updates and minor changes

embedding files now write to output folder

Changed all intermediate file outputs to save to output folder

Allowed for custom output folder, returned Dockerfile to work under user account and port 7860

Testing not running Dockerfile as user for Lambda compatibility

Modified Dockerfile to run app on port 8080, which Lambda uses

Added Lambda web adapter to Dockerfile. Updated Gradio version

Updated Dockerfile to create output folder correctly and enable regional AWS STS endpoint

Specified boto3 sts region

Correct bm25 filename usage

Now checks for output folder before saving. Minor code cleaning

Fixed cleaning for semantic search. Handles text with backslashes in (if cleaned). Updated packages. requirements file for only keyword search added.

Assigned AWS bucket name to environmental variable

Added additional password auth for AWS-based files. Changed 'Clean' default to no

AWS credentials no longer a requirement for app to work

Gradio 4.21. Limitations on file size and creating embeddings. Added AWS integration

Removed GRADIO_ROOT_PATH from the Dockerfile as it is not necessary for API Gateway access

Updated to latest Gradio version that hopefully solved root_url issues. Added ssl_verify=False to launch

Set SDK version to 4.20.0 on huggingface. Added GRADIO_SERVER_PORT to Dockerfile

set gradio version to 4.18.0, before root path issue reappears

Changed dockerfile gradio_root_path variable

String query not correctly specified in fuzzy search, changed this

ECS not allowing me to save files so increasing container privileges in Dockerfile

set Dockerfile Gradio_root_path environmental variable

Now loads in embedding model locally in Dockerfile

edited Dockerfile slightly

Added small line to dockerfile start. Added dockerignore file for local builds

Improved code for cleaning and outputting files. Added Dockerfile

Improved xlsx output formatting. Deals better with cleaning data then analysing in same session.

Added highlight search term functionality to keyword search output

Updated to Gradio 4.16.0. Now works correctly with BGE embeddings

Upgraded to Gradio 4.16.0. Added Spacy fuzzy search functionality.

Changed intro text

Changed requirements to download correct spacy model version

Cut out semantic search temporarily while issues with Jina gated model resolved. Improved error/progress tracking and messaging. Placeholder for Spacy fuzzy search.

Switch back to Gradio version 3.50.2 as 4 is not working with pyinstaller app creation yet