Repository: bcgov/met-public
Pull request #2623: Bugfix/deseng677
Author: login: Baelx
Created: 2025-05-13T20:58:12Z | Merged: 2025-05-13T23:15:51Z

Issue #: https://citz-gdx.atlassian.net/browse/DESENG-677

**Description of changes:**
- Aligned versions with Epic in an attempt to solve Dagster issues

**User Guide update ticket (if applicable):** n/a


Diff:
diff --git a/CHANGELOG.MD b/CHANGELOG.MD
index 802ab6d58..3198c19e9 100644
--- a/CHANGELOG.MD
+++ b/CHANGELOG.MD
@@ -1,3 +1,7 @@
+## May 13, 2025
+
+- **Bugfix** Align library versions with EPIC app [🎟️ DESENG-677](https://citz-gdx.atlassian.net/browse/DESENG-677)
+
 ## May 1, 2025
 
 - **Bugfix** Resolve conflicting versions for Dagster ETL pipeline [🎟️ DESENG-677](https://citz-gdx.atlassian.net/browse/DESENG-677)
diff --git a/met-etl/Dockerfile b/met-etl/Dockerfile
index 0b1d5cdd5..e6a647bff 100644
--- a/met-etl/Dockerfile
+++ b/met-etl/Dockerfile
@@ -1,12 +1,12 @@
-FROM python:3.12-slim-bookworm
+FROM python:3.8.5-buster
 
-ARG DAGSTER_LIBRARIES_VERSION=0.26.11
+ARG DAGSTER_LIBRARIES_VERSION=0.23.15
 
 RUN pip install --upgrade pip
 # ==> Add Dagster layer
 RUN \
     pip install \
-        dagster==1.10.11 \
+        dagster==1.7.15 \
         dagster-postgres==${DAGSTER_LIBRARIES_VERSION} \
         dagster-celery[flower,redis,kubernetes]==${DAGSTER_LIBRARIES_VERSION} \
         dagster-aws==${DAGSTER_LIBRARIES_VERSION} \
diff --git a/met-etl/container/dagster/Dockerfile b/met-etl/container/dagster/Dockerfile
index 0d484fea6..6018e5d43 100644
--- a/met-etl/container/dagster/Dockerfile
+++ b/met-etl/container/dagster/Dockerfile
@@ -1,14 +1,16 @@
 # Dagster libraries to run both dagit and the dagster-daemon. Does not
 # need to have access to any pipeline code.
 
-FROM python:3.12.2-bullseye
+FROM python:3.8.5-buster
+
+ARG DAGSTER_LIBRARIES_VERSION=0.23.15
 
 RUN pip install \
-    dagster \
-    dagster-graphql \
-    dagit \
-    dagster-postgres \
-    dagster-docker
+    dagster==1.7.15 \
+    dagster-graphql==1.7.15 \
+    dagit==1.7.15 \
+    dagster-postgres==${DAGSTER_LIBRARIES_VERSION} \
+    dagster-docker==${DAGSTER_LIBRARIES_VERSION}
 
 # Set $DAGSTER_HOME and copy dagster instance and workspace YAML there
 ENV DAGSTER_HOME=/opt/dagster/dagster_home/
@@ -17,4 +19,4 @@ RUN mkdir -p $DAGSTER_HOME
 
 COPY dagster.yaml workspace.yaml $DAGSTER_HOME
 
-WORKDIR $DAGSTER_HOME
+WORKDIR $DAGSTER_HOME
\ No newline at end of file
diff --git a/met-etl/container/user_code/Dockerfile b/met-etl/container/user_code/Dockerfile
index 99d9b061b..05f7a9f87 100644
--- a/met-etl/container/user_code/Dockerfile
+++ b/met-etl/container/user_code/Dockerfile
@@ -1,12 +1,12 @@
-FROM python:3.12-slim-bookworm
+FROM python:3.8.5-buster
 
-ARG DAGSTER_LIBRARIES_VERSION=0.26.11
+ARG DAGSTER_LIBRARIES_VERSION=0.23.15
 
 RUN pip install --upgrade pip
 # ==> Add Dagster layer
 RUN \
     pip install \
-        dagster==1.10.11 \
+        dagster==1.7.15 \
         dagster-postgres==${DAGSTER_LIBRARIES_VERSION} \
         dagster-celery[flower,redis,kubernetes]==${DAGSTER_LIBRARIES_VERSION} \
         dagster-aws==${DAGSTER_LIBRARIES_VERSION} \
@@ -29,4 +29,4 @@ EXPOSE 4000
 
 # CMD allows this to be overridden from run launchers or executors that want
 # to run other commands against your repository
-CMD ["dagster", "api", "grpc", "-h", "0.0.0.0", "-p", "4000", "-f", "repo.py"]
+CMD ["dagster", "api", "grpc", "-h", "0.0.0.0", "-p", "4000", "-f", "repo.py"]
\ No newline at end of file
diff --git a/met-etl/requirements.txt b/met-etl/requirements.txt
index 058087db8..e585d5e7c 100644
--- a/met-etl/requirements.txt
+++ b/met-etl/requirements.txt
@@ -1,19 +1,20 @@
-dagit==1.10.12
-dagster-docker==0.26.12
+dagster==1.7.15
+dagit==1.7.15
+dagster-docker==0.23.15
 Flask-Cors==3.0.10
 Flask-Migrate==2.7.0
 Flask-Moment==1.0.5
-Flask-SQLAlchemy==3.0.5
-Flask==2.2.5
-SQLAlchemy-Utils==0.41.2
-SQLAlchemy==1.4.52
-Werkzeug==3.0.3
-flask-marshmallow==1.0.0
-flask-restx==1.3.0
-marshmallow-sqlalchemy==1.0.0
-marshmallow==3.21.1
-packaging==24.0
-python-dotenv==1.0.1
-pytz==2024.1
+Flask-SQLAlchemy==2.5.1
+Flask==2.2.3
+SQLAlchemy-Utils==0.38.3
+SQLAlchemy==1.3.24
+Werkzeug==2.2.3
+flask-marshmallow==0.11.0
+flask-restx==0.5.1
+marshmallow-sqlalchemy==0.25.0
+marshmallow==3.18.0
+packaging==21.3
+python-dotenv==0.21.0
+pytz==2022.5
 -e git+https://github.com/bcgov/met-public.git#egg=met-api&subdirectory=met-api
--e git+https://github.com/bcgov/met-public.git#egg=analytics-api&subdirectory=analytics-api
+-e git+https://github.com/bcgov/met-public.git#egg=analytics-api&subdirectory=analytics-api
\ No newline at end of file


Reviews:
user: login: NatSquared
state: COMMENTED
author_association: COLLABORATOR
submitted_at: 2025-05-13T22:53:06Z
user: login: NatSquared
body: LGTM!
state: APPROVED
author_association: COLLABORATOR
submitted_at: 2025-05-13T23:07:19Z

Review comments:
diff_hunk: @@ -1,12 +1,12 @@
-FROM python:3.12-slim-bookworm
+FROM python:3.8.5-buster
path: met-etl/Dockerfile
user: login: NatSquared
body: were you having issues in met-etl as well?
created_at: 2025-05-13T22:50:15Z
author_association: COLLABORATOR
diff_hunk: @@ -1,19 +1,20 @@
-dagit==1.10.12
-dagster-docker==0.26.12
+dagster==1.7.15
+dagit==1.7.15
+dagster-docker==0.23.15
 Flask-Cors==3.0.10
 Flask-Migrate==2.7.0
 Flask-Moment==1.0.5
-Flask-SQLAlchemy==3.0.5
-Flask==2.2.5
-SQLAlchemy-Utils==0.41.2
-SQLAlchemy==1.4.52
-Werkzeug==3.0.3
-flask-marshmallow==1.0.0
-flask-restx==1.3.0
-marshmallow-sqlalchemy==1.0.0
-marshmallow==3.21.1
-packaging==24.0
-python-dotenv==1.0.1
-pytz==2024.1
--e git+https://github.com/bcgov/met-public.git#egg=met-api&subdirectory=met-api
--e git+https://github.com/bcgov/met-public.git#egg=analytics-api&subdirectory=analytics-api
+Flask-SQLAlchemy==2.5.1
+Flask==2.2.3
+SQLAlchemy-Utils==0.38.3
+SQLAlchemy==1.3.24
+Werkzeug==2.2.3
+flask-marshmallow==0.11.0
+flask-restx==0.5.1
+marshmallow-sqlalchemy==0.25.0
+marshmallow==3.18.0
+packaging==21.3
+python-dotenv==0.21.0
+pytz==2022.5
+-e git+https://github.com/bcgov/epic-engage.git#egg=met-api&subdirectory=met-api
path: met-etl/requirements.txt
user: login: NatSquared
body: is this an intentional change (`met-public` -> `epic-enage`)?
created_at: 2025-05-13T22:50:54Z
author_association: COLLABORATOR

PR comments:
user: login: sonarqubecloud[bot]
created_at: 2025-05-13T23:07:40Z
body: ## [![Quality Gate Passed](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/checks/QualityGateBadge/qg-passed-20px.png 'Quality Gate Passed')](https://sonarcloud.io/dashboard?id=bcgov_met-public&pullRequest=2623) **Quality Gate passed**  
Issues  
![](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/common/passed-16px.png '') [0 New issues](https://sonarcloud.io/project/issues?id=bcgov_met-public&pullRequest=2623&issueStatuses=OPEN,CONFIRMED&sinceLeakPeriod=true)  
![](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/common/accepted-16px.png '') [0 Accepted issues](https://sonarcloud.io/project/issues?id=bcgov_met-public&pullRequest=2623&issueStatuses=ACCEPTED)

Measures  
![](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/common/passed-16px.png '') [0 Security Hotspots](https://sonarcloud.io/project/security_hotspots?id=bcgov_met-public&pullRequest=2623&issueStatuses=OPEN,CONFIRMED&sinceLeakPeriod=true)  
![](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/common/passed-16px.png '') [0.0% Coverage on New Code](https://sonarcloud.io/component_measures?id=bcgov_met-public&pullRequest=2623&metric=new_coverage&view=list)  
![](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/common/passed-16px.png '') [0.0% Duplication on New Code](https://sonarcloud.io/component_measures?id=bcgov_met-public&pullRequest=2623&metric=new_duplicated_lines_density&view=list)  
  
[See analysis details on SonarQube Cloud](https://sonarcloud.io/dashboard?id=bcgov_met-public&pullRequest=2623)


author_association: NONE