Repository: featbit/featbit (language: python)

Issue:
🧹 refactor: change the way we configure kafka consumer and producer
This PR

- Split Kafka consumer config and producer config
- Allow user to specify all Kafka consumer config and producer config

Example environment variables

- Kafka__Producer__bootstrap.servers
- Kafka__Consumer__sasl.username
- Kafka__Consumer__sasl.password
- Kafka__Consumer__sasl.mechanism
- Kafka__Consumer__security.protocol

Useful links

- https://github.com/confluentinc/confluent-kafka-dotnet/blob/master/src/Confluent.Kafka/Config_gen.cs


Discussion / hints:

Fix patch:
diff --git a/modules/back-end/src/Api/appsettings.Development.json b/modules/back-end/src/Api/appsettings.Development.json
index 8a19db79c..8b34098d2 100644
--- a/modules/back-end/src/Api/appsettings.Development.json
+++ b/modules/back-end/src/Api/appsettings.Development.json
@@ -25,7 +25,7 @@
       "auto.offset.reset": "earliest",
       "enable.auto.commit": true,
       "auto.commit.interval.ms": "5000",
-      "enable.auto.offset.store": true
+      "enable.auto.offset.store": false
     }
   },
   "OLAP": {
diff --git a/modules/back-end/src/Api/appsettings.json b/modules/back-end/src/Api/appsettings.json
index d646726a5..96d888d52 100644
--- a/modules/back-end/src/Api/appsettings.json
+++ b/modules/back-end/src/Api/appsettings.json
@@ -25,7 +25,7 @@
       "auto.offset.reset": "earliest",
       "enable.auto.commit": true,
       "auto.commit.interval.ms": "5000",
-      "enable.auto.offset.store": true
+      "enable.auto.offset.store": false
     }
   },
   "OLAP": {
diff --git a/modules/evaluation-server/src/Api/appsettings.Development.json b/modules/evaluation-server/src/Api/appsettings.Development.json
index aba891f54..55f9a8229 100644
--- a/modules/evaluation-server/src/Api/appsettings.Development.json
+++ b/modules/evaluation-server/src/Api/appsettings.Development.json
@@ -15,7 +15,7 @@
       "auto.offset.reset": "latest",
       "enable.auto.commit": true,
       "auto.commit.interval.ms": "5000",
-      "enable.auto.offset.store": true
+      "enable.auto.offset.store": false
     }
   },
   "MongoDb": {
diff --git a/modules/evaluation-server/src/Api/appsettings.json b/modules/evaluation-server/src/Api/appsettings.json
index 6a5355aef..d7807d1e5 100644
--- a/modules/evaluation-server/src/Api/appsettings.json
+++ b/modules/evaluation-server/src/Api/appsettings.json
@@ -15,7 +15,7 @@
       "auto.offset.reset": "latest",
       "enable.auto.commit": true,
       "auto.commit.interval.ms": "5000",
-      "enable.auto.offset.store": true
+      "enable.auto.offset.store": false
     }
   },
   "MongoDb": {


Test patch:
diff --git a/modules/back-end/tests/Application.IntegrationTests/Snapshots/KafkaConfigTests.DefaultProducerConsumerConfig.verified.txt b/modules/back-end/tests/Application.IntegrationTests/Snapshots/KafkaConfigTests.DefaultProducerConsumerConfig.verified.txt
index e5155e3c6..abe0e3ad8 100644
--- a/modules/back-end/tests/Application.IntegrationTests/Snapshots/KafkaConfigTests.DefaultProducerConsumerConfig.verified.txt
+++ b/modules/back-end/tests/Application.IntegrationTests/Snapshots/KafkaConfigTests.DefaultProducerConsumerConfig.verified.txt
@@ -28,7 +28,7 @@
     },
     {
       Key: enable.auto.offset.store,
-      Value: True
+      Value: False
     },
     {
       Key: group.id,