Repository: minio/minio (language: go)

Issue:
[Bucket Notification] Remove maxBatchLimit
**Is your feature request related to a problem? Please describe.**
The [Kafka batch send change](https://github.com/minio/minio/pull/18164) is awesome! But it limits Kafka batch send size to 100 due to `maxBatchLimit`. With 100 Kafka batch send size, our bucket notifications with queues can easily be delayed for 30 minutes when there are a large amount of events (this happens quite frequently for us due to our usage pattern). It would be great if we can configure a larger Kafka batch send size in order to achieve lower latency for bucket notifications with queues.

**Describe the solution you'd like**
Remove `maxBatchLimit`.

**Additional context**
I saw previous discussions about maxBatchLimit in https://github.com/minio/minio/pull/18164#discussion_r1346944423. I do agree that users should be advised to configure a reasonable batch send size, but I don't think it's necessary to enforce a limit on it. I think users should be able to configure a much larger batch send size at their own risks, if they want.



Discussion / hints:
Relaxing this limit may lead to creation of too many go routines which are uncontrolled. We can set it to a higher and reasonable value perhaps. Will need some suggestions from @harshavardhana on this.

Fix patch:
diff --git a/internal/event/target/kafka.go b/internal/event/target/kafka.go
index 21cd9166db341..0e15113e682d9 100644
--- a/internal/event/target/kafka.go
+++ b/internal/event/target/kafka.go
@@ -75,8 +75,6 @@ const (
 	EnvKafkaClientTLSKey  = "MINIO_NOTIFY_KAFKA_CLIENT_TLS_KEY"
 	EnvKafkaVersion       = "MINIO_NOTIFY_KAFKA_VERSION"
 	EnvKafkaBatchSize     = "MINIO_NOTIFY_KAFKA_BATCH_SIZE"
-
-	maxBatchLimit = 100
 )
 
 // KafkaArgs - Kafka target arguments.
@@ -131,9 +129,6 @@ func (k KafkaArgs) Validate() error {
 		if k.QueueDir == "" {
 			return errors.New("batch should be enabled only if queue dir is enabled")
 		}
-		if k.BatchSize > maxBatchLimit {
-			return fmt.Errorf("batch limit should not exceed %d", maxBatchLimit)
-		}
 	}
 	return nil
 }


Test patch: