opened
jlewi
username_0
/kind feature

**Describe the solution you'd like**
[A clear and concise description of what you want to happen.]

We'd like to automatically log K8s objects to the metadata store; e.g.

* K8s Job
* TFJob 
* StudyJob
* Argo workflows

We'd like some sort of logger to do this.

Pipelines already has the persistence agent so maybe we can extend that?
https://github.com/kubeflow/pipelines/tree/master/backend/src/agent/persistence




**Anything else you would like to add:**
[Miscellaneous information that will assist in solving the issue.]
Create a generic logger for data to metadata using the persistence agent
issue
created
hougangliu
username_1
StudyJob is Katib v1alpha1 object, for katib v1alpha2 or following versions, Experiments/Trials CRD will replace StudyJob totally.
@richardsliu @johnugeorge @gaocegege I think supporting Experiments/Trials in metadata is enough, WDYT?

@username_0 @username_2 BTW, @dreamryx in my team can help contribute metadata in coming days.
comment
created
jlewi
username_0
I believe @username_2 has a prototype of a generic logger and is working on getting it turned into a PR.
comment
created
zhenghuiwang
username_2
@username_0 @username_1 @dreamryx 

I'm adding a POC in #126, which only log the k8s objects' name/uid/whole value into the metadata store.

I will keep working on it but feel free to give early feedback.
comment