Question: will a weeping compression joint stop?
Answer: And yes, a slow leak MAY stop on its own. This is especially true if you have high mineral content in your water. I personally would not mess anymore with a fitting that you had properly tightened (more than a half-turn past hand tight) that originally had a small weep but sealed itself after a few hours.