On multi GPU Model picks up certain parameters from last run on Grid search
I am doing a Grid Search over a set of hyperparameters. I do this by applying loops and re-initializing the model every time. However, the subsequent model seems to be picking up something from the previous runs because their performance changes as opposed to when I try only that particular setting of hyperparameters. Any idea what's happening here?