Before revision:  We propose a dynamic treatment  policy which attains the minimax optimal regret relative to the unknown best treatment in this dynamic setting.
After revision:  We propose a dynamic treatment assignments to be made may even be unknown. A sequential treatment policy which attains the minimax optimal regret relative to the unknown best treatment in this dynamic setting.