The CLP remained in opposition until November 1916 , when it reached a confidence and supply agreement with Prime Minister Billy Hughes , who had recently been expelled from the ALP for supporting conscription in World War I and organised his followers as the National Labor Party .
In November 1916 , the CLP made a deal with the Prime Minister Billy Hughes .