Due to his dissatisfaction with Chiang Kai-shek, he was detained and removed from office in October 1929. Following the Japanese invasion of Jehol in February 1933, Fang joined the Anti-Japanese National Salvation Movement. He organized the Movement's forces in China and led them north to confront the Japanese. On May 26, Fang united with Feng Yuxiang at Zhangjiakou and organized the Chahar People's Anti-Japanese Army Alliance, being its commander of the North Route, fighting against Japanese in the east of Chahar province. The army had some success, capturing Duolun for a time from the Japanese and their collaborators.