When KGB Chief Kryuchkov was arrested following the unsuccessful August 1991 coup against Mikhail Gorbachev, Shebarshin became head of the KGB for two days. He was replaced by Vadim Bakatin, whose job was essentially to dismantle the KGB. Shebarshin returned to his post as FCD head until Bakatin announced a new FCD deputy director, Vladimir Rozhkov, without consulting him. Shebarshin resigned his post on 20 September 1991.