The Asagaya guest house is an awesome place to stay for one night like I did or multiple nights. It's conveniently located close to Asagaya station and Ogikubo station is close by too.
The room is nice, basic but has all the essentials. And as it was cold, it was nice and warm.
Top tip: the ramen shops in Asagaya are pretty well known for being tasty. Definitely check them out!