Simply go to the Appearance » Widgets page and add the 'Latest Posts' block to your sidebar. By default, the block will show your most recent posts. You edit the block settings and scroll to the 'Sorting & Filtering' section. From here, you can choose the category that you want to display posts from.