No, themes which are well written according to defined structure then it can't slow your's site . In other case there is a problem with yours hosting provider