Depending on the work environment, you might be able to wear more casual attire. That said, joggers and sweatpants are generally considered to be casual-wear clothing, which may not fit into a formal work environment.