He began his career as an apprentice at Bristol City before moving on to Brighton and Hove Albion. He played for Brighton in the 1983 FA Cup Final. The opponents were Manchester United and, after a drawn final at Wembley, Ramsey missed the replay due to injury and Brighton lost 4–0.