Key elements to build a game in JavaScript include creating game graphics using the Canvas API, managing game elements and their properties, implementing game logic, handling user inputs with event listeners, and running a game loop with requestAnimationFrame for continuous rendering.