As a junior curler, Krause represented Denmark at seven World Junior Curling Championships. His first was in 2004, when he played second on a team skipped by Kenneth Jørgensen. The team finished 2–7 at the tournament, finishing in last place. At the 2005 World Junior Curling Championships, he was the alternate on the team, but played in six games. The team improved, finishing with a 4–5 record, tied for fifth. At the 2006 World Junior Curling Championships, he played third on the team, now skipped by Rasmus Stjerne. The team again finished 4–5, tied for fifth. At the 2007 World Junior Curling Championships, the team improved once again, going 6–3 in the round robin. This put them in a tiebreaker against the United States, which they won, followed by a loss to Canada in the semifinal and Switzerland in the bronze medal game, settling for fourth overall. The team had less success at the 2008 World Junior Curling Championships, going 4–5 (7th place), but did much better in 2009. At the 2009 World Juniors, the team finished the round robin with a 7–2 record, in second place. This put them into the page playoffs in the 1 vs. 2 game against Canada. While they lost this game, they remained alive in the playoffs, and they won their semifinal match against the United States, and then beat Canada in a rematch in the gold medal final. In his last year of junior eligibility, Krause was promoted as skip of the Danish team. Skipping a team of Oliver Dupont, Tobias Thune and Troels Harry, Krause led Denmark to a 2–7 record at the 2010 World Junior Curling Championships, placing 8th.