Given his busy job, I guess he should have been a little more careful in making promises, especially when using the very serious pinky swear.
He's unable to keep his promise and ends up picking Rin up extremely late, getting a totally deserved pouty face.