Apple says that Siri is not eavesdropping at all. Instead, the software's ability to respond to a voice command is programmed in. So, it's not really listening at all times. The iPhone can only hold a small amount of audio, and it only records what happens after it is triggered by the “Hey, Siri” command.