I think you can do it with:
```js
var i = new ol.interaction.Select({
  addCondition: ol.events.condition.noModifierKeys,
  toggleCondition: ol.events.condition.shiftKeyOnly
});
```
Haven't tested it, though.