Since Perry caught double what Jordan caught, Perry caught 2 * 4 = <<2*4=8>>8 fish.
Altogether, they caught 8 + 4 = <<8+4=12>>12 fish.
On the way back to the shore, they lost 12 * 1/4 = <<12*1/4=3>>3 fish.
They have 12 - 3 = <<12-3=9>>9 fish remaining.
#### 9