Infact 
```
pe.rva_to_file_offset(pe.hdr.opt.AddressOfEntryPoint) 
```

Seems to do the trick?