numbas/Numbas — Issue #73: rounding errors?
Author: BillFoster
Created: 2011-10-30 22:22:17+00:00
State: open

Arises in taking modulus of a complex number to a power in the form {(z1*conj(z1))^c1} - gave me 1000.000000003 or some such where z1 is a complex number such as 3+i and c1 =6. Had to round it. Would have been better to take (re(z1)^2+im(z1)^2)^3 or abs(z1)^6 as they give integers - but......