Putnam 2006, Problem A-6

Four points are chosen uniformly and independently at random in the interior of a given circle. Find the probability that they are the vertices of a convex quadrilateral.

Solution:
**First solution:** (by Daniel Kane) The probability is $1 - \frac{35}{12\pi^2}$. We start with some notation and simplifications. For simplicity, we assume without loss of generality that the circle has radius 1. Let $E$ denote the expected value of a random variable over all choices of $P, Q, R$. Write $[XYZ]$ for the area of triangle $XYZ$.

If $P, Q, R, S$ are the four points, we may ignore the case where three of them are collinear, as this occurs with probability zero. Then the only way they can fail to form the vertices of a convex quadrilateral is if one of them lies inside the triangle formed by the other three. There are four such configurations, depending on which point lies inside the triangle, and they are mutually exclusive. Hence the desired probability is 1 minus four times the probability that $S$ lies inside triangle $PQR$. That latter probability is simply $E([PQR])$ divided by the area of the disc.

Let $O$ denote the center of the circle, and let $P', Q', R'$ be the projections of $P, Q, R$ onto the circle from $O$. We can write
$$[PQR] = \pm [OPQ] \pm [OQR] \pm [ORP]$$
for a suitable choice of signs, determined as follows. If the points $P', Q', R'$ lie on no semicircle, then all of the signs are positive. If $P', Q', R'$ lie on a semicircle in that order and $Q$ lies inside the triangle $OPR$, then the sign on $[OPR]$ is positive and the others are negative. If $P', Q', R'$ lie on a semicircle in that order and $Q$ lies outside the triangle $OPR$, then the sign on $[OPR]$ is negative and the others are positive.

We first calculate
$$E([OPQ] + [OQR] + [ORP]) = 3E([OPQ]).$$
Write $r_1 = OP, r_2 = OQ, \theta = \angle POQ$, so that
$$[OPQ] = \frac{1}{2}r_1r_2(\sin \theta).$$
The distribution of $r_1$ is given by $2r_1$ on $[0, 1]$ (e.g., by the change of variable formula to polar coordinates), and similarly for $r_2$. The distribution of $\theta$ is uniform on $[0, \pi]$. These three distributions are independent; hence
$$E([OPQ])$$
$$= \frac{1}{2} \left(\int_0^1 2r^2 dr\right)^2 \left(\frac{1}{\pi} \int_0^\pi \sin(\theta) d\theta\right)$$
$$= \frac{4}{9\pi},$$
and
$$E([OPQ] + [OQR] + [ORP]) = \frac{4}{3\pi}.$$

We now treat the case where $P', Q', R'$ lie on a semicircle in that order. Put $\theta_1 = \angle POQ$ and $\theta_2 = \angle QOR$; then the distribution of $\theta_1, \theta_2$ is uniform on the region
$$0 \leq \theta_1, \quad 0 \leq \theta_2, \quad \theta_1 + \theta_2 \leq \pi.$$
In particular, the distribution on $\theta = \theta_1 + \theta_2$ is $\frac{2\theta}{\pi^2}$ on $[0, \pi]$. Put $r_P = OP, r_Q = OQ, r_R = OR$. Again, the distribution on $r_P$ is given by $2r_P$ on $[0, 1]$, and similarly