Equation solving

Equation solving
In mathematics, to solve an equation is to find its solutions, which are the values (numbers, functions, sets, etc.) that fulfill the condition stated by the equation, consisting generally of two expressions related by an equals sign. When seeking a solution, one or more variables are designated as unknowns. A solution is an assignment of values to the unknown variables that makes the equality in the equation true. In other words, a solution is a value or a collection of values (one for each unknown) such that, when substituted for the unknowns, the equation becomes an equality.
A solution of an equation is often called a root of the equation, particularly but not only for polynomial equations. The set of all solutions of an equation is its solution set.
An equation may be solved either numerically or symbolically. Solving an equation numerically means that only numbers are admitted as solutions. Solving an equation symbolically means that expressions can be used for representing the solutions.
For example, the equation is solved for the unknown by the expression , because substituting for in the equation results in , a true statement. It is also possible to take the variable to be the unknown, and then the equation is solved by . Or and can both be treated as unknowns, and then there are many solutions to the equation; a symbolic solution is , where the variable may take any value. Instantiating a symbolic solution with specific numbers gives a numerical solution; for example, gives (that is), and gives .
The distinction between known variables and unknown variables is generally made in the statement of the problem, by phrases such as "an equation in and ", or "solve for and ", which indicate the unknowns, here and .
However, it is common to reserve , ... to denote the unknowns, and to use , ... to denote the known variables, which are often called parameters. This is typically the case when considering polynomial equations, such as quadratic equations. However, for some problems, all variables may assume either role.
Depending on the context, solving an equation may consist to find either any solution (finding a single solution is enough), all solutions, or a solution that satisfies further properties, such as belonging to a given interval. When the task is to find the solution that is the best under some criterion, this is an optimization problem. Solving an optimization problem is generally not referred to as "equation solving", as, generally, solving methods start from a particular solution for finding a better solution, and repeating the process until finding eventually the best solution.
Overview
One general form of an equation is
where is a function, are the unknowns, and is a constant. Its solutions are the elements of the inverse image
where is the domain of the function . The set of solutions can be the empty set (there are no solutions), a singleton (there is exactly one solution), finite, or infinite (there are infinitely many solutions).
For example, an equation such as
with unknowns and , can be put in the above form by subtracting from both sides of the equation, to obtain
In this particular case there is not just one solution, but an infinite set of solutions, which can be written using set builder notation as
One particular solution is . Two other solutions are , and . There is a unique plane in three-dimensional space which passes through the three points with these coordinates, and this plane is the set of all points whose coordinates are solutions of the equation.
Solution sets
The solution set of a given set of equations or inequalities is the set of all its solutions, a solution being a tuple of values, one for each unknown, that satisfies all the equations or inequalities.
If the solution set is empty, then there are no values of the unknowns that satisfy simultaneously all equations and inequalities.
For a simple example, consider the equation
This equation can be viewed as a Diophantine equation, that is, an equation for which only integer solutions are sought. In this case, the solution set is the empty set, since 2 is not the square of an integer. However, if one searches for real solutions, there are two solutions, and ; in other words, the solution set is .
When an equation contains several unknowns, and when one has several equations with more unknowns than equations, the solution set is often infinite. In this case, the solutions cannot be listed. For representing them, a parametrization is often useful, which consists of expressing the solutions in terms of some of the unknowns or auxiliary variables. This is always possible when all the equations are linear.
Such infinite solution sets can naturally be interpreted as geometric shapes such as lines, curves (see picture), planes, and more generally algebraic varieties or manifolds. In particular, algebraic geometry may be viewed as the study of solution sets of algebraic equations.
Methods of solution
The methods for solving equations generally depend on the type of equation, both the kind of expressions in the equation and the kind of values that may be assumed by the unknowns. The variety in types of equations is large, and so are the corresponding methods. Only a few specific types are mentioned below.
In general, given a class of equations, there may be no known systematic method (algorithm) that is guaranteed to work. This may be due to a lack of mathematical knowledge; some problems were only solved after centuries of effort. But this also reflects that, in general, no such method can exist: some problems are known to be unsolvable by an algorithm, such as Hilbert's tenth problem, which was proved unsolvable in 1970.
For several classes of equations, algorithms have been found for solving them, some of which have been implemented and incorporated in computer algebra systems, but often require no more sophisticated technology than pencil and paper. In some other cases, heuristic methods are known that are often successful but that are not guaranteed to lead to success.
Brute force, trial and error, inspired guess
If the solution set of an equation is restricted to a finite set (as is the case for equations in modular arithmetic, for example), or can be limited to a finite number of possibilities (as is the case with some Diophantine equations), the solution set can be found by brute force, that is, by testing each of the possible values (candidate solutions). It may be the case, though, that the number of possibilities to be considered, although finite, is so huge that an exhaustive search is not practically feasible; this is, in fact, a requirement for strong encryption methods.
As with all kinds of problem solving, trial and error may sometimes yield a solution, in particular where the form of the equation, or its similarity to another equation with a known solution, may lead to an "inspired guess" at the solution. If a guess, when tested, fails to be a solution, consideration of the way in which it fails may lead to a modified guess.
Elementary algebra
Equations involving linear or simple rational functions of a single real-valued unknown, say , such as
can be solved using the methods of elementary algebra.
Systems of linear equations
Smaller systems of linear equations can be solved likewise by methods of elementary algebra. For solving larger systems, algorithms are used that are based on linear algebra. See Gaussian elimination
Polynomial equations
Polynomial equations of degree up to four can be solved exactly using algebraic methods, of which the quadratic formula is the simplest example. Polynomial equations with a degree of five or higher require in general numerical methods (see below) or special functions such as Bring radicals, although some specific cases may be solvable algebraically, for example
(by using the rational root theorem), and
(by using the substitution , which simplifies this to a quadratic equation in ).
Diophantine equations
In Diophantine equations the solutions are required to be integers. In some cases a brute force approach can be used, as mentioned above. In some other cases, in particular if the equation is in one unknown, it is possible to solve the equation for rational-valued unknowns (see Rational root theorem), and then find solutions to the Diophantine equation by restricting the solution set to integer-valued solutions. For example, the polynomial equation
has as rational solutions and , and so, viewed as a Diophantine equation, it has the unique solution .
In general, however, Diophantine equations are among the most difficult equations to solve.
Inverse functions
In the simple case of a function of one variable, say we can solve an equation of the form for some constant by considering what is known as the inverse function of .
Given a function , the inverse function, denoted and defined as , is a function such that
Now, if we apply the inverse function to both sides of , where is a constant value in , we obtain
and we have found the solution to the equation. However, depending on the function, the inverse may be difficult to be defined, or may not be a function on all of the set (only on some subset), and have many values at some point.
If just one solution will do, instead of the full solution set, it is actually sufficient if only the functional identity
holds. For example, the projection defined by has no post-inverse, but it has a pre-inverse defined by . Indeed, the equation is solved by
Examples of inverse functions include the th root (inverse of ); the logarithm (inverse of ); the inverse trigonometric functions; and Lambert's function (inverse of ).
Factorization
If the left-hand side expression of an equation can be factorized as , the solution set of the original solution consists of the union of the solution sets of the two equations and .
For example, the equation
can be rewritten, using the identity as
which can be factorized into
The solutions are thus the solutions of the equation , and are thus the set
Numerical methods
With more complicated equations in real or complex numbers, simple methods to solve equations can fail. Often, root-finding algorithms like the Newton–Raphson method can be used to find a numerical solution to an equation, which, for some applications, can be entirely sufficient to solve some problem.
Matrix equations
Equations involving matrices and vectors of real numbers can often be solved by using methods from linear algebra.
Differential equations
There is a vast body of methods for solving various kinds of differential equations, both numerically and analytically. A particular class of problem that can be considered to belong here is integration, and the analytic methods for solving this kind of problems are now called symbolic integration. Solutions of differential equations can be implicit or explicit.
See also
Extraneous and missing solutions
Simultaneous equations
Equating coefficients
Solving the geodesic equations
Unification (computer science) — solving equations involving symbolic expressions
References
Equations
Inverse functions
Unification (computer science)