The St. Petersburg Paradox The St. Petersburg paradox created by Nicolas Bernoulli (cousin of Daniel Bernoulli) empirically discovered that the decisions of rational individuals sometimes violate the axioms of preferences. When a probability distribution function has an infinite expected value, it is expected that a rational person would pay an arbitrarily large finite amount to take this gamble. However, this experiment demonstrated that there is no upper bound on the potential rewards from very low probability events. In his experimental game, a person had to flip a coin as many times as possible until it was tails. The participant's prize will be determined by the number of times the coin was turned heads consecutively. For every time the coin comes up heads (1/2 probability), the participant's prize will be doubled. The game ends when the participant flips the coin and it comes out a tail. According to the axioms of preferences, a player should be willing to pay a high price to play because his entry cost will always be less than the expected value of the game, since he could potentially win an infinite payout. However, in reality, people don't do this. “Only a few of the participants were willing to pay a maximum of $25 to enter the game because many of them were risk averse and unwilling to bet on a very small possibility at a very high price. Bernoulli's Formulation Nicolas Bernoulli described the St. Petersburg paradox (involving infinite expected values) in 1713, prompting two Swiss mathematicians to develop expected utility theory as a solution. Bernoulli's paper was the first formalization of marginal utility, which has broad application in economics in addition to expected utility theory. He used this concept to formalize the idea that the same amount of additional money was less useful to an already-wealthy person than it would be to a poor person. The theory can also more accurately describe more realistic scenarios (where expected values are finite) than expected value alone, He proposed that a nonlinear function of utility of an outcome should be used instead of the expected value of an outcome, accounting for risk aversion, where the risk premium is higher for low-probability events than the difference between the payout level of a particular outcome and its expected value. Bernoulli further proposed that it was not the goal of the gambler to maximize his expected gain but to instead maximize the logarithm of his gain. Nicolas Bernoulli drew attention to psychological and behavioral behind the individual's decision-making process and found that the utility of wealth has a diminishing marginal utility. For example, as someone gets wealthier, an extra dollar or an additional good is perceived as less valuable. In other words, he found that the desirability related with a financial gain depends not only on the gain itself buy also on the wealth of the person. He suggested that people maximize "moral expectation" rather than expected monetary value. Bernoulli made a clear distinction between expected value and expected utility. Instead of using the weighted outcomes, he used the weighted utility multiplied by probabilities. He proved that the utility function used in real life means is finite, even when its expected value is infinite. Other experiments proposed that very low probability events are neglected by considering the finite resources of the participants. For example, it makes rational sense for a rich person, but not for a poor person to pay 10,000USD in exchange for a lottery ticket that yields a 50\% chance of winning and a 50\% chance of nothing. Even though both individuals have the same chance at each monetary price, they will assign different values to the potential outcomes , according to their income levels. Bernoulli's paper was the first formalization of marginal utility, which has broad application in economics in addition to expected utility theory. Ramsey's Theoretic Approach to Subjective Probability In 1926, Frank Ramsey introduced the Ramsey's Representation Theorem. This representation theorem for expected utility assumed that preferences are defined over set of bets where each option has a different yield. Ramsey believed that we always choose decisions to receive the best expected outcome according to our personal preferences. This implies that if we are able to understand the priorities and personal preferences of an individual we can anticipate what choices they are going to take. In this model he defined numerical utilities for each option to exploit the richness of the space of prices. The outcome of each preference is exclusive from each other. For example, if you study, then you can't see your friends, however you will get a good grade in your course. In this scenario, if we analyze what are his personal preferences and beliefs we will be able to predict which he might choose. (e.g. if someone prioritizes more his social life than academic results, he will go out with her friends). Assuming that the decisions of a person are rational, according to this theorem we should be able to know the beliefs and utilities from a person just by looking the choices someone takes (which is wrong). Ramsey defines a proposition as “ethically neutral” when two possible outcome has an equal value. In other words, if the probability can be defined in terms of preference, each proposition should have ½ in order to be indifferent between both options. Ramsey shows that: P(E)=(1−U(m)(U(b)−U(w)) Savage's Subjective Expected Utility Representation In the 1950s, Leonard Jimmie Savage, an American statistician, derived a framework for comprehending expected utility. At that point, it was considered the first and most thorough foundation to understanding the concept. Savage's framework involved proving that expected utility could be used to make an optimal choice among several acts through seven axioms. In his book, The Foundations of Statistics, Savage integrated a normative account of decision making under risk (when probabilities are known) and under uncertainty (when probabilities are not objectively known). Savage concluded that people have neutral attitudes towards uncertainty and that observation is enough to predict the probabilities of uncertain events. A crucial methodological aspect of Savage's framework is its focus on observable choices. Cognitive processes and other psychological aspects of decision making matter only to the extent that they have directly measurable implications on choice. The theory of subjective expected utility combines two concepts: first, a personal utility function, and second a personal probability distribution (usually based on Bayesian probability theory). This theoretical model has been known for its clear and elegant structure and its considered for some researchers one of “the most brilliant axiomatic theory of utility ever developed”. Instead assuming the probability of an event, Savage defines it in terms of preferences over acts. Savage used the states (something that is not in your control) to calculate the probability of an event. On the other hand, he used utility and intrinsic preferences to predict the outcome of the event. Savage assumed that each act and state are enough to uniquely determine an outcome. However, this assumption breaks in the cases where the individual doesn't have enough information about the event. Additionally, he believed that outcomes must have the same utility regardless of the state. For that reason, it is essential to correctly identify which statement is considered an outcome. For example, if someone says “I got the job” this affirmation is not considered an outcome, since the utility of the statement will be different on each person depending on intrinsic factors such as financial necessity or judgments about the company. For that reason, no state can rule out the performance of any act, only when the state and the act are evaluated simultaneously you will be able to determine an outcome with certainty. Savage's Representation Theorem Savage Representation Theorem (Savage, 1954) A preference < satisfies P1-P7 if and only if there is a finitely additive probability measure P and a function u : C → R such that for every pair of acts f and g. f < g ⇐⇒ Z Ω u(f(ω)) dP ≥ Z Ω u(g(ω)) dP *If and only if all the axioms are satisfied when can used the information to reduce the uncertainty about the events that are out of your control. Additionally the theorem ranks the outcome according to utility function that reflects the personal preferences. Key Ingredients: The key ingredients in Savage's theory are: States: The specification of every aspect of the decision problem at hand or “A description of the world leaving no relevant aspect undescribed.” Events: A set of states identified by someone Consequences: A consequence is the description of all that is relevant to the decision maker's utility (e.g. monetary rewards, psychological factors, etc) Acts: An act is a finite-valued function that maps states to consequences. Von Neumann–Morgenstern utility theorem The von Neumann–Morgenstern axioms There are four axioms of the expected utility theory that define a rational decision maker. They are completeness, transitivity, independence and continuity. Completeness assumes that an individual has well defined preferences and can always decide between any two alternatives. Axiom (Completeness): For every A and B either or or both. This means that the individual prefers A to B, B to A or is indifferent between A and B. Transitivity assumes that, as an individual decides according to the completeness axiom, the individual also decides consistently. Axiom (Transitivity): For every A, B and C with and we must have . Independence of irrelevant alternatives pertains to well-defined preferences as well. It assumes that two gambles mixed with an irrelevant third one will maintain the same order of preference as when the two are presented independently of the third one. The independence axiom is the most controversial axiom.. Axiom (Independence of irrelevant alternatives): Let A, B, and C be three lotteries with , and let be the probability that a third choice is present: ; if then the third choice, C, is irrelevant, and the order of preference for A before B holds, independently of the presence of C. Continuity assumes that when there are three lotteries (A, B and C) and the individual prefers A to B and B to C, then there should be a possible combination of A and C in which the individual is then indifferent between this mix and the lottery B. Axiom (Continuity): Let A, B and C be lotteries with ; then there exists a probability p such that B is equally good as . If all these axioms are satisfied, then the individual is said to be rational and the preferences can be represented by a utility function, i.e. one can assign numbers (utilities) to each outcome of the lottery such that choosing the best lottery according to the preference amounts to choosing the lottery with the highest expected utility. This result is called the von Neumann–Morgenstern utility representation theorem. In other words, if an individual's behavior always satisfies the above axioms, then there is a utility function such that the individual will choose one gamble over another if and only if the expected utility of one exceeds that of the other. The expected utility of any gamble may be expressed as a linear combination of the utilities of the outcomes, with the weights being the respective probabilities. Utility functions are also normally continuous functions. Such utility functions are also referred to as von Neumann–Morgenstern (vNM) utility functions. This is a central theme of the expected utility hypothesis in which an individual chooses not the highest expected value, but rather the highest expected utility. The expected utility maximizing individual makes decisions rationally based on the axioms of the theory. The von Neumann–Morgenstern formulation is important in the application of set theory to economics because it was developed shortly after the Hicks–Allen "ordinal revolution" of the 1930s, and it revived the idea of cardinal utility in economic theory. However, while in this context the utility function is cardinal, in that implied behavior would be altered by a non-linear monotonic transformation of utility, the expected utility function is ordinal because any monotonic increasing transformation of expected utility gives the same behavior. Examples of von Neumann–Morgenstern utility functions The utility function was originally suggested by Bernoulli (see above). It has relative risk aversion constant and equal to one, and is still sometimes assumed in economic analyses. The utility function exhibits constant absolute risk aversion, and for this reason is often avoided, although it has the advantage of offering substantial mathematical tractability when asset returns are normally distributed. Note that, as per the affine transformation property alluded to above, the utility function gives exactly the same preferences orderings as does ; thus it is irrelevant that the values of and its expected value are always negative: what matters for preference ordering is which of two gambles gives the higher expected utility, not the numerical values of those expected utilities. The class of constant relative risk aversion utility functions contains three categories. Bernoulli's utility function has relative risk aversion equal to 1. The functions for have relative risk aversion equal to . And the functions for have relative risk aversion equal to See also the discussion of utility functions having hyperbolic absolute risk aversion (HARA). Formula for Expected Utility When the entity whose value affects a person's utility takes on one of a set of discrete values, the formula for expected utility, which is assumed to be maximized, is where the left side is the subjective valuation of the gamble as a whole, is the ith possible outcome, is its valuation, and is its probability. There could be either a finite set of possible values in which case the right side of this equation has a finite number of terms; or there could be an infinite set of discrete values, in which case the right side has an infinite number of terms. When can take on any of a continuous range of values, the expected utility is given by where is the probability density function of Measuring risk in the expected utility context Often people refer to "risk" in the sense of a potentially quantifiable entity. In the context of mean-variance analysis, variance is used as a risk measure for portfolio return; however, this is only valid if returns are normally distributed or otherwise jointly elliptically distributed, or in the unlikely case in which the utility function has a quadratic form. However, David E. Bell proposed a measure of risk which follows naturally from a certain class of von Neumann–Morgenstern utility functions. Let utility of wealth be given by for individual-specific positive parameters a and b. Then expected utility is given by Thus the risk measure is , which differs between two individuals if they have different values of the parameter allowing different people to disagree about the degree of risk associated with any given portfolio. Individuals sharing a given risk measure (based on given value of a) may choose different portfolios because they may have different values of b. See also Entropic risk measure. For general utility functions, however, expected utility analysis does not permit the expression of preferences to be separated into two parameters with one representing the expected value of the variable in question and the other representing its risk. Criticism Expected utility theory is a theory about how to make optimal decisions under a given probability of risk. It has a normative interpretation which economists used to think applies in all situations to rational agents but now tend to regard as a useful and insightful first order approximation. In empirical applications, a number of violations have been proven to be systematic and these falsifications have deepened understanding of how people actually decide. Daniel Kahneman and Amos Tversky in 1979 presented their prospect theory which showed empirically, how preferences of individuals are inconsistent among the same choices, depending on how those choices are presented. This is mainly because people are different in terms of their preferences and parameters. Additionally, personal behaviors may be different between individuals even when they are facing the same choice problem. Like any mathematical model, expected utility theory is a simplification of reality. The mathematical correctness of expected utility theory and the salience of its primitive concepts do not guarantee that expected utility theory is a reliable guide to human behavior or optimal practice. The mathematical clarity of expected utility theory has helped scientists design experiments to test its adequacy, and to distinguish systematic departures from its predictions. This has led to the field of behavioral finance, which has produced deviations from expected utility theory to account for the empirical facts. Other critics argue applying expected utility to economic and policy decisions, has engendered inappropriate valuations, particularly in scenarios in which monetary units are used to scale the utility of nonmonetary outcomes, such as deaths. Conservatism in updating beliefs Psychologists have discovered systematic violations of probability calculations and behavior by humans. This have been evidenced with examples such as the Monty Hall problem where it was demonstrated that people do not revise their degrees on belief in line with experimented probabilities and also that probabilities cannot be apply to single cases. On the other hand, in updating probability distributions using evidence, a standard method uses conditional probability, namely the rule of Bayes. An experiment on belief revision has suggested that humans change their beliefs faster when using Bayesian methods than when using informal judgment.Subjects changed their beliefs faster by conditioning on evidence (Bayes's theorem) than by using informal reasoning, according to a classic study by the psychologist Ward Edwards: According to the empirical results there has been almost no recognition in decision theory of the distinction between the problem of justifying its theoretical claims regarding the properties of rational belief and desire. One of the main reasons is because people's basic tastes and preferences for losses cannot be represented with utility as they change under different scenarios. Irrational deviations Behavioral finance has produced several generalized expected utility theories to account for instances where people's choices deviate from those predicted by expected utility theory. These deviations are described as "irrational" because they can depend on the way the problem is presented, not on the actual costs, rewards, or probabilities involved. Particular theories include prospect theory, rank-dependent expected utility and cumulative prospect theory are considered insufficient to predict preferences and the expected utility. Additionally, experiments have shown systematic violations and generalizations based on the results of Savage and von Neumann–Morgenstern. This is because preferences and utility functions constructed under different contexts are significantly different. This is demonstrated in the contrast of individual preferences under the insurance and lottery context shows the degree of indeterminacy of the expected utility theory. Additionally, experiments have shown systematic violations and generalizations based on the results of Savage and von Neumann–Morgenstern. In practice there will be many situations where the probabilities are unknown, and one is operating under uncertainty. In economics, Knightian uncertainty or ambiguity may occur. Thus one must make assumptions about the probabilities, but then the expected values of various decisions can be very sensitive to the assumptions. This is particularly a problem when the expectation is dominated by rare extreme events, as in a long-tailed distribution. Alternative decision techniques are robust to uncertainty of probability of outcomes, either not depending on probabilities of outcomes and only requiring scenario analysis (as in minimax or minimax regret), or being less sensitive to assumptions. Bayesian approaches to probability treat it as a degree of belief and thus they do not draw a distinction between risk and a wider concept of uncertainty: they deny the existence of Knightian uncertainty. They would model uncertain probabilities with hierarchical models, i.e. where the uncertain probabilities are modelled as distributions whose parameters are themselves drawn from a higher-level distribution (hyperpriors). Preference reversals over uncertain outcomes Starting with studies such as Lichtenstein & Slovic (1971), it was discovered that subjects sometimes exhibit signs of preference reversals with regard to their certainty equivalents of different lotteries. Specifically, when eliciting certainty equivalents, subjects tend to value "p bets" (lotteries with a high chance of winning a low prize) lower than "$ bets" (lotteries with a small chance of winning a large prize). When subjects are asked which lotteries they prefer in direct comparison, however, they frequently prefer the "p bets" over "$ bets". Many studies have examined this "preference reversal", from both an experimental (e.g., Plott & Grether, 1979) and theoretical (e.g., Holt, 1986) standpoint, indicating that this behavior can be brought into accordance with neoclassical economic theory under specific assumptions.
The St. Petersburg Paradox The St. Petersburg paradox created by Nicolas Bernoulli (cousin of Daniel Bernoulli) empirically discovered that the decisions of rational individuals sometimes violate the axioms of preferences. When a probability distribution function has an infinite expected value, it is expected that a rational person would pay an arbitrarily large finite amount to take this gamble. However, this experiment demonstrated that there is no upper bound on the potential rewards from very low probability events. In his experimental game, a person had to flip a coin as many times as possible until it was tails. The participant's prize will be determined by the number of times the coin was turned heads consecutively. For every time the coin comes up heads (1/2 probability), the participant's prize will be doubled. The game ends when the participant flips the coin and it comes out a tail. According to the axioms of preferences, a player should be willing to pay a high price to play because his entry cost will always be less than the expected value of the game, since he could potentially win an infinite payout. However, in reality, people don't do this. “Only a few of the participants were willing to pay a maximum of $25 to enter the game because many of them were risk averse and unwilling to bet on a very small possibility at a very high price. Bernoulli's Formulation Nicolas Bernoulli described the St. Petersburg paradox (involving infinite expected values) in 1713, prompting two Swiss mathematicians to develop expected utility theory as a solution. Bernoulli's paper was the first formalization of marginal utility, which has broad application in economics in addition to expected utility theory. He used this concept to formalize the idea that the same amount of additional money was less useful to an already-wealthy person than it would be to a poor person. The theory can also more accurately describe more realistic scenarios (where expected values are finite) than expected value alone, He proposed that a nonlinear function of utility of an outcome should be used instead of the expected value of an outcome, accounting for risk aversion, where the risk premium is higher for low-probability events than the difference between the payout level of a particular outcome and its expected value. Bernoulli further proposed that it was not the goal of the gambler to maximize his expected gain but to instead maximize the logarithm of his gain. Nicolas Bernoulli drew attention to psychological and behavioral behind the individual's decision-making process and found that the utility of wealth has a diminishing marginal utility. For example, as someone gets wealthier, an extra dollar or an additional good is perceived as less valuable. In other words, he found that the desirability related with a financial gain depends not only on the gain itself buy also on the wealth of the person. He suggested that people maximize "moral expectation" rather than expected monetary value. Bernoulli made a clear distinction between expected value and expected utility. Instead of using the weighted outcomes, he used the weighted utility multiplied by probabilities. He proved that the utility function used in real life means is finite, even when its expected value is infinite. Other experiments proposed that very low probability events are neglected by considering the finite resources of the participants. For example, it makes rational sense for a rich person, but not for a poor person to pay 10,000USD in exchange for a lottery ticket that yields a 50\% chance of winning and a 50\% chance of nothing. Even though both individuals have the same chance at each monetary price, they will assign different values to the potential outcomes , according to their income levels. Bernoulli's paper was the first formalization of marginal utility, which has broad application in economics in addition to expected utility theory. Ramsey's Theoretic Approach to Subjective Probability In 1926, Frank Ramsey introduced the Ramsey's Representation Theorem. This representation theorem for expected utility assumed that preferences are defined over set of bets where each option has a different yield. Ramsey believed that we always choose decisions to receive the best expected outcome according to our personal preferences. This implies that if we are able to understand the priorities and personal preferences of an individual we can anticipate what choices they are going to take. In this model he defined numerical utilities for each option to exploit the richness of the space of prices. The outcome of each preference is exclusive from each other. For example, if you study, then you can't see your friends, however you will get a good grade in your course. In this scenario, if we analyze what are his personal preferences and beliefs we will be able to predict which he might choose. (e.g. if someone prioritizes more his social life than academic results, they will go out with their friends). Assuming that the decisions of a person are rational, according to this theorem we should be able to know the beliefs and utilities from a person just by looking the choices someone takes (which is wrong). Ramsey defines a proposition as “ethically neutral” when two possible outcome has an equal value. In other words, if the probability can be defined in terms of preference, each proposition should have ½ in order to be indifferent between both options. Ramsey shows that: P(E)=(1−U(m)(U(b)−U(w)) Savage's Subjective Expected Utility Representation In the 1950s, Leonard Jimmie Savage, an American statistician, derived a framework for comprehending expected utility. At that point, it was considered the first and most thorough foundation to understanding the concept. Savage's framework involved proving that expected utility could be used to make an optimal choice among several acts through seven axioms. In his book, The Foundations of Statistics, Savage integrated a normative account of decision making under risk (when probabilities are known) and under uncertainty (when probabilities are not objectively known). Savage concluded that people have neutral attitudes towards uncertainty and that observation is enough to predict the probabilities of uncertain events. A crucial methodological aspect of Savage's framework is its focus on observable choices. Cognitive processes and other psychological aspects of decision making matter only to the extent that they have directly measurable implications on choice. The theory of subjective expected utility combines two concepts: first, a personal utility function, and second a personal probability distribution (usually based on Bayesian probability theory). This theoretical model has been known for its clear and elegant structure and its considered for some researchers one of “the most brilliant axiomatic theory of utility ever developed”. Instead assuming the probability of an event, Savage defines it in terms of preferences over acts. Savage used the states (something that is not in your control) to calculate the probability of an event. On the other hand, he used utility and intrinsic preferences to predict the outcome of the event. Savage assumed that each act and state are enough to uniquely determine an outcome. However, this assumption breaks in the cases where the individual doesn't have enough information about the event. Additionally, he believed that outcomes must have the same utility regardless of the state. For that reason, it is essential to correctly identify which statement is considered an outcome. For example, if someone says “I got the job” this affirmation is not considered an outcome, since the utility of the statement will be different on each person depending on intrinsic factors such as financial necessity or judgments about the company. For that reason, no state can rule out the performance of any act, only when the state and the act are evaluated simultaneously you will be able to determine an outcome with certainty. Savage's Representation Theorem Savage Representation Theorem (Savage, 1954) A preference < satisfies P1-P7 if and only if there is a finitely additive probability measure P and a function u : C → R such that for every pair of acts f and g. f < g ⇐⇒ Z Ω u(f(ω)) dP ≥ Z Ω u(g(ω)) dP *If and only if all the axioms are satisfied when can used the information to reduce the uncertainty about the events that are out of your control. Additionally the theorem ranks the outcome according to utility function that reflects the personal preferences. Key Ingredients: The key ingredients in Savage's theory are: States: The specification of every aspect of the decision problem at hand or “A description of the world leaving no relevant aspect undescribed.” Events: A set of states identified by someone Consequences: A consequence is the description of all that is relevant to the decision maker's utility (e.g. monetary rewards, psychological factors, etc) Acts: An act is a finite-valued function that maps states to consequences. Von Neumann–Morgenstern utility theorem The von Neumann–Morgenstern axioms There are four axioms of the expected utility theory that define a rational decision maker. They are completeness, transitivity, independence and continuity. Completeness assumes that an individual has well defined preferences and can always decide between any two alternatives. Axiom (Completeness): For every A and B either or or both. This means that the individual prefers A to B, B to A or is indifferent between A and B. Transitivity assumes that, as an individual decides according to the completeness axiom, the individual also decides consistently. Axiom (Transitivity): For every A, B and C with and we must have . Independence of irrelevant alternatives pertains to well-defined preferences as well. It assumes that two gambles mixed with an irrelevant third one will maintain the same order of preference as when the two are presented independently of the third one. The independence axiom is the most controversial axiom.. Axiom (Independence of irrelevant alternatives): Let A, B, and C be three lotteries with , and let be the probability that a third choice is present: ; if then the third choice, C, is irrelevant, and the order of preference for A before B holds, independently of the presence of C. Continuity assumes that when there are three lotteries (A, B and C) and the individual prefers A to B and B to C, then there should be a possible combination of A and C in which the individual is then indifferent between this mix and the lottery B. Axiom (Continuity): Let A, B and C be lotteries with ; then there exists a probability p such that B is equally good as . If all these axioms are satisfied, then the individual is said to be rational and the preferences can be represented by a utility function, i.e. one can assign numbers (utilities) to each outcome of the lottery such that choosing the best lottery according to the preference amounts to choosing the lottery with the highest expected utility. This result is called the von Neumann–Morgenstern utility representation theorem. In other words, if an individual's behavior always satisfies the above axioms, then there is a utility function such that the individual will choose one gamble over another if and only if the expected utility of one exceeds that of the other. The expected utility of any gamble may be expressed as a linear combination of the utilities of the outcomes, with the weights being the respective probabilities. Utility functions are also normally continuous functions. Such utility functions are also referred to as von Neumann–Morgenstern (vNM) utility functions. This is a central theme of the expected utility hypothesis in which an individual chooses not the highest expected value, but rather the highest expected utility. The expected utility maximizing individual makes decisions rationally based on the axioms of the theory. The von Neumann–Morgenstern formulation is important in the application of set theory to economics because it was developed shortly after the Hicks–Allen "ordinal revolution" of the 1930s, and it revived the idea of cardinal utility in economic theory. However, while in this context the utility function is cardinal, in that implied behavior would be altered by a non-linear monotonic transformation of utility, the expected utility function is ordinal because any monotonic increasing transformation of expected utility gives the same behavior. Examples of von Neumann–Morgenstern utility functions The utility function was originally suggested by Bernoulli (see above). It has relative risk aversion constant and equal to one, and is still sometimes assumed in economic analyses. The utility function exhibits constant absolute risk aversion, and for this reason is often avoided, although it has the advantage of offering substantial mathematical tractability when asset returns are normally distributed. Note that, as per the affine transformation property alluded to above, the utility function gives exactly the same preferences orderings as does ; thus it is irrelevant that the values of and its expected value are always negative: what matters for preference ordering is which of two gambles gives the higher expected utility, not the numerical values of those expected utilities. The class of constant relative risk aversion utility functions contains three categories. Bernoulli's utility function has relative risk aversion equal to 1. The functions for have relative risk aversion equal to . And the functions for have relative risk aversion equal to See also the discussion of utility functions having hyperbolic absolute risk aversion (HARA). Formula for Expected Utility When the entity whose value affects a person's utility takes on one of a set of discrete values, the formula for expected utility, which is assumed to be maximized, is where the left side is the subjective valuation of the gamble as a whole, is the ith possible outcome, is its valuation, and is its probability. There could be either a finite set of possible values in which case the right side of this equation has a finite number of terms; or there could be an infinite set of discrete values, in which case the right side has an infinite number of terms. When can take on any of a continuous range of values, the expected utility is given by where is the probability density function of Measuring risk in the expected utility context Often people refer to "risk" in the sense of a potentially quantifiable entity. In the context of mean-variance analysis, variance is used as a risk measure for portfolio return; however, this is only valid if returns are normally distributed or otherwise jointly elliptically distributed, or in the unlikely case in which the utility function has a quadratic form. However, David E. Bell proposed a measure of risk which follows naturally from a certain class of von Neumann–Morgenstern utility functions. Let utility of wealth be given by for individual-specific positive parameters a and b. Then expected utility is given by Thus the risk measure is , which differs between two individuals if they have different values of the parameter allowing different people to disagree about the degree of risk associated with any given portfolio. Individuals sharing a given risk measure (based on given value of a) may choose different portfolios because they may have different values of b. See also Entropic risk measure. For general utility functions, however, expected utility analysis does not permit the expression of preferences to be separated into two parameters with one representing the expected value of the variable in question and the other representing its risk. Criticism Expected utility theory is a theory about how to make optimal decisions under a given probability of risk. It has a normative interpretation which economists used to think applies in all situations to rational agents but now tend to regard as a useful and insightful first order approximation. In empirical applications, a number of violations have been proven to be systematic and these falsifications have deepened understanding of how people actually decide. Daniel Kahneman and Amos Tversky in 1979 presented their prospect theory which showed empirically, how preferences of individuals are inconsistent among the same choices, depending on how those choices are presented. This is mainly because people are different in terms of their preferences and parameters. Additionally, personal behaviors may be different between individuals even when they are facing the same choice problem. Like any mathematical model, expected utility theory is a simplification of reality. The mathematical correctness of expected utility theory and the salience of its primitive concepts do not guarantee that expected utility theory is a reliable guide to human behavior or optimal practice. The mathematical clarity of expected utility theory has helped scientists design experiments to test its adequacy, and to distinguish systematic departures from its predictions. This has led to the field of behavioral finance, which has produced deviations from expected utility theory to account for the empirical facts. Other critics argue applying expected utility to economic and policy decisions, has engendered inappropriate valuations, particularly in scenarios in which monetary units are used to scale the utility of nonmonetary outcomes, such as deaths. Conservatism in updating beliefs Psychologists have discovered systematic violations of probability calculations and behavior by humans. This have been evidenced with examples such as the Monty Hall problem where it was demonstrated that people do not revise their degrees on belief in line with experimented probabilities and also that probabilities cannot be apply to single cases. On the other hand, in updating probability distributions using evidence, a standard method uses conditional probability, namely the rule of Bayes. An experiment on belief revision has suggested that humans change their beliefs faster when using Bayesian methods than when using informal judgment.Subjects changed their beliefs faster by conditioning on evidence (Bayes's theorem) than by using informal reasoning, according to a classic study by the psychologist Ward Edwards: According to the empirical results there has been almost no recognition in decision theory of the distinction between the problem of justifying its theoretical claims regarding the properties of rational belief and desire. One of the main reasons is because people's basic tastes and preferences for losses cannot be represented with utility as they change under different scenarios. Irrational deviations Behavioral finance has produced several generalized expected utility theories to account for instances where people's choices deviate from those predicted by expected utility theory. These deviations are described as "irrational" because they can depend on the way the problem is presented, not on the actual costs, rewards, or probabilities involved. Particular theories include prospect theory, rank-dependent expected utility and cumulative prospect theory are considered insufficient to predict preferences and the expected utility. Additionally, experiments have shown systematic violations and generalizations based on the results of Savage and von Neumann–Morgenstern. This is because preferences and utility functions constructed under different contexts are significantly different. This is demonstrated in the contrast of individual preferences under the insurance and lottery context shows the degree of indeterminacy of the expected utility theory. Additionally, experiments have shown systematic violations and generalizations based on the results of Savage and von Neumann–Morgenstern. In practice there will be many situations where the probabilities are unknown, and one is operating under uncertainty. In economics, Knightian uncertainty or ambiguity may occur. Thus one must make assumptions about the probabilities, but then the expected values of various decisions can be very sensitive to the assumptions. This is particularly a problem when the expectation is dominated by rare extreme events, as in a long-tailed distribution. Alternative decision techniques are robust to uncertainty of probability of outcomes, either not depending on probabilities of outcomes and only requiring scenario analysis (as in minimax or minimax regret), or being less sensitive to assumptions. Bayesian approaches to probability treat it as a degree of belief and thus they do not draw a distinction between risk and a wider concept of uncertainty: they deny the existence of Knightian uncertainty. They would model uncertain probabilities with hierarchical models, i.e. where the uncertain probabilities are modelled as distributions whose parameters are themselves drawn from a higher-level distribution (hyperpriors). Preference reversals over uncertain outcomes Starting with studies such as Lichtenstein & Slovic (1971), it was discovered that subjects sometimes exhibit signs of preference reversals with regard to their certainty equivalents of different lotteries. Specifically, when eliciting certainty equivalents, subjects tend to value "p bets" (lotteries with a high chance of winning a low prize) lower than "$ bets" (lotteries with a small chance of winning a large prize). When subjects are asked which lotteries they prefer in direct comparison, however, they frequently prefer the "p bets" over "$ bets". Many studies have examined this "preference reversal", from both an experimental (e.g., Plott & Grether, 1979) and theoretical (e.g., Holt, 1986) standpoint, indicating that this behavior can be brought into accordance with neoclassical economic theory under specific assumptions.
R
$25 to enter the game because many of them were risk averse and unwilling to bet on a very small possibility at a very high price. Bernoulli's Formulation Nicolas Bernoulli described the St. Petersburg paradox (involving infinite expected values) in 1713, prompting two Swiss mathematicians to develop expected utility theory as a solution. Bernoulli's paper was the first formalization of marginal utility, which has broad application in economics in addition to expected utility theory. He used this concept to formalize the idea that the same amount of additional money was less useful to an already-wealthy person than it would be to a poor person. The theory can also more accurately describe more realistic scenarios (where expected values are finite) than expected value alone, He proposed that a nonlinear function of utility of an outcome should be used instead of the expected value of an outcome, accounting for risk aversion, where the risk premium is higher for low-probability events than the difference between the payout level of a particular outcome and its expected value. Bernoulli further proposed that it was not the goal of the gambler to maximize his expected gain but to instead maximize the logarithm of his gain. Nicolas Bernoulli drew attention to psychological and behavioral behind the individual's decision-making process and found that the utility of wealth has a diminishing marginal utility. For example, as someone gets wealthier, an extra dollar or an additional good is perceived as less valuable. In other words, he found that the desirability related with a financial gain depends not only on the gain itself buy also on the wealth of the person. He suggested that people maximize "moral expectation" rather than expected monetary value. Bernoulli made a clear distinction between expected value and expected utility. Instead of using the weighted outcomes, he used the weighted utility multiplied by probabilities. He proved that the utility function used in real life means is finite, even when its expected value is infinite. Other experiments proposed that very low probability events are neglected by considering the finite resources of the participants. For example, it makes rational sense for a rich person, but not for a poor person to pay 10,000USD in exchange for a lottery ticket that yields a 50\% chance of winning and a 50\% chance of nothing. Even though both individuals have the same chance at each monetary price, they will assign different values to the potential outcomes , according to their income levels. Bernoulli's paper was the first formalization of marginal utility, which has broad application in economics in addition to expected utility theory. Ramsey's Theoretic Approach to Subjective Probability In 1926, Frank Ramsey introduced the Ramsey's Representation Theorem. This representation theorem for expected utility assumed that preferences are defined over set of bets where each option has a different yield. Ramsey believed that we always choose decisions to receive the best expected outcome according to our personal preferences. This implies that if we are able to understand the priorities and personal preferences of an individual we can anticipate what choices they are going to take. In this model he defined numerical utilities for each option to exploit the richness of the space of prices. The outcome of each preference is exclusive from each other. For example, if you study, then you can't see your friends, however you will get a good grade in your course. In this scenario, if we analyze what are his personal preferences and beliefs we will be able to predict which he might choose. (e.g. if someone prioritizes more his social life than academic results, he will go out with her friends). Assuming that the decisions of a person are rational, according to this theorem we should be able to know the beliefs and utilities from a person just by looking the choices someone takes (which is wrong). Ramsey defines a proposition as “ethically neutral” when two possible outcome has an equal value. In other words, if the probability can be defined in terms of preference, each proposition should have ½ in order to be indifferent between both options. Ramsey shows that: P(E)=(1−U(m)(U(b)−U(w)) Savage's Subjective Expected Utility Representation In the 1950s, Leonard Jimmie Savage, an American statistician, derived a framework for comprehending expected utility. At that point, it was considered the first and most thorough foundation to understanding the concept. Savage's framework involved proving that expected utility could be used to make an optimal choice among several acts through seven axioms. In his book, The Foundations of Statistics, Savage integrated a normative account of decision making under risk (when probabilities are known) and under uncertainty (when probabilities are not objectively known). Savage concluded that people have neutral attitudes towards uncertainty and that observation is enough to predict the probabilities of uncertain events. A crucial methodological aspect of Savage's framework is its focus on observable choices. Cognitive processes and other psychological aspects of decision making matter only to the extent that they have directly measurable implications on choice. The theory of subjective expected utility combines two concepts: first, a personal utility function, and second a personal probability distribution (usually based on Bayesian probability theory). This theoretical model has been known for its clear and elegant structure and its considered for some researchers one of “the most brilliant axiomatic theory of utility ever developed”. Instead assuming the probability of an event, Savage defines it in terms of preferences over acts. Savage used the states (something that is not in your control) to calculate the probability of an event. On the other hand, he used utility and intrinsic preferences to predict the outcome of the event. Savage assumed that each act and state are enough to uniquely determine an outcome. However, this assumption breaks in the cases where the individual doesn't have enough information about the event. Additionally, he believed that outcomes must have the same utility regardless of the state. For that reason, it is essential to correctly identify which statement is considered an outcome. For example, if someone says “I got the job” this affirmation is not considered an outcome, since the utility of the statement will be different on each person depending on intrinsic factors such as financial necessity or judgments about the company. For that reason, no state can rule out the performance of any act, only when the state and the act are evaluated simultaneously you will be able to determine an outcome with certainty. Savage's Representation Theorem Savage Representation Theorem (Savage, 1954) A preference < satisfies P1-P7 if and only if there is a finitely additive probability measure P and a function u : C → R such that for every pair of acts f and g. f < g ⇐⇒ Z Ω u(f(ω)) dP ≥ Z Ω u(g(ω)) dP *If and only if all the axioms are satisfied when can used the information to reduce the uncertainty about the events that are out of your control. Additionally the theorem ranks the outcome according to utility function that reflects the personal preferences. Key Ingredients: The key ingredients in Savage's theory are: States: The specification of every aspect of the decision problem at hand or “A description of the world leaving no relevant aspect undescribed.” Events: A set of states identified by someone Consequences: A consequence is the description of all that is relevant to the decision maker's utility (e.g. monetary rewards, psychological factors, etc) Acts: An act is a finite-valued function that maps states to consequences. Von Neumann–Morgenstern utility theorem The von Neumann–Morgenstern axioms There are four axioms of the expected utility theory that define a rational decision maker. They are completeness, transitivity, independence and continuity. Completeness assumes that an individual has well defined preferences and can always decide between any two alternatives. Axiom (Completeness): For every A and B either or or both. This means that the individual prefers A to B, B to A or is indifferent between A and B. Transitivity assumes that, as an individual decides according to the completeness axiom, the individual also decides consistently. Axiom (Transitivity): For every A, B and C with and we must have . Independence of irrelevant alternatives pertains to well-defined preferences as well. It assumes that two gambles mixed with an irrelevant third one will maintain the same order of preference as when the two are presented independently of the third one. The independence axiom is the most controversial axiom.. Axiom (Independence of irrelevant alternatives): Let A, B, and C be three lotteries with , and let be the probability that a third choice is present: ; if then the third choice, C, is irrelevant, and the order of preference for A before B holds, independently of the presence of C. Continuity assumes that when there are three lotteries (A, B and C) and the individual prefers A to B and B to C, then there should be a possible combination of A and C in which the individual is then indifferent between this mix and the lottery B. Axiom (Continuity): Let A, B and C be lotteries with ; then there exists a probability p such that B is equally good as . If all these axioms are satisfied, then the individual is said to be rational and the preferences can be represented by a utility function, i.e. one can assign numbers (utilities) to each outcome of the lottery such that choosing the best lottery according to the preference amounts to choosing the lottery with the highest expected utility. This result is called the von Neumann–Morgenstern utility representation theorem. In other words, if an individual's behavior always satisfies the above axioms, then there is a utility function such that the individual will choose one gamble over another if and only if the expected utility of one exceeds that of the other. The expected utility of any gamble may be expressed as a linear combination of the utilities of the outcomes, with the weights being the respective probabilities. Utility functions are also normally continuous functions. Such utility functions are also referred to as von Neumann–Morgenstern (vNM) utility functions. This is a central theme of the expected utility hypothesis in which an individual chooses not the highest expected value, but rather the highest expected utility. The expected utility maximizing individual makes decisions rationally based on the axioms of the theory. The von Neumann–Morgenstern formulation is important in the application of set theory to economics because it was developed shortly after the Hicks–Allen "ordinal revolution" of the 1930s, and it revived the idea of cardinal utility in economic theory. However, while in this context the utility function is cardinal, in that implied behavior would be altered by a non-linear monotonic transformation of utility, the expected utility function is ordinal because any monotonic increasing transformation of expected utility gives the same behavior. Examples of von Neumann–Morgenstern utility functions The utility function was originally suggested by Bernoulli (see above). It has relative risk aversion constant and equal to one, and is still sometimes assumed in economic analyses. The utility function exhibits constant absolute risk aversion, and for this reason is often avoided, although it has the advantage of offering substantial mathematical tractability when asset returns are normally distributed. Note that, as per the affine transformation property alluded to above, the utility function gives exactly the same preferences orderings as does ; thus it is irrelevant that the values of and its expected value are always negative: what matters for preference ordering is which of two gambles gives the higher expected utility, not the numerical values of those expected utilities. The class of constant relative risk aversion utility functions contains three categories. Bernoulli's utility function has relative risk aversion equal to 1. The functions for have relative risk aversion equal to . And the functions for have relative risk aversion equal to See also the discussion of utility functions having hyperbolic absolute risk aversion (HARA). Formula for Expected Utility When the entity whose value affects a person's utility takes on one of a set of discrete values, the formula for expected utility, which is assumed to be maximized, is where the left side is the subjective valuation of the gamble as a whole, is the ith possible outcome, is its valuation, and is its probability. There could be either a finite set of possible values in which case the right side of this equation has a finite number of terms; or there could be an infinite set of discrete values, in which case the right side has an infinite number of terms. When can take on any of a continuous range of values, the expected utility is given by where is the probability density function of Measuring risk in the expected utility context Often people refer to "risk" in the sense of a potentially quantifiable entity. In the context of mean-variance analysis, variance is used as a risk measure for portfolio return; however, this is only valid if returns are normally distributed or otherwise jointly elliptically distributed, or in the unlikely case in which the utility function has a quadratic form. However, David E. Bell proposed a measure of risk which follows naturally from a certain class of von Neumann–Morgenstern utility functions. Let utility of wealth be given by for individual-specific positive parameters a and b. Then expected utility is given by Thus the risk measure is , which differs between two individuals if they have different values of the parameter allowing different people to disagree about the degree of risk associated with any given portfolio. Individuals sharing a given risk measure (based on given value of a) may choose different portfolios because they may have different values of b. See also Entropic risk measure. For general utility functions, however, expected utility analysis does not permit the expression of preferences to be separated into two parameters with one representing the expected value of the variable in question and the other representing its risk. Criticism Expected utility theory is a theory about how to make optimal decisions under a given probability of risk. It has a normative interpretation which economists used to think applies in all situations to rational agents but now tend to regard as a useful and insightful first order approximation. In empirical applications, a number of violations have been proven to be systematic and these falsifications have deepened understanding of how people actually decide. Daniel Kahneman and Amos Tversky in 1979 presented their prospect theory which showed empirically, how preferences of individuals are inconsistent among the same choices, depending on how those choices are presented. This is mainly because people are different in terms of their preferences and parameters. Additionally, personal behaviors may be different between individuals even when they are facing the same choice problem. Like any mathematical model, expected utility theory is a simplification of reality. The mathematical correctness of expected utility theory and the salience of its primitive concepts do not guarantee that expected utility theory is a reliable guide to human behavior or optimal practice. The mathematical clarity of expected utility theory has helped scientists design experiments to test its adequacy, and to distinguish systematic departures from its predictions. This has led to the field of behavioral finance, which has produced deviations from expected utility theory to account for the empirical facts. Other critics argue applying expected utility to economic and policy decisions, has engendered inappropriate valuations, particularly in scenarios in which monetary units are used to scale the utility of nonmonetary outcomes, such as deaths. Conservatism in updating beliefs Psychologists have discovered systematic violations of probability calculations and behavior by humans. This have been evidenced with examples such as the Monty Hall problem where it was demonstrated that people do not revise their degrees on belief in line with experimented probabilities and also that probabilities cannot be apply to single cases. On the other hand, in updating probability distributions using evidence, a standard method uses conditional probability, namely the rule of Bayes. An experiment on belief revision has suggested that humans change their beliefs faster when using Bayesian methods than when using informal judgment.Subjects changed their beliefs faster by conditioning on evidence (Bayes's theorem) than by using informal reasoning, according to a classic study by the psychologist Ward Edwards: According to the empirical results there has been almost no recognition in decision theory of the distinction between the problem of justifying its theoretical claims regarding the properties of rational belief and desire. One of the main reasons is because people's basic tastes and preferences for losses cannot be represented with utility as they change under different scenarios. Irrational deviations Behavioral finance has produced several generalized expected utility theories to account for instances where people's choices deviate from those predicted by expected utility theory. These deviations are described as "irrational" because they can depend on the way the problem is presented, not on the actual costs, rewards, or probabilities involved. Particular theories include prospect theory, rank-dependent expected utility and cumulative prospect theory are considered insufficient to predict preferences and the expected utility. Additionally, experiments have shown systematic violations and generalizations based on the results of Savage and von Neumann–Morgenstern. This is because preferences and utility functions constructed under different contexts are significantly different. This is demonstrated in the contrast of individual preferences under the insurance and lottery context shows the degree of indeterminacy of the expected utility theory. Additionally, experiments have shown systematic violations and generalizations based on the results of Savage and von Neumann–Morgenstern. In practice there will be many situations where the probabilities are unknown, and one is operating under uncertainty. In economics, Knightian uncertainty or ambiguity may occur. Thus one must make assumptions about the probabilities, but then the expected values of various decisions can be very sensitive to the assumptions. This is particularly a problem when the expectation is dominated by rare extreme events, as in a long-tailed distribution. Alternative decision techniques are robust to uncertainty of probability of outcomes, either not depending on probabilities of outcomes and only requiring scenario analysis (as in minimax or minimax regret), or being less sensitive to assumptions. Bayesian approaches to probability treat it as a degree of belief and thus they do not draw a distinction between risk and a wider concept of uncertainty: they deny the existence of Knightian uncertainty. They would model uncertain probabilities with hierarchical models, i.e. where the uncertain probabilities are modelled as distributions whose parameters are themselves drawn from a higher-level distribution (hyperpriors). Preference reversals over uncertain outcomes Starting with studies such as Lichtenstein & Slovic (1971), it was discovered that subjects sometimes exhibit signs of preference reversals with regard to their certainty equivalents of different lotteries. Specifically, when eliciting certainty equivalents, subjects tend to value "p bets" (lotteries with a high chance of winning a low prize) lower than "$
$25 to enter the game because many of them were risk averse and unwilling to bet on a very small possibility at a very high price. Bernoulli's Formulation Nicolas Bernoulli described the St. Petersburg paradox (involving infinite expected values) in 1713, prompting two Swiss mathematicians to develop expected utility theory as a solution. Bernoulli's paper was the first formalization of marginal utility, which has broad application in economics in addition to expected utility theory. He used this concept to formalize the idea that the same amount of additional money was less useful to an already-wealthy person than it would be to a poor person. The theory can also more accurately describe more realistic scenarios (where expected values are finite) than expected value alone, He proposed that a nonlinear function of utility of an outcome should be used instead of the expected value of an outcome, accounting for risk aversion, where the risk premium is higher for low-probability events than the difference between the payout level of a particular outcome and its expected value. Bernoulli further proposed that it was not the goal of the gambler to maximize his expected gain but to instead maximize the logarithm of his gain. Nicolas Bernoulli drew attention to psychological and behavioral behind the individual's decision-making process and found that the utility of wealth has a diminishing marginal utility. For example, as someone gets wealthier, an extra dollar or an additional good is perceived as less valuable. In other words, he found that the desirability related with a financial gain depends not only on the gain itself buy also on the wealth of the person. He suggested that people maximize "moral expectation" rather than expected monetary value. Bernoulli made a clear distinction between expected value and expected utility. Instead of using the weighted outcomes, he used the weighted utility multiplied by probabilities. He proved that the utility function used in real life means is finite, even when its expected value is infinite. Other experiments proposed that very low probability events are neglected by considering the finite resources of the participants. For example, it makes rational sense for a rich person, but not for a poor person to pay 10,000USD in exchange for a lottery ticket that yields a 50\% chance of winning and a 50\% chance of nothing. Even though both individuals have the same chance at each monetary price, they will assign different values to the potential outcomes , according to their income levels. Bernoulli's paper was the first formalization of marginal utility, which has broad application in economics in addition to expected utility theory. Ramsey's Theoretic Approach to Subjective Probability In 1926, Frank Ramsey introduced the Ramsey's Representation Theorem. This representation theorem for expected utility assumed that preferences are defined over set of bets where each option has a different yield. Ramsey believed that we always choose decisions to receive the best expected outcome according to our personal preferences. This implies that if we are able to understand the priorities and personal preferences of an individual we can anticipate what choices they are going to take. In this model he defined numerical utilities for each option to exploit the richness of the space of prices. The outcome of each preference is exclusive from each other. For example, if you study, then you can't see your friends, however you will get a good grade in your course. In this scenario, if we analyze what are his personal preferences and beliefs we will be able to predict which he might choose. (e.g. if someone prioritizes more his social life than academic results, they will go out with their friends). Assuming that the decisions of a person are rational, according to this theorem we should be able to know the beliefs and utilities from a person just by looking the choices someone takes (which is wrong). Ramsey defines a proposition as “ethically neutral” when two possible outcome has an equal value. In other words, if the probability can be defined in terms of preference, each proposition should have ½ in order to be indifferent between both options. Ramsey shows that: P(E)=(1−U(m)(U(b)−U(w)) Savage's Subjective Expected Utility Representation In the 1950s, Leonard Jimmie Savage, an American statistician, derived a framework for comprehending expected utility. At that point, it was considered the first and most thorough foundation to understanding the concept. Savage's framework involved proving that expected utility could be used to make an optimal choice among several acts through seven axioms. In his book, The Foundations of Statistics, Savage integrated a normative account of decision making under risk (when probabilities are known) and under uncertainty (when probabilities are not objectively known). Savage concluded that people have neutral attitudes towards uncertainty and that observation is enough to predict the probabilities of uncertain events. A crucial methodological aspect of Savage's framework is its focus on observable choices. Cognitive processes and other psychological aspects of decision making matter only to the extent that they have directly measurable implications on choice. The theory of subjective expected utility combines two concepts: first, a personal utility function, and second a personal probability distribution (usually based on Bayesian probability theory). This theoretical model has been known for its clear and elegant structure and its considered for some researchers one of “the most brilliant axiomatic theory of utility ever developed”. Instead assuming the probability of an event, Savage defines it in terms of preferences over acts. Savage used the states (something that is not in your control) to calculate the probability of an event. On the other hand, he used utility and intrinsic preferences to predict the outcome of the event. Savage assumed that each act and state are enough to uniquely determine an outcome. However, this assumption breaks in the cases where the individual doesn't have enough information about the event. Additionally, he believed that outcomes must have the same utility regardless of the state. For that reason, it is essential to correctly identify which statement is considered an outcome. For example, if someone says “I got the job” this affirmation is not considered an outcome, since the utility of the statement will be different on each person depending on intrinsic factors such as financial necessity or judgments about the company. For that reason, no state can rule out the performance of any act, only when the state and the act are evaluated simultaneously you will be able to determine an outcome with certainty. Savage's Representation Theorem Savage Representation Theorem (Savage, 1954) A preference < satisfies P1-P7 if and only if there is a finitely additive probability measure P and a function u : C → R such that for every pair of acts f and g. f < g ⇐⇒ Z Ω u(f(ω)) dP ≥ Z Ω u(g(ω)) dP *If and only if all the axioms are satisfied when can used the information to reduce the uncertainty about the events that are out of your control. Additionally the theorem ranks the outcome according to utility function that reflects the personal preferences. Key Ingredients: The key ingredients in Savage's theory are: States: The specification of every aspect of the decision problem at hand or “A description of the world leaving no relevant aspect undescribed.” Events: A set of states identified by someone Consequences: A consequence is the description of all that is relevant to the decision maker's utility (e.g. monetary rewards, psychological factors, etc) Acts: An act is a finite-valued function that maps states to consequences. Von Neumann–Morgenstern utility theorem The von Neumann–Morgenstern axioms There are four axioms of the expected utility theory that define a rational decision maker. They are completeness, transitivity, independence and continuity. Completeness assumes that an individual has well defined preferences and can always decide between any two alternatives. Axiom (Completeness): For every A and B either or or both. This means that the individual prefers A to B, B to A or is indifferent between A and B. Transitivity assumes that, as an individual decides according to the completeness axiom, the individual also decides consistently. Axiom (Transitivity): For every A, B and C with and we must have . Independence of irrelevant alternatives pertains to well-defined preferences as well. It assumes that two gambles mixed with an irrelevant third one will maintain the same order of preference as when the two are presented independently of the third one. The independence axiom is the most controversial axiom.. Axiom (Independence of irrelevant alternatives): Let A, B, and C be three lotteries with , and let be the probability that a third choice is present: ; if then the third choice, C, is irrelevant, and the order of preference for A before B holds, independently of the presence of C. Continuity assumes that when there are three lotteries (A, B and C) and the individual prefers A to B and B to C, then there should be a possible combination of A and C in which the individual is then indifferent between this mix and the lottery B. Axiom (Continuity): Let A, B and C be lotteries with ; then there exists a probability p such that B is equally good as . If all these axioms are satisfied, then the individual is said to be rational and the preferences can be represented by a utility function, i.e. one can assign numbers (utilities) to each outcome of the lottery such that choosing the best lottery according to the preference amounts to choosing the lottery with the highest expected utility. This result is called the von Neumann–Morgenstern utility representation theorem. In other words, if an individual's behavior always satisfies the above axioms, then there is a utility function such that the individual will choose one gamble over another if and only if the expected utility of one exceeds that of the other. The expected utility of any gamble may be expressed as a linear combination of the utilities of the outcomes, with the weights being the respective probabilities. Utility functions are also normally continuous functions. Such utility functions are also referred to as von Neumann–Morgenstern (vNM) utility functions. This is a central theme of the expected utility hypothesis in which an individual chooses not the highest expected value, but rather the highest expected utility. The expected utility maximizing individual makes decisions rationally based on the axioms of the theory. The von Neumann–Morgenstern formulation is important in the application of set theory to economics because it was developed shortly after the Hicks–Allen "ordinal revolution" of the 1930s, and it revived the idea of cardinal utility in economic theory. However, while in this context the utility function is cardinal, in that implied behavior would be altered by a non-linear monotonic transformation of utility, the expected utility function is ordinal because any monotonic increasing transformation of expected utility gives the same behavior. Examples of von Neumann–Morgenstern utility functions The utility function was originally suggested by Bernoulli (see above). It has relative risk aversion constant and equal to one, and is still sometimes assumed in economic analyses. The utility function exhibits constant absolute risk aversion, and for this reason is often avoided, although it has the advantage of offering substantial mathematical tractability when asset returns are normally distributed. Note that, as per the affine transformation property alluded to above, the utility function gives exactly the same preferences orderings as does ; thus it is irrelevant that the values of and its expected value are always negative: what matters for preference ordering is which of two gambles gives the higher expected utility, not the numerical values of those expected utilities. The class of constant relative risk aversion utility functions contains three categories. Bernoulli's utility function has relative risk aversion equal to 1. The functions for have relative risk aversion equal to . And the functions for have relative risk aversion equal to See also the discussion of utility functions having hyperbolic absolute risk aversion (HARA). Formula for Expected Utility When the entity whose value affects a person's utility takes on one of a set of discrete values, the formula for expected utility, which is assumed to be maximized, is where the left side is the subjective valuation of the gamble as a whole, is the ith possible outcome, is its valuation, and is its probability. There could be either a finite set of possible values in which case the right side of this equation has a finite number of terms; or there could be an infinite set of discrete values, in which case the right side has an infinite number of terms. When can take on any of a continuous range of values, the expected utility is given by where is the probability density function of Measuring risk in the expected utility context Often people refer to "risk" in the sense of a potentially quantifiable entity. In the context of mean-variance analysis, variance is used as a risk measure for portfolio return; however, this is only valid if returns are normally distributed or otherwise jointly elliptically distributed, or in the unlikely case in which the utility function has a quadratic form. However, David E. Bell proposed a measure of risk which follows naturally from a certain class of von Neumann–Morgenstern utility functions. Let utility of wealth be given by for individual-specific positive parameters a and b. Then expected utility is given by Thus the risk measure is , which differs between two individuals if they have different values of the parameter allowing different people to disagree about the degree of risk associated with any given portfolio. Individuals sharing a given risk measure (based on given value of a) may choose different portfolios because they may have different values of b. See also Entropic risk measure. For general utility functions, however, expected utility analysis does not permit the expression of preferences to be separated into two parameters with one representing the expected value of the variable in question and the other representing its risk. Criticism Expected utility theory is a theory about how to make optimal decisions under a given probability of risk. It has a normative interpretation which economists used to think applies in all situations to rational agents but now tend to regard as a useful and insightful first order approximation. In empirical applications, a number of violations have been proven to be systematic and these falsifications have deepened understanding of how people actually decide. Daniel Kahneman and Amos Tversky in 1979 presented their prospect theory which showed empirically, how preferences of individuals are inconsistent among the same choices, depending on how those choices are presented. This is mainly because people are different in terms of their preferences and parameters. Additionally, personal behaviors may be different between individuals even when they are facing the same choice problem. Like any mathematical model, expected utility theory is a simplification of reality. The mathematical correctness of expected utility theory and the salience of its primitive concepts do not guarantee that expected utility theory is a reliable guide to human behavior or optimal practice. The mathematical clarity of expected utility theory has helped scientists design experiments to test its adequacy, and to distinguish systematic departures from its predictions. This has led to the field of behavioral finance, which has produced deviations from expected utility theory to account for the empirical facts. Other critics argue applying expected utility to economic and policy decisions, has engendered inappropriate valuations, particularly in scenarios in which monetary units are used to scale the utility of nonmonetary outcomes, such as deaths. Conservatism in updating beliefs Psychologists have discovered systematic violations of probability calculations and behavior by humans. This have been evidenced with examples such as the Monty Hall problem where it was demonstrated that people do not revise their degrees on belief in line with experimented probabilities and also that probabilities cannot be apply to single cases. On the other hand, in updating probability distributions using evidence, a standard method uses conditional probability, namely the rule of Bayes. An experiment on belief revision has suggested that humans change their beliefs faster when using Bayesian methods than when using informal judgment.Subjects changed their beliefs faster by conditioning on evidence (Bayes's theorem) than by using informal reasoning, according to a classic study by the psychologist Ward Edwards: According to the empirical results there has been almost no recognition in decision theory of the distinction between the problem of justifying its theoretical claims regarding the properties of rational belief and desire. One of the main reasons is because people's basic tastes and preferences for losses cannot be represented with utility as they change under different scenarios. Irrational deviations Behavioral finance has produced several generalized expected utility theories to account for instances where people's choices deviate from those predicted by expected utility theory. These deviations are described as "irrational" because they can depend on the way the problem is presented, not on the actual costs, rewards, or probabilities involved. Particular theories include prospect theory, rank-dependent expected utility and cumulative prospect theory are considered insufficient to predict preferences and the expected utility. Additionally, experiments have shown systematic violations and generalizations based on the results of Savage and von Neumann–Morgenstern. This is because preferences and utility functions constructed under different contexts are significantly different. This is demonstrated in the contrast of individual preferences under the insurance and lottery context shows the degree of indeterminacy of the expected utility theory. Additionally, experiments have shown systematic violations and generalizations based on the results of Savage and von Neumann–Morgenstern. In practice there will be many situations where the probabilities are unknown, and one is operating under uncertainty. In economics, Knightian uncertainty or ambiguity may occur. Thus one must make assumptions about the probabilities, but then the expected values of various decisions can be very sensitive to the assumptions. This is particularly a problem when the expectation is dominated by rare extreme events, as in a long-tailed distribution. Alternative decision techniques are robust to uncertainty of probability of outcomes, either not depending on probabilities of outcomes and only requiring scenario analysis (as in minimax or minimax regret), or being less sensitive to assumptions. Bayesian approaches to probability treat it as a degree of belief and thus they do not draw a distinction between risk and a wider concept of uncertainty: they deny the existence of Knightian uncertainty. They would model uncertain probabilities with hierarchical models, i.e. where the uncertain probabilities are modelled as distributions whose parameters are themselves drawn from a higher-level distribution (hyperpriors). Preference reversals over uncertain outcomes Starting with studies such as Lichtenstein & Slovic (1971), it was discovered that subjects sometimes exhibit signs of preference reversals with regard to their certainty equivalents of different lotteries. Specifically, when eliciting certainty equivalents, subjects tend to value "p bets" (lotteries with a high chance of winning a low prize) lower than "$