growing recognition that resources for health care are scarce has led to broad acceptance that the evidence base should include economic as well as clinical evidence . in the uk , this is reflected in the work of the national institute for health and clinical excellence ( nice ) whose national guidance on health care for england and wales is explicitly informed by evidence of cost effectiveness as well as clinical effectiveness . the principal benefits from most clinical treatments are in the form of health gains to patients . while there can also be nonhealth benefits , for example , from earlier return to work or in terms of reduced burden on informal carers , these tend to be relatively small .   since an objective of all health care systems is to maximise the amount of health produced ( allowing for other objectives such as equity ) , it is not surprising that the economic questions most commonly addressed when evaluating clinical treatments are concerned with identifying the most cost - effective ways of producing health . there is now a growing movement toward incorporating the principles of evidence - based medicine in evidence - based public health . at the end of 2005 , nice announced that it was extending its remit to include guidance on the promotion of good health and the prevention of ill health   thus explicitly recognising the contribution of public health in improving health . of these , 1235 ( 73% ) were classed as cost effectiveness ( cea ) or cost utility ( cua ) studies which assess how 68 cost effectively a public health programme produces health . only 43 studies ( 2.5% ) were classed as cost benefit analyses ( cba)the technique of economic evaluation which addresses the broader issue of whether or not a public health programme is worthwhile . this paper considers the fundamental differences between cea / cua and cba in the context of providing an evidence base to inform public health policy . using selected studies from the database produced by the team that undertook the review , this paper examines how information provided by cea / cua studies might lead to inefficient recommendations for public health policy . it does this by briefly reviewing the principles of the different techniques of economic evaluation , considers the fundamental differences between public health and clinical treatments in terms of their objectives , and then , on the basis of information from a selection of studies , suggests a simple method for assessing where cea / cua of public health programmes might make a misleading contribution to the economic evidence base for public health . within health care , a cost effectiveness analysis will assess an intervention against a comparator in terms of cost per unit of health effect achieved . these units can be specific , for example , true positive cases of presymptomatic disease detected in a screening programme , or more generic , for example , life years saved . in cost utility analysis , the unit of effectiveness is the quality adjusted life year ( qaly ) or other single index measures which capture both life length of life and quality of life . the technique 's name refers to the fact that the quality of life element is determined by the utilities , or values , attached to different health states . thus while cua outcomes take account of preferences they can still be regarded as a form of cea since they seek to find the least cost way of producing a health - related unit of effect . nice determined early on that , where possible , cua was the preferred form of analysis to provide the economic evidence for health care interventions . cea / cua , however , only compare alternatives ways of pursuing a single objective  in this case to maximise health gain . an unambiguous result , however , is produced only if the intervention in question is both more effective and less costly than the comparator ( or vice versa ) . dominant  and there are no economic arguments for not adopting it over the comparator . whether or not the higher costs are worth incurring , that is , whether additional resources should be allocated to the treatment of these patients is an allocative efficiency question which can not be answered by cea / cua .   in order to assist decision makers , nondominant results are commonly presented in the form of incremental cost effectiveness ratios ( icers ) which show the extra cost of achieving the extra health effects . cost effectiveness acceptability curves ( ceacs ) deal with the uncertainty surrounding the estimates by showing the probability that a nondominant intervention will have an icer below a range of thresholds which represent the maximum amounts that a payer would be willing to pay for an extra unit of effect . for example , nice currently regards an icer of  30  000 per qaly as being at the upper limit for the interventions to be recommended for use in the british national health service . while the question of how much society is willing to pay for extra health benefits remains a live issue , the focus on assessing the cost effectiveness of clinical treatments through cea / cua remains the norm . results of these analyses clearly depend on which costs , including cost savings , are included , that is , on the perspective adopted . in the uk costs ( positive and negative ) to other sectors are not considered  at least in the primary analysis . this remains a contentious issue as exemplified in a recent nice appraisal of drugs for alzheimer 's disease where a major issue was whether or not to include cost borne by informal carers   and a recent editorial in the british medical journal has called for a rethink on continued use of a narrow perspective even for health service interventions . the uk faculty of public health has adopted sir donald acheson 's definition of public health as  the science and art of preventing disease , prolonging life and promoting health through organised efforts of society  . the faculty regards the key elements of public health as being population based , emphasising collective responsibility for health , recognising the key role of the state , and emphasising partnerships with all those who contribute to the health of the population . these principles make it clear that public health programmes can produce health in ways which do not necessarily involve health professionals or involve the use of health services .   while these principles are captured in most definitions of public health , the definition by allin et al . ends with   and involves mobilising local , regional , national and international resources to create conditions in which people can be healthy in contrast to producing health by treating illness , creating the conditions in which people can be healthy will often achieve important nonhealth benefits in addition to health . evidence that such nonhealth benefits are positively valued was demonstrated in a study by cropper   which examined people 's preferences for different life saving programmes . when asked to choose between programmes , a belief that a programme would produce benefits in addition to life saving was shown to significantly increase the probability of that programme being preferred over another with the same life saving benefits . cost benefit analysis ( cba ) is the technique of economic evaluation which addresses allocative efficiency . it explicitly addresses the question  how much more or how much less of society 's resources should be allocated to achieving this goal or to this type of healthcare ?  . its foundations are rooted within welfare economics where the aim is to assess how social welfare is affected by a particular project . cba does this by identifying and measuring all costs and all benefits ; defined as everything of value that results ( positive or negative ) and regardless of who gains or loses , that is , using a societal perspective . when all gains and losses are measured in commensurate terms ( i.e. , money ) healthcare objectives can be compared with each other or with those in other sectors of the economy . if the total value of the benefits ( gains ) exceeds the total value of the costs ( losses ) , then the proposal passes the cost benefit test and total social welfare is increased by implementing the programme . although in principle cea / cua are capable of capturing avoided costs in sectors other than health care , these analyses would still not capture the full range of benefits that would be picked up in a cba . for example , a cua of a proposed policy to reduce air pollution would be based on the narrow premise that the objective of the policy is solely to produce health . if the analysis showed an incremental cost / qaly above a predetermined threshold , even if that analysis included cost savings to sectors other than health such as reduced cleaning costs due to reduced pollution , the implication would be that resources should not be allocated to this intervention . a cba , however , which included nonhealth as well as health benefits  say the value attached to breathing clean air independent of any health implications  might show the same proposal to pass the cost benefit test . in this example , a policy decision taken on the basis of the cua would mean forgoing an opportunity to improve social welfare . it is , of course , possible that nonhealth benefits could be negative which reinforces the importance of not excluding them , particularly where they are significant . although economists have developed numerous methods to assign money values to costs and benefits which do not have associated market prices , this inevitably is not an easy task which might explain why comprehensive cbas remain rare . it is well recognised that many studies which include the word  cost benefit analysis  in their title are , in reality , not cba studies at all . such mistitled studies frequently use that term because they regard cost savings from avoided future illness as  benefits and thus feel that their analysis has covered both sides of the cost benefit calculus . some economic studies avoid valuation problems by simply listing the costs and consequences of any activity without aggregation . such cost - consequences analyses ( ccas ) are , strictly , not economic evaluations as they can not provide answers to either cost effectiveness or allocative efficiency questions . however , by identifying costs and consequence they can be an important aid to decision making beyond cost effectiveness ratios and a recent report from the public health research consortium in the uk has called for the intersectoral impacts of public health interventions to be presented in the form of a cost - consequences analysis .   in terms of an emerging public health evidence base , there thus appears to be a problem . if the benefits from public health interventions frequently include more than just health gains then , arguably , its evidence base ought to include a smaller proportion of cost effectiveness and cost utility analyses than does the evidence base for clinical treatments . nevertheless , as shown in the review , nearly three quarters of the economic evaluation undertaken in the area of public health have to date been cost effectiveness or cost utility studies .   in order to illustrate the partial nature of the information provided from cea / cua evaluations in public health , hence the potential for inefficient health policy , the present study examined the nature and relative importance of benefits which were included in some of the economic studies which went beyond cost effectiveness or cost utility analyses in the recent review . studies from the review were identified for possible selection if they were not classed as cost effectiveness or cost utility studies . it was evident from examination of abstracts , however , that despite their classification many of these studies had limited their analyses to health benefits alone . omission of nonhealth benefits , even where they might be significant , is not necessarily a weakness in these studies . if the value of the health benefits alone can be shown to exceed the value of all of the costs , then the intervention passes the cost benefit test without the need to consider any nonhealth benefits . including them would only reinforce the conclusion already reached although clearly , incomplete assessment would make comparisons of the benefit  :  cost ratios between programmes problematic . of these two had been classed within the review as cba ; the remainder being cca or multimethod apart from one case where no classification was given . the work by aunan et al .   evaluated the costs and benefits of implementing to reduce air pollution programme . reduced damage to public health , building materials , and agricultural crops from reduced emissions of air pollutants the possible benefits from implementing the measures described by the national energy efficiency improvement and energy conservation program were evaluated using saved energy from various sectors : households , transportation , industry , service , energy , and agriculture . health benefits included those from acute respiratory symptoms , chronic respiratory symptoms , infant deaths , and lung cancer . crop loss due to so2 was seen to be a great concern for crop production . the analysis indicated that the annual benefit of improved health alone is likely to exceed the investment needed to implement the programme . thus , the policy would pass the cost benefit even without inclusion of the significant benefits due to reduced damage to materials and crops . the work by miller et al .   modelled the potential health and economic impacts of implementing a medically prescribed heroin programme among canadian injecting drug users over 5 years . the potential impact of the programme was estimated by comparing hospitalisation and emergency use costs . reductions in criminal activity costs accounted for fully 63% of the total reduction in costs . other costs avoided since the implementation of the programme such as the costs of social housing , use of social services , counseling , and employment programs were identified but not included in the model . although this study did not claim to be a cba it provides an example of an intervention whose nonhealth benefits were significantly larger than the health benefits . had the researchers attempted a cba , the nonhealth benefits could have made the difference between the programme passing or failing the cost benefit test . the work by zeng - sui et al .   assessed the impact on enteric infectious disease by providing deep - well tap water across six villages in china . health benefits included reductions in diarrhoea , dysentery , viral hepatitis , cholera , and reduce mortality form liver cell cancer . nonhealth benefits included reductions in lost wages or earnings of patients and of their relatives who looked after them during the illness and the avoided costs of transportation , supplemental nutrition , and the value of gifts sent by relatives to assist towards their recuperation ( but interestingly not the value of the gift to the recipient which illustrates how the gifts should have been regarded as a financial transfer   rather than an economic cost avoided ) . for example , water - related conditions such as skin and eye infections , dermatosis , gynaecological conditions , parasitic enteric diseases , and vector - borne diseases were mentioned but not included . other intangible benefits such as the improved service that will benefit future generations were also mentioned but not included in the analysis . overall assessed benefits were more than double the costs . the work by guria et al .   evaluated the incremental outcomes of road safety programmes and driving campaigns enforced in new zealand and compared them with their resource costs . in addition to loss of life and reduced quality of life resulting from injury , the study also included the social costs of injuries and property damage avoided . other benefits such as the development of a safety culture , improvement of road user behaviour , and the safety quality of vehicles were mentioned but not included . the study showed that road safety programmes aimed at reducing high - risk behaviours produced high returns . if 90% of road safety expenditure is attributed to the period of investment , then the benefit to cost ratio would be 12.3 : 1 for 19931995 and 7.9 : 1 for 19941996 . the work by aehyung et al .   presented a cba of the onchocerciasis ( river blindness ) control programme . nonhealth benefits included additional agricultural output as a result of a more productive labour force and additional agricultural land made available through the control of onchocerciasis . other nonhealth benefits such as the reduction of lost production time by family members when providing care and improved parenting were mentioned but not included in the study . the net present value ( npv ) ranged from us$485 million to us$3,792 million ( 1987 dollars ) depending on the assumptions used . a positive npv is another way of saying that the programme passed the cost benefit test . the work by fleming et al .   estimated the costs and benefits of brief physician advice with problem drinkers in primary care settings . health care benefits included avoided cost from the perspective of the managed care organisation , the use of equipment , personnel , emergency medical care , hospitalisations , treatments , and clinic visits . the study indicated that physician - delivered advice can reduce not only medical costs but also social costs associated with alcohol consumption . the total economic cost of the intervention was $ 80,210 , or $ 205 ( 1993 dollars ) per study patient . the study by cohen et al .   estimated the potential benefits from saving a  high - risk youth  by estimating the lifetime costs associated with the career criminal drug abuser and high school drop out . antisocial behaviour of career criminals was included as an externality and thus seen as imposing as a social cost . assessed nonhealth benefits included the avoided social costs from stolen property and lost wages .   as this study did not examine the costs of interventions aimed at reducing antisocial behaviour , it was not a cba . however , the range and magnitude of the nonhealth benefits which were included in the valuation exercise illustrates what would be missed if a cea / cua study focussing solely on the health benefits had been undertaken . the work by caulkins et al .   on school - based drug prevention programmes   focused on reducing drug consumption , particularly cocaine , as an objective of the nation 's drug control efforts . the study reported the quantity of cocaine consumed , the cost of drug use , and the social value of cocaine control . benefits from the prevention program included reductions in the use of other drugs including marijuana , alcohol , and cigarettes . nonhealth benefits included lower crime rates , higher productivity , and an increase in the number of pupils graduating from high school graduation . the programme was deemed to be affordable and social benefits were shown to exceed the total costs which justified implementation of the programme . the work ginsberg et al .   estimated the costs of making the wearing of bicycle helmets compulsory in israel . benefits included resource saving from fewer head injuries in terms of hospitalisation , emergency room visits , ambulatory care , rehabilitation , long - term care , and special education . the authors called their analysis  conservative  as   it did not consider reduced pain , worry , grief , work losses for ambulatory visits or even time off from housework as a result of bicycle injuries . nor did we consider the intangible benefits of the lessening of anxiety concerning crashes by cyclists or by their friends and relatives . inclusion of these additional benefits was unnecessary as the partial benefits ( total = us$60.7 million ) clearly exceeded total costs ( us$20.1 million ) without their inclusion ( dollar base year not stated ) . in this example , the health service savings alone ( us$44.2 million ) were sufficient for the proposed policy to pass the cost benefit test . if , however , the results showed that the productivity gains ( us$7.5 million ) were needed to tip the balance , then their omission would have meant a lost opportunity to increase social welfare . benefits included savings from hospital admissions , professional services , rehabilitation , prescriptions , home health care , and medical equipment . the study also included benefits from avoided productivity losses due to children not being able to work when they became adults if they were killed or permanently disabled and included a value for avoided pain , grief , and suffering . for example , it mentioned but did not include productivity losses from parents dealing with injured children . nevertheless , it still showed a benefit to cost ratio of nearly 13 : 1 . in this case , however , annual productivity benefits ( $ 660 million ) were nearly 3 times those of health service benefits ( $ 230 million ) ( 1992 dollars ) which in a higher - cost programme might have made the difference between passing or failing the cost benefit test . it is evident that many public health interventions produce benefits in addition to health and in many cases these can be substantial . some of these involve resource savings which , if regarded as negative costs could in principle be included in a cea / cue provided that a societal perspective were adopted . others , however , for example , reductions in criminal activity , are clearly of value independent of any cost savings and these would not feature in a cost effectiveness or cost utility study .   the extent to which the noninclusion of nonhealth benefits in evaluation by cea / cua represents a problem  in the sense that it could potentially lead to foregone opportunities to increase social welfare  might be predicted by considering where the intervention in question would sit along a continuum of intent .   at one extreme of such a continuum would be public health measures whose intent was solely to produce health . for example , a policy to add folic acid to flour has been advocated with the specific intent of reducing the incidence of neural tube defects ( ntd ) in newborns . where health gains are the sole objective of a public health programme then , on the same principles used within health care , they can be assessed in terms of cost effectiveness . if the addition of folic acid to flour were shown to have a low incremental cost / qaly , then this public health measure would be a cost - effective way of producing health relative to interventions within health care .   even in this example , however , there could still be a case for directly addressing allocative efficiency through cba , for example , if women of childbearing age receive immediate reassurance from the knowledge that eating fortified food reduces their risk of conceiving a baby with an ntd . equally , making consumption of folic acid compulsory removes freedom of choice which to many could be a highly negatively valued nonhealth outcome . moreover , although there are no rules within the methodology of economic evaluation to prevent a cua being undertaken from a broad perspectiveand there have been recent calls to do just that such evaluations remain uncommon . in the folic acid example , the cost / qaly derived from a study which adopted a health service perspective would not include savings to other agencies such as special education which in the case of children with ntd could be substantial . further along the continuum of intent would be public health interventions where health is the primary concern but other objectives will clearly also be achieved . thus , while a road safety intervention may be advocated primarily to reduce injury and death on the roads , it is evident that a reduction in accidents will also produce savings in terms of property damage . the study by guria et al .   on road safety in new zealand included property damage in deriving its cost benefit ratios .   further still along the continuum would be public health interventions which clearly address multiple objectives . for example , illegal drug use is known to cause many social problems as well as health problems . thus the study by caulkins et al .   included reduced crime and increased productivity among the benefits of schools - based drug prevention programmes , even taking account of intangible benefits such as an increase in the proportion of pupils graduating from high school . another example is the onchocerciasis prevention programme examined by aehyung et al .   which , although driven by a desire to reduce the incidence of river blindness , would also free previously oncho - ridden tracts of land for settlement and cultivation . in both these examples , cuas would have given misleading information for policy .   further still along the continuum would be programmes which could be perceived as being only incidentally preventive in the sense that the effect of pursuing another policy objective would incidentally have a positive effect on health . an example here could be improvements in housing which are undertaken to provide people with more pleasant places to live but which can at the same time affect respiratory illnesses or reduce injuries . the health effects of such programme can be assessed via a  health impact assessment . ultimately almost any public policy can be seen as containing an element of public health . for example , macroeconomic policies to stimulate economic growth are clearly driven by concerns other than health , yet economic growth reduces unemployment and the relationship between unemployment and ill health is long established . public health programmes can have nonhealth benefits which may not be captured when a cost effectiveness / cost utility approach to economic evaluation is undertaken . a preanalysis examination of where any public health intervention would be located on a continuum of intent ( relative importance of health versus nonhealth benefits ) could identify where evaluation by cost effectiveness or cost utility analysis might produce inappropriate conclusions for policy . many of the public health programmes which to date have been assessed by cea / cua , in particular , those addressing smoking cessation   have shown incremental cost effectiveness ratios which are far below current thresholds . in such cases , equally , where a cba is undertaken and the value of the health benefits alone is anticipated to clearly outweigh the costs , addition of nonhealth benefits will not affect the decision on whether to implement the programme and hence their inclusion is again unnecessary . most public health programmes , however , are unlikely to allow such obvious a priori conclusions to be drawn and it is here that consideration of where the programme sits along the suggested continuum of intent will increase the likelihood that the most appropriate technique of economic evaluation will be used .
economic evaluations of clinical treatments most commonly take the form of cost effectiveness or cost utility analyses . 
 this is appropriate since the main  sometimes the only  benefit of such interventions is increased health . 
 the majority of economic evaluations in public health , however , have also been assessed using these techniques when arguably cost benefit analyses would in many cases have been more appropriate , given its ability to take account of nonhealth benefits as well . 
 an examination of the nonhealth benefits from a sample of studies featured in a recent review of economic evaluations in public health illustrates how overfocusing on cost effectiveness / cost utility analyses may lead to forgoing potential social welfare gains from programmes in public health . 
 prior to evaluation , programmes should be considered in terms of the potential importance of nonhealth benefits and where these are considerable would be better evaluated by more inclusive economic evaluation techniques .