# **Table A9: Errors and Appraisal Scores**

## **Dependent Variable: Within-organization z-score of civil servant's total appraisal score OLS Estimates**

**Standard Errors: Clustered at the district government-sector level**

||**(1) Unconditional**|**(2) Tier fixed**<br>**effects**|**(3) Sector fixed**<br>**effects**|**(4) Indicator fixed**<br>**effects**|**(5) Percentile**<br>**fixed effects**|**(6) Region fixed**<br>**effects**|**(7) Individual**<br>**characteristics**|**(8) Marginal costs**|**(9) Management**<br>**practices**|
|---|---|---|---|---|---|---|---|---|---|
|**Absolute error (z-score)**|-0.021|-0.023|-0.023|-0.024|-0.024|-0.028|-0.021|-0.026|-0.024|
||[0.013]|[0.013]|[0.013]|[0.013]|[0.013]|[0.013]|[0.012]|[0.012]|[0.012]|
|**Don't know**|-0.085|-0.12|-0.13|-0.14|-0.14|-0.096|-0.083|-0.031|-0.040|
||[0.066]|[0.080]|[0.086]|[0.088]|[0.088]|[0.10]|[0.092]|[0.094]|[0.092]|
|**Tier fixed effects**|No|Yes|Yes|Yes|Yes|Yes|Yes|Yes|Yes|
|**Sector fixed effects**|No|No|Yes|Yes|Yes|Yes|Yes|Yes|Yes|
|**Indicator fixed effects**|No|No|No|Yes|Yes|Yes|Yes|Yes|Yes|
|**Percentile fixed effects**|No|No|No|No|Yes|Yes|Yes|Yes|Yes|
|**Region fixed effects**|No|No|No|No|No|Yes|Yes|Yes|Yes|
|**Individual characteristics**|No|No|No|No|No|No|Yes|Yes|Yes|
|**Marginal costs and noise controls**|No|No|No|No|No|No|No|Yes|Yes|
|**Management practies**|No|No|No|No|No|No|No|No|Yes|
|**Adjusted R-squared**|0.0024|0.0033|0.0035|-0.00049|-0.00099|0.018|0.082|0.14|0.14|
|**Observations[clusters]**|3963[135]|3963[135]|3963[135]|3963[135]|3963[135]|3963[135]|3963[135]|3963[135]|3963[135]|

**Notes** : Clustered standard errors are in parentheses.  Standard errors clustered at the district government-sector interacted level.  All columns report OLS estimates.  The unit of analysis in all columns is the claim of the district government-level official.   The sample used for the analysis is the set of respondents making claims for which there is also evaluaton data for the civil servant.  The dependent variable is the within-organization z-score of the civil servant's evaluation outcome as per their annual appraisal. Tier fixed effects control for whether the respondent works in a federal, regional, or district government office.  Sector fixed effects are indicators for whether the claim is within an agriculture, education, health, revenue, or trade organization.  Indicator fixed effects control for the specific variable being claimed over.   Individual characteristics includes: years in position; years in the organization; years in the civil service; an indicator for whether the respondent has an undergraduate degree; and an indicator for whether the respondent has a masters degree; an indicator for whether the respondent is female; and an indicator for whether the respondent is a manager.  Marginal costs include the proportion of managers in the organization that state that a management information system is in place; the organization average response to "In what proportion of projects would you say information flows effectively between individuals in the same organization?"; the organization average response to "In what proportion of projects would you say Information flows effectively between organizations?"; the organization average response of managers to "How many personnel do you manage?"; the organization average response of employees to "How many people would you say regularly give you tasks as part of your formal work duties?";  alignment (the z-score of the row mean of the organization-average response to "To what extent do you believe that your organization's mission is aligned to your own mission?" and the organization proportion of selecting "I am contributing to fulfilling that mission on an everyday basis" to "How consistent with your mission are the various tasks and activities assigned to you on a day-to-day basis?").    Noise controls include the time of day of the survey, day-of-survey fixed effects, enumerator fixed effects, an indicator for the enumerator's subjective assessment of the quality of the interview; an indicator for the duration of the interview (decile of duration fixed effects); controls for the average tenure of the managers in the organization and the proportion of female managers in the organization.  Management practices incude Management practice: Monitoring and Managament practice: Other.  Management practice: Monitoring is the organization average of the monitoring topic, construced from the z-scores of each individual item noted in table A3.  Management practice: Other is the organization average of the average across the z-scores of targeting, incentives, roles, flexibility, staffing, and staff involvement, detailed in table A3.  Figures rounded to two significant figures.