Evans, Kolka, Sullivan, and Turner (Forthcoming) estimate the MVPF of the Padua Pilot, a holistic, intensive case management program designed by Catholic Charities Fort Worth (CCFW) to address the unique assortment of barriers faced by families in poverty. The program targets working-age adults who are able and willing to work, but face significant barriers to self-sufficiency.
There are five key program features: (i) a detailed assessment to uncover a participant’s goals and assets; (ii) an individualized service plan toward self-sufficiency; (iii) a two-person case management team with small caseloads to help a participant implement their service plan; (iv) case management to coach and mentor, provide internal services, and connect to a broader network of external services; and (v) strategic, flexible financial assistance to overcome barriers and incentivize positive financial behavior.
The authors partnered with CCFW to implement a randomized controlled trial evaluation of the Padua Pilot, measuring outcomes in 12- and 24-month follow-up surveys as well as administrative data on earnings, SNAP and TANF participation, and credit usage. The program was found to improve employment and housing outcomes two years after enrollment. Given the customized nature of the services, the overall program effects mask important heterogeneity. Subgroup analysis suggests that the program helped employ participants who lacked employment but had stable housing, and that those without stable housing were helped in securing it.
MVPF = 0.2
Including the costs of the case management team, the program managers, the financial assistance and other operating costs, Padua’s total cost per study participant is roughly, $22,950 (2016 USD). The cost estimate includes monthly expenses for program years 2015–18 provided by CCFW that include salary and wages, fringe and payroll taxes, professional fees (i.e., training), operating costs, an occupancy and use allowance, indirect costs, and financial assistance. Just over $3,000 of the total program cost is the difference in assistance received between the treatment and control groups, though this difference in costs does not account for any services or assistance received by the control group at other service agencies. Of the remaining approximately $19,900 in program costs, 82 percent is attributable to the total compensation (salary, wags, fringe, and payroll taxes) of the program staff.
To estimate fiscal savings, the paper follows Hendren and Sprung-Keyser (2020) by assigning tax-transfer rates from the paper based on the average earnings (conditional on positive) of the treatment group relative to a federal poverty line of $24,250 (the poverty threshold for a household of 4 in 2015). These rates are multiplied by the experimental estimates of earnings gains estimated using unemployment insurance wage records.
The estimated net fiscal cost of the program is $22,725 after removing fiscal savings stemming from earnings gains estimated over the five years after program start. Under the strong assumption that earnings gains persist through age 65 (roughly 28 years), the program’s net cost falls to $21,144 [$8,858, $33,225].
Padua is a comprehensive program designed to improve the human capital of participants. Through their work with caseworkers, participants might be connected to training or education programs that directly target soft and hard skills. Moreover, case managers might increase a client’s human capital in other ways by expanding their network or through barrier removal. Following Hendren and Sprung-Keyser (2020) when estimating the WTP of programs designed to increase labor market opportunities, the paper assumes a client’s willingness to pay is equal to their after-tax earnings gains, as well as differences in financial assistance received by the treatment and control group. The paper estimates treatment-control differences in earnings in each of the 20 quarters following random assignment (five years), remove taxes following the CBO tax-transfer rate, and calculate the net present value of these experimental impacts using a 3 percent discount rate. The paper then adds to this figure the treatment-control differences in financial assistance provided by CCFW (a roughly $3,000 difference).
The paper estimates the willingness to pay for the Padua program to be roughly $4,000 for the typical participant. Under the strong assumption that experimental earnings gains persist through age 65 (roughly 28 years), the program’s WTP increases to $10,615 [-$40,156, $62,239].
Dividing the WTP by the net cost, the paper gets an MVPF estimate of 0.18.
Unsurprisingly, the magnitude of the MVPF depends on the length of time that effects persist. Under the assumption that effects in year 5 persist for another 5 years, the MVPF increases to about 0.27 [-0.55, 1.58]. Similarly, under the stronger assumption that gains persist until retirement at age 65 (28 years after random assignment for the typical applicant), then the MVPF is around 0.50 [-1.21, 7.03].
The paper’s exploratory results on treatment effect heterogeneity suggest that the program could be more cost-effective if targeted to individuals who are more likely to benefit. Those who entered the program lacking employment but who had stable housing experienced larger gains in earnings in the five years following random assignment. The WTP estimate for this subgroup is $11,759, which translates into a larger MVPF estimate of 0.56 [-0.05, 1.4]. If these gains persist for another 5 years or until retirement, the MVPF estimate increases to 1.4 [-0.24, 5.33] or 5.86 [-0.63, \infty], respectively, for this targeted group.
Evans, William N., Shawna Kolka, James X. Sullivan, and Patrick S. Turner (Forthcoming). “Fighting Poverty One Family at a Time: Experimental Evidence from an Intervention with Holistic, Individualized, Wrap-Around Services.” American Economic Journal: Economic Policy. https://www.aeaweb.org/articles?id=10.1257/pol.20200716
Hendren, Nathaniel and Ben Sprung-Keyser (2020). “A Unified Welfare Analysis of Government Policies”, The Quarterly Journal of Economics, 135(3): 1209–1318. DOI: https://doi.org/10.1093/qje/qjaa006