The Ripple Effects of a Soda Tax: How Taxing Sugary Drinks Changes What We Consume

The sugar that makes our foods so sweet might just be turning our lives sour.

Obesity is currently one of the largest public health problems in the United States, with the CDC estimating that as many as 40.3% of Americans were obese in 2024. If current trends continue, experts estimate that as much as two thirds of Americans may be obese by 2050. One of the largest contributors to this phenomenon is the relatively high amount of sugar in our diets, with the average American consuming more than 100 pounds of sugar in a given year. While sugar is one of the basic necessities for cell energy, too much of it leads to storage, resulting in lethargy and weight gain. The question remains however, where is all this sugar coming from?

According to an analysis of NHANES data from 2003–2016, about 39% of added sugars in the American diet come from Sugar-Sweetened Beverages. Broadly, a sugar-sweetened beverage is just a drink with added caloric-sweeteners, with the term mainly referring to drinks like soda, energy drinks, and non-100% fruit juice. These drinks tend to pack quite the sugary punch, with experts estimating that the average sugar-sweetened beverage contains around 35–37.5 grams of sugar per 12 oz. To put this into perspective, under American Heart Association guidelines, this means just one 12 oz. can packs nearly 105% of daily recommended sugar intake for men and 150% for women. Think about that next time you reach for a bottle of ice-cold Coke! Additionally, these beverages can not only wreak havoc on a person’s nutritional goals, but are also associated with a myriad negative health consequences, such as cardiovascular disease, type 2 diabetes, increased stroke likelihood, cavities, enamel erosion, and of course weight gain. Despite these negative effects, these beverages are ubiquitous and often not given a second thought, allowing these vast quantities of sugar to sneak their way into our diets.

For years, health advocates have been urging lawmakers to do something about this dietary crisis. In 2014, Berkeley California became the first state to act, enacting a 1¢/fl oz. tax on all sugar-sweetened beverages sold within the city. This translates to a 12¢ tax per 12 oz. can and a 68¢ increase for two liter bottles. The tax had a substantial impact, increasing sugar-sweetened beverage prices by over 8% on average and reducing consumption by 21% just a few months after implementation. Despite the substantial price hike, the tax was generally viewed favorably and still remains in place to this day. This led other cities, such as Philadelphia, San Francisco, Albany, and Seattle to follow suit, implementing similar taxes to the one seen in Berkley. States such as Hawaii and Massachusetts have even gone as far as to propose statewide sugary beverage taxes, although none have passed yet.

One of the most important aspects to consider when enacting these taxes is how an increase in sugary beverage prices is expected to affect the consumption of other goods. If people simply swap out their sugary beverages with candies and cookies for example, this defeats the whole point of the tax. In economics, we evaluate the effect of one good’s price change on the consumption of another through “cross-price elasticity,” which is defined as the percentage increase in one good’s quantity based on a price increase in another good. For complementary goods, meaning goods that are often purchased together, these cross-price elasticities tend to be negative, meaning that as the price of one increases, consumption of the other tends to decrease. For substitutes, meaning goods that compete with each other for our hard-earned cash, cross-price elasticity is typically positive, as higher prices for one incentivizes consumption of the other. 

While cross-price elasticities are a vital tool for economic analysis, they can never truly give us the full picture on their own. In a large, interconnected market like the U.S. food market, every good has a cross-price elasticity with every other good. This results in an interconnected web of effects as the altered quantities and prices of secondary goods affect other secondary goods, leading to a perpetual cycle of cross-price effects. This can make it difficult to discern what the final quantity demanded will be once a change is enacted.

As for sugary drink taxes, we can  approximate the effects of a price increase on other goods by ignoring the cross-price elasticities of secondary goods on other secondary goods, producing what is known as a “partial equilibrium model.” Using a matrix of cross-price elasticities produced from 2006 Nielsen Homescan data, I’ve done exactly that to illustrate the effects of a 1¢/fl oz. tax on sugary drinks on the consumption of related goods. In the model I’ve constructed, we assume that 79.9% of the tax is passed on to the consumer, translating to a 15% total price increase. We also assume that only regular carbonated soft drinks, sports/energy drinks, and non-100% juice drinks are subject to the tax. Note that “Equivalent Price Change” is not the expected change in price of each good, but rather the price change that would be necessary to cause this change in quantity in the event of no tax. The results of my analysis are presented in Table 1.

Equivalent price change is NOT expected price change, it is the amount of price change needed to produce the same quantity change if there was no tax. Cross-price elasticities provided by Zhen et al.

The effects of this analysis are striking. Despite sugar drink taxes traditionally targeting soda, the beverage that the tax impacts the most is energy drinks, due to their high own-price elasticity. This is likely caused by the high plethora of substitutes for caffeine and taurine, making consumers unwilling to pay higher prices.

Another anomaly is canned soup, which is expected to experience a nearly 30% quantity increase. This may reflect increased spending on meal-oriented items, like frozen dinners and canned vegetables, which complements soup consumption. People may not only want more soup because it is now relatively cheaper, but also because it pairs well with the new assortment of items in their carts, producing a substantial consumption increase.

Sugary goods were an interesting area of heterogeneity. Sure, candy consumption increases as the soda tax is put in place but consumption of other sources of sugar such as ice cream, cakes, and cookies decreased. This could be because candy has a closer sugar concentration to sugar-sweetened beverages, meaning that if people choose to consume candy they will likely meet their sugar craving and not feel the need to consume other sugary goods.

One would expect a soda-addict to be jumping ship to diet soda at the first sign of a price increase, but that also isn’t apparent in the model. Diet carbonated drinks only increased a modest amount compared to the substantial 15% increase in sugary drink prices. The most likely reasoning for this is simply that people are pretty particular about the taste of their beverages. This is illustrated by the story of “New Coke” in the 1980s which, despite being preferred in consumer samples, was despised for being set to replace the original formula, so much so that it was discontinued after less than three months. People like the tastes they’ve grown accustomed to, and it seems like many are unwilling to switch to something they feel is just an inferior imitation.

The decrease in bottled water consumption is another surprising result, as we would expect some consumers to switch from sugary drinks to this healthy alternative. It becomes even more interesting when we see that diet soft drinks are the only beverages in the model with increased consumption, raising the question: where is the displaced beverage consumption going? One possible explanation is that consumers who prefer flavored drinks may be less inclined to spend money on flavorless bottled water, instead turning to much cheaper tap water. Another possibility is that beverages not captured by the model, such as coffee or tea, are absorbing some of the changes in consumption.

Beverage taxes can differ substantially in what they cover.  Some have even argued to extend taxes to artificially sweetened beverages, such as diet sodas and other low-calorie drinks, due to correlations found with cardiovascular disease and type 2 diabetes. I provide updated estimates in Table 2 that accounts for taxing artificial beverages at 1¢/fl oz in addition to the tax on sugar-sweetened beverages. The assumed price increase in artificial beverages is also 15%.

Overall, the changes in consumption are larger than in the previous tax regime, suggesting that taxing diet drinks in addition to sugary drinks produces larger behavior changes, coinciding with economic theory. Interestingly enough, we actually see higher consumption of all sugar-sweetened drink categories under this regime, suggesting that if artificial drinks are too expensive then people will just bite the bullet and continue to buy sugary drinks at higher prices. This indicates that artificially-sweetened beverage taxation may be suboptimal if the policy maker’s goal is to reduce sugar consumption.

We might all hate paying taxes, but they can be leveraged in certain scenarios to improve the public good. Obesity remains a major contributor to premature mortality in the U.S., and if something isn’t done, hundreds of thousands of Americans will remain vulnerable to its adverse health effects. Initiatives like sugary drink taxes may be a step in the right direction to prevent this dreadful future, although, we must be mindful of how our taxes affect the consumption of other goods; the last thing we want to do is push people towards even worse options!

Would lowering the legal blood alcohol limit reduce traffic deaths?

Last week, I was at the Association for Public Policy Analysis and Management annual conference in Boston. This conference is where policy researchers come together to share their research and discuss specific policy interventions. This is the place to be if you want to learn more about specific policy impacts.

Utah’s unique blood alcohol limit policy

In 2017, Utah passed a law that lowered the legal blood alcohol content limit from 0.08 to 0.05. When the law came into effect the following year, Utah became the only state in the country that had a legal limit for driving lower than 0.08.

This is an interesting policy change because it is unclear what the potential impacts of what they might be. It is natural to think that this policy change would reduce drunk driving, but there are two reasons why I’m skeptical. 

First, people don’t generally know their own blood alcohol content. Most people make the decision to drive based on heuristics: how many drinks have they had, how long has it been since their last drink, etc. Second, alcohol affects people differently. While being above the legal limit is unsafe for everyone, differences in individual biology could make a car crash more or less likely at the same blood alcohol level. 

The one impact this policy could have is to send a signal that drinking and driving enforcement is a policy priority. While I don’t think that people sitting at bars regularly attempt to calculate their blood alcohol content, I do think a policy change like this might make them believe that police enforcement is more likely. It would follow that if the probability of getting arrested increases, the expected value of driving after drinking would decrease, maybe to the point where calling a cab provides better value.

Did 0.05 reduce traffic deaths?

In the aftermath of this policy change, research came out that suggested it was a major improvement for road safety in Utah. One recent paper used a difference-in-differences approach, comparing changes in crash fatalities in Utah with changes in neighboring states. The researchers found reductions in alcohol-related crash fatalities associated with the law.

The basic idea behind difference-in-difference research design is that simply comparing Utah before and after the policy change isn’t enough. Traffic fatalities could change for reasons unrelated to the law. Looking at what happened in other states helps us account for changes that might have occurred independent of the policy change. The key assumption is that without the policy, Utah and the comparison states would have followed similar trends.

However, choosing that comparison group can be difficult. Just because a state borders Utah doesn’t necessarily mean that it provides a good estimate of what would have happened in Utah without the law. Additionally, there is a concern that we only have a sample size of one state that enacted this policy change.

What is a synthetic control?

At the conference, I was listening to a presentation of new research that attempts to better understand this policy change. The researchers revisited this policy using synthetic difference-in-differences, an approach that combines elements of traditional difference-in-differences and “synthetic control” methods.

A synthetic control is a weighted combination of places that did not implement the policy. Instead of choosing one state to represent Utah, researchers combine information from several states to construct a “synthetic Utah.” The weights are chosen to make the comparison resemble Utah’s outcomes before the policy change. Synthetic difference-in-differences also weights the periods before the policy to improve the comparison.

This can be especially useful when only one state implements a policy. There might not be any individual state that provides a convincing comparison, but a combination of states could better approximate its previous trends. Having only one treated state doesn’t make difference-in-differences invalid. It does make the choice of comparison particularly important.

Using data from 2014 through 2023, the researchers found no statistically detectable effect on alcohol-involved traffic fatalities or fatal crashes when compared to the synthetic control they designed. Their results did not support the conclusion that the law reduced these outcomes. 

That finding still requires careful interpretation. Failing to detect an effect does not prove that the effect is exactly zero. It also doesn’t tell us whether the law affected outcomes outside the study’s scope, such as crashes where nobody died.

What can policy analysts learn from this?

For policy analysts, this is a useful reminder that our estimates depend on the research behind them. If we wanted to estimate the benefits of adopting a similar law in another state, our choice of effect estimate could substantially change the result.

We shouldn’t automatically prefer a study because it uses a more complicated method or because its conclusions match our expectations. We need to understand whether its comparison is credible, how much uncertainty remains, and whether it measures the outcomes relevant to our question. When studies disagree, understanding why is part of our job.

Strong research includes studies that find no detectable improvement. These findings help us question assumptions and avoid treating a plausible benefit as an established one. Policy analysis relies on researchers doing this careful work, and on analysts being equally careful about how we use it.

Acton win heralds new policy era for Ohio

After last week’s election results, Ohio will be returning to divided government for the first time in half a generation.

Less than three hours after polls closed in Ohio, the Ohio Capital Journal called the race for governor. At the time I wrote this commentary, former state health director Amy Acton leads Vivek Ramaswamy by nearly 8 percentage points with 99 percent of the total votes counted.

Acton has put forth a platform of policy priorities that look to reorient state policy, and successes in the Ohio House of Representatives give her a bloc that can back up her veto pen. As Candidate Acton moves to Governor Acton, there are a number of policy issues where we could see changes that would impact people’s lives in a concrete way.

Education and Property Taxes

Ohio has been grappling with this tradeoff over the past few years. Record increases in housing valuations have led to a backlash against property taxes at the same time that the state has been working to equalize its school funding. Acton has prioritized fair school funding but will have to contend with headwinds with school finance’s most important tool in Ohio: property taxes.

Acton will face this challenges in the first few months of her governorship, with school funding questions being central to state budget negotiations.

Poverty Reduction

The Acton campaign has emphasized anti-poverty tax credits as a “day one” priority for the administration. These are changes that will have to happen in collaboration with a potentially hostile General Assembly. While Governor DeWine was successful in negotiating an expansion to the Earned Income Tax Credit early in his first term, he introduced a Child Tax Credit last year that was immediately removed from the budget by House leaders.

This is a potential place for collaboration between Acton and legislative leaders. Leaders are interested in tax relief, and if that can be brought about through support for low-income households, this could be an opportunity for compromise during budget negotiations.

Health Care

Governor Kasich famously bucked his party a decade ago by engineering a quiet approval for Medicaid expansion in the state, bringing around $8 billion of federal dollars for healthcare services into the state per year and providing health insurance coverage to 670,000 Ohio residents. Since then, legislators have worked to reduce the state’s investment in Medicaid, including passing a budget clause last year that will immediately remove coverage for those residents if the federal government changes policy to provide a dollar less than it provides for Medicaid today. I’m 

Acton has proposed medical debt relief, reducing administrative barriers to Medicaid enrollment, and using state purchasing power to reduce prescription drug costs. While some of this could be focuses for the state budget, many health care strategies may be possible through executive action. The options could grow in the second half of her term if Democrats take the White House in 2028, opening options for new waivers with the federal Department of Health and Human Services.

Energy

Acton has proposed a moratorium on data center development and requiring developers to cover their own energy costs. She has also said she wants to appoint people to the public utilities commission that focus on ratepayer protection. This is likely to be an ongoing discussion as the question of data center development is not going away in Ohio any time soon. With the widespread backlash against data center development, there are opportunities for the new administration to work together with legislative leaders to ensure the benefits of new development outweigh their costs.

The first test of Ohio’s new divided government will come during next year’s budget negotiations. Acton will have opportunities to shape education, taxation, health care and energy policy, but each step she takes will come with fiscal and political tradeoffs. How those tradeoffs are resolved will determine how much this election concretely changes the lives of Ohio residents.

This commentary first appeared in the Ohio Capital Journal.

How should policy analysts think about randomized control trials?

In my last blog, I discussed how one of the challenges with policy analysis is that it relies on data and effect estimates from other research. This means policy analysts need to be capable of understanding the quality of outside research and determining what things to include in their research. Part of this process is understanding the methods that other researchers use in their experiments.

That’s why today I wanted to talk about randomized controlled trials. A randomized control trial is often considered the strongest experimental setup under most circumstances, but as with everything in policy analysis there are better or worse implementations of it. Because of its relative importance in the research world, analysts should be aware of exactly what they are, how they work, and what to look out for when making judgments about their relative strength.

What is a randomized control trial?

A randomized controlled trial is an experiment where participants are randomly assigned to either receive treatment or serve as a control. The key insight is that because we randomly assign people to each group, we avoid selection bias. If we don’t randomly assign people to the treatment group, then we might worry that the participants are selected because they are more likely to have a positive outcome.

Imagine a city wants to understand whether a job training program helps unemployed residents find work. Simply comparing people who complete the program with people who don’t participate would not necessarily answer this question. For example, people who sign up might be more motivated to find a job. The concern is that some unobserved factor could influence their employment outcomes independently of the program.

Instead, suppose the city has more eligible applicants than available spaces and uses a lottery to offer some applicants a spot. Researchers could compare employment outcomes among those offered a spot with outcomes among those who weren’t. Because the offer was assigned randomly, we have a stronger basis for attributing differences in outcomes to access to the program rather than those unobserved differences.

One problem people have with randomized control trials is ethical concerns about not offering assistance to people who might have a real need. A classic example of this is in clinical trials where participants are facing serious health consequences and there is a new drug that might help. In order to truly understand the effectiveness of the drug, a randomized control trial might be best, but that necessarily means some people who might benefit are structurally denied access. It also means that people may randomly be exposed to side effects unknown at the time. This is why informed consent is an important element of any randomized controlled trial: so participants are aware of potential risks in trials they take part in.

Internal vs. external validity

Randomized control trials succeed at reducing selection bias, but that doesn’t mean that their results are always widely applicable. When evaluating a randomized controlled trial, it is helpful to distinguish between internal and external validity. Internal validity concerns whether the study credibly identifies a causal effect for the people and circumstances it studied. External validity concerns whether that finding applies to other populations or settings.

Our job training experiment might give us a strong estimate of what offering the program did for the people who entered the lottery. However, those applicants might differ from other unemployed residents. In effect, there is still a selection bias problem, but instead of concerning what people receive treatment we are concerned about whether the population that is eligible for the study is representative of everyone else in our society. 

When people talk about how randomized control trials reduce selection bias, they are mostly talking about the internal validity of the study. If we didn’t randomly assign people to receive treatment, then our results might not be able to tell us the treatment effect even for the sample we are studying.

In some cases, randomized control trials can have even worse external validity than other forms of experiments. This is because randomized control trials are difficult to organize. The barriers that make randomized control trials difficult to perform can lead to researchers relying on less representative samples that are easier to get as participants. As an example, an academic researcher might ask the students at their university to be the participants in a study.

What policy analysts should consider

For policy analysts, the key question is whether the findings from a study apply to the policy and population we are studying. A randomized controlled trial can provide strong evidence about what happened in one setting without necessarily telling us what would happen somewhere else. We need to look closely at who participated, how the program was implemented, and whether differences between that study and our own context might affect the results.

Identifying these differences does not necessarily mean we should discard a study with less than ideal external validity. Instead, we should consider whether there is a credible way to adjust its estimates. If the researchers report separate effects for different age groups or genders, we might be able to use those estimates to better reflect the population we are studying. For example, we could weight results based on the demographics of the area we are studying. Taking this kind of approach does introduce more assumptions into our models though, so it should be used with discretion.

In general, randomized control trials are exceptional sources of information. While external validity is important for analysts who want to take research and apply it to new situations, without internal validity there is no result in the first place. Our job as policy analysts is to build on that strong evidence while being clear about the assumptions needed to apply it to the decisions we are trying to inform.

The Montreal Protocol: a cost-benefit analysis success story

Cost-benefit analysis is one of the most common types of analysis that we conduct at Scioto Analysis. Put simply, cost-benefit analysis is a process where we inventory costs and benefits of a public policy and express them in monetary terms. Cost-benefit analysis is valuable because it produces a clean, top-level finding: what is the net present value of a public policy? What is the value of the benefits the policy produces? What is the value of the costs the policy incurs?

Most recently, Scioto Analysis released a cost-benefit analysis of data center policy in Ohio. Some other cost-benefit analyses we’ve conducted in the past include analyses of congestion fees in New York City, homelessness in Hawaii, and cigarette taxes in Ohio.

Cost-benefit analysis is most commonly used at the federal level. In fact, most major federal regulations are required to undergo a formal cost-benefit analysis. Cost-benefit analysis can be a valuable decision-making tool. In fact, one of the most consequential cost-benefit analyses in federal history came from an administration known for deregulation.

The hole in the ozone layer

In May 1985, a Nature report found that a massive hole had opened in the ozone shield and suggested the use of “chlorofluorocarbons” were responsible for it. Chlorofluorocarbons came into widespread use in the 1950s for industrial and consumer goods such as refrigerators, air conditioners, fire extinguishers, and spray cans. The ozone layer absorbs a great deal of ultraviolet radiation from the sun, so a compromised ozone layer posed a threat to human health, wildlife, and ecosystem strength. 

Formal diplomatic negotiations surrounding chlorofluorocarbon reduction began in late 1986, and dozens of nations signed the Montreal Protocol in late 1987, an agreement to significantly reduce chlorofluorocarbons in the atmosphere by regulating their production and consumption.

The Reagan administration was divided over how aggressively to push for reductions in chlorofluorocarbons. Interior Secretary Donald Hodel led a coalition of officials from the Departments of Commerce and Agriculture, the Office of Management and Budget, and parts of the staff who questioned both the science and economic costs of chlorofluorocarbon controls.

The core disagreement was over the size of the cuts. The State Department and Environmental Protection Agency recommended a freeze and 20% reduction in chlorofluorocarbons, followed by a second-stage cut of about 30%. Hodel’s coalition, along with the European Commission, Japan, and the Soviet Union, opposed the second stage. With the administrations split, there was an important question that needed an answer: were reductions in chlorofluorocarbons worth the cost? That’s where cost-benefit analysis came in: cost-benefit analysis could help estimate the net social value of each scenario.

The cost-benefit analysis of reducing CFCs

The Council of Economic Advisers’s first estimate came in a May 1987 memo. Using the Environmental Protection Agency’s risk assessment, it estimated that a freeze and 20% reduction in chlorofluorocarbons would prevent about 992,900 skin cancer deaths among Americans alive in 1987 and those born through 2075, and that an additional 30% reduction would prevent another 78,700 deaths. The Council calculated the monetary benefits of a freeze and 20% reductions to be $1.3 trillion (in 1987 dollars) and the costs to be no more than $13 billion, a benefit-cost ratio of about 100:1. However, the memo didn’t state its key assumptions, such as the value of a statistical life or the discount rate it used, and it only counted costs through 2000.

A few weeks later, a more complete interagency cost-benefit analysis, with assumptions the Council endorsed, was presented to the Domestic Policy Council. Rather than relying on a single set of assumptions, it tested 32 combinations of the following assumptions:

  • a value of a statistical life of $2 million or $4 million

  • a value of life that either stayed constant or grew 2% per year

  • discount rates of 4% or 6%

  • four different timelines for when deaths would occur

The June analysis also extended costs indefinitely, assuming they would grow between 0.625% and 2.5% per year. Under these assumptions, moving from no action to a freeze and 20% reduction produced average benefits of $773 billion at a 4% discount rate and $137 billion at a 6% discount rate, and costs of roughly $5 billion to $10 billion. At a 4% discount rate, that’s a benefit-cost ratio of roughly 75:1 to 150:1. In this analysis benefits exceeded costs in all 32 combinations.

This range of benefit-cost ratios is very high, and it suggests that the benefits exceeded the costs by a great deal. Over the past several years, the cost-benefit analyses conducted by Scioto Analysis with the highest benefit-cost ratios were for an Ohio cigarette tax, with a benefit-cost ratio of 23:1, and for a full replacement of lead service lines in Ohio, with a benefit-cost ratio of 31:1. Upon reviewing the Washington State Institute for Public Policy’s current cost-benefit analyses, a leading organization in the cost-benefit analysis field, I found just 20 of 336 studies with a benefit-cost ratio above 100:1.

The June analysis also evaluated the additional 30% reduction. It estimated benefits of $58 billion at a 4% discount rate and $11 billion at a 6% discount, and costs of roughly $9 billion to $19 billion. Benefits exceeded costs in 56% of the combinations, were roughly equal to costs in 19%, and were lower than costs in 25%.

The scope of the cost-benefit analysis only includes deaths from skin cancer in the United States. The scope does not include benefits to other countries, and it also doesn’t include non-health benefits or benefits from avoidance of non-fatal skin cancers and cataracts. This suggests that the Council’s estimates, while high, are likely to be an underestimate of the full benefits from reducing chlorofluorocarbons.

As a result of the cost-benefit analysis, the Council of Economic Advisers changed their initial stance of skepticism to support a strong international protocol to reduce chlorofluorocarbons. Some members of the Reagan administration continued to emphasize their opposition to the regulation, but President Reagan ultimately accepted the freeze and 20% reduction in chlorofluorocarbons, alongside the additional 30% reduction. It would be imprecise to say that the cost-benefit analysis conducted by the Council of Economic Advisers was the single determinant of President Reagan’s decision, but it likely helped tip the scales.

The implications of the Montreal Protocol CBA

An important part of cost-benefit analysis is making well-founded assumptions and using high-quality data. In 1987, economists and researchers from the Council of Economic Advisers and the Environmental Protection Agency were working with limited models and data. In the decades since, scientists have gathered far more evidence, and the models used to estimate the effects of ultraviolet radiation have improved. Revisiting the Montreal Protocol with updated estimates shows how our understanding of a policy’s impacts can change over time.

In 2020, the Environmental Protection Agency estimated that the efforts taken to restore the ozone layer will reduce United States cases of skin cancer by 443 million, save an estimated 2.3 million American lives, and prevent more than 63 million cataract cases for Americans born between 1890 and 2100. These estimates are not directly comparable to the 1987 analysis, however, as they reflect the Montreal Protocol in its final state, which went beyond the scope of the original freeze and 50% reduction.

Additionally, the National Oceanic and Atmospheric Administration found that the Montreal Protocol eliminated a significant contributor to climate change, which will avoid a potential global temperature increase of 0.5 to 1 degree Fahrenheit by the year 2100. This is a benefit the 1987 analyses did not consider at all.

The Montreal Protocol cost-benefit analysis is a useful case study for anyone who works in this field. A one-page memo from the Council of Economic Advisers helped persuade skeptical officials in an administration generally wary of regulation. At Scioto Analysis, we see cost-benefit analysis as a tool to inform decisions. The Montreal Protocol is a reminder that a clear, well-communicated analysis can shape policy even when the politics are difficult, and that looking back at how a policy actually turned out is one of the best ways to improve the analyses we do going forward.

Scioto Analysis Releases Economic Impact Analysis of Cleveland's Music Industry

This morning, Scioto Analysis, in partnership with The Democracy Collaborative, published The Economic Impact of Cleveland’s Music Industry. The report estimates that Cleveland’s music industry contributes more than $2.5 billion in annual economic value, supports nearly 23,000 jobs, and generates more than $1.1 billion in annual earnings throughout the metropolitan economy.

A city with a long musical history, Cleveland provides a case study of the relationship between cultural institutions and regional economic activity. Institutions such as the Cleveland Orchestra, Playhouse Square, the Rock and Roll Hall of Fame, and a diverse ecosystem of local venues, festivals, artists, and educators help sustain both cultural vitality and economic activity across the region. The economic impacts extend beyond the music industry into retail, information services, professional services, hospitality, and other industries.

Analysts also estimate that 58% of the earnings generated by the music industry within the region's arts and entertainment sector go to local residents. These earnings help support people who live, work, and create in the community. Understanding who receives these earnings is an important part of assessing how economic activity benefits local residents.

The report is part of an ongoing effort to deepen Cleveland’s understanding of its anchor institutions and their role in local economic development. Anchor institutions are organizations with deep roots in their communities, including hospitals, universities, foundations, and cultural nonprofits. These organizations purchase goods and services, employ workers, invest in facilities, educate young people, and convene local stakeholders.

More than two decades ago, The Democracy Collaborative coined the term “Community Wealth Building” to describe an approach to local economic development centered on democratic ownership, broadly shared prosperity, and community control. One of the first Community Wealth Building pilot projects occurred in Cleveland, where hospitals, universities, and foundations supported the creation and development of the Evergreen Cooperatives, a network of worker-owned businesses that continues to operate in the area.

In the years since, The Democracy Collaborative has developed the concept of an “anchor mission,” through which institutions direct their purchasing, hiring, investment, and other resources toward the long-term welfare of their communities. Adoption of this approach has primarily been concentrated in universities and hospitals. This report extends that conversation to Cleveland's music economy, estimating its economic contributions and identifying opportunities for community wealth building through local artists, businesses, and cultural institutions.

Museums, theaters, music venues, orchestras, libraries, and cultural nonprofits have procurement budgets, investments, and payrolls that connect them to the wider economy. Cleveland’s music industry includes local entrepreneurs, creative workers, independent venues, and community-focused organizations. The report’s findings provide a basis for examining how these organizations’ economic activity supports local employment and earnings.

Cleveland’s musical heritage is both a cultural and an economic asset. By estimating the industry’s economic contribution and examining where earnings flow, this report provides information for policymakers, cultural institutions, and residents considering the role of music in regional economic development. The full report can be accessed here.

How do you know if your strategic plan is working?

If you are a nonprofit executive, you are certainly familiar with the idea of a “strategic plan.” A group of board members get together, sometimes for a day or a weekend, to chart out a plan for the organization for the next few years.

While strategic planning has become a profession in itself, what comes after the strategic plan can be where things break down for an organization. And this can happen even if the organization is successful at executing all the strategy decided upon during strategic planning. This is because strategic planning tends to focus on what an organization hopes to accomplish. If an organization wants to know if their activities are actually bringing those outcomes to fruition, they need to get into the business of evaluation.

But how do we go about evaluating our success at executing a plan? Here is one four-step framework you can use for evaluating your organization’s success in light of their strategic plan.

Step 1: Translate strategic goals into measurable outcomes

Quantify, quantify, quantify. It is easy to walk away from strategic planning jazzed about the potential future outcomes, but if nothing can be measured from those efforts a few years later, then how do you know that you did anything in the first place?

I am going to use an example of a hypothetical nonprofit whose board has decided that “improving housing stability” will be the focus of its strategic plan. What are a few ways that this strategic goal can be translated into measurable outcomes?

The economist in me focuses on housing cost burden: take the population the nonprofit is serving and see how many people the organization can get to where their housing costs are less than 30% of their total income. You could also use outcomes like reducing rates of homelessness, reducing evictions, reducing nonpayment of rent, or increasing length of stay at a given home.

Sometimes these are laid out in a strategic plan. Often they are not. If they are not, it may take collaboration between board members, executives, and clients to decide exactly which quantitative measures best capture the goals and resources of the organization. An organization working to reduce housing cost burden could undertake very different activities than an organization working to reduce homelessness.

Step 2: Map activities, outputs, and outcomes

For those of you who are familiar with logic modeling, this is probably ringing a bell to you. A good way to then connect your organization’s work to your strategic plan’s goals is to map activities to outputs then eventually outcomes.

Activities are the specific programs that are carried out by an organization. Outputs are the direct results of those activities. Outcomes are the broader impacts that come about from outputs that are not directly controlled by the organization but that the organization wants to bring into being.

So for instance, our hypothetical nonprofit could have adopted the goal of promoting housing stability, then the executive director could have determined that “reduce the number of people experiencing homelessness” is a good measurable outcome that follows the goals of the board. The organization then undertakes an activity of providing permanent supportive housing to homeless residents of a target community. The output would be the number of people housed by the program. The outcome of interest would be the number of previously-homeless people who then do not experience homelessness over the upcoming year.

As you can see, the activities of the organization bring about outputs, which then bring about outcomes that tie into the organization’s strategic plan.

Step 3: Estimate impact

It would be a mistake at this point to say that we have now determined how successful the organization has been at carrying out the strategic plan. This is because no nonprofit provides services in a vacuum. Ultimately, the goal of a nonprofit organization is not to just be associated with outcomes, they want to make these outcomes happen.

Let’s make this a little more concrete. So say our hypothetical nonprofit program director was choosing people to stay in its permanent supportive housing program. She finds a group of people who have above-average income who recently lost their homes to a hurricane. They are living in fairly nice hotels right now, subsidized by support from their local government. You would imagine once these people get housing again, they will likely be housed continuously for the next year. If she brings those people into her permanent supportive housing, the outcome of homelessness will not show up, but it likely had little to do with their actions. These people would probably have overcome their homelessness anyway.

This is why approaches like randomized controlled trials and quasiexperimental methods are so vital to social programs. An effective nonprofit goes beyond outcomes to determine the real outcomes brought about by their work.

Step 4: Use evidence to improve decisions

If you have done step 3, you now have an incredible tool: knowledge of what does (or does not) advance the goals of your strategic plan. With this information, you can tune up programs to make them more effective, make the case to funders about programs that are already successful at a smaller scale and could use more resources to scale up, or reallocate funds from programs that do less to advance the goals in your strategic plans to goals that are working more.

Consider our hypothetical nonprofit. If they evaluate their permanent supportive housing program and find that it reduces homelessness by 25% against a control group of similarly-situated people, the executive director may want to put more resources into the permanent supportive housing program than on more treatment-focused programs that aren’t showing much success in reducing homelessness.

A good strategy for nonprofits is to put a lot of evaluation dollars into new programs, less into programs that are tested already on a smaller scale, and a minimum amount of evaluation on large programs that have been well established. This ensures that programs with strong evidence are scaled up and new approaches are tested for effectiveness against the goals of the organization.

Make evaluation a part of your strategic plan

Ultimately, a strategic plan without evaluation is a plan without teeth. What is measured is what matters, and if activities are living in a world divorced from their outputs, outcomes, and the reality on the ground, then the strategic plan is an aspirational document and a wasted Saturday for busy board members. On the other hand, an executive director can take a strategic plan, turn it into measurable outcomes, map activities onto outputs then onto those outcomes, find the real impact of those activities, then use them to advance the plan her board of directors set in motion. And that is what I would call an effective strategic plan.

How are data centers impacting Cincinnati, Cleveland, and Columbus?

A couple of weeks ago, Scioto Analysis published a cost-benefit analysis of data center policies in Ohio. We found that data centers in Ohio produced a net social benefit of $62 billion between 2013 and 2026. Between 2027 and 2034, however, we project that they will produce a net social benefit of only about $2.4 billion. This is partly because data centers have strong early employment effects: a county gains most of its jobs when its first data centers are developed, and later ones add relatively few. At the same time, newer data centers are more energy intensive, so electricity use grows faster than the number of facilities. As electricity demand grows, so do the strain on the grid and the emissions from power generation. That raises costs for ratepayers and harms public health.

We estimate that 178 data centers currently operate in Ohio. If all planned projects come online by 2034, that number will rise to 294. Many of these facilities are concentrated in particular parts of the state. To better understand the benefits and costs that different areas of Ohio will see from data centers over the next several years, I wanted to look at our cost-benefit results for major metropolitan areas across Ohio.

Columbus MSA

The Columbus Metropolitan Statistical Area consists of ten counties:

  • Delaware County

  • Fairfield County

  • Franklin County

  • Hocking County

  • Licking County

  • Madison County

  • Morrow County

  • Perry County

  • Pickaway County

  • Union County

Across those ten counties, there are 106 existing data center facilities and 47 planned or proposed data center facilities between now and 2034. We estimate that these 106 data centers consume about 37 million megawatt-hours of electricity per year, an average of 350,000 annual megawatt-hours per facility. This amount of electricity could power around 3.4 million homes per year, nearly four times the number of households in the Columbus Metropolitan Statistical Area. 

By 2034, we estimate that data centers in the Columbus Metropolitan Statistical Area will consume about 89 million megawatt-hours of electricity per year, an average of 580,000 annual megawatt-hours per facility. This amount of electricity could power over nine times the number of households in the Columbus Metropolitan Statistical Area.

With no policy intervention, we estimate that data centers within the Columbus Metropolitan Statistical Area have generated about $18 billion in net social value since 2013, mostly due to around 30,000 jobs supported. However, between now and 2034, we estimate that data centers within the Columbus Metropolitan Statistical Area will generate about $2 billion in net social loss, mainly due to higher electricity prices and emissions associated with  electricity generation.

If future data center projects are banned within the Columbus Metropolitan Statistical Area, we estimate the net social value of data centers in the region to be about $8.1 billion between now and 2034. If future data center projects are required to generate electricity behind-the-meter, with 90% renewables and 10% natural gas, we estimate the net social value of data centers in the region to be about $8.2 billion between now and 2034, slightly higher than a ban on construction.

The table below shows the future impacts of data centers in the Columbus Metropolitan Statistical Area under each scenario.

Cincinnati MSA

The Cincinnati Metropolitan Statistical Area consists of fifteen counties, five in Ohio. There are also ten counties in the Cincinnati Metropolitan Statistical Area in Indiana and Kentucky, but we didn’t track data centers in counties outside of Ohio for this study.

  • Brown County

  • Butler County

  • Clermont County

  • Hamilton County

  • Warren County

Across those five counties, there are 24 existing data center facilities and 3 planned data center facilities between now and 2034. We estimate that these 24 data centers consume about 6.1 million megawatt-hours of electricity per year, an average of 250,000 annual megawatt-hours per facility. This amount of electricity could power around 570,000 homes per year, over half the number of households in the Cincinnati Metropolitan Statistical Area. 

By 2034, we estimate that data centers in the Cincinnati Metropolitan Statistical Area will consume about 9.7 million megawatt-hours of electricity per year, an average of 360,000 annual megawatt-hours per facility. This amount of electricity could almost power every home in the Cincinnati Metropolitan Statistical Area.

With no policy intervention, we estimate that data centers within the Cincinnati Metropolitan Statistical Area have generated about $21 billion in net social value since 2013, mostly due to around 24,000 jobs supported. Between now and 2034, we estimate that data centers within the Cincinnati Metropolitan Statistical Area will generate about $11 billion in net social value. The employment benefits from data centers in Cincinnati will slow down, but the utility and public health related costs aren’t as bad in Cincinnati as they are in Columbus due to slower data center growth.

If future data center projects are banned within the Cincinnati Metropolitan Statistical Area, we estimate the net social value of data centers in the region between now and 2034 will increase to $12 billion. If future data center projects are required to generate electricity behind-the-meter, with 90% renewables and 10% natural gas, we estimate the net social value of data centers in the region to be about the same as a ban on construction, about $12 billion between now and 2034.

The table below shows the future impacts of data centers in the Cincinnati Metropolitan Statistical Area under each scenario.

Cleveland MSA

The Cleveland Metropolitan Statistical Area consists of six counties:

  • Ashtabula County

  • Cuyahoga County

  • Geauga County

  • Lake County

  • Lorain County

  • Medina County

Across those six counties, there are 12 existing data center facilities and 1 planned data center facility for 2028. We estimate that these 12 data centers consume about 440,000 megawatt-hours of electricity per year, an average of 36,000 annual megawatt-hours per facility. This amount of electricity could power around 40,000 homes per year, only around 4% the number of households in the Cleveland Metropolitan Statistical Area. 

With no policy intervention, we estimate that data centers within the Cleveland Metropolitan Statistical Area have generated about $21 billion in net social value since 2013, mostly due to around 20,000 jobs supported. Between now and 2034, we estimate that data centers within the Cleveland Metropolitan Statistical Area will generate about $12 billion in net social value. 

The Cleveland Metropolitan Statistical Area only has one planned data center facility between now and 2034; however, this singular data center facility is massive, so its impacts are meaningful.

If future data center projects are banned within the Cleveland Metropolitan Statistical Area, we estimate the net social value of data centers in the region between now and 2034 will decrease to slightly below $12 billion. If future data center projects are required to generate electricity behind-the-meter, with 90% renewables and 10% natural gas, we estimate the net social value of data centers in the region to increase to about $13 billion between now and 2034.

The table below shows the future impacts of data centers in the Cleveland Metropolitan Statistical Area under each scenario. 

What does this mean for Ohio?

If we add up the future net present values from the Columbus, Cincinnati, and Cleveland metropolitan statistical areas, we get about $21 billion in net social value over the next several years. This is much higher than the $2.4 billion net present value we calculate for the state of Ohio as a whole. This finding suggests that outside of Ohio’s three largest metropolitan areas, the future costs of data centers exceed the future benefits.

The main reason behind this is that the majority of employment benefits from data centers in Ohio are felt in Ohio’s three largest metropolitan statistical areas. According to Yue and Zeng in 2026, our source for the employment impacts of data centers, the statistically significant employment benefits of data centers are concentrated in metropolitan areas.

However, it’s also possible that employment benefits are overestimated in these core metropolitan areas. As we discuss in our full cost-benefit analysis, employment benefits are highly uncertain, while emissions costs are much more certain.

In areas where data center growth is slow over the next several years, it doesn’t appear that the costs begin to outpace the benefits of data centers. In metropolitan areas like Cleveland or Cincinnati where there are only a handful of planned data center projects, the sustained employment benefits continue to outpace the costs from electricity consumption and emissions. 

On the other hand, in metropolitan areas that are experiencing rapid growth in data centers, like Columbus, we predict that the costs from electricity consumption and emissions will begin to outpace data center benefits. Local policymakers may want to consider policies such as requiring behind-the-meter electricity generation with a high share of renewable energy sources to minimize the costs of future data centers while maintaining the benefits.

What do you do when there are data or methodological limitations in a policy analysis?

While I was still in school, I worked as a guide on wilderness expeditions. As part of that job, I was a certified Wilderness First Responder. In that training there is a mantra about working from “ideal to real.” We’d love to work in sterile, safe environments all the time but if someone needs help while sitting in the mud during a rainstorm that's where you need to help them. Policy analysis is similar.

One of the challenges of policy analysis is its reliance on external factors for its success. Things like demographic data, effect size estimates, or methodological frameworks are all prerequisites for a strong policy analysis. While it would be extremely nice to live in an ideal world where all the data and methods are well established and credible, our actual job is to provide information in the real world when conditions are often subpar.

There are many times when analysts don’t have all the ideal prerequisites they need for an analysis. Maybe a dataset doesn’t include the population we are interested in, or maybe the policy we are studying has never been implemented in the state where we are working. 

These limitations don’t mean we can’t provide useful information or that an analysis is impossible. Situations where we have to work around these kinds of limitations are fairly frequent. Instead, we have to think carefully about what the available evidence can tell us and what assumptions are needed to fill in the gaps. 

What can we do when we don’t have the right data?

Data concerns are always at the front of mind when conducting a policy analysis. All statistical models are threatened by the “garbage in, garbage out” principle. Understanding how to work around these limitations is a key part of quantitative policy analysis.

One way this manifests is a situation where we have good data on the implementation of a policy in one context (say a neighboring state), but we lack the information needed to estimate what the impact will be in the context we are studying.

Imagine we are studying a rental assistance program that has been implemented in a different city. The city we are studying is smaller than the city with the existing program, so we lack some of the requisite data needed to help us estimate uptake. As a starting point, we could compare the number of renter households in each city and scale the program size accordingly. If our city has half as many renter households, we might initially estimate that a similar program would have half as many participants.

This simple model requires a lot of underlying assumptions to hold. There must be a similar share of renter households who would qualify for and participate in the program. These households must have characteristics that imply that they would experience similar outcomes. If we have information on things like differences in income or housing cost burdens, we might be able to refine that estimate. If we don’t, we need to acknowledge that our estimate relies on those populations being sufficiently similar.

If there is no suitable data available and there isn’t a credible way to adjust an estimate from another context, then we might have to rely on describing outcomes qualitatively. When providing a qualitative description, it is important to distinguish between an outcome we have evidence to expect and one that is simply possible. We might be able to explain how rental assistance could help households avoid eviction without estimating how many evictions it would prevent. That still provides useful information, as long as we explain the evidence supporting that relationship and why we cannot confidently estimate its size.

What if the available methods don’t answer our question?

As analysts, we try not to reinvent the wheel as often as possible. If a method has been shown to work well before, our first instinct is to replicate and adapt rather than search for a novel approach. Established methods give us a starting point for organizing an analysis and understanding its limitations. However, we still need to check whether their requirements and assumptions fit the question we are trying to answer.

There are of course situations where there aren’t existing methods that directly address our question. When this happens, we have to find a creative way to understand the question at hand.

It can often be helpful to start thinking through the problem logically. Say we don’t know how this rental assistance will impact health outcomes directly. We could perhaps get around this limitation by estimating the impact it has on net household incomes, and then making the connection between higher net household incomes and better health outcomes.

Why is it important to explain our assumptions?

Every time we work around one of these limitations in data or methodology, we increase the number of assumptions we are making with our models. While this is not inherently bad, it does expose us to more variability and it requires us to be more detailed about the assumptions we make and what their implications may be.

It is essential that we make all of these choices visible. It should be readily apparent in the narrative of a report what parts of the model depend on our assumptions. It can also be helpful in some situations to explain qualitatively why we believe our assumptions are reasonable and where we have less confidence.

This matters because policymakers may reasonably disagree with an assumption while still finding the analysis useful. If they can see how we arrived at a result, they can better judge whether it applies to the decision they are facing. An estimate without that explanation can appear more certain than the evidence actually supports.

How can sensitivity analysis help?

Disclosing an assumption is an important first step, but we also want to know how much it matters. Sensitivity analysis allows us to change assumptions and see what happens to our results.

Returning to the rental assistance example, we could estimate outcomes assuming the program is less effective than the study suggests, then compare those results with our main estimate. We could also test different participation levels or program costs. 

Note that when we do sensitivity analysis we aren’t just seeing what happens if our model is wrong. The goal is to understand how our assumptions affect our conclusions. When we say that a policy is more or less effective, that should always be based on the best available evidence about the variation in outcomes.

Sometimes these changes have little effect on the overall conclusion. Other times, a relatively small adjustment changes whether a policy’s estimated benefits exceed its costs. Both findings are useful. The first suggests that the conclusion holds across the conditions we tested, while the second tells policymakers that the decision depends heavily on something we don’t know with much confidence. Sensitivity analysis cannot make weak evidence stronger or account for every possible uncertainty. Its goal is to communicate the uncertainty in our results. 

As with wilderness medicine, policy analysis is about working from ideal to real.  It would be so much easier if there was always high-quality data and highly rigorous methodological frameworks to fall back on, but often there aren’t. If we want policymakers to have better information to inform their decisions, then we need to be able to work with what we have. There are situations where these concerns make some aspects of an analysis impossible, but our goal should always be thinking about “ideal to real.” What questions can we answer with the data and methods we have available?

What kind of analysis could I get for $40,000?

Often, governments, nonprofits, foundations, and associations have budgets to answer important questions but don’t know exactly what kind of study they need to answer them. I use $40,000 as an example of a typical analysis because it is enough to answer a significant policy question but requires an agency or organization to make decisions about what sort of analytical approach they want to use.

This article explores four examples for what a policy analysis firm could do with $40,000. These are illustrative scopes, not fixed-price packages. But these are all approaches we have taken with $40,000 or less to great success on a range of different topics.

Option 1: Understand the economic impact of an industry or project

Are you asking a question like “how much does our industry contribute to a local economy?” If so, economic impact analysis could be the right approach for you.

Economic impact analysis is an approach to economic analysis that focuses on jobs, earnings, economic output, tax revenue, and other activity associated with a given industry or project. A $40,000 economic impact analysis project could pay for an analysis of an industry including its impact on regional Gross Domestic Product, jobs supported, earnings supported, and tax revenue generated.

This kind of study could include those results, a methodology explaining how the results were calculated, analysis of the results, and a report ready to be distributed to the public. This gives the client evidence to inform economic development and investment decisions and information about how to explain the impact of an industry to policymakers. A limitation of this approach is that this kind of analysis rarely can establish what would happen if an industry or project didn’t exist and it generally does not analyze the social impacts of policies.

Option 2: Determine whether social benefits of a policy outweigh social costs

If you are asking a question like “would expanding this program generate more benefits than it costs?,” then a cost-benefit analysis may be what you are looking for.

Cost-benefit analysis is the process of assessing all the social impacts of a policy, quantifying those impacts, then monetizing them to see what society’s aggregate willingness to pay for the intervention is. An exploratory cost-benefit analysis using existing data sources can be done for $40,000.

In a cost-benefit analysis, we can estimate what the benefits or costs of a policy are, the net benefits of a policy, the benefit-cost ratio, and conduct sensitivity analysis to see how the assumption about the policy affect its results. Clients can use this to learn whether a policy creates social benefits and under what conditions it does. Some limitations of this approach are that cost-benefit analysis often lends itself to analyzing specific policies and that extensive primary data collection is not usually possible with this approach.

Option 3: Compare policies for fighting a public problem

If you are asking a question like “what should we do to most effectively solve this problem?,” then policy analysis could be the approach for you.

Formal policy analysis compares policy options against consistent evaluative criteria. Policy analysis begins with defining a problem rigorously then moves into assembling evidence on the problem, constructing options to ameliorate it, defining criteria, projecting outcomes on those criteria, then confronting tradeoffs and telling the story.

A policy analysis generally includes an assessment of each policy option, a comparison of how policies bring about certain outcomes, identification of tradeoffs between policies, all written into a report on the findings. Clients walk away from a policy analysis with evidence to help policymakers choose among competing policy approaches. One limitation is that a $40,000 project likely has to rely on existing high-quality research to make estimates about a given policy since extensive data collection is difficult to do with a budget like this. 

Option 4: Benchmark a community against its peers

If you are more interested in questions of comparison like “how does our community compare to other communities and where are we falling behind,” then community benchmarking may be what you are looking for.

Benchmarking uses a series of indicators to assess how a community compares to others in community conditions and performance. A $40,000 community benchmarking report could include choosing comparison communities, collecting data, and compiling data into a digestible and sharable report.

A report like this could include the indicators themselves, trend analysis, visualizations, and analysis of which indicators make a given community unique. This can be helpful to clients who want a clearer picture of local conditions for the purpose of strategic planning, making decisions about investments, and evaluation of the community in the future. A limitation of this approach is that with this kind of budget, we usually have the ability to talk about what a community looks like without the ability to say why it looks like this.

It’s also worth mentioning that benchmarking doesn’t have to just be communities. It can also apply to organizations.

Which type of analysis should I choose?

The type of analysis an organization should choose is based on the decision you are trying to make.

If you are trying to understand the economic activity associated with an industry, organization, or project, economic impact analysis is the best tool for you. If you are trying to understand if the economic benefits of a policy will outweigh its economic costs, cost-benefit analysis is the best type of analysis for you. If you are trying to evaluate the relative benefits of competing approaches to solving a problem, policy analysis is the best tool for you. If you need to understand the conditions, trends, or performance of your community versus others, data analysis and benchmarking will be the best approach for you.

These are analytical archetypes. Different analyses can combine techniques from different analytical frameworks. But limited budgets tend to limit the ability of answering all of these questions, so prioritizing which questions are most important to you and your organization is key to doing a thorough analysis with a given budget. Your most important job is to find out which question you most need answered, then analysts can help you understand the best way to go about answering them.

A $40,000 budget can support a range of different kinds of helpful analyses. There is no universally correct way to allocate those funds. It all depends on the question you are trying to answer. The most useful engagement for a policy analysis firm is when they can work with a client who needs evidence to help make decisions. If you want to learn more about costs associated with policy analysis, check out another blog I wrote on the topic. And if you are trying to figure out what kind of analysis you need, email me. I’d be happy to have a conversation with you about the question you are trying to answer and what can be answered with your budget.