Skip to content
Blog

Tag: measurement

Washington Roundtable Urges Legislators to Prioritize Higher Education

Posted on

A recent update on our state’s progress toward meeting the Washington Roundtable’s Benchmarks for a Better Washington emphasizes the need for legislative action on education, including protecting funding for our public universities, as well as transportation and business costs.  The Roundtable – a nonprofit, public policy organization comprised of major, local business executives – created the Benchmarks in 2011 as a means to measure and track Washington’s economic vitality and quality of life. The organization publishes annual updates that examine state-by-state comparative data (primarily from federal sources like the U.S. Dept. of Education); assess Washington’s position in key categories; and highlight opportunities for improvement.

The May 2013 update showed that:

  • Washington trails most states in high school graduation rates (ranking 32nd nationally) and bachelor’s degrees awarded per capita (39th nationally).
  • Washington’s road condition rankings have dropped from 16th (2012 ranking based on 2008 data) to 29th (2013 ranking based on 2011 data) and our state continues to rank poorly on bridge conditions (41st).
  • Washington ranks in the bottom third of states for business tax burden (36th), unemployment insurance tax rates (40th) and workers’ compensation benefits paid (50th).
  • However, Washington has held onto its lead in patent generation (5th) and in low commercial and industrial electricity rates (3rd).

The authors argue that Washington must move quickly to improve its education pipeline and align with workforce needs. As 70 percent of Washington jobs will require postsecondary training by 2020, they assert, “It is imperative that Washington prioritizes higher education and does a better job of preparing its citizens to succeed.”

In Monday’s edition of CrossCut, Roundtable President, Steve Mullin, urged lawmakers to focus on two key topics during the remaining weeks of session:  education and transportation. He specifically called for legislators to ensure our colleges and niversities have the funding they need to develop necessary talent. “Decision time is here,” he wrote, “Education is the driver of prosperity and individual quality of life. Transportation is the backbone of commerce. Both need attention before the 2013 Legislature adjourns.”

Is It All About the Money?

Posted on

As a recent post discussed, if you attend college, you are more likely to earn more money. But, as you might imagine, the financial value of higher education depends on what program you choose and where.

Information on the annual earnings of students from different programs and institutions is exactly what Sen. Ron Wyden, a Democrat of Oregon, and Sen. Marco Rubio, a Republican of Florida, hope to provide. Their recently-introduced “Student Right to Know Before You Go Act” proposes creating a state-based, individual-level data system linking the average costs and graduation rates of specific programs and institutions to their graduates’ accrued debt and annual earnings.

Although useful, Senator Wyden acknowledged that such information is limited and that focusing on financial indicators alone could undermine the importance of liberal arts—whose graduates may not earn large salaries right after college. He stated that the bill’s intention is “to empower people to make choices.” However, “people” include not just students, but policy makers—such as Florida’s Governor Rick Scott who sparked controversy last October when he asserted that state money should go to job-oriented fields, rather than fields like anthropology which, he said, do not serve the state’s vital interest.

Regardless of the bill’s success, about half of the states already have the ability to link postsecondary academic records with labor data. And some, such as Tennessee, have already done so. Here in Washington, the Education Research and Data Center is in the process of connecting certain employment and enrollment data for schools, such as the UW, to analyze in the coming months.

All this begs the question: Is college chiefly for personal economic gain?

A recent report by the College Board highlights both the financial and nonfinancial payoffs of college. Additionally, David A. Reidy, head of the philosophy department at University of Tennessee Knoxville, stated in a recent Chronicle article that four-year degrees, particularly in liberal-arts, are not solely for job training. “The success of the American democratic experiment depends significantly on a broadly educated citizenry, capable of critical thinking, cultural understanding, moral analysis and argument,” he wrote. Philosophy and other core disciplines help nurture such a citizenry, he continued, “And the value there is incalculable.”

NRC Panel Publishes Report on Productivity Measurement in Higher Education

Posted on

A few weeks ago, the National Research Council’s Panel on Measuring Higher Education Productivity published its 192-page report on Improving Measurement of Productivity in Higher Education, marking the culmination of a three-year, $900,000 effort funded by the Lumina Foundation and involving 15 higher education policy experts nationwide.

In explaining the need for a new productivity measure, the Panel made several key observations:

  • It’s all about incentives: Institutional behavior is dynamic and directly related to the incentives embedded within measurement systems. As such, policymakers must ensure that the incentives in the measurement system genuinely support the behaviors that society wants from higher education institutions and are structured so that measured performance is the result of authentic success rather than manipulative behaviors.
  • Costs and productivity are two different issues: Focusing on reducing the cost of credit hours or credentials invites the obvious solutions: substitute cheap teachers for expensive ones, increase class sizes, and eliminate departments that serve small numbers of students unless they somehow offset their costs. In contrast, focusing on productivity assesses whether changes in strategy are producing more quality-adjusted output (credit hours or credentials) per quality-adjusted unit of input (faculty, equipment, laboratory space, etc.).
  • Using accountability measures without context is akin to reading a legend without looking at the map: Different types of institutions have different objectives, so the productivity of a research university cannot be compared to that of a liberal arts or community college, not least because they serve very different student populations who have different abilities, goals, and aspirations. The panel notes that, among the most important contextual variables that must be controlled for when comparing productivity measures are institutional selectivity, program mix, size, and student demographics.

The Panel also contributed a thorough documentation of the difficulties involved in defining productivity in higher education. From time to time, it is helpful to remind ourselves that, while it may be “possible to count and assign value to goods such as cars and carrots because they are tangible and sold in markets, it is harder to tabulate abstractions like knowledge and health because they are neither tangible nor sold in markets”. The diversity of outputs produced by the institutions, the myriad inputs used in its activities, quality change over time and quality variation across institutions and systems all contribute to the complexity of the task.

Despite these difficulties, the Panel concluded that the higher education policy arena would be better served if it used a measure of productivity whose limitations were clearly documented than if it used no measure of productivity at all. It proposed a basic productivity metric measuring the instructional activities of a college or university: a simple ratio of outputs over inputs for a given period. Its preferred measure of output was the sum of credit hours produced, adjusted to reflect the added value that credit hours gain when they form a completed degree. Its measure of input was a combination of labor (faculty, staff) and non-labor (buildings and grounds, materials, and supplies) factors of production used for instruction, adjusted to allow for comparability. The Panel was careful to link all components of its formula to readily available data published in the Integrated Postsecondary Education Data System (IPEDS) so that its suggested measure may easily be calculated and used. It also specified how improvements to the IPEDS data structure might help produce more complete productivity measures.

The key limitation in the Panel’s proposal – fully acknowledged in the report – is that it does not account for the quality of inputs or outputs. As the Panel notes, when attention is overwhelmingly focused on quantitative metrics, there is a high risk that a numeric goal will be pursued at the expense of quality. There is also a risk that quantitative metrics will be compared across institutions without paying heed to differences in the quality of input or output. The report summarizes some of the work that has been done to help track quality, but concludes that the state of research is not advanced enough to allow any quality weighting factors to be included in its productivity formula.

While readers may lament the Panel’s relegation of measures of quality to further research, especially given the time and resources invested in its effort, the report remains a very useful tool in understanding the issues involved in assessing productivity in higher education and provides valuable food for thought for policymakers and administrators alike.