Thursday, February 23

Evaluation

We have been conducting evaluation studies for two decades. Ryn Hamilton has an advanced degree in econometrics and spearheaded some of the earliest econometric-based impact evaluation studies in the 1980s.

In the intervening years we have analyzed virtually every customer class and market sector. The past decade has produced advances in the art of evaluation that have significantly elevated the practice. The optimal evaluation approach integrates the guidance in industry protocols with the unique attributes of each program, forces impacting its performance and expectations of regulators.

Energy Efficiency Evaluation StudiesRyn Hamilton has been involved in the development of new standards for impact analysis of energy efficiency and demand response products and programs in both wholesale and retail markets through participation in the North American Energy Standards Board on behalf of a utility client.  (Wholesale measurement and verification standards are pending approval by the Federal Energy Regulatory Commission. Retail standards will be submitted to NARUC and may be adopted by state utility commissions at their discretion).

Our evaluation studies are transparent, relevant, and provide a balance between certainty of results and cost. Greater evaluation consistency and rigor has been introduced by the International Performance Measurement and Verification Protocol and the California Public Utilities Commission Evaluator Protocols.  The California Measurement and Advisory Council has compiled a valuable database of completed evaluation studies, and the American Evaluation Association has made its own contribution to the art of evaluation and greater standardization.

Periodic Program Evaluation

Our studies are conducted within the context of an annual portfolio plan that outlines the major activities that will be conducted during the year, including budget and allocation between programs and measures. Evaluation must be performed on a regular schedule and a reasonable percent of program expenditures should be devoted to its practice. The risk of under-investment is a drift in program focus that can result in non-attainment of goals and erosion of program quality.  

Accurate estimation of impacts from energy efficiency and demand response programs is necessary to guide future investments, improve program design and enable the energy and demand savings from these programs to be counted toward achievement of utility resource goals.  Our evaluation methods and practices provide data for utility and regional planners, allow comparison with other programs, reveal best practices and enhance credibility with stakeholders.

 

  • Evaluation Studies

    Evaluation Studies

    We have conducted numerous studies for utilities, states and other entities.

    Duke Energy. We developed monitoring and verification plans for Duke’s portfolio of energy efficiency programs which formed the basis for a competitive solicitation for evaluation contractors.

    Wisconsin Focus on Energy Program. We conducted an impact evaluation of a performance contracting program and a commercial retrofit program using statistical modeling and engineering analysis to estimate demand and energy impacts.

    National M&V Standards Development. We participated in development of recommendations to FERC for impact evaluation protocols for demand response resources and energy efficiency programs.

    American Society of Mechanical Engineers. In another kind of evaluation project, we participated in an assessment of the ASME Board of Governors, collecting and analyzing data from Board members and staff on accomplishments and areas for improvement.

    Connecticut Municipal Electric Cooperative. Under subcontract to MGALLC, we participated in CMEEC’s Annual Board Evaluation Study, and contrasted findings with previous years to assess progress.

    Georgia Department of Transportation. We evaluated the Georgia DOT’s compliance with air quality regulations under subcontract to Cambridge Systematics.

    Northeast Energy Efficiency Alliance. We participated in an evaluation of a local government association project assessing the extent to which the goals of the organizations overlapped, and whether there was a basis for a common agenda.

    University of Massachusetts. We performed an evaluation of training courses for workers employed in occupations in which hazardous waste is a factor.

    We have conducted additional impact evaluation studies for NStar, NGrid, Bangor Hydro, NYPA, Wisconsin Electric Power, Sierra Pacific Power, Washington Electric Coop, Citizens Utilities, CVPS, Southern Company and PP&L.