Program Effectiveness & Impact

Strategic planning; strengthen reputation value of EERE portfolio by executing communication plans for each deliverable; Special Project: Recovery Act evaluation, monitoring, and verification.

Primary Contact:

Previous and Ongoing Analyses :

Program Evaluation

  • Brown, M.A., V. Kreitler, and A.K. Wolfe, 1996. "The Persistence of Program Impacts: Methods, Applications, and Selected Findings." Energy Services Journal 2(3):167-192 (Amy Wolfe)
  • Wolfe, A.K., M.A. Brown, and D. Trumble, 1995. Measuring Persistence: A Literature Review Focusing on Methodological Issues. ORNL/CON-401. Oak Ridge National Laboratory, Oak Ridge, Tennessee (Amy Wolfe)
  • Weatherization Assistance for Low-Income Households: An Evaluation of Local Program Performance, February 1987. Prepared with M. Schweitzer, R. Cantor, T. Mason, B. Ragins, and S. Rayner. Draft Final Report, ORNL-6337, Oak Ridge National Laboratory, Oak Ridge, TN (Marty Schweitzer)
  • Retrospective evaluation of DOE's Weatherization Assistance Program (Bruce Tonn)
  • Weatherization Assistance Program ARRA evaluation (Bruce Tonn)
  • Evaluation of DOE's State Energy Program (Bruce Tonn)
  • Evaluation of DOE Automotive Lightweighting program projects (Bruce Tonn)
  • Program evaluations of both the Weatherization Assistance Program and the State Energy Program using competitively selected contractors under an EERE and OMB approved process for selection independent evaluators (Joel Eisenberg)

Prospective Analysis

  • Greene, D.L. and P.N. Leiby. (2006). The Oil Security Metrics Model: A Tool for Evaluating the Prospective Oil Security Benefits of DOE's Energy Efficiency and Renewable Energy R&D Programs, ORNL/TM-2006/505, Oak Ridge National Laboratory, Oak Ridge, Tennessee, May. (David Greene, Paul Leiby)
  • Assisted EERE in developing methodological framework for prospectively estimating the benefits of its R&D programs (http://www.esd.ornl.gov/benefits_conference/) (Russell Lee)
  • Lee, R., Jordan, G., Leiby, P.N., Owens, B., Wolf, J.W. (2003) Estimating the benefits of government-sponsored energy R&D," Evaluation Research, Vol. 12, no. 3, pp. 183-195 (Russell Lee, Paul Leiby)
  • Lee, R., "OE Benefits Analysis for GPRA, Annual Budget Submission, and Addressing R&D Investment Criteria, and other R&D Planning," prepared for the Office of Energy Reliability and Electricity, Oak Ridge, TN: Oak Ridge National Laboratory, May 2007
  • Lee, R., "Option Benefits of Government Investment in Energy Technology RD3: Concepts and Approach," prepared for the Office of Energy Efficiency and Renewable Energy, U.S. Department of Energy, Oak Ridge, TN: Oak Ridge National Laboratory, August 2007 (original draft written July 2005)

Metrics and Strategic Planning

  • Synergies among NYSERA energy efficiency programs (Bruce Tonn)
  • Building upon team's strengths in ITP's data systems and metrics development, analysis and reporting, the team also supports ITP in strategic planning activities; develops planning models based on the empirical from our metrics system and evaluation results; and is responsible for impacts reporting for ITP activities with industry. The team also has had some success gaining OMB approval on survey instruments (Michaela Martin and M. Schweitzer, S.U. Nimbalkar, B. Tonn, M. Lapsa, A. Wolfe, L. Truett, R. Schmoyer, R. Goeltz)

Evaluating Different Types of Benefits

  • Non-energy impacts of energy-oriented water and wastewater treatment projects (for NYSERDA) (Amy Wolfe)
  • Environmental impact assessment of disposition of uranium tailings (Shih-Miao Chin and Ho-Ling Hwang)
  • Traffic impact and noise analysis environmental assessment study (Shih-Miao Chin and Ho-Ling Hwang)
  • Temporarily lost highway capacity study (Shih-Miao Chin and Ho-Ling Hwang)
  • Disruption of rail services (Shih-Miao Chin and Ho-Ling Hwang)
  • Non-energy benefits of WAP (Bruce Tonn)

Relevant Areas of Expertise and Capabilities:

Program Evaluation Methods

  • Cost-benefit analysis (Russell Lee)
  • PHEV usage behavior modeling (David Greene, Zhenhong Lin)
  • National commodity flows and analysis (Shih-Miao Chin and Ho-Ling Hwang)
  • Expertise in passenger and freight characteristics and their movements in the U.S. (Shih-Miao Chin and Ho-Ling Hwang)
  • Knowledge of data and movement involving foreign trades (Shih-Miao Chin and Ho-Ling Hwang)
  • Intermodal and multimodal transportation analysis (Shih-Miao Chin and Ho-Ling Hwang)
  • Project/technology/program effectiveness and impacts assessment - evaluate technology effectiveness, program effectiveness, infrastructure changes, program changes, etc. (Rekha Pillai, et al.)
  • Readiness or resiliency assessments - performance metrics at technology, asset, systems level (Rekha Pillai, et al.)
  • Pilots planning and assessment - operational testing and evaluation (Rekha Pillai, et al.)
  • Energy program evaluation (Bruce Tonn)
  • Methods development (Bruce Tonn)
  • Evaluation of public and private sector energy efficiency programs, assessment of socioeconomic impacts related to construction and operations of large-scale energy-related facilities (Martin Schweitzer)
  • ORNL has extensive experience in the analysis of DOE's grants programs and the statistical and engineering expertise to conduct these projects.  We have also had extensive experience with both the EE&RE and OMB procedural requirements (Joel Eisenberg)
  • Well-versed in design and use of ITP industrial databases, EIA-MECS, industrial customers. Team comprised of engineers, evaluators and a statistician (Michaela Martin and M. Schweitzer, S.U. Nimbalkar, B. Tonn, M. Lapsa, A. Wolfe, L. Truett, R. Schmoyer, R. Goeltz)

Preliminary Ideas on Possible Studies

  • Use PHEV consumer choice model as a quick analysis tool to analyze the impact of policies on PHEV development. The model currently can respond to purchase subsidy, tax credit (e.g. ARRA PHEV tax credit), battery warrantee extension, free parking, free HOV access. It can be adjusted to allow more types of policies. (David Greene, Zhenhong Lin)
  • Compare effectiveness of alternative policies, such as PHEV purchase tax credit vs. Cash for Clunkers, in reducing GHG (David Greene, Zhenhong Lin)
  • Continue and expand the oil security metrics project (David Greene, Zhenhong Lin)
  • Develop, implement and apply a methodological framework to estimate the benefits of investments made by the Office of Energy Efficiency and Renewable Energy, under the American Recovery and Reinvestment Act (Russell Lee)
  • Estimate economic impacts and energy supply shortages due to interruptions in transportation services (Shih-Miao Chin and Ho-Ling Hwang)
  • Systematically identify synergies among EERE Technology R&D Programs and Projects (Bruce Tonn)
  • Develop methodology and systems for program performance tracking, reporting, feedback and planning. (Michaela Martin and M. Schweitzer, S.U. Nimbalkar, B. Tonn, M. Lapsa, A. Wolfe, L. Truett, R. Schmoyer, R. Goeltz)

Highlights

JUST RELEASED! 2013 Vehicle Technologies Market Report
The 2013 Vehicle Technologies Market Report was released March 31, 2014 via the web. The report details the major trends in U.S. light-duty vehicle and medium/heavy truck markets. This report is produced by Oak Ridge National Laboratory for the U.S. Department of Energy's Office of Energy Efficiency and Renewable Energy.

Edition 32 of the Transportation Energy Data Book Released
The Transportation Energy Data Book (TEDB) is a compendium of data on transportation with an emphasis on energy. Designed for use as a desktop reference, the TEDB was first published in 1976 and has continued to Edition 32. The TEDB is produced by Oak Ridge National Laboratory for the U.S. Department of Energy's Office of Energy Efficiency and Renewable Energy.

Numerous CTA Staff make presentations at the DOE Annual Merit Review Meeting, May 13-17, 2013.
The U.S. Department of Energy's (DOE's) 2013 Annual Merit Review and Peer Evaluation Meetings for the Hydrogen and Fuel Cells Program and the Vehicle Technologies Program held May 13–17, 2013. The staff members attending were David Greene, P.T. Jones, Andreas Malikopoulos, Zhenhong Lin and Stacy Davis

ITS Asset Viewer Unveiled at ITS-America Meeting in Nashville, TN
At the Annual Intelligent Transportation Association of America (ITS-A) meeting held in Nashville on April 22 -24, the U.S. DOT unveiled the new ITS Asset Viewer that uses visual mapping technology to identify locations of specific ITS deployments by type. Mike Schultz and Steve Gordon worked with their U.S. DOT Joint Program Office sponsor, James Pol, to provide demonstrations during the meeting.