Evaluations

The Philip R. Lee Institute for Health Policy Studies has long been a leader in conducting program and policy evaluation to informing decision-making related to health care delivery, access to care, and quality improvement. Institute faculty and researchers have designed and executed single and mixed-method evaluations at the international, national and local levels on behalf of non-profit organizations, government agencies, and private foundations. 

PRL-IHPS faculty and researchers bring their tested ability to design, execute and manage complex, multi-site evaluations and their strong analytical skills. Their experience spans developing and administering quantitative and qualitative study designs, including the collection and analysis of data from telephone, mail and electronic surveys, focus groups, structured and semi-structured interviews, and secondary sources.

PRL-IHPS has also launched the UCSF Evaluation Community of Practice to support professional development, networking, and sharing of designs, methods and findings. 

The Institute is also at the forefront of communicating evaluation findings to diverse stakeholders through a variety of dissemination modalities. In addition to considerable technical and methodological skill, the Institute's evaluators bring significant content expertise to their work. Among the topical areas for which the Institute is well known include:  

Claire Brindis, DrPH, is Director of the Philip R. Lee Institute for Health Policy Studies (PRL-IHPS) and Professor of Pediatrics and Health Policy. She also serves as Director of UCSF's Bixby Center for Global Reproductive Health and Co-Project Director for the Adolescent and Young Adult Health National Resource Center. As Principal Investigator of the School Health Services Evaluation team, she has led numerous local, state, and national evaluations of school-based health centers, reproductive health services for low income adolescents, children's health coverage initiatives, and coalitions devoted to expanding access to community clinics. Dr. Brindis incorporates a variety of research methodologies into her work, including community participatory research, quantitative, and qualitative approaches. She is particularly committed to the translation of research findings into policies and programs.  Dr. Brindis helped open one of the first school-based health centers in San Francisco, California, and authored several manuscripts on school-based health centers, as well as the "Guidebook for Evaluating School-Based Health Centers," the first comprehensive evaluation manual of its kind. 

Janet M. Coffman, MA, MPP, PhD has designed and directed evaluations of health workforce initiatives. She is currently leading an evaluation of a pilot project under which paramedics are being trained to practice in expanded roles for the California HealthCare FoundationShe is also directing an evaluation of grants The California Endowment has made to the California Office of Statewide Health Planning and Development to support training programs for primary care providers and to the Health Professions Education Foundation to fund service-contingent scholarship and loan repayment programs for health professionals. Dr. Coffman utilizes both quantitative and qualitative methods, including interviews, surveys, and analyses of secondary data. She has also conducted quantitative analyses of the effects of interventions on cost, utilization, satisfaction, and health outcomes.

Mara Decker, DrPH, MHS has designed and overseen several applied research projects and evaluations focusing on reproductive health both domestically and globally. Currently, she directs the evaluation of California's Teen Pregnancy Prevention programs as well as a needs assessment on adolescent reproductive health in several countries for the World Bank. Most of her work involves mixed methods and is dedicated to identifying and reducing health disparities. Previous international evaluation efforts include assessing youth-serving clinics in Kenya and the reproductive health needs of internally displaced women in Angola. Other topic areas evaluated include supportive housing services for chronically homeless individuals, STI prevention efforts among youth, and various health policies in rural California. She currently serves on the Data and Evaluation Committee of the Adolescent Health Work Group.

Jason D. Flatt, PhD, MPH has led several program evaluations for dementia programs and health-related services for diverse aging populations. As part of the UCSF Health Workforce Research Center in Long-term Care, he is conducting research on dementia care workforce, including services and staffing models for Adult Day Health Center and the role and practice of dementia care specialists. He is also co-leading the evaluation of two, 3-year Alzheimer’s Disease Initiative – Specialized Supports and Services Grants with San Francisco’s Department of Aging and Adult Services and San Diego County. He also has experience with both qualitative and quantitative research methods, including online surveys, health assessments, focus groups, in-depth interviews, and the analysis of longitudinal data. Jason works with community members to apply evaluation findings to address disparities in risk of dementia and care for diverse aging populations.

Annette Gardner, PhD, MPH has designed, directed and served as an advisor on national, state and local evaluations focusing on expanding access to care, insurance coverage expansions, the adoption of health information technology, and expanded advocacy capacity. She was the Director of an 8-year evaluation of The California Endowment's Clinic Consortia Policy and Advocacy Program that paved the way for advocacy and policy change evaluation more broadly. She was the Director of a 4-year evaluation of the California HealthCare Foundations Step-by-Step Local Coverage Expansion Initiative to expand insurance coverage for uninsured children and adults. She is currently involved in designing and executing components of medical education evaluations focusing on health care provider interprofessional collaboration at the Veterans Administration Health Care System. Dr. Gardner uses a variety of qualitative research methods, including case studies, focus groups, surveys, observations, and informant interviews, as well as quantitative methods such as financial analyses and descriptive statistics.  She is well-versed in working with stakeholders to apply evaluation findings to program improvement and strategic learning

Sara Geierstanger, MPH, has designed and directed multiple evaluations on a variety of community health topics, including school-based health services, the impact of school health services on academic outcomes, sustainability of school-based health services, adolescent reproductive health, and community health center advocacy. As part of the School Health Services Evaluation team, her current activities include an evaluation of the Alameda County Center for Healthy Schools and Communities' School Health Services program, as well as an evaluation of California Department of Education's Promoting Adolescent Health through School-Based HIV/STD Prevention and School Surveillance program funded by the Centers for Disease Control. She also consults the School Based Health Alliance as they work to develop standardized performance measures for school-based health centers nationwide. Her expertise is in multi-site program evaluations using a combination of qualitative and quantitative methods to inform programs and policies, including surveys, focus groups, and analysis of clinic encounter data.  She is particularly committed to ensuring that the evaluation data meets the needs of the programs and funders, and translates into improved services for youth. 

Dana Hughes, DrPH, MS, has designed, directed and managed numerous complex, multi-site evaluations at the federal, state and local levels. Currently, she is co-leading an evaluation of seven oral health innovations  designed to improve utilization of preventive oral health and achieve oral health outcomes.  She is also co-leading a national organizations funded to engage low income and older consumers in the process of transforming the organization and delivery of health services to better meet needs and reduce costs.  Dr. Hughes employs both quantitative and qualitative methods (including telephone, mail and electronic surveys, focus groups, structured and semi-structured interviews, and secondary sources) and applies substantive knowledge of issues related to health and health care issues associated with low income and other vulnerable population to help shape projects' design, methods and implementation.

Elizabeth Mertz, PhD, MA, has led, designed, executed and advised various evaluations with a focus on oral health systems, dental workforce and health disparities. She has done work with multiple foundations and educational institutes to evaluate policy initiative such as alternative practice dental hygiene and loan repayment programs in terms of improvements in access to care. She has evaluated educational programs such as the dental post-baccalaureate for their capacity to change workforce practice patterns. She is currently the co-Principal Investigator on a multi-phase NIDCR-funded program evaluation of standardized preventive dental care on reducing dental disparities in Children. Dr. Mertz employs mixed methods in her evaluation work including primary data collection though surveys, focus groups, structured and semi-structured interviews, as well as secondary data analysis. She brings substantive knowledge of the oral health system and theoretical grounding in medical sociology, health policy, and health services research issues to her projects' design, methods and implementation. She prefers a highly collaborative process of evaluation rooted in best practices of stakeholder engagement from start to finish.

Sandy Ng, MPH, works in health policy research evaluation with a focus on school-based health services, children's health insurance coverage, and adolescent health. Working full-time on the School Health Services Evaluation team, she currently coordinates the clinic-based data collection for the evaluation of 25 school health centers in Alameda County. She oversees their web-based electronic data collection database and is leading the effort to import clinic data from Electronic Health Records. In addition, Sandy is evaluating 6 school health centers in Contra Costa County through focus groups, client surveys, and analysis of clinic encounter data. She has previously evaluated school-based yoga and mindfulness programs, school-based behavioral health services, and after school programs.  Finally, she has worked on quality improvement efforts with health and human services agencies throughout California to streamline outreach, enrollment, and retention in public/private health insurance programs.  

Matthew J. Niedzwiecki, PhD, has worked on projects designed to improve care coordination for high-cost patients. He is currently co-leading an evaluation of the Pay for Success Project in Santa Clara county that provides permanent supportive housing for homeless individuals who are frequent users of county health care facilities, corrections, and homeless services. Previous research projects have investigated the effect of health insurance expansion on patient utilization of the emergency department and the degree to which Medicare patients select into emergency department care instead of primary care. Dr. Niedzwiecki works in quantitative analysis of secondary data, including applied econometric techniques to estimate causal effects.

Shira P. RutmanShira P. Rutman, MPH joined PRL-IHPS in 2017 to support the evaluation of California’s Adolescent Pregnancy Prevention programs among other projects. Her work over the past decade has included quantitative and qualitative studies focused on adolescent health, infant mortality, reproductive health, sexual violence, and social determinants of health among urban American Indian and Alaska Native populations. Most recently, she led the design and implementation of an evaluation of the CDC’s largest single investment to prevent chronic disease among American Indians/Alaska Natives, including 23 tribes and tribal organizations nationwide. She has also conducted projects in a range of topics, such as data quality improvement, clinic capacity assessment, communication campaign development, and health data literacy training. Shira is dedicated to identifying and reducing health disparities particularly among vulnerable populations.

Samira Soleimanpour, MPH, has led numerous multi-site, multi-method evaluations of school and adolescent health initiatives with the School Health Services Research and Evaluation Team for over 17 years. Specifically, her areas of evaluation research include school-based health centers (SBHCs), school-based mental health services, community-based participatory research, and adolescent sexual health programs. Samira is currently the Principal Investigator on evaluations of two federally-funded initiatives led by the California Department of Education focusing on school-based behavioral health and adolescent sexual health services. She also leads evaluations of Bay Area initiatives focused on school-based health services and youth trauma exposure. In addition, she serves as a consultant to the national School-Based Health Alliance on their initiative to develop standardized performance measures for SBHCs and their national Census of school-based health care programs. Samira received her Master of Public Health from the George Washington University and her Doctor of Philosophy from the Johns Hopkins Bloomberg School of Public Health. She utilizes both quantitative and qualitative methods in her evaluation work, including primary data collection through surveys, interviews, and focus groups and secondary data analysis. She is particularly committed to the translation of evaluation findings into policies and programs that improve children's health and educational outcomes. 

Joanne Spetz, PhD, has directed multiple evaluations of health care programs and innovative workforce education and deployment initiatives.  Prior evaluation studies include the California Nurse Workforce Initiative, the Central Valley Nursing Diversity Initiative Evaluation, the VA's health information technology systems on the nursing workforce and quality of care, implementation of an integrated information technology system in a rural hospital, the Shared Services Project of the Betty Irene Moore Nursing Initiative, and the Betty Irene Moore Nursing Initiative Faculty Supply Grants. Current projects include an evaluation of Oral Health Workforce Innovations, the acceleration of registered nurses to baccalaureate education, and the success of the Robert Wood Johnson Foundation Campaign for Action for the Future of Nursing. Dr. Spetz works with a variety of methods, including process analysis, cost analysis, surveys and individual interviews. She aims for her evaluation work to support the development of more successful programs and policies.

Renae Waneka, MPH, has managed and implemented multiple evaluations with a focus on evaluation management. Her recent work includes evaluation of an online system used to schedule clinical placements for nursing students that was supported by funding from the Gordon and Betty Moore Foundation; a mixed-methods evaluation of the Betty Irene Moore Nursing Initiative Faculty Supply Grants, using surveys, secondary data analysis, and repeated interviews with graduates of the programs, nursing faculty, and mentors of new faculty; and guiding and managing evaluation efforts of health workforce investments made by the California Endowment. Renae has used a variety of mixed-methods techniques, including interviews, focus groups, primary data collection through surveys, secondary data analysis, and data analysis using Stata.

Jennifer Yarger, PhD, has designed and directed evaluations focusing on unintended pregnancy prevention and reproductive health services. She has been involved with the evaluation of California's Family Planning, Access, Care, and Treatment (Family PACT) program and teenage pregnancy prevention programs. Her current work includes research and evaluation on the impact of the Affordable Care Act (ACA) on publicly funded family planning centers. Dr. Yarger has expertise in mixed methods research and longitudinal data collection and analysis.

Presentations
and Evaluation Reports

Evaluating Standardized Preventive Care to Reduce Dental Disparities in Children

Video: Exploring the role, preparation, and practice of Dementia Care Specialists

Video: Designs, methods, and tools needed to conduct effective advocacy and policy change evaluations

Talk, Read, Sing Intervention at UCSF Benioff Children’s Hospital Oakland

Video: Evaluation of the Campaign for Better Care

Presentations from the 2016 Community of Evaluators Meeting at PRL-IHPS

Access to Publicly Funded Family Planning Services in California, Fiscal Year 2007-08 to Fiscal Year 2011-12

Decline in Adolescent Female Participation in the the Family PACT Program

Teen Pregnancy Prevention
in California after State
Budget Cuts

Brief: Teen Pregnancy Prevention in California after State Budget Cuts

Clinic Consortia Policy & Advocacy Program Evaluation - Executive 
Summary 2004-2006

Alameda County Health Care Services Agency School Health Centers 2012-13 Evaluation Report