Assess the effectiveness of a pedestrian program by involving procedures that are useful, feasible, ethical, and accurate.
Evaluating the program can demonstrate to stakeholders how effective the program is. The program can be then replicated in other areas with more confidence.
Align intervention efforts with the overall goals of your agency (and other partner agencies when possible) to keep the evaluation focused and useful.
The goals and objectives should align with other strategic plans such as the State Highway Safety Strategic Plan.
Developing pedestrian safety interventions for goals and objectives are on the individual programs within the PSAP or can be done on the PSAP as a whole.
You may not need to create the goals and objectives of the intervention being evaluated. A well-crafted PSAP or intervention description will have the goals and objectives clearly outlined.
The partners and stakeholders can provide additional insight (not described in the PSAP) on how the interventions were implemented and changes to the implementation. Including them in the process is essential to understanding the intervention and enhancing the evaluation.
When you take the time to build population profile, remember to consider the perspective or your target audience. For example, if your priority population reads at a low literacy level, be sure to draft education materials and signage with easy-to-read and accessible language so that the messaging is clear.
Well-designed PSAPs should already have the risk factors and protective factors identified before an intervention has been implemented.
There are other models that can be useful to map out the relationship of the intervention. For example, the Social Economic Model (SEM) or the Action Model are frameworks that provide a visual representation of the network of interactions between an individual, their interpersonal relationships, organizations, community, and policy.
Logic models are designed to illustrate the intervention in a clear and concise format. Keeping it simple will keep you, your team, and the intervention on track.
Make sure partner concerns are included to increase applicability of the evaluation results to pedestrian safety improvements.
Existing Data Systems include Crash and Roadway data, Vehicle data, Driver Citation & Adjudication data
Injury Surveillance Systems (i.e., MS, Trauma Registry, State level ED and Hospital inpatient discharge data, and Vital Records).
Using data/information collected from pedestrian counts can inform the change in pedestrian behaviors prior to and after a new intersection design was created.
The DOT may collect pedestrian counts as part of the street auditing procedures. Working closely with the DOT partners can ensure that other variables that can inform the evaluation will be collected by during street auditors.
Often this method requires a great deal of pre-planning and coordination with other partners to ensure that timing and survey distribution logistics are appropriate and in alignment with the intervention.
For the purpose of triangulation, it’s good practice to have more indicators of an outcome or activities collected in more than one data collection instrument.
A survey should contain simply written questions that will help collect accurate and meaningful survey responses. For more tips on how to construct survey questions see “CDC Program Evaluation Tip Sheet: Constructing Survey Questions”
For more tips and guidance on how to design a survey visit Creative Research Systems
Here is a table of variables to consider from each data source.
A more detailed list and data source description can be found in the ISW8
When deciding on which format to use for your KII or FGD, be sure to have an understanding of your target audience and goals of your evaluation. For example, if you want to measure interactions and body language, it might be best to do a face-to-face interview.
Although it is extremely valuable to review case studies presented by others online and through your network, you may find it even more valuable to create and review case studies from your own agencies. Review what you have done in the past and evaluate an intervention. Here is a resource to help you write a case study for your agency.
When conducting an environmental observational study on a specified area, you can engage your stakeholders and ask them to join you. This is a great way to continue collaboration and to get to know the environment and its functionality as best as you can.
When you are working with stakeholders to prioritize needs, make sure that you are working in a small group. The more opinions you have at the table, the longer this process will take. Working with partners to identify needs will establish buy-in when it's time to put in the work and implement change.