Assignment #2-Evaluating a Pre-Natal Exercise Program

Assignment #2: Program Evaluation of the Pre-Natal Exercise Program for Aboriginal Women.

It has been found that children born to a mother with gestational diabetes (GDM) have a greater chance of developing type 2 diabetes (Klomp, Dyck, & Sheppard, 2003).  Diabetes is a concern in the aboriginal population as it is estimated that 20% is affected by diabetes (Canadian Diabetes Association, 2013). This program was set up to try to decrease the incidences of GDM and eventually type 2 diabetes in Aboriginal people.  In order to accomplish this, pregnant Aboriginal women were invited to participate in an exercise program.  I think that Stufflebeam’s CIPP would be useful in the evaluation of this program.  I chose this model as it is well suited for needs assessment and planning, monitor the process of implementation, and provide feedback and judg­ment of the project’s effectiveness for continuous improvement, which is precisely what this project needs (Zhang et al, 2011). Stufflebeam’s CIPP model is composed of four components: Context, Input, Process and Product.

Context: The objective of context evaluation is to help decision makers assess needs, problems, assets and opportunities while defining goals and actions (Tan, Lee, Hall, 2010). The context of this study is the pre and post natal health of Aboriginal women. There are many socioeconomic needs that need to be considered when using this focus group. Limitations to transportation, program costs and lack of child care were all problems that were addressed to prevent women from participating in the program. The project was initiated to increase physical activity among young aboriginal women leading to healthy pregnancies reducing the occurrences of diabetes in future generations. The program intends to achieve this goal by hosting a weekly 45 minute exercise class instructed by a qualified instructor.

Input: Input evaluation helps decision makers to assess plans for the feasibility and cost-effectiveness for achieving planning objectives (Tan, Lee and Hall, 2010). The study was funded by the National Health Research and Development Program (NHRDP) and they would be using the information gathered by the evaluation. Assessing the cost-effectiveness is very important to determine as many costs are incurred in the delivery of the program. Staffing costs include: certified fitness instructor, registered nurse, project facilitator, and physiotherapist. Other additional costs that were incurred include: childcare, transportation, maternity swimwear, door prizes, food and drinks, and educational materials and resources.

Process: Process evaluation allows decision makers to determine if the program is achieving what it was intended to (Tan, Lee and Hall, 2010).  By examining the program and how it had adapted with the participants allows evaluators to gauge how the current program is functioning as well as how to structure anyn future programs. It is unclear as to how the participants were able to give their feedback, whether it was through surveys or verbal conversations, but either method would work.

Product: Product evaluation aids in identifying and assessing outcomes, those intended and unintended, short-term and long-term (Tan, Lee and Hall, 2010). Due to the short length of this ‘pilot’ study only short-term outcomes could be determined. If the study continued, long-term outcomes could be analyzed by seeing if GDM actually decreased due to the program. Short-term goal of ‘optimizing healthy pregnancies’ could be determined by allowing the participants to give feedback on the benefits of the program. Although I don’t believe it was done, vital signs (blood pressure, weight gain, etc) could be taken and used to give some concise data to the evaluation.  Some unintended outcomes of the program would be the added value of the program such as the information resources for loan and the social aspect from participants meeting after class.

I think a major problem with the program is the lack of clear and concise goals. Initially the program was designed to reduce type 2 diabetes in Aboriginals. Nothing in the program is set up to actually determine if this is occurring, not to mention what a huge undertaking that would be. Another problem is why there was such low participation (<%7).  Was this acceptable to the program or was it a goal to increase participation as well?

Canadian Diabetes Association. (2013). Six hundred Aboriginal diabetes programs at risk across Canada. Retrieved from http://www.newswire.ca/en/story/576011/six-hundred-aboriginal-diabetes-programs-at-risk-across-canada.

Klomp, H., Dyck, R., and Sheppard, S. (2003). Description and evaluation of a prenatal exercise program for urban Aboriginal women. Canadian Journal of Diabetes, 27: 231–238.

Tan, S., Less, N., and Hall, D. (2010). CIPP as a model for evaluating learning spaces. Swinburne University of Technology. Retrieved from http://www.swinburne.edu.au/spl/learningspacesproject/.

Zhang, G., Zeller, N., Griffith, R., Metcalf, D., Williams, J., Shea, C., and Misulis K., (2011). Using the Context, Input, Process, and Product Evaluation Model (CIPP) as a Comprehensive Framework to Guide the Planning, Implementation, and Assessment of Service-learning Programs. Journal of Higher Education Outreach and Engagement, Volume 15, Number 4, p. 57.