Results
Evaluation:
Horseback Miracles, Inc. (HBM) is committed to evaluating the impact of our program by successfully monitoring the life values and pro-social behaviors of the participants. HBM’s performance evaluation is more than an academic exercise conducted at a single point in time – it is a complete strategic systematic approach that has become an intrinsic component of our quest to build an effective and efficient operation.
Impact Measurement:
HBM worked collaboratively with clinical professionals and a behavioral research methodologist to specifically design an evaluation of participant changes in self-control, relationships, and pro-social competency skills. Data is collected through pre-and post-testing, weekly observations, focus groups, and one-on-one interviews using assessments developed for the measurement of HBM’s scientific and evidence-based equine therapy program. Successful statistical outcomes are reflected through the scores registered on the pre/post-assessment testing instruments. Reliability calculation for each scale of evaluation consistency among the scale items. In addition, a successful quantitative analysis is based upon an increased agency level recognition schedule of the participants.
Outcome:
HBM defines success by the ability of our program to positively affect behavioral changes in our participants. HBM’s program outcomes are defined in terms of each participant’s developmental progress, with regard to her relationships, pro-social competency skills and self-control of her antisocial behaviors.
Technical Summary of Key Results:
A repeated measuring t-test, and effect size, displayed a significant positive large difference between the participants pre and post self-assessment scores; t(20) = 9.57, P<.01, d = 1.91.
Layperson’s Summary of Key Results:
According to Cohen’s d interpretation scale …
.2 = small change from the pre- to post-test evaluation
.5 = moderate change
.8 = large change
- to post-test evaluation change
Out of the core treatment issues measured, HBM’s overall average improvement score ranged between 1.25 and 2.54, which is significantly higher than the scale presented above for results from the pre- to post-testing evaluations. An excerpt taken from the initial data analysis conducted by clinical professionals and behavioral research methodologists follows:
The preliminary analysis revealed that both youth self-report and therapist assessment of youths’ behaviors indicate that female adolescents engage in more positive social and emotional behavior after completing the HBM program. A significant difference between both youth and therapists pre and post totals, as well as the majority of sub-scale scores, provides preliminary evidence that the HBM therapy program may influence the expression of positive social skills in high-risk adolescent girls. The data from the evaluation has provided preliminary evidence that therapy at HBM is currently achieving the measurable desired objectives/outcomes of the program.
