February 19, 2007 - 9:52pm
Strategic planning has been used by public and non-profit organizations for decades. Planning has both its adherents and its detractors--those who feel it is a useful exercise find that it helps to set direction and keep varied interest groups focused on issues important to the key mission. Others find it nearly impossible to create plans that anticipate all possible future scenarios, and particularly that monitoring progress falls to the wayside as day-to-day reality sets in.
February 7, 2007 - 12:29pm
In our work with the Girl Scouts of the USA to evaluate the uniquely ME! program, we currently designing a blog for girls that will be used as part of the evaluation. This is a new and exciting territory for us and our heads have been buzzing with ideas of how best to collect and analyze the data. We’ve designed the blog so that girls will be able to comment on our posted questions about beauty, self-esteem and healthy living.
January 2, 2007 - 12:35pm
Clients often ask us how they can be sure they are getting the "true" answer to their research questions. This question comes up when developing a survey, reviewing participant files, or even recruiting for a focus group. The answer comes down to both sampling strategy and sample size.
December 26, 2006 - 4:09pm
Recently we had a data security issue in our office; a flash drive with client data was lost. All of us involved were very devastated; we felt horrible that it happened and worried about the risks to our client and the people they serve. Although our client was understandably upset, and we felt horrible, we did the best we could under the circumstances to make amends. We actually received compliments (!) on how we handled the issue. We also were told by several people that this sort of thing happens all the time.
December 14, 2006 - 6:36am
In our on-going work with Performing Arts Workshop, we've been asked to conduct a quasi-experimental evaluation of their arts residency program, Artists-in-Schools. Based on results in the last three years, they created the ARISE program, designed to bring arts residencies to classrooms with some students with special needs (called inclusion classrooms in California).
November 13, 2006 - 1:02pm
In October I attended a session and the Minnesota Council of Non-Profits/Foundations conference on how to build on assets in rural communities. The session’s panel shared some interesting examples of how their rural communities had uncovered new resources to help meet their needs. For instance, one non-profit organization described how they had been able to secure a phone system donation from a local company that had upgraded to a new phone system; another organization described how they had been able to shape a fundraising event around board members' landscaping expertise.
October 20, 2006 - 2:33pm
The most recent issue of the American Journal of Evaluation (v. 27, n3, Sept. 2006) presents an interesting ethical scenario: when is an evaluator no longer external? In the scenario, an evaluator has been working with an agency for a number of years, and a significant portion of their income comes from the single agency. A foundation, interested in funding a replication of a program that was found to have promising results by the evaluator, is concerned that the evaluator is not external.
September 14, 2006 - 3:47pm
Today we had the opportunity to join Tom DeCaigny, executive director of Performing Arts Workshop, as he visited with corporate giving staff from St. Paul Travelers, one of their funders. Although we've worked directly with funders who require evaluation, this is the first time we've had the opportunity to sit down and learn about the interests of those who primarily support programs.
September 8, 2006 - 4:16pm
All good ideas... are difficult to implement! The Improve Group has some tools that we are making better use of in our own planning, however. Thanks to a SharePoint site, our staff are able to host discussions, post ideas and share lists of resources that are open to any contributers. We can also create sub-sites for any of our projects which serves us well for managing some of our larger projects.
September 1, 2006 - 6:48am
We are in the process of piloting retrospective pre-test surveys for one of our clients. The retrospective pre-test has been shown in research to be the most valid way to capture change as a result of a program or intervention, particularly among young people. It asks participants at the end of the program to rate their own status at the beginning of the program and their current status; so a sample question might be: For each question below, circle your answer.