Thoughts on Evaluation Process
August 26th, 2009The process of redesigning the Pulitzer’s Exploring Art program has been long and circuitous. We have agreed at last on the intended audience and overall purpose for the program: to draw in first time visitors and individuals who do not normally have any interest in or feel uncomfortable in art museums. We have structured the program content so as to put visitors at ease and increase their comfort level within the walls of the Pulitzer and with the art itself. We have trained our docents in Visual Thinking Strategies and facilitating group dialogue. And now, as we schedule our first group of visitors, our discussions have centered on how to best evaluate Exploring Art.
In theory, to effectively evaluate this pilot program we should take extensive measurements regarding our participants’ experience. Administering surveys pre-visit, immediately post-visit, and two weeks after the visit would allow us to establish a base line and track changes over time. The breadth and depth of such data collection would give us a richer picture of Exploring Art’s impact. However, with each level of increasing evaluative rigor we also increase the invasiveness of our questioning. Requesting participants to complete a 20-item survey and then consent to supplying personal contact information is hardly a lighthearted trip to the museum.
Of course, some visitors may truly appreciate being able to share their opinions; some may really value taking part in the program piloting. Still, in many ways our goal of making first time visitors feel comfortable is at odds with our goal of in depth evaluation. Which leaves us with the question — How do we balance this tension between wanting quality data that can inform future programs and wanting to create a welcoming atmosphere for potentially nervous or disinterested visitors?












