Sustainable development: Will we ever know if weâve achieved it?
The UN has just passed a series of Sustainable Development Goals (SDGs). Seventeen bold goals for the world: No more hunger! Education for all! Watch the video to see what theyâve agreed to work toward. Itâs a beautiful picture of what humans could achieve. Â
Leave it to Dr. Tom Schwandt of the University of Illinois at Urbana-Champaign to bring a sobering voice to the party. How will we ever measure progress toward those goals? And if we canât measure them, how will we ever know if we achieved them?Â
âIf evaluation is a religion,â he says, referencing an earlier comment by Dr. Deborah Rugg, âwe might have to do a little praying.â He brings up five issues the UN will face in trying to measure progress.Â
1) The SDGs are meant to be universal, but itâs not clear yet what policies and programs will be needed. The challenges to achieving sustainable development are different for low, middle and high income countries. How can we collapse both interventions and their measurement into a global summary, or even a global picture? How can we structure meaningful reporting on a global scale?Â
2) There is an extremely strong focus on data, both availability and quality. Thereâs an entire UN subgroup assigned to coming to agreement on a set of indicators for the 17 SDGs. So far theyâve come to agreement on 159 indicators and are still debating another 20 or so. Big data, citizen-generated data, other types of data, what are the risks of data collection and ownership? The real danger here, Schwandt says, is that a focus on data for indicators leads to focus on monitoring which is not the same thing as evaluation. How do we do evaluation without falling into the monitoring trap?Â
3) Schwandt suggests reading a blog post by Caroline Heider of the Independent Evaluation Group at the World Bank. In sum, she points out the 17 SDGs are so complex, integrated and interrelated that standard linear models for measuring and impact will not work. We will have to develop new strategies for incorporating systems thinking and methods of doing systems oriented evaluation.
4) Attribution and contribution: how can we possibly measure which policies and programs and in what dosage work? And in which settings?Â
5) Finally, thereâs that tricky issue of scale. Itâs hard enough to measure some of these outcomes at the country level. How can we roll up findings to the global level, taking into account inter- and intra-regional differences in measurement.
1 note
¡
View note
I learned evaluation as a science, practiced it as an art, and continue to believe in it as a religion.
Dr. Deborah Rugg, senior advisor to US mission to the UN
1 note
¡
View note
At the American Evaluation Association poster session I saw dogs, dragons, kittehs and multivariate regression analysis. Watch the video here!
1 note
¡
View note
The LA Times just did a great dataviz of arts education data from the LA Unified School District. I was curious about how they did it, so I opened up the code to take a look.
When I scrolled down to the very bottom, I found this little Easter egg hiding in the code. Click on the image to get a closer look.
1 note
¡
View note
THIS IS REBLOG RELEVANT FOR ONLY TODAY IN THE WHOLE OF HUMAN HISTORY AND ITS FUTURE
465K notes
¡
View notes
Data: not just numbers; not always big
Pity the poor arts administrator who has drunk the Big Data kool-aid without fully understanding its strengths, limitations and ramifications.Â
Who thinks data only means numbers (âBut how can I quantify that?â) without knowing the many varied research and evaluation tools available to them. See: An intro to qualitative methods.
Who thinks research always begins with a survey. See: What is a research question?
Who thinks you always have to collect original data yourself. See: What is secondary data?Â
Who doesnât take the time to find out if the biggest questions the organization is asking have already been researched and answered. See: How to write a literature review.
Who doesnât consider the potential ramifications of null (or negative!) results before launching a study. See: Research on why researchers donât publish when their study turns up nothing terribly interesting.
Who has fallen for the Big Data Gurus who argue that quantity can overcome non-representative methods. See: A very technical article about overcoming bias in large nonrepresentative internet datasets.
Who asks grantees to âproveâ the âimpactâ of their programs without understanding what it truly takes to measure cause and effect in the social sciences. See: Actual news headlines that mistook correlation for causality.
As an arts administrator, you donât need big data, you need accurate information. You need to ask smart questions and provide guidance to your research/evaluation staff or contractors about whatâs important to you, then let them figure out what the best methods are to answer your questions. Before diving into the research, make sure your question hasnât already been answered. If not, see if there is secondary data available already to answer it. Good quality research takes time and resources - make sure you have enough of both to commit to the project.
Data is only as powerful as the people who wield it. As you would with any sharp instrument, use it with care and respect and it will serve you well.
1 note
¡
View note
Happy birthday to Ursula Le Guin! Hereâs a great letter penned by Le Guin from Letters of Note in 1987.
37 notes
¡
View notes
This is my favorite part of the Broad. It reminds me of the assembly line factory videos on Electric Company.
1 note
¡
View note
What I learned at breakfastâŚ. 1) When arts are used as an interpretive layer, they can clarify, complicate or make things visible. âRosten Woo 2) âThe only way out is in. Once we take that risk, we will make it outâŚ. Perhaps not unscathed, but certainly all the better for it.â âcrystal am Nelson 3) âI grew up when we were embracing this new technology: the automobile.â âAaron Paley
1 note
¡
View note
Greater Philadelphia Cultural Alliance issues a report comparing arts and culture in eleven cities nationwide. Iâd give you the details, but Iâm sworn to secrecy until Oct 26.
1 note
¡
View note
If you were doing research in the arts, which of these would you select as your top priorities?
1 note
¡
View note
âArts, no less than transportation, health, housing and human services, are essential building blocks of community.â âRip Rapson President and CEO, Kresge Foundation
2 notes
¡
View notes
Allow me to recommend Spring for Coffee, just outside the back door, near the registration desk
1 note
¡
View note
Plenarying at GIA; looking for the unexpected
0 notes
What I learned at the #GIArts plenary: The big idea is welcome --Alison M. De LaCruz We look to the #arts to break borders --Yuval Sharon I want to be philanthropic in the broadest sense possible: I want to love people. --Alexandra Grant
1 note
¡
View note
I just finished reading Us Conductors by Sean Michaels. Look for by review soon in TNBB Blog .
0 notes
Poetry
Now the poems
seem to come
one after the other.
That can only mean one thing:
Autumn
has arrived.
âPoetryâ is a poem from Cold Moons, a collection of sparse, minimalistic ecopoetry by Icelandic poet MagnĂşs SigurĂ°sson that deals with natureâs resilience to the passage of time. You can read a larger excerpt of Cold Moons here.
Meg Matich is the recipient of a 2015 PEN/Heim Translation Fund Grant for her translation of Cold Moons. You can read Matichâs essay on translating Cold Moons here.
29 notes
¡
View notes