Module Code - Title:
LA5062
-
USING EVIDENCE TO IMPROVE SOCIETAL OUTCOMES IN THE REAL WORLD (ONLINE)
Year Last Offered:
2025/6
Hours Per Week:
Grading Type:
N
Prerequisite Modules:
Rationale and Purpose of the Module:
This module considers what it means for professionals who serve society (e.g. public officials, non-governmental organisations etc) to be evidence-informed, what the value is for citizens, and the practicalities of such an approach. In exploring the role of evidence, identifying and addressing complex social problems and issues, it will introduce participants to debates about the nature of evidence, and invite critical reflection on the theoretical, conceptual and practical tools for developing evidence-informed strategies for change.
Syllabus:
Part 1 - The meaning of evidence (introducing the key concepts)
Duration 4 weeks
- Introduction: 'Evidence informed policy - what does this mean?
- Key epistemological and theoretical ideas
- Historical development of evidence as a concept and practice
- Introduction to quantitative and qualitative evidence (strengths and weaknesses)
- Understandings of evidence across different disciplines
- Sources of evidence [strengths and weaknesses]
- The discourse of evidence {e.g. search for proof versus creeping enlightenment)
- The place of values and ideology in approaches to evidence
- Paradigms of knowledge building [trial and error processes, contribution versus impact, improving versus proving,]
- Evidence and the realpolitik of public administration
Part 2 - Evidence in practice (what it means to be evidence-informed)
Duration 4 weeks
- How does successful use of evidence improve outcomes for citizens?
- The role of administrative routine data (databases) in supporting evidence
- The 'purveyors' of evidence and influence in different policy spheres
- The role and place of evaluation
- Identifying programme impact: Randomised Control Trials, other experimental and Quasi-experimental methods
- Identifying programme 'contribution' to better outcomes, realist approaches to evaluation
- Engineering concept of evidence informed design
- The emergence of implementation science
- Dealing with real world evidence inadequacy and making informed judgments
Part 3 - Evidence informed practice (dealing with real world problems)
Duration 4 weeks
Participants will be divided into smaller teams and will follow a case study through the four weeks. Route 1 participants will be presented with real 'brownfield' problems and will tasked with (a) the challenge of conceptualising realistic improvement, (b) designing a programme outline, (c) an implementation strategy and (d) evaluation framework. Route 2 participants will follow the same process while working on issues in their own setting. The sessions will be punctuated with short inputs by external expert speakers who have been involved in evidence informed change. Importantly these inputs will be honest accounts of the craft of bringing about change, leadership qualities, incremental gains and pitfalls.
Learning Outcomes:
Cognitive (Knowledge, Understanding, Application, Analysis, Evaluation, Synthesis)
On successful completion of this module, students will be able to:
- Demonstrate understanding of key theoretical debates and concepts relating to the nature and uses of evidence in social policy
- Use appropriate concepts and theoretical frameworks to critically interpret social problems and consider potential solutions
- Make informed judgements about the practical application of evidence in day to day public administration and other settings
- Articulate the qualities and competencies required to be 'evidence informed' in the task of public administration
- Explain how they could employ an evidence-informed approach in their own organisation, or in the work setting more generally.
Affective (Attitudes and Values)
On successful completion of this module, students will be able to:
1 Display an understanding of the real-life challenges of incorporating evidence into policy, programme and practice arenas
2 Acknowledge the impact of evidence informed planning on stakeholders in the implementation process
3 Make better judgments in interpreting evidence, dealing with experts and commissioning services
Psychomotor (Physical Skills)
N/A
How the Module will be Taught and what will be the Learning Experiences of the Students:
Lectures will provide theoretical inputs and a range of resources and materials, including case studies, to stimulate group discussion and encourage critical reflection and debate. Participants will be encouraged to draw from their own experience and that of others. Support for self-study will be provided through access to the learning facilities in the School's library and computer labs. Systematic use will be made of journals and websites for up to date discussions of issues. A comprehensive course reader will be provided ensuring access to an extensive range of training materials and resources.
Research Findings Incorporated in to the Syllabus (If Relevant):
Prime Texts:
Axford, N., Berry, V., Blower, S., Little, M., Hobbs, T. and Sodh, S (2013)
Design & Refine - Developing effective interventions for children and young people
, Dartington: Social Research Unit.
Buchanan, A. and Lara Montero, A (2015)
Evidence-based Social Services: Toolkit for planning and evaluating social services
, European Social Network, Brighton.
Coote, J., Allen, J. Woodhead, D. (2004)
Finding Out WhatWorks Building knowledge about complex, community-based initiative.
, London: King's Fund Publications.
Burton, P., Goodlad, R., Croft, J., Abbott, J., Hastings, A., Macdonald, G. and Slater, T. (2004)
What works in community involvement in area-based initiatives? A systematic review of the literature
, University of Bristol and University of Glasgow. London: Research Development and Statistics Directorate, Home Office
Hammersley, M. (2005)
'The Myth of Research-based Practice: The Critical Case of Educational Inquiry'
, International Journal of Social Research Methodology. Vol (8)4: 317-330
Kania, J. and Kramer, M. (2013)
Embracing Emergence: How Collective Impact Addresses Complexity Collective impact efforts are upending conventional wisdom about the manner in which we achieve social progress
, Stanford Social Innovation Review
Marston, G. and Watts, R (2003)
Tampering With the Evidence: a critical appraisal of evidence-based policy making.
, The Drawing Board: An Australian Review of Public Affairs. Vol (3)3: 143-163.
Nutley, S., Walter, I. and Davies, H.T.O. (2003)
From Knowing to Doing A Framework for Understanding the Evidence-Into-Practice Agenda
, Evaluation. Vol 9(2): 125-148
Nutley, S., Walter, I. and Davies, H.T.O. (2007)
Using Evidence - How Research Can Inform Public Services
, Bristol: Policy Press at the University of Bristol
Picho K., Maggio L.A. and Artino A.R. Jr (2016)
Science: the slow march of accumulating evidence.
, Perspect Med Educ. Vol 5:350-353
Simons, H. (2003)
'Evidence-based practice: panacea or over promise?
, Research Papers in Education. Vol (18)4: 303-31.
Sullivan H. and Stewart, M (2006)
Who Owns the Theory of Change?
, Evaluation. Vol 12(2):179-199.
Other Relevant Texts:
Programme(s) in which this Module is Offered:
MLHRCJTFA - HUMAN RIGHTS IN CRIMINAL JUSTICE
MLHRCJTPA - HUMAN RIGHTS IN CRIMINAL JUSTICE
MAPUADTFA - PUBLIC ADMINISTRATION
MAPUADTPA - PUBLIC ADMINISTRATION (PART-TIME)
GDPUADTPA - PUBLIC ADMINISTRATION
MAHRCJTFA - HUMAN RIGHTS IN CRIMINAL JUSTICE
MAHRCJTPA - HUMAN RIGHTS IN CRIMINAL JUSTICE
MLLAGETFA - (GENERAL)
MLLAGETPA - (GENERAL) P/T
Semester(s) Module is Offered:
Spring
Module Leader:
Johnny.connolly@ul.ie