National Assembly for Wales:
Evaluation of Second Round of Joint Reviews
Evaluation Programme
This evaluation
The evaluation is small scale and therefore has to be focused to get maximum benefit. There are major questions that could be asked of activities like Joint Reviews: -
- Do they present an accurate record of the activities of a local authority?
- Do they create change?
- Are they worth the money?
Such questions are beyond what is possible in this study, demanding as they would a total analysis of the way each review was conducted and the evidence on which each judgement was made. However, these are all fundamental questions and this evaluation will capture aspects of the first two of the questions. Readers of the final report should be in a position to make their own judgement as to the third question.
This evaluation is small scale - only 48 days of staff time - and so has to be focused. It is to be completed by the end of August 2006, with a follow up conference or workshop in September.
The elements of the evaluation are:
- a literature review - a very brief overview
- document analysis - a study of documents used by SSIW/WAO in Joint Reviews
- information from stakeholders - this will be the main focus of the study and is discussed more fully below
- a case study approach tracking the work of the Joint Review Team in the collection of evidence, drawing together of conclusions and writing of report in one authority
The information collected will be reported to SSIW/WAO in interim and final reports.
Information from stakeholders
Given the small scale of this study we are reliant primarily on information being collected through this web site. Therefore we want maximum publicity for the web site. Making substantial use of data collection via a web site is an effective method in getting high levels of response from those who regularly use computers. This should result in good levels of response from social services staff and non statutory organisations if they wish to contribute. However, we know that it will limit access for some users and carers. The small number of available days does not allow extensive means of trying to make contact with users and carers. To compensate for this we will endeavour to get coverage of our study through local media, local authorities and voluntary organisations. We will produce a paper version of the questionnaire.
We are collecting information in relation to the 6 authorities which have been the first to be inspected in the second round of Joint Reviews:
- Powys, Torfaen (inspection completed; reports published)
- Carmarthenshire, Rhondda Cynon Taff (inspection completed; reports still to be published)
- Isle of Anglesey and the Vale of Glamorgan (inspection still taking place)
We will undertake a small amount of follow up work (phone interviews and meetings) in one authority from each of these groups: Powys; Rhondda Cynon Taff and the Vale of Glamorgan.