'Trying to pin down jelly' - exploring intuitive processes in quality assessment for meta-ethnography.
Toye F., Seers K., Allcock N., Briggs M., Carr E., Andrews J., Barker K.
BACKGROUND: Studies that systematically search for and synthesise qualitative research are becoming more evident in health care, and they can make an important contribution to patient care. However, there is still no agreement as to whether, or how we should appraise studies for inclusion. We aimed to explore the intuitive processes that determined the 'quality' of qualitative research for inclusion in qualitative research syntheses. We were particularly interested to explore the way that knowledge was constructed. METHODS: We used qualitative methods to explore the process of quality appraisal within a team of seven qualitative researchers funded to undertake a meta-ethnography of chronic non-malignant musculoskeletal pain. Team discussions took place monthly between October 2010 and June 2012 and were recorded and transcribed. Data was coded and organised using constant comparative method. The development of our conceptual analysis was both iterative and collaborative. The strength of this team approach to quality came from open and honest discussion, where team members felt free to agree, disagree, or change their position within the safety of the group. RESULTS: We suggest two core facets of quality for inclusion in meta-ethnography - (1) Conceptual clarity; how clearly has the author articulated a concept that facilitates theoretical insight. (2) Interpretive rigour; fundamentally, can the interpretation 'be trusted?' Our findings showed that three important categories help the reader to judge interpretive rigour: (ii) What is the context of the interpretation? (ii) How inductive is the interpretation? (iii) Has the researcher challenged their interpretation? CONCLUSIONS: We highlight that methods alone do not determine the quality of research for inclusion into a meta-ethnography. The strength of a concept and its capacity to facilitate theoretical insight is integral to meta-ethnography, and arguably to the quality of research. However, we suggest that to be judged 'good enough' there also needs to be some assurance that qualitative findings are more than simply anecdotal. Although our conceptual model was developed specifically for meta-ethnography, it may be transferable to other research methodologies.