Improvement science: engineering 42 – ethics 0

In my last post I considered a “thought paper” entitled “The habits of an improver” and welcomed that critical thinking was considered a necessary habit.

The word “engineer” or “engineering” is to be found on 42 separate occasions in this Health Foundation thought paper.

The word “ethics” does not appear at all. Despite the fact that the introduction begins with this quote:

That ethics do not seem to be considered amongst the “habits” necessary for “improvement science” is concerning.

The last time I looked, I found this result using the Healthcare Improvement Scotland search facility:

The former Chief Executive for the Mental Welfare Commission for Scotland used to introduce me as “Bayesian Peter”. Bayesian is the name given to interpretations of probability and returns to Reverend Thomas Bayes original considerations of complexity.

Healthcare, like life, is complex. We are human and live in an ever changing world.

This is not all so simply “engineered”.

Ethics is integral to science.  I do not deserve the epithet “Bayesian Peter” – for whilst I am interested in ethics this does not mean that I am more ethical than you the reader.

However, I want to say as clearly as I can, and yes with passion, that without ethical considerations “improvement science” should linger in quotes.

The habits of an improver

I have recently read this most interesting “thought paper” entitled “The habits of an improver” which was published by the Health Foundation in October 2015.

Several months before this was published, the Executive Clinical Director for Healthcare Improvement Scotland wrote to my employers  stating that “[this individual] clearly does not understand the improvement science approach”. This defamatory letter almost ended my unblemished career as an NHS doctor. I subsequently felt that I had no option but to resign from NHS Forth Valley after 13 years as a Consultant working in Clackmannanshire. The glowing and unsolicited feedback that I received on my resignation can be read here.

‘The habits of an improver’ would seem to confirm that it was in fact the Executive Clinical Director for Healthcare Improvement Scotland who lacked understanding of the “improvement science approach”. Two of the key ‘habits’ include (1) a willingness to consider conflicting points of view and (2) a requirement of critical thinking.

I have asked for an apology from Healthcare Improvement Scotland but it has been confirmed from the Chair, Dame Denise Coia, that this will not be forthcoming.

In a follow up post I will share evidence that appears to 
substantiate the concerns that I raised about mandatory 
screening for delirium.



 

If NHS Scotland has been genetically-modified with QI

It is most welcome to hear from Philippa Whitford about positive outcomes of NHS Scotland’s collaborative approach to quality improvement and the learning that this might provide for the rest of the UK. I share Philippa Whitford’s concerns about the potential consequences of competitive systems such as occurs more in NHS England with providers, commissioners and contracts and the inevitable fragmentation that this brings. The integrated approach taken in Scotland along with the engagement of patients and frontline practitioners is indeed something to be most positive about.

However, NHS Scotland’s approach to Quality Improvement is based on what is known as “improvement science”. This is a relatively new approach to science introduced from the USA and based on methodologies from the engineering and airline industries. The Health Foundation, in its ‘Evidence Scan’ found a “real paucity of evidence about the field of improvement science” . The Health Foundation found papers on the conceptual nature of Improvement Science but concluded that: “none of these could be said to be seminal pieces of research acting as building blocks for the field as a whole”.

As far back as 2007 Brent et al identified that “ethical issues arise in QI because attempts to improve quality may inadvertently cause harm, waste scarce resources, or affect some patients unfairly.”

Scotland has two key National Improvement initiatives for older people in acute hospital care. One is for Delirium and the other is for Frailty.

The QI initiative on Delirium was reliant upon “screening tools” that were effectively made mandatory for all those aged 65 years and over admitted to hospital. Healthcare Improvement Scotland measured the “compliance” with the use of these “screening tools” across Scotland. On the wards I was finding that these tools were not infrequently being interpreted as diagnostic and that older people were sometimes considered as lacking in “capacity” on this basis. I was also concerned that this approach could lead to greater use of antipsychotic medication.

The QI initiative on Frailty is currently being implemented across NHS Scotland. This is despite the fact that there is no internationally accepted clinical definition for Frailty. More “screening tools” have been developed by Healthcare Improvement Scotland and “Frailty Hubs” are now being set up in most NHS Boards. It may be worth noting recent high-level disagreement amongst British Geriatricians about the validity of the “Frailty Industry” as one senior Geriatrician described it.

The experience of these national initiatives perhaps highlights the limitations of approaches which work best in mechanical settings. The same success cannot be guaranteed when applied to more complex presentations such as delirium and frailty.

It has recently been stated that “ethical approval is less burdensome” for QI. However I suggest that we must be wary of taking shortcuts that may result in potential harm as well as potential good. This is why ethics and philosophy have an established role in science.

Another risk is that if science is pre-determined as “improvement”, this may limit the acceptance of critical thinking.

Philippa Whitford concludes that in NHS Scotland “Quality improvement has made its way into the DNA of frontline staff”. I share the view that Quality Improvement has much to offer. However, if NHS Scotland has been genetically-modified with QI let us hope that the wider considerations necessary for science are included in the base-code.

Dr Peter J Gordon
Psychiatrist for Older Adults
NHS Scotland

 

We are far more than our labels

“National Improvement” work for older people has focused on Frailty and in NHS Scotland we are reminded by healthcare Improvement Scotland to “THINK frailty”

This short film is based on “thought for the day” by Anna Magnusson, BBC Radio Scotland, Friday 5th August 2017.

Music is “Seeing the future” by Dexter Britain (under common license)

We are far more than our labels from omphalos.

Improvement goggles

What follows are three slides taken from a talk given by Dr Brian Robson, Executive Clinical Director, Healthcare Improvement Scotland and IHI Fellow, given at the Edinburgh International Conference of Medicine in September 2016:



 

I most certainly agree that culture is important. But what kind of culture? Is it healthy just to follow one? In this case the Institute of Healthcare Improvement, Boston.

The “Improvement Goggles”, it would seem, come as part of the “toolkit”?

As a doctor who is passionate about improving care it matters to me that I follow science that does not risk being pre-determined.

It is important that there is philosophical depth to the approaches that we take to healthcare.

I understand the overwhelmingly good intentions of all those involved in “improvement science”, however I would suggest that we should carefully consider the potential benefits and harms of a most determined “one organisation” approach that starts and ends with reductionist and mechanical algorithms.

 

 

‘How to Improve’

The Nuffield Trust has recently published “Learning from Scotland’s NHS”. This report was based on a select group of “30 senior leaders and experts from Scottish health and care”.

One of the primary “learning points” of this report was that Scotland should be considered as “the model of how to improve healthcare across the British isles”. What is not made clear in this report is that the improvement methodology that Scotland has embraced was introduced from the USA not by “30 senior leaders” but by three:

  1. Derek Feeley, President of the Institute for Healthcare Improvement (IHI) and former Director General for NHS Scotland
  2. Professor Jason Leitch, who is a Dental practitioner, IHI Fellow and National Clinical Director of Healthcare Quality and Strategy (Scottish Government)
  3. Dr Brian RobsonIHI Fellow and Clinical Director of Healthcare Improvement Scotland

The “30 senior leaders and experts” would seem to be “marking their own homework”.

A few personal thoughts:

I am a passionate about science but am of the view that passion should not pre-determine scientific method and process.

I have previously argued why it is unhelpful to pre-determine science as “improvement”.

I fully welcome a coordinated approach to improving healthcare.

I worry about the inherent reductionism that is the basis of IHI “improvement science”

IHI promotes learning to healthcare based upon the experience of Industry (mechanical engineering). This may work well for less complex interactional processes, such as Hospital Acquired Infection. However healthcare is rarely linear (it is more often Bayesian) and reductionist interventions (however well intentioned) can cause harm.

I have found that Healthcare Improvement Scotland (IHI) does not routinely include ethical considerations in its approach to “improvement science”.

In summary:

I would suggest that it would have been more accurate (evidence based) for the Nuffield Trust report to have been titled: “Learning from the USA”.

I welcome all learning and from all reaches of the globe. I also seek improvement. But as a philosopher and NHS doctor (of 25 years) I worry about any one-system approach.

Science needs to consider culture, ethics, narrative, and the experience of being.

“How to Improve” needs to consider the voices of people and place. It should not just be the voices of the “senior leaders and experts from Scottish health and care”.

 

 

 

 

Quality Improvement and ethics

Response by Dr Sian F Gordon and Dr Peter J Gordon, 4 June 2017

This Acute Perspective by Dr David Oliver has our interest, in part because we all embarked on our career in medicine around the same time.We very much share Dr Oliver’s advocacy for “the actions and engagement of frontline practitioners and the real world context in which they work” and agree that these “are critical to success.”

We would like to contribute in the spirit of critical thinking  regarding the place of ethics in Quality Improvement (QI).

Dr Oliver states that QI can deliver “tangible outcomes” and that it has “a methodological and theoretical rigour and peer community of its own”.

As far back as 2007 Brent et al identified that “ethical issues arise in QI because attempts to improve quality may inadvertently cause harm, waste scarce resources, or affect some patients unfairly.”

Dr Oliver states that “ethical approval is less burdensome” for QI. We are of the view that ethics must be one of the necessary starting principles for any QI work and would argue that any attempt, however well intentioned, to demote ethics from this role might result in outcomes that may not be described as “improvement”.

 

 

Reductionism – truly, madly, deeply

On Friday the 25th of November 2016 I gave a talk for the Scottish Philosophy and Psychiatry Special Interest Group.

My subject was “Improvement Science”.

The following is based on the slides and the four short films that I presented.

My talk was entitled:
001-improvement-science The meeting was held at the Golden Lion Hotel, Stirling:golden-lion-hotel-stirling-25-nov-2016-1golden-lion-hotel-stirling-25-nov-2016-2I started the day off:
002-improvement-scienceI gave these declarations:
003-improvement-science
I explained to the audience that like Dr Rev I M Jolly I can be overly pessimistic:


005-improvement-scienceThe dictionary definition of ‘Improvement’:
006-improvement-scienceThe dictionary definition of ‘Science’:
007-improvement-scienceMy concern is any pre-determinism to science:
008-improvement-scienceThe Health Foundation have considered Improvement Science: this is from 2011:
009-improvement-scienceMany different terms are used including “QI” for “Quality Improvement”:
010-improvement-scienceThis is where improvement science began, in Boston, Massachusetts:
011-improvement-scienceThe Founder of the Institute for Healthcare Improvement (IHI) was Don Berwick:
013-improvement-scienceThe first description of this movement in Britain goes back to 1992 by Dr Godlee:
014-improvement-scienceFifteen years later, Dr Godlee, Editor of the BMJ, said this:
015-improvement-scienceOnly last month the BMJ briefly interviewed Don Berwick:
016-improvement-scienceIHI describes improvement science as being based on a “simple, effective tool”:
017-improvement-scienceThis tool was developed from the work of an American engineer, W. A. Deming:
018-improvement-scienceThe “Model for Improvement” Tool [TM] is described by IHI as a “simple, yet powerful tool”:
019-improvement-scienceThe current President and CEO of IHI is Derek Feeley:
024-improvement-scienceUp until 2013, Derek Feeley was Chief Executive [Director General] for NHS Scotland:
021-improvement-scienceIn April 2013 Derek Feeley resigned from NHS Scotland:
022-improvement-science22nd February 2015 it was reported: “The astonishing and largely hidden influence of an American private healthcare giant at the heart of Scotland’s NHS”:
023-improvement-scienceDr Brian Robson, Executive Clinical Director for Healthcare Improvement Scotland [HIS] is an “IHI Fellow”:
dr-brian-robsonProfessor Jason Leitch, National Clinical Director for the Scottish Government is an “IHI Fellow”:
026-improvement-scienceMight we be facing the biggest change to healthcare in Scotland since the NHS began?nhs-scotland-1947 Improvement science is moving quickly and widely across Scotland:
027-improvement-scienceThis “Masterclass 1” for Board members cost  £146,837:
028-improvement-scienceAn NHS Board member commented after the Masterclass:
029-improvement-scienceHealthcare Improvement Scotland is one organisation with a very wide remit over NHS Scotland and it works closely with the Scottish Government:
031-improvement-scienceNine cohorts of Safety Fellows and National Improvers have so far been trained following IHI methodology:
032-improvement-scienceI was reminded of the current enthusiasm for improvement science when the Convener of a recent Scottish Parliament Committee meeting said of targets (another approach enthusiastically taken by NHS Scotland):033-improvement-scienceWhat is the place of ethics in Improvement Science?
034-improvement-scienceIn 2007 the Hastings Centre, USA, looked into this in some depth:
035-improvement-scienceThe Hastings Centre argue that Improvement science cannot ignore ethics:
036-improvement-scienceIn 2011 the Health Foundation, UK, produced this “Evidence Scan”:improvement-science-2011a2The Health Foundation commented that “improvement science is just emerging”:
037-improvement-science
The Evidence Scan found a “real paucity of evidence about the field of improvement science”:
038-improvement-scienceI would also suggest that there is a real paucity of philosophy about the field of improvement science:
039-improvement-scienceThe Health Foundation did find papers on the conceptual nature of Improvement Science but concluded that:
040-improvement-scienceMary Midgley is a philosopher now aged 95 years who is widely respected for her ethical considerations:
041-improvement-scienceChapter 7 of her book “Heart and Mind: The Varieties of Moral Experience” begins:
042-improvement-scienceMary Midgley is concerned about the overuse of reductionist tests in medicine stating that:
043-improvement-science
This film is about the potential consequences of inappropriate reductionism:

Leon Eisenberg has written many papers about this subject. He argues that reductionism should not be “abandoned” but that we must keep sight of where such an approach is scientifically useful and also where it is inappropriate:
045-improvement-scienceIn the Hastings Report, Margaret O’Kane asks:
046-improvement-scienceIn my view the answer to this question is YES. I am hopeful that the National Improvers recruited to NHS Scotland would agree:
047-improvement-scienceAs an NHS doctor I have seen unintentional harm brought about by National improvement work in Scotland. This related to a “Screening Tool” that was introduced across Scotland as part of this work. I found that the unintended consequences of the use of the following tool included implications for patients’ autonomy and the risk of over treatment:
048-improvement-scienceBoth the Hasting Group and the Health Foundation are of the view that improvement science cannot separate itself from the ethical requirements of research:
049-improvement-scienceThis article published in February 2016 argues that individual “rights transcend all aspects of Improvement science”
050-improvement-scienceThe following is a verbatim representation of a conversation held by National Improvers working in NHS Scotland:
051-improvement-scienceIn November 2016 Professor Joshi, also a psychiatrist outlined his concerns about reductionism in a published letter to the BMJ:
052-improvement-science
In this short film the mechanical language of healthcare improvers is considered:

Professor John Bruce was a Moral Philosopher in Edinburgh University in the 18th century. He built this temple, the “Temple of Decision”, in the grounds of his home by Falkland Palace so that he could consider his thesis:
054-improvement-scienceProfessor John Bruce did not succeed in his endeavour. His Temple however stood for many years:
055-improvement-scienceBut it eventually collapsed and his endeavour to “reduce the science of morals to the same certainty that attends other sciences” collapsed with it.
057-improvement-scienceAny search of Healthcare Improvement Scotland for “ethics” finds this result:
056-improvement-science
This film is about more up-to-date buildings – the enthusiasm for which was based on improvement science: The Red Road flats in Glasgow:

 

                         Post-script:

The following is an edited clip of the evidence given to the Scottish Parliament by Healthcare Improvement Scotland (HIS) on the 31st January 2017:

The full session can be watched here

The Official Report can be accessed here