Health Education England working across the South West

2017 GMC National Training Survey - Executive Summary Report

 

This report provides an overview of the 2017 GMC National Training Survey (NTS) outcomes for Trainees and Trainers for Health Education England working across the South West (HEE SW) which includes Peninsula Postgraduate Medical Education (PPME – formerly Peninsula Deanery) and Severn Postgraduate Medical Education (SPME – formerly Severn Deanery). 

 

Background

Conducted annually, the GMC NTS gathers feedback from trainees undertaking postgraduate medical training, and trainers, in order to monitor the quality of medical education and training in the UK. 

 

Trainee survey

The NTS comprises of a core set of approximately 85 questions, with additional questions being included from relevant educational bodies for specific programmes.

 

Questions within the NTS are linked to the indicators of: 

  1. Adequate Experience
  2. Clinical Supervision
  3. Clinical Supervision out of hours
  4. Curriculum Coverage
  5. Educational Governance
  6. Educational Supervision
  7. Feedback
  8. Handover
  9. Induction
  10. Local Teaching
  11. Overall Satisfaction
  12. Regional Teaching
  13. Reporting systems
  14. Study Leave
  15. Supportive environment
  16. Teamwork
  17. Work Load

 

In 2017 there are new indictors called Curriculum Coverage, Educational Governance and Teamwork

 

Trainer survey

The trainer survey comprises of about 50 questions. These are linked to the indicators of:

 

  1. Overall Satisfaction
  2. Work Load
  3. Handover
  4. Supportive environment
  5. Curriculum Coverage
  6. Educational Governance
  7. Time for training
  8. Rota Design
  9. Resources for trainers
  10. Support for trainers
  11. Trainer Development

 

In 2017 there are new indictors called Overall Satisfaction, Workload, Curriculum Coverage, Educational Governance, Time for Training, Rota Design, Recourses for trainers and Trainer Development. 

Since 1st April 2013 Local Education and Training Boards (LETBs) have replaced Deaneries in England, however to provide comparative results over time reporting structures prior to April 2013 are still used for the GMC NTS.

 

Trainee Survey results

 

1. Response Rates

A total of 53,338 / 54,381 trainees in the UK completed the NTS giving a national response rate of 98.1%. With 1491 /1514 trainees completing the survey in PPME, and 2018/2056 in SPME, the response rates were 98.5% and 98.2%, respectively. 

 

2. Indicator Summary

This section provides a brief summary of each indicator for both PPME and SPME.

PPME and SPME achieved means above the national UK average on seven of the seventeen indicators.

Both SPME and PPME ranked within the top 5 in the UK for: Adequate Experience, Educational Governance, Overall Satisfaction, Reporting Systems, Supportive Environment and Teamwork. In addition, PPME ranked first for Clinical Supervision and Clinical Supervision out of hours.

 

Indicator Region

2017 Mean Score

National UK mean HEE Ranking
Adequate Experience PPME 80.4 79.02 2
SPME 79.70
Clinical Supervision PPME 92.20 90.39
SPME 89.87 10 
Clinical Supervision Out of Hours PPME 91.07 89.20
SPME 89.31 
Curriculum Coverage PPME 77.42 75.99
SPME 75.81  6
Educational Governance PPME 75.36  73.34 2
SPME 73.7 5
Educational Supervision PPME 88.68  88.31 6
SPME 87.88  10
Feedback PPME 79.15  76.76 3
SPME 75.33  12
Handover PPME 70.19  70.15 4
SPME 69.52  10
Induction PPME 82.16  81.92 5
SPME 81.43  10
Local Teaching PPME  64.08  64.6 10
SPME  63.94  11
Overall Satisfaction PPME  81.37  79.3 2
SPME  80.27  3
Regional Teaching PPME 68.86  70.71 11
SPME 69.62  10
Reporting systems PPME  76.91  75.37 2
SPME  75.93  3
Study Leave PPME  59.13  61.48 10
SPME 56.19 12
Supportive environment PPME 75.36 73.06 2
SPME  74.00 4
Teamwork PPME 76.44 74.41 2
SPME 75.46 3
Work Load PPME 48.44 47.2 3
SPME 47.08 8

 

3. Overall Satisfaction

This section of the report will focus on the Overall Satisfaction indicator which combines general questions about the quality and usefulness of the training post, to provide a global satisfaction score.

 

The questions which form the Overall Satisfaction indicator are:

 

•           How would you rate the quality of teaching (informal and bedside teaching as well as formal and organised sessions) in this post?

•           How would you rate the quality of clinical supervision in this post?

•           How would you rate the quality of experience in this post?

•           How would you describe this post to a friend who was thinking of applying for it?

•           How useful do you feel this post will be for your future career?

 

3.1. Overall Satisfaction by Postgraduate Medical Education Department

PPME (2nd) and SPME (3rd) were ranked within the top three in England for Overall Satisfaction by Deanery (out of 13). Over the last six years PPME and SPME have both ranked within the top half of Deaneries in England, demonstrating a consistently high level of performance. 

 

Postgraduate Medical Education Departments/Deanery

2012

2013 2014 2015 2016 2017
Mean HEE Rank Mean HEE Rank Mean HEE Rank Mean HEE Rank Mean HEE Rank Mean HEE Rank
Wessex Deanery 81.3 3 80.7  81.9  82.8  82.98   1  79.9 4
Peninsula Deanery  81.2  82.2 82.6  2 83   82.72  2 81.4 2
Northern Deanery  81.8  82.4  82.9  83.5  82.71   3 81.6 1
North Western Deanery  80  80.9  81.5  81.7  81.91   4 78.2 12
Mersey Deanery  80.9  81  81.4  82  81.75   5 79.9 6
Severn Deanery  81.4  81  81.6  82.1  81.52   6 80.3 3
London Deanery  80.1  80.8  81.3  81.8  81.37   7 78.8 10
NHS West Midlands Workforce Deanery  80.4  80.7  81.3  81.4  81.34   8 78.8 9
East of England Multi-Proessional Deanery  79.7  11  79.9  11  80.6  11  81.2  11  80.9   9 79 8
East Midlands Healthcare Workforce Deanery  79.1  12  79.6 12  79.9  12  80.4  12  80.88   10 77.2 13
Yorkshire and Humber Postgraduate Deanery  79.8  10  80.5  80.8  81.4  10  80.87   11 78.3 11
Oxford Deanery  80.7  80.1  10  80.6  10  81.8  80.86   12 79.5 7
Kent, Surrey and Sussex Deanery  78.9  13  79.5  13  79.3  13  80.3  13  79.47   13 79.9 5
National Mean   80.4  80.8   81.2   81.7   81.6   79.3

 

3.2. Overall Satisfaction by Programme          

The proportion of programmes ranked within the top three in England in 2015 is substantially higher than the proportion of programmes falling within the bottom three for both PPME and SPME. This trend has been consistently observed since 2012. 

 

pg6 chart 1

 

pg6 chart 2

 

In 2017 fifteen programmes (18%) in HEE SW are ranked 1st in England for Overall Satisfaction and 37% (31 of 83) are ranked in the top three

 

Region Programme Overall Satisfaction Mean Score (%) England Rank Rank Denominator
PPME Broad Based Training 92 1 10
SPME Cardiology 88 1 13
SPME Clinical Oncology 91 1 13
SPME Core Medical Training 75 1 13
SPME Core Surgical Training 83 1 13
PPME Endocrinology & Diabetes Mellitus 88 1 13
PPME General Practice (Primary Care Setting) 93 1 13
SPME General Psychiatry 92 1 13
PPME Geriatric Medicine 90 1 13
SPME Intensive Care Medicine 94 1 13
SPME Old Age Psychiatry 89 1 13
PPME Otolaryngology 95 1 13
SPME Public Health Medicine 89 1 11
PPME Rheumatology 98 1 13
SPME Trauma and Orthopaedic Surgery 90 1 13
PPME Foundation 78 2 12
PPME General Practice (Acute Care Setting) 77 2 13
SPME Otolaryngology 91 2 13
PPME Palliative Medicine 99 2 13
PPME Urology (over-arching programme) 87 2 12
PPME Vascular Surgery (over-arching programme) 87 2 12
SPME Acute Care Common Stem 83 3 13
PPME Clinical Radiology 88 3 13
PPME Core Medical Training 75 3 13
SPME Endocrinology and Diabetes Mellitus 85 3 13
PPME Gastroenterology 82 3 13
SPME General Practice (Primary Care Setting) 89 3 13
SPME Obstetrics and Gynaecology 81 3 13
SPME Paediatric Surgery 83 3 11
SPME Psychiatry of Learning Disability 90 3 12
PPME Respiratory Medicine (over-arching programme) 81 3 13

NB. In this table, the ranking denominator is the number of Deaneries in England.

In contrast 17% (14 out of 83) of programmes across HEE SW are ranked within the bottom three in England for Overall Satisfaction.

 

Region Programme Overall Satisfaction Mean Score (%) England Rank Rank Denominator
SPME Paediatric Cardiology 74 7 8
SPME Neurosurgery (Over-arching programme) 75 9 11
SPME Haematology 75 10 12
SPME Acute Internal Medicine 75 11 13
SPME Anaesthetics 80 11 13
SPME Palliative Medicine 82 11 13
SPME Child and Adolescent Psychiatry 86 12 12
PPME Clinical Oncology 80 12 13
PPME Core Psychiatry Training 76 12 13
PPME Dermatology 76 12 13
SPME Neurology 77 12 13
SPME Oral and Maxilo-Facial Surgery (Over-arching programme) 75 12 12
PPME Emergency Medicine 73 13 13
PPME Paediatrics 77 13 13

NB. In this table, the ranking denominator is the number of Deaneries in England. 

 

3.3. Overall Satisfaction by Provider

The charts on the next page depict Overall Satisfaction for Local Educational Providers (LEP), split by Acute Providers in PPME and SPME and Mental Health Providers across HEE SW compared to the National UK average. 

 

image 1 overall satisfaction mean score acute profider SPME

 

image 2 overall satisfaction mean score acute profider PPME

 

image 3 overall satisfaction mean score mental health profider HEE

 

4. Outliers by Provider (trainee survey)

N.B Benchmark group = post specialty groups

 

Local Education Provider Green Outliers   

Ratio of Positive

outliers to number    

of trainees

Red Outliers

Ratio of Negative

outliers to number  

of trainees

2gether NHS Foundation Trust 0   0  
Avon and Wiltshire Mental Health Partnership NHS Trust    2 1:51 1  1:10
Cornwall Partnership NHS Foundation Trust 2 1:9 0  
Devon Partnership NHS Trust 5 1:7 4 1:9
Gloucestershire Hospitals NHS Foundation Trust 8 1:33 31 1:9 
Great Western Hospitals NHS Foundation Trust 8 1:19 21 1:7 
Livewell Southwest 6 1:4 0  
North Bristol NHS Trust 24 1:13 18 1:18 
Northern Devon Healthcare NHS Trust 9 1:9 3 1:26 
Plymouth Hospitals NHS Trust 23 1:15 39 1:9 
Royal Cornwall Hospitals NHS Trust 16 1:15 14 1:17 
Royal Devon and Exeter NHS Foundation Trust 37 1:7 20 1:12 
Royal United Hospitals Bath NHS Foundation Trust 15 1:14 13 1:16 
Sirona Care and Health 3 1:2 0  
Somerset Partnership NHS Foundation Trust 4 1:5 0  
Taunton and Somerset NHS Foundation Trust 41 1:4 5 1:34
Torbay and South Devon NHS Foundation Trust 60 1:3 11 1:17 
University Hospitals Bristol NHS Foundation Trust 27 1:15 19 1:21 
Weston Area Health NHS Trust 0   31 1:2 
Yeovil District Hospital NHS Foundation Trust 2 1:33 15 1:4 
Grand Total 292   245  

An Outlier is where the survey score falls into the bottom or top quartile and with a mean outside the 95% confidence intervals of the national mean.

 

Trainer Survey results

1. Response Rates

A total of 24,593 / 45,889 trainers in the UK completed the NTS giving a national response rate of 53.6%. With 435 / 905 trainers completing the survey in PPME, and 875 / 1864 in SPME, the response rates were 48.1% and 46.9%, respectively. 

 

2. Indicator Summary

This section provides a brief summary of each indicator. This is only reported at a Local Education Training Board (LETB) level by the GMC. Therefore all results in this section combine PPME and SPME into HEE SW.

 

Indicator HEE-SW Mean Score National UK Mean HEE Ranking
Overall Satisfaction 73.58 71.87 1
Trainer Development 73.41 70.3 1
Resources for trainers 73.73 70.59 2
Support for trainers 70.15 68.5 2
Supportive environment 70.67 68.93 3
Time for training 56.79 56.28 4
Educational Goverance 68.47 68.32 8
Work load 41.98 42.86 9
Curriculum Coverage 70.57 72.06 10
Handover 69.47 70.38 11
Rota Design 56.81 59.82 12

 

3. Outliers by Provider (trainer survey)

 

Local Education Provider Green Outliers Red Outliers
2gether NHS Foundation Trust 12 0
Avon and Wiltshire Mental Health Partnership NHS Trust 2 0
Cornwall Partnership NHS Foundation Trust 4 0
Devon Partnership NHS Trust 1 0
Gloucestershire Hospitals NHS Foundation Trust 8 10
Great Western Hospitals NHS Foundation Trust3 12 5
NHS Bristol CCG 1 0
NHS Swindon CCG 1 0
North Bristol NHS Trust 19 9
Northern Devon Healthcare NHS Trust 6 1
Plymouth Hospitals NHS Trust 8 16
Public Health England (South of England) 1 0
Royal Cornwall Hospitals NHS Trust 10 3
Royal Devon and Exeter NHS Foundation Trust3 7 16
Royal United Hospitals Bath NHS Foundation Trust1 16 0
Sirona Care and Health 2 0
Taunton and Somerset NHS Foundation Trust 11 4
Torbay and South Devon NHS Foundation Trust 11 6
University Hospitals Bristol NHS Foundation Trust 10 21
University of Bristol 8 0
Weston Area Health NHS Trust 3 1
Yeovil District Hospital NHS Foundation Trust 11 0
Grand Total 164 92

An Outlier is where the survey score falls into the bottom or top quartile and with a mean outside the 95% confidence intervals of the national mean.

 

 

Further Information

The data contained within this report will be triangulated with other information, to enable the quality management of the training programmes across HEE SW, by identifying potential areas of good practice and development.

 

More detailed analysis of the 2017 NTS data is contained within the supplementary Trust/Programme Reports which will be sent out in July 2017. Should you require any further information on the content of this report please approach your local Quality Team contact:

 

Peninsula Quality Team:

Associate Dean – Quality: Martin Davis

Martin.Davis@hee.nhs.uk

 

Quality Manager: Jane Bunce

Jane.Bunce@hee.nhs.uk

 

Quality Support Manager: Gemma Agar

Gemma.Agar@hee.nhs.uk

 

Quality & Information Co-ordinator: Sophie Rose

Sophie.Rose@hee.nhs.uk

 

 

Severn Quality Team:

Associate Dean – Quality: Jon Francis

Jon.Francis@hee.nhs.uk

 

Quality Manager: Andy Gadsby

Andy.Gadsby@hee.nhs.uk

 

Quality Support Manager: Lyn Cox

Lynette.Cox@hee.nhs.uk

 

 

Prepared by:

Andy Gadsby, Quality Manager

July 2017