Health Education South West

2016 GMC National Training Survey - Executive Summary Report

 

This report provides an overview of the 2016 GMC National Training Survey (NTS) outcomes for Trainees and Trainers for Health Education England working across the South West (HEE SW) which includes Peninsula Postgraduate Medical Education (PPME – formerly Peninsula Deanery) and Severn Postgraduate Medical Education (SPME – formerly Severn Deanery). 

 

Background

Conducted annually, the GMC NTS gathers feedback from trainees undertaking postgraduate medical training, in order to monitor the quality of medical education and training in the UK. In 2016 for the first time in a number of years, trainers were also surveyed.

 

Trainee survey

The NTS comprises of a core set of approximately 85 questions, with additional questions being included from relevant educational bodies for specific programmes.

 

Questions within the NTS are linked to the indicators of:  

 

1.         Overall Satisfaction

2.         Clinical Supervision

3.         Clinical Supervision Out of Hours

4.         Handover

5.         Induction

6.         Adequate Experience

7.         Supportive Environment

8.         Work Load

9.         Educational Supervision

10.       Access to Educational Resources

11.       Feedback

12.       Local Teaching

13.       Regional Teaching

14.       Study Leave

15.       Reporting Systems

 

In 2016 there is a new indictor called reporting systems.

 

Trainer survey

The trainer survey comprises of about 50 questions. These are linked to the indicators of:

 

  1. Organisational Culture
  2. Supportive Environment
  3. Handover
  4. Time for Trainers
  5. Support for Trainers
  6. Supervisor Training

 

Since 1st April 2013 Local Education and Training Boards (LETBs) have replaced Deaneries in England, however to provide comparative results over time reporting structures prior to April 2013 are still used for the GMC NTS.

 

Trainee Survey results

 

1. Response Rates

A total of 53,837 / 54,589 trainees in the UK completed the NTS giving a national response rate of 98.6%. With 1474 /1512 trainees completing the survey in PPME, and 2078/2078 in SPME, the response rates were 98% and 100%, respectively.

 

2. Indicator Summary

This section provides a brief summary of each indicator for both PPME and SPME.

 

PPME and SPME achieved means above the national UK average on 6 of the fourteen indicators.

 

Both SPME and PPME ranked within the top 5 in the UK for: Clinical Supervision Out of Hours, Induction and Access to Educational Resources. In addition, PPME ranked first for Adequate Experience, Supportive Environment and Access to Educational Resources.

 

Indicator Region

2016 Mean Score

National UK mean HEE Ranking
Overall Satisfaction PPME 82.72 81.63 2
SPME 81.52 6
Clinical Supervision PPME 90.62 89.35 2
SPME 89.19 7
Clinical Supervision Out of Hours PPME 90.04 88.57 2
SPME 88.78 5
Reporting Systems PPME 75.87 74.49 2
SPME 74.54 7
Handover PPME 70.88 71.43 8
SPME 70.64 9
Induction PPME 86.25 85.61 4
SPME 86.75 3
Adequate Experience PPME 82.85 81.51 1
SPME 81.54 6
Supportive Environment PPME 78.01 76.38 1
SPME 76.74 6
Workload PPME 46.01 44.53 4
SPME 43.45 9
 Educational Supervision PPME   91.43  91.53
SPME   90.94 10
 Access to Educational Resources PPME   71.22  69.16
SPME   69.42 5
 Feedback  PPME  78.09  77.39 5
 SPME  74.5 13
 Local Teaching PPME   63.41  64.35 10 
SPME   63.15 12 
 Regional Teaching PPME   69.95 70.82 
SPME 68.88 12
Study Leave PPME 66.77 70.37 10
SPME   65.09 12

 

3. Overall Satisfaction

This section of the report will focus on the Overall Satisfaction indicator which combines general questions about the quality and usefulness of the training post, to provide a global satisfaction score.

 

The questions which form the Overall Satisfaction indicator are:

 

•           How would you rate the quality of teaching (informal and bedside teaching as well as formal and organised sessions) in this post?

•           How would you rate the quality of clinical supervision in this post?

•           How would you rate the quality of experience in this post?

•           How would you describe this post to a friend who was thinking of applying for it?

•           How useful do you feel this post will be for your future career?

 

 

3.1. Overall Satisfaction by Postgraduate Medical Education Department

PPME (2nd) and SPME (6th) were ranked within the top six in England for Overall Satisfaction by Deanery (out of 13). Over the last five years PPME and SPME have both ranked within the top half of Deaneries in England, demonstrating a consistently high level of performance. 

 

Postgraduate Medical Education Departments/Deanery 2012 2013 2014 2015 2016
Mean HEE Rank Mean HEE Rank Mean HEE Rank Mean HEE Rank Mean HEE Rank
Wessex Deanery 81.3 3 80.7  81.9  82.8  82.98   1 
Peninsula Deanery  81.2  82.2 82.6  2 83   82.72  2
Northern Deanery  81.8  82.4  82.9  83.5  82.71   3
North Western Deanery  80  80.9  81.5  81.7  81.91   4
Mersey Deanery  80.9  81  81.4  82  81.75   5
Severn Deanery  81.4  81  81.6  82.1  81.52   6
London Deanery  80.1  80.8  81.3  81.8  81.37   7
NHS West Midlands Workforce Deanery  80.4  80.7  81.3  81.4  81.34   8
East of England Multi-Proessional Deanery  79.7  11  79.9  11  80.6  11  81.2  11  80.9   9
East Midlands Healthcare Workforce Deanery  79.1  12  79.6 12  79.9  12  80.4  12  80.88   10
Yorkshire and Humber Postgraduate Deanery  79.8  10  80.5  80.8  81.4  10  80.87   11
Oxford Deanery  80.7  80.1  10  80.6  10  81.8  80.86   12
Kent, Surrey and Sussex Deanery  78.9  13  79.5  13  79.3  13  80.3  13  79.47   13
National Mean   80.4  80.8   81.2   81.7   81.6  

 

3.2. Overall Satisfaction by Programme          

The proportion of programmes ranked within the top three in England in 2015 is substantially higher than the proportion of programmes falling within the bottom three for both PPME and SPME. This trend has been consistently observed since 2012. 

 

3.2 chart 1 2016 Training Survey Summary 

3.2 chart 2 2016 Training Survey Summary

 

 

 

In 2016 ten programmes (12%) in HEE SW are ranked 1st in England for Overall Satisfaction and 29% (24 of 83) are ranked in the top three. 

 

Region Programme Overall Satisfaction Mean Score (%) England Rank Rank Denominator
SPME Cardiology 89  1 13 
PPME Clinical Oncology 93  1 12 
PPME Core Anaesthetics 91  13 
SPME Core Psychiatry Training 87  13 
PPME General Practice (Acute care setting) 81  13 
PPME General Practice (Primary care setting) 94  113 
PPME General Psychiatry 95  13 
PPME Geriatric Medicine 91  13 
PPME Old Age Psychiatry 94  13 
PPME Palliative Medicine 94  12 
SPME Core Surgical Training 82  13 
PPME Endocrinology and Diabetes Mellitus 13 
SPME General Practice (Acute setting) 81  13 
SPME Obstetrics and Gynaecology 82  13 
SPME Occupational Medicine (over-arching programme) 89 
SPME Otolaryngology 93  213 
SPME Trauma and Orthopaedic Surgery 90  2 13 
SPME Chemical Pathology 88 
SPME Child and Adolescent Psychiatry 90  12 
SPME Genito-urinary Medicine 92 
PPME Histopathology 91  12 
SPME Intensive Care Medicine 87  11 
PPME Otolaryngology 92  13 
SPME Paediatric Surgery 86 

 

In contrast 22% (18 out of 83) of programmes across HEE SW are ranked within the bottom three in England for Overall Satisfaction.

 

Region Programme Overall Satisfaction Mean Score (%) England Rank Rank Denominator
SPME Chemical Pathology 88 
SPME Broad Based Training 77 
SPME Paediatric Cardiology 82 
PPME Medical Microbiology 80 
PPME Intensive Care Medicine 81  11 
PPME Plastic Surgery (over-arching programme) 81  10 
PPME Vascular Surgery (over-arching programme) 75 
SPME Cardio-thoracic Surgery (over-arching programme) 77  10  10 
PPME Haematology 80  10  12 
SPME Neurosurgery (over-arching programme) 74  10  11 
SPME Public Health Medicine (over-arching programme) 83  10  10 
PPME Neurology 81  11  13 
PPME Acute Internal Medicine 75  12  13 
SPME Foundation 76  12  13 
PPME Gastroenterology 77  12  13 
SPME Clinical Radiology 77  13  13
PPME Core Psychiatry Training 81  13  13 
SPME Neurology 76  13  13 

 

NB. In this table, the ranking denominator is the number of Deaneries in England. 

 

3.3. Overall Satisfaction by Provider

The charts on the next page depict Overall Satisfaction for Local Educational Providers (LEP), split by Acute Providers in PPME and SPME and Mental Health Providers across HEE SW compared to the National UK average.

 

 3.3 chart 1 2016 Training Survey Summary

 

3.3 chart 2 2016 Training Survey Summary

 

3.3 chart 3 2016 Training Survey Summary

 

 

4. Outliers by Provider (trainee survey)

N.B Benchmark group = post specialty groups

 

Local Education Provider Green Outliers Red Outliers
2gether NHS Foundation Trust 4 0
Avon and Wiltshire Mental Health Partnership NHS Trust 4 1
Cornwall Partnership NHS Foundation Trust 0 2
Devon Partnership NHS Trust 3 0
Gloucestershire Hospitals NHS Foundation Trust 6 27
Great Western Hospitals NHS Foundation Trust 6 25
Livewell Southwest 4 0
North Bristol NHS Trust 28 20
Northern Devon Healthcare NHS Trust 7 6
Plymouth Hospitals NHS Trust 17 41
Royal Cornwall Hospitals NHS Trust 16 12
Royal Devon and Exeter NHS Foundation Trust 24 14
Royal United Hospitals Bath NHS Foundation Trust 18 11
Somerset Partnership NHS Foundation Trust 0 1
Taunton and Somerset NHS Foundation Trust 19 8
Torbay and South Devon NHS Foundation Trust 19 13
University Hospitals Bristol NHS Foundation Trust 35 36
Weston Area Health NHS Trust 1 22
Yeovil District Hospital NHS Foundation Trust 2 7
Grand Total 213 246

 

An Outlier is where the survey score falls into the bottom or top quartile and with a mean outside the 95% confidence intervals of the national mean.

 

Trainer Survey results

1. Response Rates

A total of 23,617 / 44,413 trainers in the UK completed the NTS giving a national response rate of 53.2%. With 450 /1002 trainers completing the survey in PPME, and 950/1847 in SPME, the response rates were 44.9% and 51.4%, respectively.

 

2. Indicator Summary

This section provides a brief summary of each indicator. This is only reported at a Local Education Training Board (LETB) level by the GMC. Therefore all results in this section combine PPME and SPME into HEE SW.

 

Indicator 2016 Mean Score National UK Mean HEE Ranking
Appraisals 68.77 68.18 3rd
Educational governance 75.24 72.39 2nd
Organisational culture 79.65 75.61 1st
Supervisor training 76.06 70.24 1st
Support for trainers

74.27

67.15 1st

 

3. Outliers by Provider (trainer survey)

 

Local Education Provider Green Outliers Red Outliers
2gether NHS Foundation Trust 5 0
Cornwall Partnership NHS Foundation Trust 2 0
Devon Partnership NHS Trust 1 0
Gloucestershire Hospitals NHS Foundation Trust 4 3
Great Western Hospitals NHS Foundation Trust3 1 3
NHS Swindon CCG 1 0
North Bristol NHS Trust 6 8
Northern Devon Healthcare NHS Trust 3 1
Plymouth Hospitals NHS Trust 5 5
Royal Cornwall Hospitals NHS Trust 7 2
Royal Devon and Exeter NHS Foundation Trust3 3 3
Royal United Hospitals Bath NHS Foundation Trust1 10 1
Taunton and Somerset NHS Foundation Trust 8 1
Torbay and South Devon NHS Foundation Trust 5 1
University Hospitals Bristol NHS Foundation Trust 8 13
Weston Area Health NHS Trust 3 0
Yeovil District Hospital NHS Foundation Trust 1 0
Grand Total 73 41

An Outlier is where the survey score falls into the bottom or top quartile and with a mean outside the 95% confidence intervals of the national mean.

 

 

Further Information

The data contained within this report will be triangulated with other information, to enable the quality management of the training programmes across HEE SW, by identifying potential areas of good practice and development.

 

More detailed analysis of the 2016 NTS data is contained within the supplementary Trust/Programme Reports which will be sent out in July 2016. Should you require any further information on the content of this report please approach your local Quality Team contact:

 

Peninsula Quality Team:

Associate Dean – Quality: Martin Davis

Martin.Davis@southwest.hee.nhs.uk

 

Quality Manager: Jane Bunce

Jane.Bunce@southwest.hee.nhs.uk

 

Quality & Information Co-ordinator: Alice Brindle

Alice.Brindle@southwest.hee.nhs.uk

 

Quality & Information Co-ordinator: Sophie Rose

 

Sophie.Rose@southwest.hee.nhs.uk

 

 

Severn Quality Team:

Associate Dean – Quality: Jon Francis

Jon.Francis@southwest.hee.nhs.uk

 

Quality Manager: Allegra Stone

Allegra.Stone@southwest.hee.nhs.uk

 

Quality Data Specialist: Andy Gadsby

Andy.Gadsby@southwest.hee.nhs.uk

 

Quality Support Manager: Lyn Cox

Lynette.Cox@southwest.hee.nhs.uk

 

 

 

Prepared by:

Andy Gadsby, Quality Data Specialist

July 2016