Health Education England working across the South West
2018 GMC National Training Survey - Executive Summary Report
Purpose
This report provides an overview of the 2018 GMC National Training Survey (NTS) outcomes for Trainees and Trainers for Health Education England working across the South West (HEE SW) which includes Peninsula Postgraduate Medical Education (PPME – formerly Peninsula Deanery) and Severn Postgraduate Medical Education (SPME – formerly Severn Deanery).
Background
Conducted annually, the GMC NTS gathers feedback from trainees undertaking postgraduate medical training, and trainers, in order to monitor the quality of medical education and training in the UK.
Trainee survey
The NTS comprises of a core set of approximately 85 questions, with additional questions being included from relevant educational bodies for specific programmes.
Questions within the NTS are linked to the indicators of:
- Adequate experience
- Clinical supervision
- Clinical supervision (Out of hours)
- Curriculum coverage
- Educational governance
- Educational supervision
- Feedback
- Handover
- Induction
- 10. Local teaching
- 11. Overall satisfaction
- 12. Regional teaching
- 13. Reporting systems
- 14. Rota design
- 15. Study leave
- 16. Supportive environment
- 17. Teamwork
- 18. Work load
In 2018 there is a new indicator called Rota design.
Trainer survey
The trainer survey comprises of about 50 questions. These are linked to the indicators of:
- Overall Satisfaction
- Work Load
- Handover
- Supportive environment
- Curriculum Coverage
- Educational Governance
- Time for training
- Rota Design
- Resources for trainers
- Support for trainers
- Trainer Development
In 2017 there was also the additional new indicator called Rota Design.
Since 1st April 2013 Local Education and Training Boards (LETBs) have replaced Deaneries in England, however to provide comparative results over time reporting structures prior to April 2013 are still used for the GMC NTS.
Trainee Survey results
Response Rates
A total of 42,568/ 44,421 trainees in the UK completed the NTS giving a national response rate of 95.8%. With 1324 /1442 trainees completing the survey in PPME, and 1837/2106 in SPME, the response rates were 91.8% and 87.2% respectively.
Indicator Summary
This section provides a brief summary of each indicator for both PPME and SPME.
PPME and SPME achieved means above the national UK average on fourteen of the eighteen indicators.
Both SPME and PPME ranked within the top 5 in the England for: Educational Governance, Induction, Local Teaching, Reporting Systems, Rota Design, and Teamwork. In addition, PPME ranked first for Adequate Experience, Clinical Supervision (Out of Hours), Overall Satisfaction and Supportive Environment
|
Indicator |
Region |
2018 Mean Score |
National UK mean |
HEE Ranking |
|
Adequate Experience |
PPME |
81.4 |
78.82 |
1 |
|
SPME |
79.74 |
4 |
||
|
Clinical Supervision |
PPME |
92.2 |
90.31 |
2 |
|
SPME |
90.08 |
8 |
||
|
Clinical Supervision (Out of hours) |
PPME |
89.37 |
87.61 |
1 |
|
SPME |
88.23 |
4 |
||
|
Curriculum Coverage |
PPME |
78.09 |
75.74 |
2 |
|
SPME |
76.23 |
6 |
||
|
Educational Governance |
PPME |
75.32 |
73.32 |
2 |
|
SPME |
74.34 |
4 |
||
|
Educational Supervision |
PPME |
86.11 |
84.46 |
2 |
|
SPME |
84.33 |
8 |
||
|
Feedback |
PPME |
78.33 |
75.47 |
2 |
|
SPME |
72.82 |
12 |
||
|
Handover |
PPME |
65.35 |
65.25 |
8 |
|
SPME |
66.09 |
2 |
||
|
Induction |
PPME |
80.37 |
78.62 |
3 |
|
SPME |
80.4 |
2 |
||
|
Local Teaching |
PPME |
76.21 |
74.73 |
2 |
|
SPME |
76.06 |
4 |
||
|
Overall Satisfaction |
PPME |
81.87 |
79.01 |
1 |
|
SPME |
79.66 |
5 |
||
|
Regional Teaching |
PPME |
72.05 |
69.29 |
5 |
|
SPME |
69.67 |
8 |
||
|
Reporting systems |
PPME |
76.92 |
74.78 |
2 |
|
SPME |
75.2 |
3 |
||
|
Rota Design |
PPME |
57.22 |
56.18 |
4 |
|
SPME |
56.98 |
5 |
||
|
Study Leave |
PPME |
61.76 |
61.72 |
8 |
|
SPME |
59.27 |
10 |
||
|
Supportive environment |
PPME |
75.94 |
72.66 |
1 |
|
SPME |
73.6 |
4 |
||
|
Teamwork |
PPME |
76.63 |
73.86 |
2 |
|
SPME |
75.08 |
3 |
||
|
Work Load |
PPME |
49.64 |
48.19 |
3 |
|
SPME |
48.33 |
8 |
Overall Satisfaction
This section of the report will focus on the Overall Satisfaction indicator which combines general questions about the quality and usefulness of the training post, to provide a global satisfaction score.
The questions which form the Overall Satisfaction indicator are:
• How would you rate the quality of teaching (informal and bedside teaching as well as formal and organised sessions) in this post?
• How would you rate the quality of clinical supervision in this post?
• How would you rate the quality of experience in this post?
• How would you describe this post to a friend who was thinking of applying for it?
• How useful do you feel this post will be for your future career?
Overall Satisfaction by Postgraduate Medical Education Department
PPME (1st) and SPME (5th) were ranked within the top five in England for Overall Satisfaction by Deanery (out of 13). Over the last seven years PPME and SPME have both ranked within the top half of Deaneries in England, demonstrating a consistently high level of performance.
|
Postgraduate Medical Education Departments/ |
2014 |
2015 |
2016 |
2017 |
2018 |
|||||
|
Deanery |
Mean |
HEE Rank |
Mean |
HEE Rank |
Mean |
HEE Rank |
Mean |
HEE Rank |
Mean |
HEE Rank |
|
Peninsula Deanery |
82.6 |
2 |
83 |
2 |
82.7 |
2 |
81.4 |
2 |
81.87 |
1 |
|
Northern Deanery |
82.9 |
1 |
83.5 |
1 |
82.7 |
3 |
81.6 |
1 |
81.27 |
2 |
|
Wessex Deanery |
81.9 |
3 |
82.8 |
3 |
83 |
1 |
79.9 |
4 |
80.24 |
3 |
|
Kent, Surrey and Sussex Deanery |
79.3 |
13 |
80.3 |
13 |
79.5 |
13 |
79.9 |
5 |
80.07 |
4 |
|
Severn Deanery |
81.6 |
4 |
82.1 |
4 |
81.5 |
6 |
80.3 |
3 |
79.66 |
5 |
|
NHS West Midlands Workforce Deanery |
81.3 |
7 |
81.4 |
9 |
81.3 |
8 |
78.8 |
9 |
79.17 |
6 |
|
Oxford Deanery |
80.6 |
10 |
81.8 |
6 |
80.9 |
12 |
79.5 |
7 |
79.03 |
7 |
|
Mersey Deanery |
81.4 |
6 |
82 |
5 |
81.8 |
5 |
79.5 |
6 |
78.88 |
8 |
|
London Deanery |
81.3 |
8 |
81.8 |
7 |
81.4 |
7 |
78.8 |
10 |
78.74 |
9 |
|
North Western Deanery |
81.5 |
5 |
81.7 |
8 |
81.9 |
4 |
78.2 |
12 |
78.01 |
10 |
|
East of England Multi-Professional Deanery |
80.6 |
11 |
81.2 |
11 |
80.9 |
9 |
79 |
8 |
77.86 |
11 |
|
Yorkshire and the Humber Postgraduate Deanery |
80.8 |
9 |
81.4 |
10 |
80.9 |
11 |
78.3 |
11 |
77.46 |
12 |
|
East Midlands Healthcare Workforce Deanery |
79.9 |
12 |
80.4 |
12 |
80.9 |
10 |
77.2 |
13 |
77.06 |
13 |
|
National Mean |
81.2 |
81.7 |
81.6 |
79.3 |
79.01 |
|||||
Overall Satisfaction by Programme
The proportion of programmes ranked within the top three in England in 2018 is substantially higher than the proportion of programmes falling within the bottom three for both PPME and SPME. This trend has been consistently observed since 2012.
In 2018 ten programmes (13%) in HEE SW are ranked 1st in England for Overall Satisfaction and 42% (33 of 79) are ranked in the top three.
NB. In this table, the ranking denominator is the number of Deaneries in England.
|
Region |
Programme |
Overall Satisfaction Mean Score (%) |
England rank |
Rank Denominator |
|
SPME |
Acute Internal Medicine |
80 |
1 |
13 |
|
PPME |
Core Anaesthetics |
96 |
1 |
13 |
|
SPME |
Core Surgical Training |
79 |
1 |
13 |
|
SPME |
Emergency Medicine |
83 |
1 |
13 |
|
PPME |
Foundation year 2 |
81 |
1 |
12 |
|
PPME |
General Practice (Primary care setting) |
93 |
1 |
13 |
|
PPME |
Geriatric Medicine |
87 |
1 |
13 |
|
PPME |
Histopathology |
93 |
1 |
12 |
|
SPME |
Intensive Care Medicine |
91 |
1 |
11 |
|
SPME |
Rheumatology |
89 |
1 |
13 |
|
PPME |
Acute Care Common Stem |
85 |
2 |
13 |
|
PPME |
Acute Internal Medicine |
79 |
2 |
13 |
|
SPME |
Child and Adolescent Psychiatry |
92 |
2 |
11 |
|
PPME |
Core Surgical Training |
78 |
2 |
13 |
|
SPME |
Endocrinology and Diabetes Mellitus |
87 |
2 |
13 |
|
SPME |
Forensic psychiatry |
95 |
2 |
10 |
|
PPME |
Foundation year 1 |
76 |
2 |
12 |
|
PPME |
Gastroenterology |
84 |
2 |
13 |
|
SPME |
General Practice (Acute setting) |
78 |
2 |
13 |
|
PPME |
Obstetrics and Gynaecology |
82 |
2 |
13 |
|
SPME |
Old Age Psychiatry |
91 |
2 |
13 |
|
PPME |
Ophthalmology |
86 |
2 |
13 |
|
SPME |
Anaesthetics |
83 |
3 |
13 |
|
PPME |
Cardiology |
80 |
3 |
13 |
|
PPME |
Core Medical Training |
74 |
3 |
13 |
|
PPME |
Endocrinology and Diabetes Mellitus |
86 |
3 |
13 |
|
SPME |
General Psychiatry |
90 |
3 |
13 |
|
SPME |
Histopathology |
91 |
3 |
12 |
|
PPME |
Intensive Care Medicine |
87 |
3 |
11 |
|
SPME |
Obstetrics and Gynaecology |
80 |
3 |
13 |
|
PPME |
Old Age Psychiatry |
91 |
3 |
13 |
|
SPME |
Psychiatry of Learning Disability |
90 |
3 |
7 |
|
PPME |
Urology (over-arching programme) |
87 |
3 |
12 |
In contrast 9% (7 out of 79) of programmes across HEE SW are ranked within the bottom three in England for Overall Satisfaction.
NB. In this table, the ranking denominator is the number of Deaneries in England.
|
Region |
Programme |
Overall Satisfaction Mean Score (%) |
England Rank |
Rank Denominator |
|
SPME |
Occupational Medicine (Over-arching programme) |
88 |
4 |
6 |
|
PPME |
Plastic Surgery (over-arching programme) |
78 |
10 |
10 |
|
SPME |
Haematology |
76 |
11 |
12 |
|
PPME |
Rheumatology |
78 |
11 |
13 |
|
SPME |
Core Medical Training |
69 |
12 |
13 |
|
PPME |
Trauma and Orthopaedic Surgery |
83 |
12 |
13 |
|
PPME |
Emergency Medicine |
70 |
13 |
13 |
Overall Satisfaction by Provider
The charts on the next page depict Overall Satisfaction for Local Educational Providers (LEP), split by Acute Providers in PPME and SPME and Mental Health Providers across HEE SW compared to the National UK average.
4. Outliers by Provider (trainee survey)
N.B Benchmark group = post specialty groups
|
Local Education Providers |
Positive Outliers |
Ratio of Positive outliers to number of trainees |
Negative Outliers |
Ratio of Negative outliers to number of trainees |
|
2gether NHS Foundation Trust |
0 |
0 |
0 |
0 |
|
Avon and Wiltshire Mental Health Partnership NHS Trust |
13 |
1:8 |
0 |
0 |
|
Cornwall Partnership NHS Foundation Trust |
0 |
0 |
0 |
0 |
|
Devon Partnership NHS Trust |
0 |
0 |
2 |
1:17 |
|
Gloucestershire Hospitals NHS Foundation Trust |
4 |
1:73 |
25 |
1:12 |
|
Great Western Hospitals NHS Foundation Trust |
9 |
1:18 |
12 |
1:14 |
|
Livewell Southwest |
1 |
1:24 |
0 |
0 |
|
North Bristol NHS Trust |
28 |
1:11 |
21 |
1:15 |
|
Northern Devon Healthcare NHS Trust |
9 |
1:8 |
9 |
1:8 |
|
Royal Cornwall Hospitals NHS Trust |
25 |
1:9 |
9 |
1:25 |
|
Royal Devon and Exeter NHS Foundation Trust |
30 |
1:8 |
12 |
1:21 |
|
Royal United Hospitals Bath NHS Foundation Trust |
42 |
1:5 |
9 |
1:24 |
|
Sirona Care & Health |
2 |
1:4 |
0 |
0 |
|
Somerset Partnership NHS Foundation Trust |
0 |
0 |
0 |
0 |
|
Taunton and Somerset NHS Foundation Trust |
56 |
1:3 |
8 |
1:21 |
|
Torbay and South Devon NHS Foundation Trust |
44 |
1:4 |
2 |
1:92 |
|
University Hospitals Bristol NHS Foundation Trust |
35 |
1:11 |
31 |
1:13 |
|
University Hospitals Plymouth NHS Trust |
27 |
1:12 |
26 |
1:13 |
|
Weston Area Health NHS Trust |
2 |
1:28 |
20 |
1:3 |
|
Yeovil District Hospital NHS Foundation Trust |
7 |
1:8 |
7 |
1:8 |
|
Grand Total |
245 |
|
115 |
|
An Outlier is where the survey score falls into the bottom (negative outlier) or top (positive outlier) quartile and with a mean outside the 95% confidence intervals of the national mean.
Trainer Survey results
Response Rates
A total of 15,475 / 38,384 trainers in the UK completed the NTS giving a national response rate of 40.3%. With 283 / 927 trainers completing the survey in PPME, and 563 / 1802 in SPME, the response rates were 30.5% and 31.2%, respectively.
Indicator Summary
This section provides a brief summary of each indicator. This is only reported at a Local Education Training Board (LETB) level by the GMC. Therefore all results in this section combine PPME and SPME into HEE SW.
|
Indicator |
HEE SW Mean Score |
National Mean |
HEE ranking |
|
Curriculum Coverage |
69.86 |
71.46 |
11 |
|
Educational Governance |
67.00 |
66.75 |
7 |
|
Handover |
67.46 |
68.04 |
10 |
|
Overall Satisfaction |
73.77 |
71.13 |
2 |
|
Resources for trainers |
73.1 |
69.48 |
2 |
|
Rota Design |
57.77 |
61.1 |
11 |
|
Support for trainers |
70.32 |
68.01 |
2 |
|
Supportive Environment |
67.85 |
67.00 |
5 |
|
Time for training |
54.77 |
56.39 |
10 |
|
Trainer Development |
74.14 |
69.61 |
1 |
|
Work Load |
42.23 |
43.84 |
12 |
Outliers by Provider (trainer survey)
N.B Benchmark group = trainer specialty
|
Local Education Providers |
Positive Outliers |
Negative Outliers |
|
2gether NHS Foundation Trust |
3 |
0 |
|
Avon and Wiltshire Mental Health Partnership NHS Trust |
4 |
0 |
|
Cornwall Partnership NHS Foundation Trust |
4 |
0 |
|
Devon Partnership NHS Trust |
2 |
0 |
|
Gloucestershire Hospitals NHS Foundation Trust |
1 |
0 |
|
Great Western Hospitals NHS Foundation Trust |
0 |
0 |
|
Livewell Southwest |
8 |
0 |
|
North Bristol NHS Trust |
0 |
0 |
|
Northern Devon Healthcare NHS Trust |
2 |
0 |
|
Royal Cornwall Hospitals NHS Trust |
2 |
0 |
|
Royal Devon and Exeter NHS Foundation Trust |
0 |
0 |
|
Royal United Hospitals Bath NHS Foundation Trust |
2 |
0 |
|
Sirona Care & Health |
0 |
0 |
|
Somerset Partnership NHS Foundation Trust |
2 |
0 |
|
Taunton and Somerset NHS Foundation Trust |
2 |
0 |
|
Torbay and South Devon NHS Foundation Trust |
3 |
0 |
|
University Hospitals Bristol NHS Foundation Trust |
0 |
0 |
|
University Hospitals Plymouth NHS Trust |
0 |
1 |
|
Weston Area Health NHS Trust |
0 |
0 |
|
Yeovil District Hospital NHS Foundation Trust |
1 |
0 |
|
Grand Total |
36 |
1 |
An Outlier is where the survey score falls into the bottom (negative outlier) or top (positive outlier) quartile and with a mean outside the 95% confidence intervals of the national mean.
Further Information
The data contained within this report will be triangulated with other information, to enable the quality management of the training programmes across HEE SW, by identifying potential areas of good practice and development.
More detailed analysis of the 2018 NTS data is contained within the supplementary Trust/Programme Reports which will be sent out in July 2018. Should you require any further information on the content of this report please approach your local Quality Team contact:
Peninsula Quality Team:
Head of Quality: Martin Davis - Martin.Davis@hee.nhs.uk
Quality Lead for Practice Placement: Val Heath - Val.Heath@hee.nhs.uk
Quality Manager: Jane Bunce - Jane.Bunce@hee.nhs.uk
Quality Support Administrator: Sophie Rose - Sophie.Rose@hee.nhs.uk
Severn Quality Team:
Head of Quality: Jon Francis - Jon.Francis@hee.nhs.uk
Quality Lead for Practice Placement: Andy Gadsby - Andy.Gadsby@hee.nhs.uk
Quality Manager: Lynette Cox - Lynette.Cox@hee.nhs.uk
Quality Support Administrator: Helena Hogan - Helena.Hogan@hee.nhs.uk
Prepared by: Andy Gadsby, Quality Lead
July 2018