Health Education England working across the South West

2018 GMC National Training Survey - Executive Summary Report

 

Purpose

This report provides an overview of the 2018 GMC National Training Survey (NTS) outcomes for Trainees and Trainers for Health Education England working across the South West (HEE SW) which includes Peninsula Postgraduate Medical Education (PPME – formerly Peninsula Deanery) and Severn Postgraduate Medical Education (SPME – formerly Severn Deanery). 

 

Background

Conducted annually, the GMC NTS gathers feedback from trainees undertaking postgraduate medical training, and trainers, in order to monitor the quality of medical education and training in the UK. 

 

Trainee survey

The NTS comprises of a core set of approximately 85 questions, with additional questions being included from relevant educational bodies for specific programmes.

Questions within the NTS are linked to the indicators of:  

  1. Adequate experience
  2. Clinical supervision
  3. Clinical supervision (Out of hours)
  4. Curriculum coverage
  5. Educational governance
  6. Educational supervision
  7. Feedback
  8. Handover
  9. Induction
  10. 10. Local teaching
  11. 11. Overall satisfaction
  12. 12. Regional teaching
  13. 13. Reporting systems
  14. 14. Rota design
  15. 15. Study leave
  16. 16. Supportive environment
  17. 17. Teamwork
  18. 18. Work load

In 2018 there is a new indicator called Rota design.

 

Trainer survey

The trainer survey comprises of about 50 questions. These are linked to the indicators of:

  1. Overall Satisfaction
  2. Work Load
  3. Handover
  4. Supportive environment
  5. Curriculum Coverage
  6. Educational Governance
  7. Time for training
  8. Rota Design
  9. Resources for trainers
  10. Support for trainers
  11. Trainer Development

In 2017 there was also the additional new indicator called Rota Design.

Since 1st April 2013 Local Education and Training Boards (LETBs) have replaced Deaneries in England, however to provide comparative results over time reporting structures prior to April 2013 are still used for the GMC NTS.

 

Trainee Survey results 

Response Rates

A total of 42,568/ 44,421 trainees in the UK completed the NTS giving a national response rate of 95.8%. With 1324 /1442 trainees completing the survey in PPME, and 1837/2106 in SPME, the response rates were 91.8% and 87.2% respectively.

 

Indicator Summary

This section provides a brief summary of each indicator for both PPME and SPME.

PPME and SPME achieved means above the national UK average on fourteen of the eighteen indicators.

Both SPME and PPME ranked within the top 5 in the England for: Educational Governance, Induction, Local Teaching, Reporting Systems, Rota Design, and Teamwork. In addition, PPME ranked first for Adequate Experience, Clinical Supervision (Out of Hours), Overall Satisfaction and Supportive Environment

 

Indicator

Region

2018 Mean Score

National UK mean

HEE Ranking

Adequate Experience

PPME

81.4

78.82

1

SPME

79.74

4

Clinical Supervision

PPME

92.2

90.31

2

SPME

90.08

8

Clinical Supervision (Out of hours)

PPME

89.37

87.61

1

SPME

88.23

4

Curriculum Coverage

PPME

78.09

75.74

2

SPME

76.23

6

Educational Governance

PPME

75.32

73.32

2

SPME

74.34

4

Educational Supervision

PPME

86.11

84.46

2

SPME

84.33

8

Feedback

PPME

78.33

75.47

2

SPME

72.82

12

Handover

PPME

65.35

65.25

8

SPME

66.09

2

Induction

PPME

80.37

78.62

3

SPME

80.4

2

Local Teaching

PPME

76.21

74.73

2

SPME

76.06

4

Overall Satisfaction

PPME

81.87

79.01

1

SPME

79.66

5

Regional Teaching

PPME

72.05

69.29

5

SPME

69.67

8

Reporting systems

PPME

76.92

74.78

2

SPME

75.2

3

Rota Design

PPME

57.22

56.18

4

SPME

56.98

5

Study Leave

PPME

61.76

61.72

8

SPME

59.27

10

Supportive environment

PPME

75.94

72.66

1

SPME

73.6

4

Teamwork

PPME

76.63

73.86

2

SPME

75.08

3

Work Load

PPME

49.64

48.19

3

SPME

48.33

8

 

Overall Satisfaction

This section of the report will focus on the Overall Satisfaction indicator which combines general questions about the quality and usefulness of the training post, to provide a global satisfaction score.

 

The questions which form the Overall Satisfaction indicator are:

 

•           How would you rate the quality of teaching (informal and bedside teaching as well as formal and organised sessions) in this post?

•           How would you rate the quality of clinical supervision in this post?

•           How would you rate the quality of experience in this post?

•           How would you describe this post to a friend who was thinking of applying for it?

•           How useful do you feel this post will be for your future career?

 

Overall Satisfaction by Postgraduate Medical Education Department

PPME (1st) and SPME (5th) were ranked within the top five in England for Overall Satisfaction by Deanery (out of 13). Over the last seven years PPME and SPME have both ranked within the top half of Deaneries in England, demonstrating a consistently high level of performance.

Postgraduate Medical Education Departments/

2014

2015

2016

2017

2018

Deanery

Mean

HEE Rank

Mean

HEE Rank

Mean

HEE Rank

Mean

HEE Rank

Mean

HEE Rank

Peninsula Deanery

82.6

2

83

2

82.7

2

81.4

2

81.87

1

Northern Deanery

82.9

1

83.5

1

82.7

3

81.6

1

81.27

2

Wessex Deanery

81.9

3

82.8

3

83

1

79.9

4

80.24

3

Kent, Surrey and Sussex Deanery

79.3

13

80.3

13

79.5

13

79.9

5

80.07

4

Severn Deanery

81.6

4

82.1

4

81.5

6

80.3

3

79.66

5

NHS West Midlands Workforce Deanery

81.3

7

81.4

9

81.3

8

78.8

9

79.17

6

Oxford Deanery

80.6

10

81.8

6

80.9

12

79.5

7

79.03

7

Mersey Deanery

81.4

6

82

5

81.8

5

79.5

6

78.88

8

London Deanery

81.3

8

81.8

7

81.4

7

78.8

10

78.74

9

North Western Deanery

81.5

5

81.7

8

81.9

4

78.2

12

78.01

10

East of England Multi-Professional Deanery

80.6

11

81.2

11

80.9

9

79

8

77.86

11

Yorkshire and the Humber Postgraduate Deanery

80.8

9

81.4

10

80.9

11

78.3

11

77.46

12

East Midlands Healthcare Workforce Deanery

79.9

12

80.4

12

80.9

10

77.2

13

77.06

13

National Mean

81.2

81.7

81.6

79.3

79.01

 

Overall Satisfaction by Programme          

The proportion of programmes ranked within the top three in England in 2018 is substantially higher than the proportion of programmes falling within the bottom three for both PPME and SPME. This trend has been consistently observed since 2012. 


NTS1

 

NTS2

 

In 2018 ten programmes (13%) in HEE SW are ranked 1st in England for Overall Satisfaction and 42% (33 of 79) are ranked in the top three.

NB. In this table, the ranking denominator is the number of Deaneries in England.

Region

Programme

Overall Satisfaction Mean Score (%)

England rank

Rank Denominator

SPME

Acute Internal Medicine

80

1

13

PPME

Core Anaesthetics

96

1

13

SPME

Core Surgical Training

79

1

13

SPME

Emergency Medicine

83

1

13

PPME

Foundation year 2

81

1

12

PPME

General Practice (Primary care setting)

93

1

13

PPME

Geriatric Medicine

87

1

13

PPME

Histopathology

93

1

12

SPME

Intensive Care Medicine

91

1

11

SPME

Rheumatology

89

1

13

PPME

Acute Care Common Stem

85

2

13

PPME

Acute Internal Medicine

79

2

13

SPME

Child and Adolescent Psychiatry

92

2

11

PPME

Core Surgical Training

78

2

13

SPME

Endocrinology and Diabetes Mellitus

87

2

13

SPME

Forensic psychiatry

95

2

10

PPME

Foundation year 1

76

2

12

PPME

Gastroenterology

84

2

13

SPME

General Practice (Acute setting)

78

2

13

PPME

Obstetrics and Gynaecology

82

2

13

SPME

Old Age Psychiatry

91

2

13

PPME

Ophthalmology

86

2

13

SPME

Anaesthetics

83

3

13

PPME

Cardiology

80

3

13

PPME

Core Medical Training

74

3

13

PPME

Endocrinology and Diabetes Mellitus

86

3

13

SPME

General Psychiatry

90

3

13

SPME

Histopathology

91

3

12

PPME

Intensive Care Medicine

87

3

11

SPME

Obstetrics and Gynaecology

80

3

13

PPME

Old Age Psychiatry

91

3

13

SPME

Psychiatry of Learning Disability

90

3

7

PPME

Urology (over-arching programme)

87

3

12

In contrast 9% (7 out of 79) of programmes across HEE SW are ranked within the bottom three in England for Overall Satisfaction.

NB. In this table, the ranking denominator is the number of Deaneries in England. 

 

Region

Programme

Overall Satisfaction Mean Score (%)

England Rank

Rank Denominator

SPME

Occupational Medicine (Over-arching programme)

88

4

6

PPME

Plastic Surgery (over-arching programme)

78

10

10

SPME

Haematology

76

11

12

PPME

Rheumatology

78

11

13

SPME

Core Medical Training

69

12

13

PPME

Trauma and Orthopaedic Surgery

83

12

13

PPME

Emergency Medicine

70

13

13

 

Overall Satisfaction by Provider

The charts on the next page depict Overall Satisfaction for Local Educational Providers (LEP), split by Acute Providers in PPME and SPME and Mental Health Providers across HEE SW compared to the National UK average. 

NTS3

 

NTS4

 

NTS5

 

4. Outliers by Provider (trainee survey)

N.B Benchmark group = post specialty groups

Local Education Providers

Positive Outliers

Ratio of Positive outliers to number of trainees

Negative Outliers

Ratio of Negative outliers to number of trainees

2gether NHS Foundation Trust

0

0

0

0

Avon and Wiltshire Mental Health Partnership NHS Trust

13

1:8

0

0

Cornwall Partnership NHS Foundation Trust

0

0

0

0

Devon Partnership NHS Trust

0

0

2

1:17

Gloucestershire Hospitals NHS Foundation Trust

4

1:73

25

1:12

Great Western Hospitals NHS Foundation Trust

9

1:18

12

1:14

Livewell Southwest

1

1:24

0

0

North Bristol NHS Trust

28

1:11

21

1:15

Northern Devon Healthcare NHS Trust

9

1:8

9

1:8

Royal Cornwall Hospitals NHS Trust

25

1:9

9

1:25

Royal Devon and Exeter NHS Foundation Trust

30

1:8

12

1:21

Royal United Hospitals Bath NHS Foundation Trust

42

1:5

9

1:24

Sirona Care & Health

2

1:4

0

0

Somerset Partnership NHS Foundation Trust

0

0

0

0

Taunton and Somerset NHS Foundation Trust

56

1:3

8

1:21

Torbay and South Devon NHS Foundation Trust

44

1:4

2

1:92

University Hospitals Bristol NHS Foundation Trust

35

1:11

31

1:13

University Hospitals Plymouth NHS Trust

27

1:12

26

1:13

Weston Area Health NHS Trust

2

1:28

20

1:3

Yeovil District Hospital NHS Foundation Trust

7

1:8

7

1:8

Grand Total

245

 

115

 

An Outlier is where the survey score falls into the bottom (negative outlier) or top (positive outlier) quartile and with a mean outside the 95% confidence intervals of the national mean.

 

Trainer Survey results

 

Response Rates

A total of 15,475 / 38,384 trainers in the UK completed the NTS giving a national response rate of 40.3%. With 283 / 927 trainers completing the survey in PPME, and 563 / 1802 in SPME, the response rates were 30.5% and 31.2%, respectively. 

 

Indicator Summary

This section provides a brief summary of each indicator. This is only reported at a Local Education Training Board (LETB) level by the GMC. Therefore all results in this section combine PPME and SPME into HEE SW.

Indicator

HEE SW Mean Score

National Mean

HEE ranking

Curriculum Coverage

69.86

71.46

11

Educational Governance

67.00

66.75

7

Handover

67.46

68.04

10

Overall Satisfaction

73.77

71.13

2

Resources for trainers

73.1

69.48

2

Rota Design

57.77

61.1

11

Support for trainers

70.32

68.01

2

Supportive Environment

67.85

67.00

5

Time for training

54.77

56.39

10

Trainer Development

74.14

69.61

1

Work Load

42.23

43.84

12

 

Outliers by Provider (trainer survey)

N.B Benchmark group = trainer specialty

Local Education Providers

Positive Outliers

Negative Outliers

2gether NHS Foundation Trust

3

0

Avon and Wiltshire Mental Health Partnership NHS Trust

4

0

Cornwall Partnership NHS Foundation Trust

4

0

Devon Partnership NHS Trust

2

0

Gloucestershire Hospitals NHS Foundation Trust

1

0

Great Western Hospitals NHS Foundation Trust

0

0

Livewell Southwest

8

0

North Bristol NHS Trust

0

0

Northern Devon Healthcare NHS Trust

2

0

Royal Cornwall Hospitals NHS Trust

2

0

Royal Devon and Exeter NHS Foundation Trust

0

0

Royal United Hospitals Bath NHS Foundation Trust

2

0

Sirona Care & Health

0

0

Somerset Partnership NHS Foundation Trust

2

0

Taunton and Somerset NHS Foundation Trust

2

0

Torbay and South Devon NHS Foundation Trust

3

0

University Hospitals Bristol NHS Foundation Trust

0

0

University Hospitals Plymouth NHS Trust

0

1

Weston Area Health NHS Trust

0

0

Yeovil District Hospital NHS Foundation Trust

1

0

Grand Total

36

1

An Outlier is where the survey score falls into the bottom (negative outlier) or top (positive outlier) quartile and with a mean outside the 95% confidence intervals of the national mean.

 

Further Information

The data contained within this report will be triangulated with other information, to enable the quality management of the training programmes across HEE SW, by identifying potential areas of good practice and development.

More detailed analysis of the 2018 NTS data is contained within the supplementary Trust/Programme Reports which will be sent out in July 2018. Should you require any further information on the content of this report please approach your local Quality Team contact:

 

Peninsula Quality Team:

Head of Quality: Martin Davis - Martin.Davis@hee.nhs.uk 

Quality Lead for Practice Placement: Val Heath - Val.Heath@hee.nhs.uk

Quality Manager: Jane Bunce - Jane.Bunce@hee.nhs.uk

Quality Support Administrator: Sophie Rose - Sophie.Rose@hee.nhs.uk

 

Severn Quality Team:

Head of Quality: Jon Francis - Jon.Francis@hee.nhs.uk

Quality Lead for Practice Placement: Andy Gadsby - Andy.Gadsby@hee.nhs.uk

Quality Manager: Lynette Cox - Lynette.Cox@hee.nhs.uk

Quality Support Administrator: Helena Hogan - Helena.Hogan@hee.nhs.uk

 

Prepared by: Andy Gadsby, Quality Lead

July 2018