Submit manuscript...
eISSN: 2378-315X

Biometrics & Biostatistics International Journal

Short Communication Volume 9 Issue 3

A simple Fibonacci weighted scoring system to rate examinations of children with respiratory illness

Flynn MF, Blacklock CT

Royal Alexandra Hospital, United Kingdom

Correspondence: Matthew Flynn, Victoria Hospital, Victoria Hospital, Hayfield Road, Kirkcaldy, KY2 5AH, UK, Tel +447786018918

Received: May 14, 2020 | Published: June 11, 2020

Citation: Flynn MF, Blacklock CT. A simple Fibonacci weighted scoring system to rate examinations of children with respiratory illness. Biom Biostat Int J. 2020;9(3):106-109. DOI: 10.15406/bbij.2020.09.00307

Download PDF

Abstract

A thorough examination of the head and neck is necessary to establish a diagnosis in pyrexial children, and for the exclusion of rare, but not to be missed conditions, such as Lymphoma and EBV. Scoring systems are a key tool in providing feedback to clinicians on how well these are carried out, and tracking their improvements.

This audit looked at how well children with suspected respiratory illness were examined and how this was improved with such a tool. Feverish children over the age of 6 months were tracked: by whom they saw and how well they were examined. The quality of examination was stratified under a 3-teir standard (Gold, Silver and Bronze) with the “Gold” examinations including correct documentation of the state of ears, throat and lymph nodes, with Silver and Bronze allocated to standards approaching this.

This Fennobacci-weighted scoring system was employed to average a score achieved by each grade over 21-month periods. Clinicians had re-education on the clinical exams in the interim. Junior doctors improved scores by 25%, nurse practitioners by 112% and more senior grades by 6%. The scoring system proved a motivational feedback mechanism across teams.

Revalidation and confidence-building are required for doctors in training to achieve a high consistency in clinical examination, and novel scoring systems can be helpful in achieving this.

Keywords: otolaryngology, paediatrics, clinical examination, fever, COVID 19

Abbreviations

SHO, senior house officer; ANP, advanced nurse practitioner; FA, first assessor; ENT, ear nose and throat

Introduction

Respiratory infections of the head and neck are a common presentation in the paediatric population, but, being routine, present an opportunity for serious pathology to be missed. Epstein-Barr Virus, Kawasakis’ Disease and Lymphoma, for instance, can present with signs not dissimilar to the common cold. A thorough examination of the head and neck is necessary to establish a diagnosis in pyrexial children, and for the exclusion of these rarer, but not to be missed, conditions.i,ii,iii Such in depth clinical examinations are not often employed outwith the specialty of otolaryngology, but paediatrics is an area where they are well employed.iv In light of the coronavirus pandemic of 2020, the effective triage and discharge of children with respiratory infections from hospital has heightened relevance.v,vi

This project established a feedback mechanism for clinicians in training, and examined whether simple re-education of medical staff suffices to elicit a detectable improvement in practice, aiding safe discharge of these children. The audit was conducted in a Paediatric Assessment Unit in a District General Hospital receiving referrals from primary care, from where patients were to be either admitted or discharged based on this assessment.

Scoring systems have been used effectively to stratify clinical competencies across grades of clinicians.vii,viii A Fenobacci weighted points system, such as that used in the Olympic games to declare overall leaders across diverse teams, was used to asses overall performance of each clinician team.ix This led to development of a Gold/Silver/Bronze rating, which was hoped to be motivational.

Materials and methods

Case note review

Case note records were obtained for 2 groups of patients (43 and 36 respectively) in two cycles of analysis, by Foundation Year 2 Doctors and GP trainees (collectively SHO’s), Advanced Nurse Practitioners (ANP’s) and Paediatric Specialty Trainees and Staff Grades (Registrars). Included were children who were older than 6 months, those presenting to the acute paediatric assessment unit (accepting ages 0-15), and temperature >37.5°C or “Pyrexia,” “Fever,” “Hot” or “[High] Temperature” recorded on either nursing or medical admission notes. Excluded were examinations by medical students or those conducted in the emergency department.

Fenobacci scoring system

The results were collated by clinician group they saw and how well they were examined. A 1:2:3 (a+b=c)*scoring system was employed: full documentation of the ear, throat and neck was awarded 3 points, a focussed examination of two of these systems qualified 2, and any other documented attempt of ENT examination falling short of these, was awarded 1 (Table 1).

Necessary documentation

Bronze

Silver

Gold

Documented neck examination

X

X

X

“ENT:NAD”*

X

X

 

Focussed documented examination of ears and throat

X

X

 

Any documentation of ENT examination below above standards

X

 

 

No documentation

X

 

 

Table 1 Necessary documented examination for each score
*Nasal examination was not deemed an essential component and was seldom otherwise documented
ENT, Ear, nose and throat; NAD, Nothing abnormal detected

Collation of scores by clinician grade

The standards of the examinations being thus identified, a mean of the maximum score of 3 would be applied to each subgroup of clinicians. The process was repeated after an interval of a month, with the aim of demonstrating an augmentation of scores.  

Action taken

A departmental presentation was given on the first round of results, highlighting the clinical relevance of the ENT examination, and clinicians were invited to participate in an online survey, summarising attitudes towards what was considered effective. The national guidelines for assessment of feverish children were signposted.

*In Fibonacci sequences, a higher number is the sum of the two preceding, ensuring the ‘gold standard’ examinations contributed to scoring as much as two poorer examinations combined [IX]

Results (Graph 1-3)

During the first cycle the SHO’s (Regs, ANP’s) completed a total of 23 (16,2) examinations which grew to 29 (12,7). As a cohort SHO’s demonstrated improvement in scores towards the gold standard, with an increase in net score of 2.17 to 2.34 in response to retraining. Registrar level doctors showed no overall improvement, with their decreased rate of attaining gold-level examinations being proportional to the decrease in bronze level. From the relatively small numbers of ANP’s sampled there was a noticeable improvement in scores from 1.00 to 1.57.

Number of Examinations per category

SHO

Reg

ANP

Cycle 1

Cycle 2

Cycle 1

Cycle 2

Cycle 1

Cycle 2

Bronze = 1pt

4

5

4

2

2

3

Silver = 2pts

11

9

8

8

0

4

Gold = 3pts

8

15

4

2

0

0

Average fenobacci weighted score

2.17

2.34

2

2

1

1.57

SHO, senior house officer; Reg, registrar staff grade; ANP, advanced nurse practitioner

Graph 1 Scores per doctor grade during Cycle 1.

Graph 2 Scores per doctor grade during Cycle 2.

Graph 3 Improvement in score: SHO’s vs. Registrar/Staff Grade.

Discussion

Simple education sufficed to close the gap towards best practice, especially for junior grade doctors and ANP’s. During the process no serious pathology was missed. Revalidation and confidence-building for doctors in training achieved a higher consistency in clinical examination.The lack of confidence of non- ENT specialists in examining uncooperative children is potential factor, with a need for more robust undergraduate confidence-building in this skill, and/or for it to be re-taught as part of a paediatric departmental induction. There is a need to develop tools for eliciting increased cooperation from children in this scenario.x The scoring system used was a helpful feedback mechanism, articulating to doctors how their standards measured up against best practice and motivating improvement.

Conclusion

  1. Full Ear, Throat and Neck examinations should be carried out for children presenting with feverish illness
  2. Feedback to front line clinicians is helpful in maintaining best practice with the help of scoring systems
  3. Further education and revalidation of these clinicians is called for in light of the challenges presented by children and COVID -19, particularly for training grade, non ENT specialists.

Acknowledgments

Thanks to Dr Fiona Hillis, Consultant Paediatrician, Royal Alexandra Hospital, for advice on the design and relevant guideline framework

Conflicts of interest

No conflict of interest to declare.

Endnotes

iRationale and impact | Fever in under 5s: assessment and initial management | Guidance | NICE. Nice.org.uk. https://www.nice.org.uk/guidance/ng143/chapter/Rationale–and–impact#kawasaki–disease–2. Published 2020. Accessed May 23, 2020.
iiNHS Greater Glasgow and Clyde. Feverish Illness In Children (< 5 Years) Paediatric Emergency Department, RHC. Glasgow; 2020.
iiiBickely L. Bates’ Guide To Physical Examination And History Taking. 7th ed. Philadelphia: Lippincot Williams and Wilkins; 1999 ch. 18.
ivDemir E, Topal S, Atsal G, Erdil M, Coskun ZO, Dursun E. Otologic Findings Based on no Complaints in a Pediatric Examination. Int Arch Otorhinolaryngol. 2019;23(1):36–40.
vWang E, Brar K. COVID–19 in children: an epidemiology study from China [published online ahead of print, 2020 Apr 21]. J Allergy Clin Immunol Pract. 2020.
viEvaluating and Testing Persons for Coronavirus Disease 2019 (COVID–19). Centers for Disease Control and Prevention. https://www.cdc.gov/coronavirus/2019–ncov/hcp/clinical–criteria.html. Published 2020. Accessed May 23, 2020.
viiFranzese CB. Pilot study of an Objective Structured Clinical Examination ("the Six Pack") for evaluating clinical competencies. Otolaryngol Head Neck Surg. 2008;138(2):143–148.
viiiMAXIM B, DIELMAN T. Dimensionality, internal consistency and interrater reliability of clinical performance ratings. Med Educ. 1987;21(2):130–137.
ixSergeyev Y. The Olympic Medals Ranks, lexicographic ordering and numerical infinities. The Mathematical Intelligencer. 2020;37(2):4–8. https://arxiv.org/abs/1509.04313v1. Accessed May 23, 2020.
xLeclerc JE, Julien AS, Leclerc LD, Bergeron–Dupras T. Tips for children's better cooperation during the examination of the head and neck: A Delphi method. Int J Pediatr Otorhinolaryngol. 2016;86:233–239.

Creative Commons Attribution License

©2020 Flynn, et al. This is an open access article distributed under the terms of the, which permits unrestricted use, distribution, and build upon your work non-commercially.