Chrishantha Abeysena , Pushpa Jayawardana
Chrishantha Abeysena1, Pushpa Jayawardana2
|
Corresponding Author: Chrishantha Abeysena, Senior Lecturer / Department of Public Health, Faculty of Medicine, University of Kelaniya, Ragama, Sri Lanka, E-mail: chrishantha-beysena@mfac.kln.ac.lk |
Related article at Pubmed, Scholar Google |
Objective: To determine reliability of period of gestation determined by three independent raters using four different foetal measurements.
Methods: One hundred and eighty pregnant women were divided into three equal groups. Each group was assigned a rater to perform ultrasound scan to measure bi-parietal diameter, femur length, abdominal circumference and head circumference and to compute the respective periods of gestation using these four measurements. Reliability between periods of gestation derived by each rater from above four measurements were analysed using repeated measure ANOVA. Results were expressed as intra-class correlation coefficients (ICCs) and coefficients of variation (CsOV).
Results: For Raters I (F= 6.47; p=0.001) and II, (F= 4.80; p= 0.003), computations using abdominal circumferences resulted in the lowest mean periods of gestation (PsOG). For Rater III, computations using both femur length and abdominal circumference resulted in the lowest mean periods of gestation (F= 7.5; p=0.001). ICCs were 0.73 (95%CI 0.64–0.81) for Rater I, 0.78 (95% CI 0.70–0.85) for Rater II and 0.87 (95% CI 0.81– 0.91) for Rater III When comparing CsOV, the highest variation for Raters I and III was observed for femur length. For Rater II it was bi-parietal diameter. The lowest variation for Rater I was observed for head circumference and for Raters II and III for abdominal circumference. The highest CsOV of all the PsOG were demonstrated by Rater III. When comparing the differences between the highest and the lowest values for each period of gestation determined, the difference was more than two weeks for 38% (n=23), 24% (n=14) and 22% (n=13) of observations made by Raters I, II and III respectively.
Conclusions: Reliability of period of gestation depends on the type of measurement taken, method of assessment and the rater who performs the measurements. Our findings are not conclusive enough to recommend any PsOG based on specific measurement more reliable than others. In-service training of the obstetricians is likely to improve the reliability of PsOG determined using ultra sound scan measurements.
Key words |
Gestational age, pregnancy duration, reliability, ultrasound scan |
Introduction |
Gestational age is usually determined by the date of the woman's last menstrual period. Sometimes a woman may be uncertain of the date of her last menstrual period. Ultrasound scans offer an alternative method for estimating gestational age.1 It is currently considered to be a safe, non-invasive, accurate and cost-effective investigation of the foetus and there is no strong evidence to suggest that ultrasound harms babies.2 It has progressively become an indispensable obstetric tool and plays an important role in the care of every pregnant woman. |
The main uses of ultrasonography are determination of gestational age and assessment of foetal size. Foetal body measurements reflect the gestational age of the foetus. This is particularly true in early gestation. In patients with uncertain last menstrual periods, such measurements must be made as early as possible in pregnancy to arrive at a correct dating for the patient. In the latter part of pregnancy measuring body parameters will allow assessment of the size and growth of the foetus and will greatly assist in the diagnosis and management of intrauterine growth retardation. |
The most accurate measurement for dating is the crown-rump length of the foetus, which can be done between 7 and 13 weeks of gestation. After 13 weeks of gestation, the foetal age may be estimated by the biparietal diameter (the transverse diameter of the head), the head circumference and the length of the femur (the longest bone in the body).3 The abdominal circumference of the foetus may also be measured and this gives an estimate of the weight and size of the fetus4 as well. |
Reliability refers to the consistency of a measure. A test is considered reliable if we obtain the same result on repetition of the measurement. Even though it is impossible to calculate it exactly, there are different ways to estimate it.5 Several types of reliability are explained.6,7 To assess test-retest reliability, the measurement is taken twice at two different points in time. To assess inter-rater reliability, two or more independent observers have to take the measurement from the same individual and then determine the consistency of the raters estimates. Intra-rater reliability requires taking two or more independent measurements by an individual at two different points in time. Alternative-form reliability uses different methods to measure the same variable. Validity is the extent to which a test measures what it claims to measure. It is vital for a test to be valid in order for the results to be accurately applied and interpreted. Reliability is an essential component of validity but, on its own, is not a sufficient measure of validity. A test can be reliable but not valid, whereas a test cannot be valid and yet to be unreliable.7 |
Reliability and validity of the period of gestation determined by ultrasound scan depends on several factors: the type of measurement performed, the training and skills of the person performing the scan, duration of gestation for which the scan is performed and the lie of the foetus.8 The objective of the study was to determine reliability of the periods of gestation determined using four different foetal measurements. |
Methods |
Descriptive study was conducted using 180 pregnant women who were recruited before 16th weeks of gestation. They were invited for the ultrasound scan before the completion of the 20th week of gestation. All of them were randomly divided into three equal groups. Each group was assigned a rater who was a Consultant Obstetrician. All women were subjected to the scan by the respective raters during which bi-parietal diameter, femur length and abdominal and head circumferences of the foetus were measured. The period of gestation (PsOG) derived from each of these measurements and displayed on the machine were noted in the relevant record sheet. All scans were conducted using the same ultrasound machine. |
Repeated measure ANOVA was applied to compare the mean values of the different measurements of each rater. Reliability was assessed by computing intra-class correlation coefficients (ICCs) and coefficients of variation (CsOV). The difference between the highest and the lowest values of PsOG derived were computed for each individual mother to determine the proportion of observations that exceeded a difference of two weeks. Ethical clearance was obtained from the Ethics Review Committee of the Faculty of Medicine, University of Kelaniya. |
Results |
Statistically significant differences were observed between the mean PsOG computed using the four measurements by all the three raters: Rater I (F= 6.47; p=0.001), Rater II (F= 4.80; p= 0.003) and Rater III (F= 7.5; p=0.001) (Tables 1, 2 and 3). For Raters I and II, computations using abdominal circumferences resulted in the lowest mean PsOG. For Rater III, computations using both femur length and abdominal circumference resulted in the lowest mean PsOG. Intra class correlation coefficients between PsOG derived taking the four measurements by each rater were 0.73 (95%CI 0.64–0.81) for Rater I, 0.78 (95% CI 0.70–0.85) for Rater II and 0.87 (95% CI 0.81– 0.91) for Rater III (Tables 1, 2 and 3). |
With regard to CsOV, the highest variation was observed for the PsOG derived using femur length for Raters I and III and for the bi-parietal diameter for Rater II (Tables 1, 2 and 3). The lowest variation was observed for PsOG derived using head circumference by Rater I and for abdominal circumference by Raters II and III. All the four PsOG derived by Rater III recorded the highest CsOV. |
When comparing the differences between the highest and the lowest values of each period of gestation determined, a difference of more than two weeks was observed for 38% (n=23), 24% (n=14) and 22% (n=13) of assessments made by Raters I, II and III respectively (Table 4). |
Discussion |
Periods of gestation based on measurements taken by Rater III had higher reliability in terms of ICC than Raters I and II. Further, reliability was highest for Rater III considering the differences between the highest and the lowest PsOG for each individual mother. However in terms of PsOG based on individual four measurements, reliability was lowest for Rater III as all the CsOV were higher than that of Raters I and II. Comparing the CsOV values across the three raters, period of gestation derived from abdominal circumference had the lowest CsOV indicating highest reliability. |
Our design mainly assessed alternative-form reliability, where different measurements were used to assess the PsOG in the same woman. This was conducted using three raters even though the use of a single rater would have sufficed and we calculated ICC for periods of gestation separately for each rater. Even though we selected three groups randomly for each rater, there is a possibility that the average true period of gestation for each group might vary. Therefore pooling the data obtained from each rater could bias the ICC as well as making the calculated CsOV uninterpretable. Further, assessment of interrater reliability was not our objective. |
The PsOG are derived automatically based on regression equations fed to the ultrasound scan machine. Thus the variations of our results may also be based on the validity of the regression equations which was not under our control. Further, for clinical practice, it is the reliability of PsOG which are more important than foetal body measurements from which they are derived using the regression equations. Hence our focus was on the reliability of the former and not the latter. |
Reliability and validity are often confused, but the terms actually describe two completely different concepts, although they are often closely inter-related. Reliability is an essential component of validity but, on its own, is not a sufficient measure of validity. A test can be reliable but not valid, whereas a test cannot be valid yet unreliable. We did not assess the validity of the period of gestation. Even though there are several methods of assessing reliability statistically, it is important to review its applicability clinically. We considered a difference of more than two weeks between the highest and the lowest PsOG as clinically significant. |
Olesen9 pointed out that the gestational ages estimated using ultrasound scanning were 2-3 days shorter than gestational ages estimated by the menstrual dates. However, they have observed a good concordance between the self-reported and ultrasound-estimated gestational ages.9 Kieler10 also compared the expected date of delivery derived from biparietal diameter and the last regular menstrual period and found that 91.8% delivered within +14 days and 61.8% within seven days of expected date of delivery (EDD) derived using the bi-parietal diameter. Corresponding figures were 91.6% and 61.1% respectively for EDD derived from last regular menstrual period.10 However, comparison of EDD calculated from bi-parietal diameter and last regular menstrual period in the same woman showed that measurements derived using bi-parietal diameter postponed EDD by more than seven days in 18.0% and advanced it more than by seven days in 1.8%.10 Campbell had reported that bi-parietal diameter measurements done between 12 and 18 weeks gestation were significantly more accurate in gestational predictions (89.4%) than those based on menstrual history.11 Persson also commented that gestational age estimated using by bi-parietal diameter gave the best reliability, with a standard deviation from true gestational age of 3.2 days. 12 Of the patients with an optimal menstrual history 84.7% delivered within two weeks of the predicted date.12 The maximum difference between gestational age estimated by biparietal diameter and by femur length had been seven days.12 |
According to a study done by O’Brien femur length had been reported to provide a reproducible determination of length of the fetus.13 Johnsen reported that gestational age assessment based on femur length was an equally robust method as using head circumference.14 |
In conclusion reliability of PsOG was dependant on the type of measurement taken from the foetus from which they were derived, the method of assessment of reliability and the obstetrician who performed the measurements. Our findings are not conclusive enough to recommend any PsOG based on specific measurement more reliable than others. Inservice training of the obstetricians is likely to improve the reliability of assessments. |