- Academic Editors
Background: Global strategies to eliminate cervical cancer will
probably be followed by a drop in prevalence of precursor cervical neoplasias,
leading to the need of improving colposcopic diagnostic performance that may
negatively be affected. The aim of this study was to assess agreement among five
colposcopists regarding the presence of three isolated colposcopic images, and
different degrees of colposcopic findings. Methods: In this
retrospective study, two original colposcopists examined colposcopic images of
patients treated between 2005 and 2018, classified them following the
International Federation for Cervical Pathology and Colposcopy terminology, and
evaluated them for the presence of obstructed dilated grouped glands, aceto-white
villi with invaginated borders fused or not, and atypical vessels in cylindrical
epithelium area. Posteriorly, three independent colposcopists also classified
those colposcopic findings. The degree of agreement between the findings of the
three independent, and the two original colposcopists was assessed using the
Kappa (
In Brazil, after excluding non-melanoma skin tumors, cervical cancer is the most frequent in the North (22.47/100,000), and the second in the Northeast (17.62/100,000) and Midwest Regions (15.92/100,000) [1]. In the United States, carcinomas, i.e., tumors of epithelial origin, account for about 98% of cervical cancers, among which, squamous-type carcinomas represent 64.4% of the cases, while different subtypes of glandular carcinomas correspond to 28.9% of the cases [2].
The World Health Organization has proposed two main strategies to enable its ambitious project to reduce the incidence of cervical cancer to age-adjusted annual rates of less than 4/100,000 women by the end of the twenty-first century. The first is the broad immunization of girls under 15 against human papillomavirus (HPV), and the second is the implementation of high-sensitivity screening based on the detection of HPV DNA [3].
Adenocarcinoma in situ (AIS) has been recognized as the precursor to invasive cervical adenocarcinoma [4], and its detection by cervical cytology has traditionally been less than ideal [5]. The introduction of high-sensitivity screening should allow earlier diagnoses not only of squamous cervical precursor neoplasias, but also, and especially of those of glandular origin [5].
Women considered at risk of cervical precursor neoplasias during screening, including those who have been followed for already treated cervical intraepithelial neoplasias (CIN), should undergo colposcopy, either with or without targeted biopsy [6]. At this stage of the diagnostic investigation, this exam is considered the gold standard [6], despite its intrinsic subjectivity [7], and restricted efficiency to identify glandular cervical precursor neoplasias [8, 9]. It is necessary to take into consideration that CIN treated women continue at a higher risk of cervical malignancies than the general population [10].
Thus, strategies to improve the diagnostic performance of colposcopy should be undertaken so that smaller and more subtle neoplasias, more likely to be detected in earlier screened patients [11], are effectively identified. New studies on specific patterns of colposcopic images are, therefore, desirable, because publications of this nature have already contributed to increase the specificity of colposcopy. The colposcopic signs named inner border and ridge sign were described in 2009 [12, 13], and incorporated into the colposcopic nomenclature of the International Federation of Cervical Pathology and Colposcopy (IFCPC) in 2011 [14], precisely because of their high specificity for detecting CIN grades 2 and 3.
The agreement among colposcopists on the detection of the images described by the IFCPC terminology has been evaluated in a few classic studies and ranged from weak to substantial [15, 16, 17, 18, 19, 20, 21, 22, 23, 24], again showing the need to expand the research in this field. However, this worldwide accepted parameter does not include colposcopic images more frequently found in glandular cervical precursor lesions or AIS. Therefore, to the best of our knowledge, no previous studies have been conducted to evaluate the agreement on the detection of images related to AIS.
Considering the need to improve the colposcopic diagnostic performance, the present study aimed to assess the agreement between three independent colposcopists, previously trained using a manual with digital images (Supplementary Material), and the consensual finding of two original colposcopists. Agreement on the colposcopic findings grading and detection of three specific colposcopic images, namely obstructed dilated grouped glands, aceto-white villi with invaginated borders fused or not, and atypical vessels in cylindrical epithelium area [25], from now on called here grouped glands, aceto-white villi, and atypical vessels, were evaluated.
This retrospective cross-sectional study, approved by the Research Ethics Committee of the Hospital das Clínicas, Universidade Federal de Goiás (CAAE: 03421418.8.0000.5078), was conducted in a private colposcopy service, and followed the principles of the Declaration of Helsinki [26]. A written and signed consent was waived since only digital images and medical records were reviewed without identifying the patients included in this research.
Five experienced colposcopists reviewed filed digital images (640
Three colposcopic images investigated in filed digital images. (A) Obstructed dilated grouped glands. (B) Aceto-white villi with invaginated borders, fused or not. (C) Atypical vessels in cylindrical epithelium area [25]. Note that the third image of group A has been intentionally repeated as the fifth image of group C, to emphasize the diversity of aspects that are commonly seen each colposcopic examination.
Data about age, parity, referral cytology, visualization of the squamous-columnar junction (SCJ), degree of colposcopic findings, and histopathological diagnosis were collected in standardized medical records and colposcopy reports filed in LPT4 programs (LPT4 Information systems, Curitiba, PR, Brazil) and Zscan (Zscan Software, 2001–2016, Goiânia, GO, Brazil). Subsequently, these data were entered into Excel 2013 spreadsheets (Microsoft Corp., Redmond, WA, USA).
Files of all patients examined between 2005 and 2018, and diagnosed with cervical intraepithelial neoplasias grades 1, 2, or 3, or AIS after an excisional procedure, were included. To this initial list of files, randomly selected digital image files obtained from patients with both normal and abnormal initial colposcopy, but without CIN, were added. Images with no visible SCJ and/or insufficient quality for reading were excluded.
The two original colposcopists created a manual with digital images of 61 patients not included in this study, used for training the three independent colposcopists. The former had access to all the data collected and jointly and consensually identified the cases presenting the three colposcopic images of interest. The three independent colposcopists, experts from other services, received a spreadsheet containing information of all cases, except the degrees of colposcopic findings, and histopathological diagnosis. Subsequently, they reviewed the filed digital images of the cases included in the study, recorded the presence of each of the three aforementioned images, the degree of colposcopic finding, and the quality of the images.
One of the original colposcopists carried out the initial examinations employing
D.F. Vasconcelos (Valença, RJ, Brazil), or Medpej Equipamentos Médicos
(Ribeirão Preto, SP, Brazil) colposcopes at five levels of magnification
(6
The cytological abnormalities were classified following the Bethesda Cytological Classification, updated in 2014 [27], whereas the colposcopic findings were categorized according to the terminology proposed by the IFCPC [14]. Histopathological examinations of the biopsy fragments and excisional specimens of the TZ were performed by a single examiner and classified according to the World Health Organization International Histological Classification of Tumors [28] and Richart’s classification for cervical intraepithelial neoplasias [29].
The Statistical Package for Social sciences (SPSS) for Windows 21.0 (IBM Brasil,
São Paulo, SP, Brasil), SPSS, was used for descriptive and frequency
distribution analysis of collected clinical data, as well as for calculating the
Kappa (
After applying the exclusion criteria, colposcopic digital image files of 822
patients were included in this study. The mean age of the patients was 30.4
Variable | Years | ||
Age | |||
Range | 15 to 73 | ||
Mean |
30.4 |
||
Age at first intercourse |
|||
Range | 10 to 41 | ||
Mean |
18.3 |
||
Variable | n | % | |
Lifetime sexual partners |
|||
253 | 30.8 | ||
502 | 61.1 | ||
Full-term pregnancy |
|||
479 | 58.3 | ||
339 | 41.2 | ||
Tobacco use |
|||
Past and current smoker | 69 | 8.4 | |
Never smoker | 707 | 86.0 | |
Contraception |
|||
Hormonal | 448 | 54.5 | |
Condom | 28 | 3.4 | |
Others | 71 | 8.6 | |
Not applicable | 154 | 18.7 |
Missing data:
n, number; SD, standard deviation.
Variable | n | % | |
Referral cytology |
|||
ASC-US/LSIL | 420 | 51.1 | |
ASC-H/HSIL | 319 | 38.8 | |
AGC | 27 | 3.3 | |
Negative | 47 | 5.7 | |
Colposcopic findings | |||
Normal | 12 | 1.5 | |
Minor | 215 | 26.1 | |
Major | 593 | 72.1 | |
Suspicious for invasion | 2 | 0.2 | |
Squamocolumnar junction | |||
Ectocervical | 160 | 19.5 | |
Endocervical | 232 | 28.2 | |
On the external orifice | 430 | 52.3 | |
Final diagnosis | |||
Control | 115 | 14.0 | |
CIN 1 | 97 | 11.8 | |
CIN 2 or 3 | 554 | 67.4 | |
AIS | 56 | 6.8 | |
Image quality | |||
Original colposcopists | |||
Readable | 803 | 97.7 | |
Hardly readable | 19 | 2.3 | |
Independent colposcopist 1 | |||
Readable | 342 | 41.6 | |
Hardly readable | 480 | 58.4 | |
Independent colposcopist 2 | |||
Readable | 579 | 70.4 | |
Hardly readable | 243 | 29.6 | |
Independent colposcopist 3 | |||
Readable | 255 | 31.0 | |
Hardly readable | 567 | 69.0 |
Missing data:
AGC, atypical glandular cells; AIS, adenocarcinoma in situ; ASC-H/HSIL,
atypical squamous cells: cannot exclude high-grade squamous intraepithelial
lesion/high-grade squamous intraepithelial lesion; ASC-US/LSIL, atypical squamous
cells of undetermined significance/low-grade squamous intraepithelial lesion;
CIN, cervical squamous intraepithelial neoplasia; n, number.
Independent colposcopist | Original colposcopists | Kappa (95% CI) | p | ||
Grouped glands n (%) | |||||
Present | Absent | ||||
Colposcopist 1 | |||||
Present | 67 (8.2) | 79 (9.6) | 0.24 (0.15–0.33) | ||
Absent | 128 (15.6) | 548 (66.7) | |||
Colposcopist 2 | |||||
Present | 62 (7.5) | 84 (10.2) | 0.15 (0.06–0.24) | ||
Absent | 162 (19.7) | 514 (62.5) | |||
Colposcopist 3 | |||||
Present | 71 (8.6) | 75 (9.1) | 0.19 (0.10–0.28) | ||
Absent | 168 (20.4) | 508 (61.8) | |||
Aceto-white villi n (%) | |||||
Present | Absent | ||||
Colposcopist 1 | |||||
Present | 90 (10.9) | 78 (9.5) | 0.37 (0.28–0.45) | ||
Absent | 100 (12.2) | 554 (67.4) | |||
Colposcopist 2 | |||||
Present | 60 (7.3) | 108 (13.1) | 0.29 (0.20–0.39) | ||
Absent | 62 (7.5) | 592 (72.0) | |||
Colposcopist 3 | |||||
Present | 54 (6.6) | 114 (13.9) | 0.15 (0.06–0.25) | ||
Absent | 112 (13.6) | 542 (65.9) | |||
Atypical vessels n (%) | |||||
Present | Absent | ||||
Colposcopist 1 | |||||
Present | 54 (6.6) | 30 (3.6) | 0.21 (0.12–0.30) | ||
Absent | 186 (22.6) | 552 (67.2) | |||
Colposcopist 2 | |||||
Present | 20 (2.4) | 64 (7.8) | 0.24 (0.10–0.38) | ||
Absent | 31 (3.8) | 707 (86.0) | |||
Colposcopist 3 | |||||
Present | 58 (7.1) | 26 (3.2) | 0.14 (0.06–0.21) | ||
Absent | 276 (33.6) | 462 (56.2) |
95% CI, 95% confidence interval; n, number.
In the assessment of grouped glands, the agreement values obtained were
intermediate in relation to the other two images, ranging from
The agreement between the degree of colposcopic findings assessed by the
independent colposcopists and those assessed by the original colposcopists ranged
from
Independent colposcopist | Original colposcopists | Kappa (95% CI) | p | ||
Normal colposcopic findings n (%) | |||||
Present | Absent | ||||
Colposcopist 1 | |||||
Present | 7 (0.8) | 39 (4.7) | 0.22 (0.00–0.45) | ||
Absent | 5 (0.6) | 771 (93.8) | |||
Colposcopist 2 | |||||
Present | 7 (0.8) | 66 (8.0) | 0.14 (0.00–0.33) | ||
Absent | 5 (0.6) | 744 (90.5) | |||
Colposcopist 3 | |||||
Present | 11 (1.3) | 86 (10.5) | 0.18 (0.02–0.34) | ||
Absent | 1 (0.1) | 724 (88.1) | |||
Minor findings n (%) | |||||
Present | Absent | ||||
Colposcopist 1 | |||||
Present | 101 (12.3) | 80 (9.7) | 0.36 (0.28–0.43) | ||
Absent | 114 (13.9) | 527 (64.1) | |||
Colposcopist 2 | |||||
Present | 133 (16.2) | 267 (32.5) | 0.14 (0.07–0.21) | 0.001 | |
Absent | 82 (9.8) | 340 (41.4) | |||
Colposcopist 3 | |||||
Present | 131 (15.9) | 191 (23.2) | 0.25 (0.18–0.33) | ||
Absent | 84 (10.2) | 416 (50.6) | |||
Major findings n (%) | |||||
Present | Absent | ||||
Colposcopist 1 | |||||
Present | 505 (61.4) | 89 (10.8) | 0.46 (0.39–0.53) | ||
Absent | 88 (10.7) | 140 (17.0) | |||
Colposcopist 2 | |||||
Present | 311 (37.8) | 31 (3.8) | 0.29 (0.23–0.35) | ||
Absent | 282 (34.3) | 198 (24.1) | |||
Colposcopist 3 | |||||
Present | 354 (43.1) | 39 (4.7) | 0.34 (0.27–0.40) | ||
Absent | 239 (29.1) | 190 (29.1) | |||
Suspicious for invasion n (%) | |||||
Present | Absent | ||||
Colposcopist 1 | |||||
Present | (0.0) | 1 (0.1) | 0.00 (0.00–0.00) | 0.961 | |
Absent | 2 (0.2) | 819 (99.6) | |||
Colposcopist 2 | |||||
Present | 2 (0.2) | 5 (0.6) | 0.44 (0.04–0.93) | ||
Absent | (0.0) | 815 (99.1) | |||
Colposcopist 3 | |||||
Present | (0.0) | 10 (1.2) | 0.00 (0.00–0.6) | 0.875 | |
Absent | 2 (0.2) | 810 (98.5) |
95% CI, 95% confidence interval; n, number.
On one hand, the agreement for the detection of normal colposcopic findings
ranged from
In the present study, the degree of agreement between three independent and two
original colposcopists on the detection of three colposcopic images, namely
grouped glands, aceto-white villi, and atypical vessels, was statistically
significant when evaluated isolatedly (p
The degree of agreement between the different colposcopists on the
identification of the images evaluated in this study showed great variability.
However, this is inherent to methods based on the interpretation of images,
similarly to the interpretation of cytological and histopathological images [30].
Despite these limitations, this study achieved levels of agreement between the
independent and the original colposcopists that significantly (p
Digital colposcopic image files are undoubtedly useful for documenting, training, and assessing expert proficiency. Nonetheless, another important consideration, in addition to the subjectivity of image interpretation, is that the analysis of filed digital images is not as accurate as the assessment of colposcopic examination in real-time. In the former, it is not possible to change the focus or the magnification level. Furthermore, the mobilization of the cervix, the removal of blood or mucus, the longitudinal assessment of the aceto-whitening reaction, and the use of a green filter are also impossible [31]. Thus, the identification of these images in real-time colposcopy, rather than in filed digital images, would most probably result in better degrees of agreement among colposcopists.
The study that most closely resembles the present one [12] was the basis for the
inclusion of the colposcopic signs inner border and ridge sign, according to the
IFCPC terminology, as findings that indicate the presence of major alterations
[14]. The degree of agreement among three different colposcopists for the
detection of the ridge sign in digital colposcopic images of 592 patients ranged
from regular to moderate (
Other groups that assessed the degree of agreement of isolated images found
values of
In contrast, other evaluations of the degree of agreement of colposcopic
findings, but not of isolated images, categorized into four or five levels,
obtained an agreement of
Three colposcopic images indicative of minor alterations, six indicative of
major alterations, and two patterns corresponding to suspicious for invasion
(atypical vessels and additional signs) were described according to the IFCPC
terminology [14]. Nevertheless, the increase in the number of images to be
detected, or categories and subcategories in which the findings should be
included, may result in a decrease in the agreement indices [32]. This occurred
in a study carried out in the United Kingdom, which obtained an agreement of
Similarly, several studies have reported lower degrees of agreement considering
the identification of isolated images [12, 15, 18, 24]. In a Canadian study, the
authors found an agreement of
In another publication of our team, the assessment of the diagnostic performance of the three aforementioned images showed that the area under the receiver operating characteristic curve, found when at least one of them was present, was 0.82 (95% CI: 0.77–0.88) for the diagnosis of AIS, and 0.60 (95% CI: 0.56–0.63) for the diagnosis of CIN 2 and 3 [25]. This performance, especially relevant for the identification of glandular precursor cervical neoplasias, could probably be similar in other colposcopy services, provided that the specialists received specific additional training to identify them.
The categories suspicious for invasion and normal colposcopic findings showed a low prevalence of positive findings in this study, 0.24% (2 cases) and 1.46% (12 cases), respectively. This low prevalence must have contributed to the lack of agreement in the former, as well as to the weak agreement in the latter, due to the prevalence effect [34]. This effect appears anytime the proportion of positive results is substantially different from 50%, and implies a variation in the Kappa coefficient inversely proportional to this difference [34].
The agreement between colposcopists on the major and minor colposcopic finding
categories ranged from weak to moderate in this study, comparable to the findings
of other publications [18, 24, 33]. Furthermore, the weak to moderate degrees of
agreement obtained, concerning major and minor colposcopic findings, were also
similar to those found for the detection of aceto-white villi images, as shown by
the overlap of their 95% CI, except for colposcopist 3 regarding major
colposcopic findings. An apparent difference in the level of agreement with the
findings of the original colposcopists, achieved by each one of the three
independent colposcopists, was discarded due to the overlap of the 95% CI found
among their
This study showed levels of agreement between distinct colposcopists that significantly exceeded those expected only by chance. Even though these outcomes suggest that new examiners can be trained to recognize the three images here evaluated, it still remains necessary to take multiple biopsies of any abnormal colposcopic finding to maximize the sensitivity of this method, especially considering the already widely known great variability on the final findings of exams based on interpretation of images [7].
Three independent colposcopists, trained using a digital colposcopic imaging manual with cases different than those included in this study, reached statistically significant agreement in relation to the findings of the two original colposcopists. The degree of agreement that they obtained ranged from weak to regular for the identification of three isolated colposcopic images, namely grouped glands, aceto-white villi, and atypical vessels. Additionally, the agreement found for the detection of major and minor colposcopic findings varied between weak and moderate. The higher agreement in the identification of major and minor colposcopic findings compared to the lower agreement for the three images, which in a previous study showed higher performance for the identification of glandular intraepithelial neoplasias, suggests that new studies in the field are still necessary, especially to clarify whether the improvement in the detection of these images could lead to better rates of colposcopic diagnosis of AIS and, consequently, reduce the incidence of invasive cervical adenocarcinoma.
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.
GFM: conceptualized and designed the study; carried out initial colposcopies, collected and analyzed data; reviewed images; wrote the manuscript. RRFA: conceptualized and designed the study; analyzed data; reviewed images; wrote the manuscript. MARM: performed histopathological diagnoses. RMZ, MJC, EPR: reviewed images. All authors have agreed to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved. All authors contributed to editorial changes in the manuscript. All authors read and approved the final manuscript.
The study was approved by the Institutional Review Board and Ethics Committee of the Clinical Hospital, Universidade Federal de Goiás (CAAE: 03421418.8.0000.5078). No signed written consent was required, since only stored digital images, medical records, and colposcopy reports were accessed.
We would like to thank all the patients analyzed for their crucial role in benefiting the ones who followed them.
This research received no external funding.
The authors declare no conflict of interest.
Publisher’s Note: IMR Press stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.