- Research article
- Open Access
Individual risk of cutaneous melanoma in New Zealand: developing a clinical prediction aid
BMC Cancer volume 14, Article number: 359 (2014)
New Zealand and Australia have the highest melanoma incidence rates worldwide. In New Zealand, both the incidence and thickness have been increasing. Clinical decisions require accurate risk prediction but a simple list of genetic, phenotypic and behavioural risk factors is inadequate to estimate individual risk as the risk factors for melanoma have complex interactions. In order to offer tailored clinical management strategies, we developed a New Zealand prediction model to estimate individual 5-year absolute risk of melanoma.
A population-based case–control study (368 cases and 270 controls) of melanoma risk factors provided estimates of relative risks for fair-skinned New Zealanders aged 20–79 years. Model selection techniques and multivariate logistic regression were used to determine the important predictors. The relative risks for predictors were combined with baseline melanoma incidence rates and non-melanoma mortality rates to calculate individual probabilities of developing melanoma within 5 years.
For women, the best model included skin colour, number of moles > =5 mm on the right arm, having a 1st degree relative with large moles, and a personal history of non-melanoma skin cancer (NMSC). The model correctly classified 68% of participants; the C-statistic was 0.74. For men, the best model included age, place of occupation up to age 18 years, number of moles > =5 mm on the right arm, birthplace, and a history of NMSC. The model correctly classified 67% of cases; the C-statistic was 0.71.
We have developed the first New Zealand risk prediction model that calculates individual absolute 5-year risk of melanoma. This model will aid physicians to identify individuals at high risk, allowing them to individually target surveillance and other management strategies, and thereby reduce the high melanoma burden in New Zealand.
New Zealand and Australia are the two countries with the highest melanoma incidence rates in the world. In 2009, New Zealand had an age-standardised rate (ASR) of 42.8 per 100,000 in men and 33.6 per 100,000 in women . Despite over 20 years of health promotion campaigns predominantly focusing on melanoma prevention, and ad hoc opportunistic screening by skin examination, both the rates  and the thickness of melanomas have been increasing in Maori and non-Maori New Zealanders . Notwithstanding these worrying trends, as thickness is the major prognostic factor, the best avenue for reducing melanoma mortality remains early diagnosis while the lesion is still thin .
It is generally believed that screening of high-risk people by total skin examination for early detection is more feasible, cheaper, has fewer false positive screens and lower patient anxiety  compared to population screening. However, screening of high-risk people requires their accurate identification.
Risk assessment and prognostication are regularly used in medicine to guide management decisions. Nevertheless, accurately predicting disease development is challenging, and the common practice of stratifying individual risk based on a single variable, such as age, rarely gives a precise enough estimate of individual risk. Although many risk factors for melanoma are well described, their multiple interactions make risk prediction complex. However, having estimated an individual’s absolute risk by consideration of their personal combination of risk factors, appropriate strategies for prevention, surveillance and early diagnosis can be offered. By encouraging joint patient-clinician decisions on these strategies it is hoped to improve melanoma control, particularly in people at high and very high risk, and thus reduce morbidity and mortality from melanoma in New Zealand.
As an aid to clinical decision-making, we have developed a personal risk assessment model that estimates the probability of an individual developing their first melanoma within the next 5 years. The model is based on results from a New Zealand population-based case–control study of risk factors for melanoma.
The data from a 1992–1994 case–control study of skin screening and melanoma risk factors in three geographic regions of New Zealand  provided the relative risk estimates for melanoma.
Histology reports of melanomas were obtained directly from pathology laboratories in the Bay of Plenty (population 117,500; lat 38°S, long 177°E), Hawkes Bay (population 111,000; lat 39°S, long 177°E) and Nelson-Marlborough (population 104,000; lat 41.5°S, long 174°E) regions of New Zealand from 1 July 1992 to 30 June 1994. In addition, research nurses manually searched laboratory files for missed reports. Finally, all melanoma registrations of the New Zealand Cancer Registry that were not identified through the laboratories, were also included. Cases aged from 20 to 79 years, with a first diagnosis of in-situ, invasive or metastatic cutaneous melanoma, were interviewed within one year of diagnosis. Eligible interviews were completed for 368 cases.
Control subjects were randomly selected from the electoral roll. In New Zealand all residents aged 18 years or older have to be enrolled on an electoral roll by law. The rolls are about 95% complete for residents aged 30 years and over. Controls were frequency matched by age and region to cases accrued in the first 6 months of the study, and those with a history of melanoma were excluded. Eligible interviews were completed for 270 controls.
Trained interviewers, using a standardised telephone interview, collected data on demographics, melanoma risk factors, previous medical history, family history of skin cancer, experience of screening skin examinations, knowledge of melanoma, and for cases, diagnostic histories. Participants self-assessed their freckling and mole numbers prior to interview, according to a mailed protocol. No clinical examinations were performed. A week before interview, participants were mailed an information pack including photographs of moles to help with identification, a transparent plastic measurement card to measure their moles, and diagrams of body parts with different densities of moles and freckles. In a separate study we compared our method of self-assessment with clinical examination and found very good agreement for large moles (Kappa 0.83).
Ethnicity and phenotype data for all subjects were collected by self-report during the interview; participants with coloured or dark phenotype were excluded.
The protocol was approved by the three regional ethics committees (the Bay of Plenty Regional Ethics Committee, the Hawkes Bay Regional Ethics Committee, and the Nelson/Marlborough Regional Ethics Committee). All participants gave informed consent to take part in the case–control study.
Variables in the logistic model
From the original variables in the case–control study we selected 44 of interest based on published risk factors for melanoma, previous analysis of the case–control study, and ease of collection in primary care, including several measures of sun exposure, skin reaction to sun and phenotype (see Additional file 1). Chi-square tests and univariate logistic regression were used to measure the association between each categorical variable and case–control status. Pearson correlation coefficients measured correlations between continuous variables and chi-square tests between categorial variables. From the 44 variables of interest, 9 candidate variables for women and 8 candidate variables for men (Table 1) had p-values <0.25 in univariate tests of association so were considered for inclusion in the final multivariate models . The mole count on the right arm was included as a continuous variable in the model for men. However, as one woman reported a very high but unspecified number of moles on her right arm, this variable was treated as a categorical variable for women. Some variables of interest were excluded as they occurred infrequently (for example, having a 1st degree relative with a history of melanoma), or they were highly correlated with or were linear functions of another variable (for example, the number of large moles on the body and the number of large moles on the right arm). Very few data were missing. Cases and controls with missing data were excluded unless otherwise specified: no missing data were imputed.
There were 3 components to the calculation of the 5-year absolute risk:
The development of logistic models, separately for men and women, to provide estimates of relative risk (RR), from odds ratios, for risk factors identified in the case–control study.
The calculation of the attributable risk (AR), using data from the cases only and the RRs from the logistic model, using the method of Bruzzi et al. .
The use of an estimating equation (described by Gail et al. ) incorporating baseline melanoma incidence and non-melanoma mortality to provide individualised estimates of 5-year absolute risk of melanoma.
To avoid unstable models and unreliable assessment of model performance  instead of building the logistic models from a subset of the dataset and validating the model on the remainder, the models were developed from the entire dataset. As these models were developed for use in primary care, smaller models with fewer variables to measure were preferred for practical reasons. Model selection techniques described below were used to determine the best and most parsimonious logistic model from the variables and 1st order interaction terms. We used backward selection with the likelihood ratio statistic  as the exclusion criterion for nested models, and Akaike’s Information Criterion (AIC) as the exclusion criterion for non-nested models. For internal validation, forward selection was also used, and the validity of variable selection was assessed by backward and forward bootstrap resampling . Calibration was examined by plotting observed versus expected probabilities for deciles of individual predicted risk  and assessed by the Hosmer-Lemeshow test ; the linktest  was used to test the specification of the model; and a classification test  was used to examine sensitivity, specificity and percentage of participants correctly classified. Discrimination was assessed by the C-statistic (the area under the curve of the receiver operating characteristic (ROC)) .
From the RRs provided by the logistic models, we calculated the AR and obtained standard errors through bootstrapping (see Additional file 2: Appendix 1).
For estimates of risk by latitude, district health board regions of residence were collated into four groups at different latitudes: North (Northland, Waitemata, Auckland, Counties Manukau), Midland (Waikato, Lakes, Bay of Plenty, Tairawiti, Hawke’s Bay, Taranaki, Whanganui), Central (Mid Central, Capital and Coast, Hutt, Wairarapa, Nelson, Marlborough), and South (West Coast, Canterbury, South Canterbury, Otago, Southland). The regional baseline age- and sex-specific hazard rate of melanoma for people with no risk factors was calculated as the age-, sex- and region-specific incidence (obtained from New Zealand Ministry of Health publications ) times one minus the AR.
To include competing mortality (which reduces the absolute risk of developing melanoma) in the calculation of absolute risk, age- and sex-specific non-melanoma mortality rates for 1996–2006 were calculated from publications of the Ministry of Health [16, 17]. The baseline incidence rates for people without melanoma risk factors, and non-melanoma mortality rates are shown in Table 2. Using the above information, individual 5-year absolute risks were calculated (see Additional file 2: Appendices 2 and 3).
The data for the current analysis included 368 cases (182 women, 186 men) and 270 controls (139 women, 131 men).
In the case–control study we received notifications for 604 cutaneous melanoma patients of whom 166 were ineligible to participate (73 were outside the age range, 54 had a previous diagnosis of melanoma, 19 had died, 5 lived outside New Zealand and 15 had mental impairment or deafness preventing them from being interviewed). Of the 438 eligible cases, interviews were completed with 368 giving a response rate of 84.0% and a cooperation rate (number of completed interviews in those whom we could contact) of 84.9% (368/433). Of the 368 cases, 158 had in-situ melanoma at diagnosis and the remainder were invasive. The depth of the invasive lesions ranged from 0.1 mm to 6.1 mm, and 62% of the invasive lesions were < =1 mm at diagnosis.
We approached 573 potential controls of whom 73 were ineligible (32 had dark or coloured skin, 14 lived outside the region, 5 had a previous diagnosis of melanoma, 5 had died, and 17 could not complete a telephone interview because of deafness, history of stroke or other mental impairment). Of the 500 eligible controls, interviews were completed for 270 giving a response rate of 54.0% and a cooperation rate of 67.3% (270/401).
Logistic model for women
From the results of the case–control analysis, nine candidate variables were considered for the logistic model for women: age group at diagnosis (AGE: <=50/>50 years), ever having had a blistering sunburn (SUNBURN: yes/no), teenage hair colour (HAIRCOLOUR: black, brown/fair, blond, red), eye colour (EYECOLOUR: brown/hazel/green/grey, blue), skin colour (SKINCOLOUR: olive/medium/fair), freckling (FRECKLING: none/few/moderate/many), number of moles > =5 mm on right arm (MOLES_RARM: 0/1/2/3+), 1st degree relative with large moles (FAMHXMOLES: yes/no) and personal history of non-melanoma skin cancer (NMSC: yes/no) (Table 1). The data for these variables were almost complete: only two participants were missing mole counts. After the formal model selection, four variables were independently associated with melanoma risk: SKINCOLOUR, MOLES_RARM, FAMHXMOLES, and NMSC (Table 3). There were no significant first-order interactions between any of these terms. Having fair skin (compared to olive skin) gave the greatest risk of melanoma (Table 3) with an adjusted odds ratio (OR) of 4.50, closely followed by having three or more large moles (versus none) on the right arm (adjusted OR = 4.28), and a personal history of NMSC (adjusted OR = 3.75).
The reproducibility of the model assessed by bootstrap re-sampling was very good: about 98% of the models chosen included FAMHXMOLES, 71% and 70% included NMSC and SKINCOLOUR, respectively, and 61% included MOLES_RARM. The diagnostic tests confirmed that the model was appropriately specified and fitted adequately. The model correctly classified 68.3% of participants; discrimination, as shown by the C-statistic, was 0.74; the model exhibited good calibration over the range of predicted probabilities (Figure 1a); and the AR for these variables in women was 0.89 (95% CI: 0.68 to 0.97).
Logistic model for men
From the case–control study the eight candidate variables considered for the model for men were age group at diagnosis (AGE: <=50/>50 years), outdoor occupation aged < = 18 years (OCC < =18: indoor/indoor and outdoor/outdoor), outdoor occupation after 18 years old (OCC > 18: indoor/indoor and outdoor/outdoor), eye colour (EYECOLOUR: brown/hazel/green/grey, blue), skin colour (SKINCOLOUR: olive/medium/fair), number of moles > =5 mm on the right arm (MOLES_RARM: continuous variable), birthplace (BIRTHPLACE: outside New Zealand/in New Zealand) and personal history of NMSC (NMSC: yes/no) (Table 1). Only 0.6% of data was missing for OCC < =18 and OCC > 18 and none for the other variables. The five variables selected for the final model were AGE, OCC < =18, MOLES_RARM, BIRTHPLACE and NMSC (Table 3). Statistical criteria did not support the inclusion of any interactions.
In men the highest odds of developing melanoma was from a personal history of NMSC (OR = 3.1) whereas AGE > 50 yrs (compared to < =50 years) gave an OR of 2.59 (Table 3).
Bootstrap resampling showed that the model was reproducible. About 96% of fitted models included AGE; 71% of models included BIRTHPLACE; and 72%, 71% and 52% identified MOLES_RARM, NMSC and OCC < =18 as important predictors, respectively. Statistical tests indicated that the model had an adequate fit. There was no evidence of nonlinearity in risk from the number of large moles on the right arm, so this was included as a continuous variable. The model correctly classified 66.7% of participants; the C-statistic was 0.71; the model had good calibration (Figure 1b); and the AR for men was estimated to be 0.85 (95% CI: 0.67 to 0.94).
5-year absolute risk calculations
For each person, their RR was estimated from their profile of risk factors. The appropriate baseline incidence and non-melanoma mortality rates were selected from Table 2 based on their age, sex and region of residence, and these were combined (see equation in Additional file 2: Appendix 2) to calculate personal absolute 5-year risk of melanoma. Examples of absolute risks by age and region of residence are shown in Table 4.
The highest possible combined RR for women was 189.38, corresponding to women who had fair skin, 3 or more moles > =5 mm on their right arm, 1st degree relatives with large or unusual moles and a personal history of NMSC. For the selected ages shown in Table 4, the 5-year absolute risk of developing melanoma for these high-risk women ranged from 0.89% for a 20 year-old living in the Central region of New Zealand, to 14.52% for an 80 year-old living in the Midland region. For the lowest risk women (with none of the melanoma risk factors included in the model), their absolute 5-year risk was very low, even at older ages.
For men aged over 50 years, or for men aged 50 years and under whose occupation was mainly outdoors at age 18 or below, who had 5 large moles on their right arm, who were born in New Zealand and had a personal history of NMSC, the RR of melanoma was 70.31 or 27.19, respectively, compared to men with no risk factors (Table 4). For the selected ages shown, the 5-year absolute risk for these high-risk men ranged from 0.15% for 20 year-olds living in the North, to 12.19% for 80 year-olds living in the Midland region.
For both sexes and all regions of residence, the absolute risk increased with age. The Midland region had the highest absolute risk in most subgroups.
To our knowledge these are the first comprehensive risk assessment models for melanoma developed for a light-skinned population with very high melanoma incidence. The models exhibited good performance characteristics for men and women, suggesting that the models are likely to aid the clinical management of patients concerned about their risk of melanoma. These models included well-recognised risk factors for melanoma (for example, having several large moles) as well as less well-established factors (for example, indoor versus outdoor occupation up to the age of 18 years, in men). The high attributable risk estimates show that the few variables included in the final models captured most of the melanoma risk. The RRs from these models were then included in the calculation of individual 5-year absolute risk of melanoma for New Zealand men and women.
Criteria for defining population groups at high risk of melanoma often rely on lists of risk factors and relative risk estimations frequently seen in aetiological research [18–21]. However, predicting the individual likelihood of an outcome is distinct from explaining disease causality. Prediction models should focus on absolute risk: relative risks are only used as part of the calculation of the absolute probability of the outcome . Moreover, the regression coefficients obtained from a prediction model indicate the mutually adjusted relative contribution of factors to the risk of the outcome . This adjustment is not possible when using only a simple list of risk factors for individual risk assessment.
The design of the case–control study ensured complete reporting of melanomas, and the candidate variables were almost 100% complete. The response rate and cooperation rate in this study were very high for cases (84.5% and 85.5%, respectively) and comparable to other international case–control studies (54.2% and 67.6%, respectively), for controls.
Our results are consistent with what is known about melanoma in New Zealand. However, the prevalence and nature of some risk factors related to sun exposure, for example solaria use, may have changed since 1992–94, so the absolute risks produced from this historical data may not be as applicable now. The risk of melanoma increases with age  as do the absolute risks from our models. The higher than expected risk for 20 year-olds in the Southern regions may be related to the high sun exposure of youth in the central, very sunny parts of the region. The three geographical regions that supplied melanoma cases cover latitudes from about 39°S to 42°S, whereas New Zealand covers latitudes from about 35°S to 46°S, but there is no a priori reason to expect that melanoma risk factors and their magnitude of risk vary by region. The variability of the underlying risk by latitude was incorporated in the baseline incidence estimates.
Some model overfitting is inevitable with moderately sized datasets, but to compensate for this we used AIC as one measure of model fit. AIC penalises large models and hence reduces overfitting . The two models have been well validated internally. Bootstrap resampling using both forward and backward selection showed that the models were reproducible, and calibration was very good. Internal validation, although essential, does not provide information about performance in other populations: although infrequently done, the models should be externally validated before clinical use.
Few population-based absolute risk predictor models for melanoma have been developed worldwide. Fortes et al.  assessed a risk prediction tool in Italian and Brazilian populations, but most other models have not been validated. Fears et al. in 2006  developed an absolute risk predictor for non-Hispanic whites in the US. New Zealand has more than twice the incidence rate of melanoma in the United States and our results show absolute risks several times the comparable risks from the American study . Australia has a melanoma predictor tool available which has been created without the formal development of a multivariable model or identification of the most important predictors so is not comparable to ours .
Melanoma risk in people with multiple risk factors is greater, and sometimes much greater, than in people with no risk factors, and although almost all the risk factors included in the models are unmodifiable, these results, once incorporated into a prediction tool, provide health professionals with a more accurate method of identifying individuals at high risk and thus allow them to offer preventive, surveillance and screening activities appropriately targeted to their absolute risk. These strategies are necessary to help reduce the very high morbidity and mortality from melanoma in New Zealand.
Ministry of Health: Cancer: New Registrations and Deaths, 2009. 2012, Wellington, New Zealand: Ministry of Health
Richardson A, Fletcher L, Sneyd M, Cox B, Reeder AI: The incidence and thickness of cutaneous malignant melanoma in New Zealand 1994–2004. N Z Med J. 2008, 121 (1279): 18-26.
Sneyd M, Cox B: Clinical and histologic factors associated with melanoma thickness in New Zealand Europeans, Maori, and Pacific peoples. Cancer. 2011, 117 (11): 2489-2498. 10.1002/cncr.25795.
Sneyd M, Cox B: The control of melanoma in New Zealand. N Z Med J. 2006, 119 (1242): 1-11.
Williams L, Shors A, Barlow W, Solomon C, White E: Identifying persons at highest risk of melanoma using self-assessed risk factors. Clin Exp Dermatol Res. 2011, 2: 6-
Sneyd MJ: Malignant Melanoma: Early Diagnosis and Screening. PhD Thesis. 1999, Dunedin: University of Otago
Hosmer D, Lemeshow S: Applied Logistic Regression. 1989, New York: J Wiley & Sons
StataCorp: Stata: Stata: Release 11. 2009, College Station, TX: StataCorp LP: Statistical Software
Fears T, Guerry D, Pfeiffer R, Sagebiel R, Elder D, Halpern A, Holly E, Hartge P, Tucker M: Identifying individuals at high risk of melanoma: a practical predictor of absolute risk. J Clin Oncol. 2006, 24 (22): 3590-3596. 10.1200/JCO.2005.04.1277.
Bruzzi P, Green S, Byar D, Brinton L, Schairer C: Estimating the population attributable risk for multiple risk factors using case–control data. Am J Epidemiol. 1985, 122 (5): 904-914.
Gail M, Brinton L, Byar D, Corle D, Green S, Schairer C, Mulvihill J: Projecting individualized probabilities of developing breast cancer for white females who are being examined annually. J Natl Cancer Inst. 1989, 81: 1879-1886. 10.1093/jnci/81.24.1879.
Steyerberg E: Clinical Prediction Models: A practical approach to development, validation and updating. 2009, New York: Springer
Austin P, Tu J: Bootstrap methods for developing predictive models. Am Stat. 2004, 58 (2): 131-137. 10.1198/0003130043277.
Royston P, Moons K, Altman D, Vergouwe Y: Prognosis and prognostic research: developing a prognostic model. BMJ. 2009, 338: 1373-1377. 10.1136/bmj.b1373.
Harrell FE, Lee KL, Mark DB: Multivariable prognostic models: Issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med. 1996, 15 (4): 361-387. 10.1002/(SICI)1097-0258(19960229)15:4<361::AID-SIM168>3.0.CO;2-4.
Ministry of Health: Cancer: new registrations and deaths. http://www.health.govt.nz/nz-health-statistics/health-statistics-and-data-sets/cancer-data-and-stats,
Ministry of Health: Mortality and Demographic Data. http://www.health.govt.nz/nz-health-statistics/health-statistics-and-data-sets/mortality-data-and-stats,
Cho E, Rosner B, Feskanich D, Colditz G: Risk factors and individual probabilities of melanoma for whites. J Clin Oncol. 2005, 23: 2669-2675.
Fortes C, Mastroeni S, Bakos L, Antonelli G, Alessandroni L, Pilla M, Alotto M, Zappalà A, Manoorannparampill T, Bonamigo R, Pasquini P, Melchi F: Identifying individuals at high risk of melanoma: a simple tool. Eur J Cancer Prev. 2010, 19 (5): 393-400. 10.1097/CEJ.0b013e32833b492f.
Harbauer A, Binder M, Pehamberger H, Wolff K, Kittler H: Validity of an unsupervised self-administered questionnaire for self-assessment of melanoma risk. Melanoma Res. 2003, 13 (5): 537-542. 10.1097/00008390-200310000-00013.
MacKie R, Freudenberger T, Aitchison T: Personal risk-factor chart for cutaneous melanoma. Lancet. 1989, 2: 487-490.
Moons K, Royston P, Vergouwe Y, Grobbee D, Altman D: Prognosis and prognostic research: what, why, and how?. BMJ. 2009, 338: 1317-1320. 10.1136/bmj.b1317.
Sneyd M, Cox B: Melanoma in Maori, Asian and Pacific peoples in New Zealand. Cancer Epidemiol Biomarkers Prev. 2009, 18 (6): 1706-1713. 10.1158/1055-9965.EPI-08-0682.
Mar V, Wolfe R, Kelly JW: Predicting melanoma risk for the Australian population. Australas J Dermatol. 2011, 52 (2): 109-116. 10.1111/j.1440-0960.2010.00727.x.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2407/14/359/prepub
CC and the project were funded by the Genesis Oncology Trust. MJS and BC are funded by the Director’s Cancer Research Trust.
The authors have no conflicts of interest to disclose.
MJS carried out the original case–control study and its analysis, conceived and designed the current study, interpreted the results, drafted the manuscript and revised it for intellectual content. CC designed the study, carried out the analysis and revised the paper for intellectual content. BC helped with interpretation of results and revised the paper for intellectual content. All authors read and approved the final manuscript.
Mary Jane Sneyd, Claire Cameron contributed equally to this work.
Electronic supplementary material
Additional file 2: Appendices 1, 2 & 3: Attributable Risk Calculations, 5-year Absolute Risk Calculations, Two examples. (DOCX 162 KB)
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
About this article
Cite this article
Sneyd, M.J., Cameron, C. & Cox, B. Individual risk of cutaneous melanoma in New Zealand: developing a clinical prediction aid. BMC Cancer 14, 359 (2014). https://doi.org/10.1186/1471-2407-14-359
- Absolute risk
- Risk prediction
- Logistic model
- Risk assessment