Skip directly to: content | left navigation | search

PETITIONED PUBLIC HEALTH ASSESSMENT

NEWTOWN COMMUNITY
GAINESVILLE, HALL COUNTY, GEORGIA


APPENDIX I: PUBLIC COMMENTS

The Agency for Toxic Substances and Disease Registry (ATSDR) issued a public health assessment draft for public comment on October 5, 2000 for the Newtown Community in Gainesville, Georgia. Between October 5, 2000 and November 17, 2000 the public had the opportunity to provide comments on the draft public health assessment. During that time, ATSDR has addressed comments and reader evaluations from residents, Georgia Department of Natural Resources, Division of Air Quality, and local officials. These comments/questions are presented below. Comments are printed in italics.

General Responses to Comments

ATSDR received several reader evaluations and two letters presenting formal comments from state officials and residents. An evaluation received from a concerned resident stated that the report was not comprehensive enough, that ATSDR should have performed more testing, and that ATSDR should have suggested more testing that should be conducted. In addition, the resident stated that the summary "gives the false impression that the testing was conclusive, showing no problems."

ATSDR attempted to make the public health assessment as comprehensive as possible. Every study that has been conducted in the community was discussed in detail and analyzed as thoroughly as the data would allow. ATSDR determined whether or not health problems should be expected based on the analysis of these data.

The resident stated that ATSDR should have done more testing. ATSDR does not conduct comprehensive environmental sampling. ATSDR does from time to time collect a limited number of samples for screening purposes only. The health assessor was able to mobilize resources for one of these screening efforts, which is referred to in the document as an "exposure investigation". Comprehensive sampling is generally conducted by regulatory agencies such as those who have previously conducted sampling in Newtown.

Comment: The summary gives the false impression that testing was conclusive, showing no problems...

ATSDR Response: The summary specifically explains the uncertainty and inconclusiveness of the data:

"Some data may not be representative of potential exposures in this community"
"ATSDR was unable to determine the public health implications of particulate emissions because no data were available..."
"ATSDR was unable to assess health implications of past exposure because no historical environmental sampling data exists"
"no surface soil outside the playground has been investigated in the community"


Comments from Ga DNR, Division of Air Quality

Comment: Page 14, second paragraph and page H-2 should read "NorthEAST Georgia Medical Center" instead of NorthWEST....

ATSDR Response: Thank you, ATSDR made these corrections.

Comment: Page H-17 has an incomplete sentence about the risk of tobacco on liver cancer.."

ATSDR Response: Thank you, ATSDR corrected this section.

Comment: Because the data collected thus far do not suggest any reason to believe that residential soil would be unduly contaminated, Georgia EPD will have difficulty allocating our limited resources for sampling analysis of residential soils in the community.

ATSDR Response: ATSDR recommended surface soils be analyzed in the community outside the playground because there is no characterization of residential soils for soils 0-3" in residential yards. However, ATSDR understands the need for justification to spend resources on additional sampling. ATSDR cannot recommend further sampling to EPA or Georgia EPD in the absence of any indication of elevated contamination in soils. The Public Health Action Plan (p. 20) delineates these recommendations to specific agencies. Please note the third bullet under "future activities", which states that residents are "pursuing grants to conduct surface soil (0-3") sampling in accordance with an ATSDR recommendation".


Comments from the Newtown Florist Club

Before these comments are addressed, please note that ATSDR site managers are "health assessors" and not "risk assessors". Health assessors examine public health concerns of a community and whether or not it has been impacted by industrial and environmental contamination. Risk assessors calculate the theoretical risk of disease based on risk assessment criteria and default exposure scenarios. The instances where residents mention "risk assessor" should be changed in these comments to [health assessor].

Regarding particulate dusts

Comment: There is no indication of analysis having been performed by the agency or any other entity to determine the composition of the dusts. No particulate data was available for analysis at the time of the report. No attempt was made to identify the potential for contamination from this potential airborne source of contamination.

ATSDR Response: The metal concentrations in air collected by Ga DNR, Division of Air Quality were the result of analyzing total suspended particulate (TSP) data. The composition of the dusts are what are reported as metals concentrations in Ga DNR air data.

Page 20 of the public health assessment ("Public Health Action Plan"), second bullet under Future Activities, states "....included in that report will be a particulate matter analysis from data provided by the Georgia Air Quality Branch". This refers to a future health consultation regarding air that will address historical air modeling and will also address particulate concentrations in air reported by Georgia DNR. This report includes an in-depth analysis of the sources of all emissions within 4 miles of the Newtown area. The specific contaminants were modeled to evaluate estimated exposure to these airborne contaminants. ATSDR expects to release this document in Spring 2001.

Comment: The fallacy of the argument that there is no known public health hazard is clearly based on the rationales given by EPA for regulating TSP and PM2.5. There is in fact significant probable health hazard due to exposures from Total Respirable Dusts in the community.

ATSDR Response: ATSDR did not have data at the time this report was written to comment on TSP concentrations. However, ATSDR has obtained data from Ga DNR since the release of this report and will comment on them in the ambient air public health consultation, which ATSDR expects to release in Spring 2000. Ambient air data that were reviewed do not pose a public health risk to residents at the time data were collected.

Comment: While it may be justifiable to assume the deposited particulates were not toxic, the fact that the particulates were heavy enough to be deposited by Brownian motion indicated that there possibly existed some particulates that were respirable.

ATSDR did not make any assumptions about the toxicity of particulate or respirable dusts. ATSDR analyzed the concentrations of contaminants in air that were reported, researched the scientific literature and health-based exposure guidelines, and determined whether or not negative health outcomes could be expected based on data available to ATSDR at the time this report was written.

Comment:
The Newtown Florist Club made the following recommendation: Review of the Title V air permits and TRI reports for current and previous years of the neighboring plants would be an important source of information regarding discharged pollutants. There was no mention of this as a source of air toxic exposure data. Thus the hazard identification for particulate fraction of the air quality is inadequate. Without an adequate hazard identification process reviewing all available facility information, exposure assessment is not possible and the following comment made on page 1 is invalid "Current ambient air contamination in the community is not a public health hazard".

ATSDR Response: As stated on pages 1, 19, and 20, air modeling has been conducted to reconstruct past emission concentration scenarios given specific meteorological conditions of the area. This modeling used TRI data that exists in catalogued databases. In this case TRI data for all facilities within a 4 mile radius has been pulled from a number of sources. Reviewing the Title V permits of facilities located in close proximity to the community may explain the types of emissions a plant can release, to which media, and in what manner, but it would not help to determine whether or not contamination exists in the community, which is the focus of this document. ATSDR is not an enforcement agency and does not regulate facilities under Title V. The particulate fraction of the air quality will be addressed in the same document as the air modeling, estimated to be released in Spring 2001.

ATSDR concludes that "based on all available data current ambient air contamination in the community is not a public health hazard.....". There are no data which have been presented to ATSDR which suggest that the lives of residents are in danger because of the levels of contamination detected in ambient air. No levels that have been reported represent concentrations that would be expected to result in negative health effects for residents.

Regarding section "Extent of Contamination-Air"

Comment: The state of Georgia has not justified why the monitors were located at this site, which is neither in the neighborhood, nor does it have any apparent meteorological relationship to prevailing wind patterns.

ATSDR Response:
Georgia DNR, Air Quality Branch, has responded to this issue with the following comments:

"Several points must be considered before establishing an ambient air monitoring site, including wind direction, purpose(s) of the study including scale of representativeness, and physical siting criteria and limitations. A meteorological station was established at the school prior to beginning air sampling. Wind roses produced from this data indicated that the wind direction was from the industrialized area south of Newtown only 18% of the time and that the majority of the time, the wind direction was from some other direction other than the nearby industrialized area. The direction of the winds indicate that the majority of the time the source of air pollutants in the Newtown area are due to sources other than [these] facilities.

The Fair Street school site meets the siting criteria of representativeness for a middle scale study. Middle scale represents air quality areas on the order of about 100 meters to 0.5 kilometers and characterizes areas of several city blocks in size. The school also meets all of the physical siting criteria of unobstructed air flow, probe height, and availability. Several sites were investigated as possible sites, including the playground. These sites did not meet physical siting criteria."

Ga DNR collected meteorological data for nine months prior to installing the air monitor. If the air blows form the southern industry 18% of the time, then Newtown residents are exposed to the emissions from those facilities 18% of the time, and the monitor is fairly accurately representing ambient air conditions in the community. ATSDR is currently evaluating the appropriateness of the ambient air monitoring location.

Comment:
Residents offered the following recommendation: Relocate the air monitoring device to a location that has meteorological significance with respect to wind patterns in the community, and also add the capability of monitoring TSP/PM2.5. Evaluate this data weekly for VOCs, SOX, NOX, CO and particulate materials.

ATSDR Response: Ga DNR has a report that justifies the choice of location and a significant amount of meteorological data in their sampling protocol. This report is available from Ga DNR or ATSDR if residents are interested in reviewing it. Ga DNR began sampling for PM2.5 at the Fair Street School location on February 14, 1999. This data was supplied to ATSDR for our review and use and will be discussed in the air health consultation to be released in spring of this year. In order to justify sampling for SOX, NOX, and CO, there would have to be a potential identifiable source for these emissions in this community. These contaminants are generally related to combustion processes, such as power plants and boilers. However, these contaminants are ubiquitous in the environment, and can be released from cars and trucks, as well as gas stoves, fireplaces, and other sources inside the home. Because there are so many potential sources for the elevation of these contaminants in ambient air, it would be extremely difficult to identify any one source as a major contributor.

The Ga DNR collects data twice a month for the Fair Street monitor. Unless data existed which indicated that VOCs were present in significantly elevated concentrations, the likelihood that DNR would allocate limited time and resources to additional monitoring is small.

Regarding Chromium

The reviewer noted information regarding chromium on page 7, however it appears that these data were not addressed in the Exposure Investigation, but rather in the Health Outcome Data section, which begins on page 13. We assume the reviewer is commenting on the hair analysis on page 15.

Comment: Since the type of chromium found in biological monitoring and environmental sampling has not been completely characterized, this metal may pose a health hazard if exposure is due to the more toxic form. The [risk] assessor assumes that the less toxic form of chromium is the type of exposure that is assumed by the assessor.

ATSDR Response: Levels of chromium found in hair cannot be proven to be caused by environmental contamination. There is no environmental evidence which suggests that the levels of chromium found in air and soil are elevated above normal levels. Therefore, it is not possible to link the elevated chromium in hair to exposure to chromium in air or soil. Chromium is a necessary element and can be found in vitamins and dietary supplements. It is also found naturally in food, water, and air.

The chromium type was not identified in reported environmental data (unspeciated), and therefore ATSDR assumed that the chromium detected in air, water, and soil was hexavalent chromium, the most toxic form. We feel this was the most protective basis on which to compare concentrations of chromium in environmental media.

Comment:
The community made the following recommendation: If there is no basis, then a risk assessment of chromium should be included or a criteria for exclusion should be given. This is a risk assessment and even if an environmental toxin is present in the environment and is found in biological monitoring, there is an assumption that there may be an association. Thus, it may be an exposure and possible route unless the assessor can justify why it is not. We need to see a justification or some type of risk assessment of the chemical, chromium.

ATSDR Response: ATSDR's justification of why no cancer risk assessment, from herein called a cancer risk evaluation, for chromium was done is the following: chromium was not found to be present at elevated levels in a single environmental media (in air, water, or soil). ATSDR will not assume there is an association between a contaminant found in hair and the environment if there is no environmental evidence to support such an association. If there are no data which suggest that chromium is present at harmful levels, conducting a cancer risk evaluation would not be appropriate. ATSDR determines the toxicological implications of exposure if there is a potential that exposure has occurred and could result in adverse health effects. Contaminants of concern (COCs) are those for which there are no health based guidelines (or comparison value) or one which exceeds established health based guidelines. Chromium falls into neither of these categories.

Risk assessments are conducted by regulatory agencies as a risk management tool. ATSDR conducts health assessments and health consultations, which attempt to evaluate the public health implications of chemical contamination and exposure.

Regarding the Exposure investigation and benzene

Comment: The [risk] assessor does not indicate the accuracy, specificity, nor sensitivity of the testing method, nor the EPA/NIOSH method number...without this kind of information [method number] this data is not real science and cannot be used to assess the health of a community".

ATSDR Response: Any government agency collecting or analyzing data is required by law to follow the appropriate applicable guidelines set forth by EPA. Data requirements for ATSDR health assessments are specified at http://www.atsdr.cdc.gov/ednpha.html in the "Environmental Data Needed for Public Health Assessments Guidance Manual". The specific method used to analyze benzene and other organics is printed on the data results which were provided to residents shortly after ATSDR received lab results from the SUMMA canister analysis. The cover page of those results have a section that reads "analysis method(s): TO-15". Specific information on this method can be found at http://www.epa.gov/ttn/amtic/airtox.html. Exiting ATSDR Website This is a gas chromatograph/mass spectometry analysis of toxic organics ("TO") EPA method 15.

The reference of this document is as follows:
EPA 625/R-96-010b
Compendium of Methods for the Determination of Toxic Organic Compounds in Ambient Air, Second Edition. January 1997. Compendium Methods TO-14A, 15,16,17. (NCEPI or AMTIC)

Comment: ....to ensure the accuracy of the reported data regarding benzene, more than four samples would have had to be taken."

ATSDR Response: Georgia DNR has been sampling the Newtown area with the Fair Street monitor for four years. ATSDR took a limited number of air canister samples to determine whether or not they would be different than those collected by the air monitor, which they were not, with the exception of one sample (.5 miles outside the community). During the year of 1997, a total of 22 samples were collected by Ga DNR and an additional 10 were collected by ATSDR. In total, there were 32 samples taken that would detect the presence of benzene, and only one was detected at a level that was markedly elevated. Even at that level, ATSDR determined that the concentration detected would not result in an increased risk of cancer. If requested, ATSDR is willing to continue to analyze additional years of data as they become available to monitor trends in emissions concentrations. However, at this time, no additional data are available.

Regarding Soils

Page 9, subsurface soils

Comment: It was indicated that only subsurface soil samples were taken, but earlier in the document it was indicated that surface soil samples were taken from the playground, (page 1-Soils section). The report is contradictory as to whether or not subsurface samples were taken in the community.

ATSDR Response: The summary states that residential subsurface soils do not pose a public health threat. It goes on to state that the surface soils collected in the playground do not pose a public health threat, but that no additional surface soils have been collected outside the playground. There appears to be some confusion over this issue, but the purpose of the summary is to give a concise summary of the content of the report. ATSDR examined both surface and subsurface soil data, which are presented in detail in the report. Surface soils as defined by ATSDR are soils collected between 0-3 inches, and anything deeper is considered subsurface soil.

On page 8, there is a section about the soil borings collected by Ga DNR and University of Georgia. Subsurface soil borings were collected in twelve inch composite samples between 0 and 23 feet in these studies. The discussion of surface soils begins on page 9, under the heading "ATSDR Exposure Investigation". To alleviate some confusion, ATSDR will add the subheading "Surface Soil" to the heading "ATSDR Exposure Investigation". ATSDR was the only agency to collect and analyze surface soils and these samples were only taken in the playground. Five samples were taken in the playground, and although ATSDR does not recommend further sampling in the playground, there is a lack of surface soil data (0-3") in residential yards. This is the data gap that ATSDR refers to when it recommends additional surface soil collection and analysis in residential yards (p.1, p.19, p.20).

Comment: In addition, most [risk] assessors are aware that all humans ingest some amount of soil; more importantly, until 7 years ago, Newtown residents were eating food grown in their home gardens. As a result, soil characterization is very important to model possible exposures due to soils ingestion, food chain contamination, and most importantly to obtain an exposure assessment from surface soil. We also agree with the conclusion that subsurface soil contamination does not pose a current health hazard to residents...

ATSDR Response: ATSDR is aware that soils are inhaled and ingested by adults, and to a greater extent, children. ATSDR compares levels found in soils with health based guidelines for soil ingestion and inhalation. Unfortunately, there are no biota data to analyze in order to determine whether or not vegetables grown by residents were in fact contaminated. Unless residents are excavating soils for construction or some other purpose, it is unlikely that they would be exposed to subsurface soil contamination. However, even if they were exposed to the levels detected underground in this area, adverse health effects are not likely. ATSDR has stated that additional surface soil data are needed to fully characterized soil contamination and potential exposure (p.1).

Comment: If surface soil samples were taken, why were neither the number of samples, nor analysis information presented in the report? Were the samples representative? Did it indicate statistical significance for any contaminant?

ATSDR Response: On page 6, where the exposure investigation was first mentioned, surface soil sampling is explained briefly:

In January, 2000 ATSDR conducted an exposure investigation, composed of five composite surface soil samples in the community playground and ten air canister samples. Soils were tested for metals, and air was tested for VOCs....Exposure investigations are not in depth collections of environmental data, and do not provide complete characterization of sampled media because of the small number of samples collected.

ATSDR agrees that mentioning the soil samples here is confusing and inappropriate and will add the specific soil sample information to the aforementioned section that was titled "ATSDR Exposure Investigation" on page 9. The data for the surface soil analysis is in fact present in the document in Appendix E, page 7. The discussion on page 9 under "ATSDR Exposure Investigation" analyzes these results. Because of the small number of samples taken, the calculation of statistical significance is not an appropriate method for analyzing surface soil data.

Residents recommended a section on exposure to contaminants through the food chain. At the levels detected when soil samples were taken, samples evaluated by ATSDR would not be of concern through the uptake of garden vegetables. However, no specific garden soil sampling data are available to evaluate the likelihood that residents were exposed to contaminated soils through the vegetables they ate.

Regarding health outcome data

Page 12

Comment: In addition to the studies listed here in this section, other pertinent data (with respect to the lupus study by Emory University) that could be used to analyze the existing health data with respect to environmental exposures include:

Kilburn, K.H., Warsha, R.H., Prevalence of symptoms of systemic lupus erythematosus (SLE) and of fluorescent antinuclear antibodies associated with chronic exposureto trichloroethylene and other chemicals in well water. USC School of Medicine.

Conrad, K. et al. Systemic Lupus Erythematosus after heavy exposure to quartz dust in uranium mines: clinical and serological characteristics, Lupus 5(1): 62-9, 1996, Feb.

ATSDR Response: While these studies may help to substantiate a growing body of evidence of associations between environmental exposures and lupus, they are not pertinent to this community. Residents are not exposed to contaminated well water, nor are they exposed to high levels of quartz dust in uranium mines. ATSDR acknowledges that although no specific associations have been strongly substantiated, it is possible with the chemical triggers of lupus in medications, that there may also be environmental triggers through toxins. ATSDR found numerous studies investigating exposure to silica dust and lupus, however could not find any additional studies documenting the association between other contaminants and lupus. Many studies are necessary to make scientific findings credible. There are a large number of studies available on the subject of exposure to silica dusts and scleroderma and lupus incidence, but inconclusive findings regarding the association between other contaminants and lupus. Silica exposure is highly unlikely in this community, unless residents are occupationally exposed. ATSDR is not aware of any facilities in the Newtown area which uses or handles silica or silica dusts.

Comment: The [risk] assessor added sections in the appendices relevant to cancer prevalence. It would make this information clearer if the [risk] assessor would list cancers found in the Newtown community (prevalence ratios) and compare this to prevalence ratios for another population or with national figures in summary tables side by side...to be relevant to this population, the information presented should be ...for African-Americans...

ATSDR Response: We agree that this data would be useful to residents to illustrate our conclusions about cancer incidence in the Newtown community. Below is the information residents and reviewers have requested:

Residents in this area are concerned that emissions from neighboring facilities may be causing excess cancer in their community. In response to these concerns, ATSDR investigated cancer statistics for the Newtown community to determine whether or not cancer rates in the community are statistically different compared to United States rates for African Americans. No formal report of this comparison was used to interpret the comparison, and ATSDR analyzed raw data generated by the Northeast Georgia Medical Center.

Almost all diseases or health outcomes occur at different rates in different age groups. Most chronic diseases, including most cancers, occur more often among older people while other outcomes, such as many types of injuries, occur more often among younger people. Therefore, the most common health problems in a community will be influenced by the age distribution within the community. This community has a very large elderly population (22% are 65 or older), and so we expect to see a higher number of cancers diagnosed than in a younger population.

One means of comparing the pattern of health outcomes in communities of different sizes is to calculate an incidence or mortality rate, which is the number of new cases or deaths divided by the size of the population. In chronic diseases and injuries, rates are usually expressed in terms of the number of new cases or deaths per 100,000 people per year. Adjusting rates for age allows for direct comparison between populations with potentially different age distributions. The cancer rates discussed below are age adjusted cancer rates.

In this analysis, cancer incidence rates of residents living in the Newtown community were compared to cancer rates of the US population. Newtown cancer incidence rates were derived from the Northeast Georgia Medical Center and population estimates from the 1990 census.

US cancer incidence rates were extrapolated from the Surveillance, Epidemiology, and End Results program (SEER) of the National Cancer Institute. The SEER database tracks cancers in five states (Connecticut, Hawaii, Iowa, New Mexico, Utah) and six metropolitan areas (Atlanta, Detroit, Los Angeles, Seattle/Puget Sound, San Francisco/Oakland, San Jose/ Monterey). With respect to selected demographic and epidemiologic factors, these areas are reasonably representative subsets of the United States population. The disease rates and patterns documented in the SEER database are accepted as fairly accurate representations of the disease incidence rates and patterns of the United States as a whole. Therefore, the 'normal rates' of disease are often based on cancer rates in the SEER areas.

The cancer incidence and mortality data suggest that age-adjusted cancer rates for all cancers are actually lower in Newtown than in the United States (400.23/100,000 vs. 482.25/100,000). Newtown rates of cancer of the bladder, cervix, esophagus, kidney, liver, and for leukemia slightly exceeded those of the US population. However, the differences between the rates were not found to be statistically significant. Please see the "technical notes" section following the cancer incidence tables for the methods ATSDR used to make this determination.

Presented on the next two pages are the age-adjusted incidence of cases per year for the Newtown Community when compared to the age-adjusted incidence of SEER sites representing the U.S. population. ATSDR used the incidence for African-Americans in the SEER database based on the racial makeup of the Newtown community. The cancers listed were those diagnosed during a seventeen year study period in the Newtown community.

Table 1. Rates of Cancer in the Newtown community and United States SEER sites 1980-1996

Newtown cancer rates compared to national SEER rates for African-Americans

Cancer type

Actual number of Cancers

Newtown
age-adjusted cancer rate

U.S. Standard (SEER)
age-adjusted cancer rate

All Cancers 36 400.23/100,000 482.25/100,000
Bladder 3 Male 21.6/100,000*
Female 10.82/100,000*
Male 15.83/100,000
Female 5.75/100,000
Breast 4 43.29/100,000 92.9/100,000
Cervical 4 <50 years old 43.29/100,000*
50+ N/A
<50 years old 7.45/100,000
50+ years old 36.55/100,000
Colorectal 5 Male 21.65/100,000
Female 32.47/100,000
Male 59.5/100,000
Female 46.39/100,000
Esophageal 2 Male 10.82/100,000
Female 10.82/100,000*
Males 17.15/100,000
Females 4.7/100,000
Kidney 1 Male 10.82/100,000* Male 4.67/100,000
Leukemia 3 Male10.82/100,000
Female 21.64/100,000*
Male 11.9/100,000
Female 7.38/100,000
Liver 1 Female 10.82/100,000* Female 2.29/100,000
Lung 1 (in Newtown) Male 10.82/100,000 Male 124.1/100,000
Oral/pharyngeal 3 Male 21.6/100,000
Female 10.8/100,000*
Male 23.7/100,000
Female 7/100,000
Pancreatic 2 Male 10.82/100,000
Female 10.82/100,000
Male 16.4/100,000
Female 12.3/100,000
Prostate 6 146.5/100,000 1395.59/100,000
Testicular 1 <50 years old 10.82/100,000 < 50 years old .95/100,000
Uterine 1 50+ years old 10.8/100,000 50+ years old 58.02/100,000
* these rates exceeded SEER rates and therefore were chosen to be tested for statistical significance


Table 2. Statistical test of significance for differences in Newtown rates and SEER rates
95 % Confidence intervals for differences in cancer incidence rates between 1980 and 1996
Cancer type Standard incidence Ratio (SIR) Confidence interval Statistically significant?
Bladder Male 1.36
Female 1.88
Male .034-7.57
Female .0475-10.47
No
No
Cervical 5.81 .1469-32.36 No
Esophageal Female 2.3 .058-12.8 No
Kidney Male 2.32 .059-12.9 No
Leukemia Female 2.9 .073-16.2 No
Liver Female 4.7 .12-26.18 No
Oral/pharyngeal Female 1.54 .039-8.58 No
Testicular 11.39 .29-63.44 No

Technical Notes: Methods for Analyzing and Interpreting Cancer Incidence Data

In order to be able to analyze and interpret cancer incidence data, it is necessary to convert the number of cases we observe to ratios. Using ratios allows us to compare the number of cases in the population living in Newtown and the area of interest with a reference population to determine if there is an excess of a particular disease of health condition. When interpreting cancer data, an observed occurrence is compared to an "expected" occurrence using ratios. The expected occurrence is based on the occurrence observed in a reference population, in this case the SEER population for African Americans. For cancer, the ratio of observed to expected number of cases (incidence) was examined, and the information was further standardized to eliminate possible effects due to age. These ratios are referred to as the standard incidence ratio (SIR).

Specifically, the SIR is the observed number of cases divided by the expected number of cases. A ratio of 1.0 means that the number of cases observed in the population being evaluated is equal to the number of cases expected based on the rate of disease in the reference population. A ratio greater than 1.0 indicates that more cases occurred than expected; and a ratio of less than 1.0 indicates that fewer cases occurred than expected. Accordingly, a ratio of 1.5 is interpreted as 1.5 times as many cases as the expected number, and a ratio of 0.9 indicates 0.1 fewer cases than would be expected.

Caution should be exercised, however, when interpreting these ratios. The interpretation of a ratio depends on both the size of the ratio and the number of cases used to calculate the ratio. For example, a ratio of 1.5 based on two expected cases and three observed cases indicates a 1.5 times excess in cancer, but the excess is actually only one case. Conversely, a ratio based of 1.5 on 200 expected cases and 300 observed cases represents the same 1.5 times excess in cancer , but because the ratio is based on a greater number of cases, the estimate is more stable. It is very unlikely that 100 excess cases of cancer would occur by chance alone.

Experience has shown us that we can expect a certain amount of chance variation when looking at the occurrence of different health conditions. Statisticians have developed methods to take this into account. One method is to calculate a confidence interval for the SIR. A 95% confidence interval (CI) is calculated to determine if the observed number of cases is significantly different than the expected number, or if the differences may be due solely to chance. A 95% CI is the range of estimated values that has a 95% probability of including the true ratio for the population. The confidence interval is a statistical measure of the precision of the risk estimate. If the confidence interval contains 1.0, no statistically significant excess of disease is indicated.

Definitions:

Standardized (Adjusted) Rates: help control for demographic differences between populations being compared. Adjusted incidence rates estimate what the incidence rates for populations would be if their composition were similar ro that of a comparison, or standard, population (and, therefore, to each other). Adjustments can be made for various characteristics that influence incidence rates, including their age, race or ethnicity, and gender.

Although a crude rate (non-adjusted rate) is a valuable summary measure, comparison of crude rates between populations can be problematic if demographic characteristics (such as age distribution) that affect health outcomes differ between the populations. The overall crude incidence rate for a population depends on not only the incidence rate for each age group, but also the proportion of people in each age group.

Age-adjustment helps control for differences in the age structure of the population. Age-adjusted incidence rates for two populations are calculated by multiplying the age-specific incidence rates for each age group by the proportion of people in the same age group in the standard population. The sum of these products is the age-adjusted, or age-standardized, incidence rate for each of the populations.

Statistically significant: there is less than a certain percent change (usually selected at 5%) that the observed difference is merely the result of random fluctuation in the number of observed cancer cases. For example, if the confidence interval does not include 1.0 and the interval is below 1.0, the number of cases is significantly lower than expected. Similarly, if a confidence interval does not include 1.0 and the interval is above 1.0, then there is a significant excess in the number of cases. If the confidence interval includes 1.0, than the true ratio may be 1.0, and it cannot be concluded with sufficient confidence that the observed number of cases reflects a real excess or deficit. As long as the 95% confidence interval contains 1.0, that indicates that the ratio is still within the range one might expect based on the disease experience of the comparison population.

In addition to the number of cases, the width of the confidence interval also reflects the stability of the ratio estimates. For example, a narrow confidence interval (e.g. 1.03-1.15) allows a fair level of certainty that the calculated ratio is close to the true ratio for the population. A wide interval (e.g. 0.85-4.50) leaves considerable doubt to the true ratio, which could be much lower than or much higher than the calculated ratio.

No Newtown cancer rates were found to be significantly higher than those of the reference population (SEER). The cancer rates that had an SIR of 1.0 or greater were tested for significance (table 2). The confidence intervals for these cancers were very wide, and all included 1.0. As the explanation above states, if a confidence interval includes 1.0, it is not considered statistically significant. A wide confidence interval usually means that the sample size is too small, there weren't enough cases for comparison, or the population was too small to calculate significant statistics.

Table of Contents




Agency for Toxic Substances and Disease Registry, 1825 Century Blvd, Atlanta, GA 30345
Contact CDC: 800-232-4636 / TTY: 888-232-6348
 
USA.gov: The U.S. Government's Official Web Portal