Recommendations following a multi-laboratory comparison of microbial source tracking methods

Microbial source tracking (MST) methods were evaluated in the Source Identification Protocol Project (SIPP), in which 27 laboratories compared methods to identify host sources of fecal pollution from blinded water samples containing either one or two different fecal types collected from California. This paper details lessons learned from the SIPP study and makes recommendations to further advance the field of MST. Overall, results from the SIPP study demonstrated that methods are available that can correctly identify whether particular host sources including humans, cows and birds have contributed to contamination in a body of water. However, differences between laboratory protocols and data processing affected results and complicated interpretation of MST method performance in some cases. This was an issue particularly for samples that tested positive (non-zero Ct values) but below the limits of quantification or detection of a PCR assay. Although false positives were observed, such samples in the SIPP study often contained the fecal pollution source that was being targeted, i.e., the samples were true positives. Given these results, and the fact that MST often requires detection of targets present in low concentrations, we propose that such samples be reported and identified in a unique category to facilitate data analysis and method comparisons. Important data can be lost when such samples are simply reported as positive or negative. Actionable thresholds were not derived in the SIPP study due to limitations that included geographic scope, age of samples, and difficulties interpreting low concentrations of target in environmental samples. Nevertheless, the results of the study support the use of MST for water management, especially to prioritize impaired waters in need of remediation. Future integration of MST data into quantitative microbial risk assessments and other models could allow managers to more efficiently protect public health based on site conditions.

Performance of forty-one microbial source tracking methods: a twenty-seven lab evaluation study

The last decade has seen development of numerous new microbial source tracking (MST) methodologies, but many of these have been tested in just a few laboratories with a limited number of fecal samples. This method evaluation study examined the specificity and sensitivity of 41 MST methodologies by analyzing data generated in 27 laboratories. MST methodologies that targeted human, cow, ruminant, dog, gull, pig, horse, and sheep were tested against sewage, septage, human, cow, dog, deer, pig, chicken, pigeon, gull, horse, and goose fecal samples. Each laboratory received 64 blind samples containing a single source (singletons) or two sources (doubletons), as well as diluted singleton samples to assess method sensitivity. Laboratories utilized their own protocols when performing the methods and data were deposited in a central database before samples were unblinded. Between one and seven laboratories tested each method. The most sensitive and specific assays, based on an analysis of presence/absence of each marker in target and non-target fecal samples, were HF183 endpoint and HF183SYBR (human), CF193 and Rum2Bac (ruminant), CowM2 and CowM3 (cow), BacCan (dog), Gull2SYBR and LeeSeaGull (gull), PF163 and pigmtDNA (pig), HoF597 (horse), PhyloChip (pig, horse, chicken, deer), Universal 16S TRFLP (deer), and Bacteroidales 16S TRFLP (pig, horse, chicken, deer); all had sensitivity and specificity higher than 80% in all or the majority of laboratories. When the abundance of MST markers in target and non-target fecal samples was examined, some assays that performed well in the binary analysis were found to not be sensitive enough as median concentrations fell below a minimum abundance criterion (set at 50 copies per colony forming units of enterococci) in target fecal samples. Similarly, some assays that cross-reacted with non-target fecal sources in the binary analysis were found to perform well in a quantitative analysis because the cross-reaction occurred at very low levels. Based on a quantitative analysis, the best performing methods were HF183Taqman and BacH (human), Rum2Bac and BacR (ruminant), LeeSeaGull (gull), and Pig2Bac (pig); no cow or dog-specific assay met the quantitative specificity and sensitivity criteria. Some of the best performing assays in the study were run by just one laboratory so further testing of assay portability is needed. While this study evaluated the marker performance in defined samples, further field testing as well as development of frameworks for fecal source allocation and risk assessment are needed.

Performance of forty-one microbial source tracking methods: a twenty-seven lab evaluation study

The last decade has seen development of numerous new microbial source tracking (MST) methodologies, but many of these have been tested in just a few laboratories with a limited number of fecal samples. This method evaluation study examined the specificity and sensitivity of 41 MST methodologies by analyzing data generated in 27 laboratories. MST methodologies that targeted human, cow, ruminant, dog, gull, pig, horse, and sheep were tested against sewage, septage, human, cow, dog, deer, pig, chicken, pigeon, gull, horse, and goose fecal samples. Each laboratory received 64 blind samples containing a single source (singletons) or two sources (doubletons), as well as diluted singleton samples to assess method sensitivity. Laboratories utilized their own protocols when performing the methods and data were deposited in a central database before samples were unblinded. Between one and seven laboratories tested each method. The most sensitive and specific assays, based on an analysis of presence/absence of each marker in target and non-target fecal samples, were HF183 endpoint and HF183SYBR (human), CF193 and Rum2Bac (ruminant), CowM2 and CowM3 (cow), BacCan (dog), Gull2SYBR and LeeSeaGull (gull), PF163 and pigmtDNA (pig), HoF597 (horse), PhyloChip (pig, horse, chicken, deer), Universal 16S TRFLP (deer), and Bacteroidales 16S TRFLP (pig, horse, chicken, deer); all had sensitivity and specificity higher than 80% in all or the majority of laboratories. When the abundance of MST markers in target and non-target fecal samples was examined, some assays that performed well in the binary analysis were found to not be sensitive enough as median concentrations fell below a minimum abundance criterion (set at 50 copies per colony forming units of enterococci) in target fecal samples. Similarly, some assays that cross-reacted with non-target fecal sources in the binary analysis were found to perform well in a quantitative analysis because the cross-reaction occurred at very low levels. Based on a quantitative analysis, the best performing methods were HF183Taqman and BacH (human), Rum2Bac and BacR (ruminant), LeeSeaGull (gull), and Pig2Bac (pig); no cow or dog-specific assay met the quantitative specificity and sensitivity criteria. Some of the best performing assays in the study were run by just one laboratory so further testing of assay portability is needed. While this study evaluated the marker performance in defined samples, further field testing as well as development of frameworks for fecal source allocation and risk assessment are needed.

Genomics in marine monitoring: new opportunities for assessing marine health status

This viewpoint paper explores the potential of genomics technology to provide accurate, rapid, and cost efficient observations of the marine environment. The use of such approaches in next generation marine monitoring programs will help achieve the goals of marine legislation implemented world-wide. Genomic methods can yield faster results from monitoring, easier and more reliable taxonomic identification, as well as quicker and better assessment of the environmental status of marine waters. A summary of genomic methods that are ready or show high potential for integration into existing monitoring programs is provided (e.g. qPCR, SNP based methods, DNA barcoding, microarrays, metagenetics, metagenomics, transcriptomics). These approaches are mapped to existing indicators and descriptors and a series of case studies is presented to assess the cost and added value of these molecular techniques in comparison with traditional monitoring systems. Finally, guidelines and recommendations are suggested for how such methods can enter marine monitoring programs in a standardized manner.

Benthic macrofaunal assemblages of the San Francisco Estuary and Delta, USA

The spatial and temporal distribution of macrobenthic assemblages in the San Francisco Estuary and Sacramento-San Joaquin River Delta were identified using hierarchical cluster analysis of 501 samples collected between 1994 and 2008. Five benthic assemblages were identified that were distributed primarily along the salinity gradient: (1) a polyhaline assemblage that inhabits the Central Bay, (2) a mesohaline assemblage that inhabits South Bay and San Pablo Bay, (3) a low-diversity oligohaline assemblage primarily in Suisun Bay, (4) a low-diversity sand assemblage that occurs at various locations throughout the Estuary, and (5) a tidal freshwater assemblage in the Delta. Most sites were classified within the same assemblage in different seasons and years, but a few sites switched assemblage designations in response to seasonal changes in salinity from freshwater inflows.

Effect of platform, reference material, and quantification model on enumeration of Enterococcus by quantitative PCR methods

Quantitative polymerase chain reaction (qPCR) is increasingly being used for the quantitative detection of fecal indicator bacteria in beach water. QPCR allows for same-day health warnings, and its application is being considered as an option for recreational water quality testing in the United States (USEPA, 2011. EPA-OW-2011-0466, FRL-9609-3, Notice of Availability of Draft Recreational Water Quality Criteria and Request for Scientific Views). However, transition of qPCR from a research tool to routine water quality testing requires information on how various method variations affect target enumeration. Here we compared qPCR performance and enumeration of enterococci in spiked and environmental water samples using three qPCR platforms (Applied Biosystem StepOnePlus™, the BioRad iQ™5 and the Cepheid SmartCycler(®) II), two reference materials (lyophilized cells and frozen cells on filters) and two comparative CT quantification models (ΔCT and ΔΔCT). Reference materials exerted the biggest influence, consistently affecting results by approximately 0.5 log(10) unit. Platform had the smallest effect, generally exerting <0.1 log(10) unit difference in final results. Quantification model led to small differences (0.04-0.2 log(10) unit) in this study with relatively uninhibited samples, but has the potential to cause as much as 8-fold (0.9 log(10) unit) difference in potentially inhibitory samples. Our findings indicate the need for a certified and centralized source of reference materials and additional studies to assess applicability of the quantification models in analyses of PCR inhibitory samples.

Framework for interpreting sediment quality triad data

Integration of multiple lines of evidence (MLOE) data in a sediment quality triad assessment can be accomplished by means of numerous approaches, with most relying on some form of expert best professional judgment. Best professional judgment (BPJ) can be problematic in application to large data sets or in a regulatory setting where the assessment protocol needs to be transparent and consistently reproducible. We present a quantitative, objective framework for integrating the results of triad-based assessments and test its efficacy by applying it to 25 California sites and comparing the resulting classifications with those of 6 experts who were provided the same data. The framework is based on integrating the answers to 2 questions: 1) is there biological degradation, and 2) is chemical exposure high enough to potentially result in a biological response? The framework produced results that matched the median classifications of the experts better than did 5 of the 6 experts. Moreover, the framework was unbiased, with samples that differed from the median expert response evenly divided between those classified as more or less impacted. The framework was also evaluated by application to a set of sites from known degraded and reference areas, which the framework distinguished well. Although any framework needs to be flexible to supplemental data when they are available, the framework presented provides an objective means for using a triad-based approach in large-scale assessments for which relying on expert input for every sample is impractical.

Habitat-related benthic macrofaunal assemblages of bays and estuaries of the western United States

Data from 7 coastwide and regional benthic surveys were combined and used to assess the number and distribution of estuarine benthic macrofaunal assemblages of the western United States. Q-mode cluster analysis was applied to 714 samples and site groupings were tested for differences in 4 habitat factors (latitude, salinity, sediment grain size, and depth). Eight macrofaunal assemblages, structured primarily by latitude, salinity, and sediment grain size, were identified: (A) Puget Sound fine sediment, (B) Puget Sound coarse sediment, (C) southern California marine bays, (D) polyhaline central San Francisco Bay, (E) shallow estuaries and wetlands, (F) saline very coarse sediment, (G) mesohaline San Francisco Bay, and (H) limnetic and oligohaline. The Puget Sound, southern California, and San Francisco Bay assemblages were geographically distinct, while Assemblages E, F and H were distributed widely along the entire coast. A second Q-mode cluster analysis was conducted after adding replicate samples that were available from some of the sites and temporal replicates that were available for sites that were sampled in successive years. Variabilities due to small spatial scale habitat heterogeneity and temporal change were both low in Puget Sound, but temporal variability was high in the San Francisco estuary where large fluctuations in freshwater inputs and salinity among years leads to spatial relocation of the assemblages.

Effect of sample area and sieve size on benthic macrofaunal community condition assessments in California enclosed bays and estuaries

Benthic macrofauna are used extensively for environmental assessment, but the area sampled and sieve sizes used to capture animals often differ among studies. Here, we sampled 80 sites using 3 different sized sampling areas (0.1, 0.05, 0.0071 m(2)) and sieved those sediments through each of 2 screen sizes (0.5, 1 mm) to evaluate their effect on number of individuals, number of species, dominance, nonmetric multidimensional scaling (MDS) ordination, and benthic community condition indices that are used to assess sediment quality in California. Sample area had little effect on abundance but substantially affected numbers of species, which are not easily scaled to a standard area. Sieve size had a substantial effect on both measures, with the 1-mm screen capturing only 74% of the species and 68% of the individuals collected in the 0.5-mm screen. These differences, though, had little effect on the ability to differentiate samples along gradients in ordination space. Benthic indices generally ranked sample condition in the same order regardless of gear, although the absolute scoring of condition was affected by gear type. The largest differences in condition assessment were observed for the 0.0071-m(2) gear. Benthic indices based on numbers of species were more affected than those based on relative abundance, primarily because we were unable to scale species number to a common area as we did for abundance.

Performance of two Southern California benthic community condition indices using species abundance and presence-only data: relevance to DNA barcoding

DNA barcoding, as it is currently employed, enhances use of marine benthic macrofauna as environmental condition indicators by improving the speed and accuracy of the underlying taxonomic identifications. The next generation of barcoding applications, processing bulk environmental samples, will likely only provide presence information. However, macrofauna indices presently used to interpret these data are based on species abundances. To assess the importance of this difference, we evaluated the performance of the Southern California Benthic Response Index (BRI) and the AZTI Marine Biotic Index (AMBI) when species abundance data were removed from their calculation. Presence only versions of these two indices were created by eliminating abundance weighting while preserving species identity. Associations between the presence and abundance BRI, and the presence and abundance AMBI were highly significant, with correlation coefficients of 0.99 and 0.81, respectively. The presence versions validated almost equally to the abundance-based indices when applied to the spatial and the temporal monitoring data used to validate the original indices. Simulations in which taxa were systematically removed from calculation of the indices were also conducted to assess how large the barcode library must be for the indices to be effective. Correlation between the BRI-P and BRI remained above 0.9 with only 370 species in the library and reducing the number of species to 450 had almost no effect on correlation between the presence and abundance versions of the AMBI.

Effectiveness of qPCR permutations, internal controls and dilution as means for minimizing the impact of inhibition while measuring Enterococcus in environmental waters

AIMS

  Draft criteria for the optional use of qPCR for recreational water quality monitoring have been published in the United States. One concern is that inhibition of the qPCR assay can lead to false-negative results and potentially inadequate public health protection. We evaluate the effectiveness of strategies for minimizing the impact of inhibition.

METHODS AND RESULTS

  Five qPCR method permutations for measuring Enterococcus were challenged with 133 potentially inhibitory fresh and marine water samples. Serial dilutions were conducted to assess Enterococcus target assay inhibition, to which inhibition identified using four internal controls (IC) was compared. The frequency and magnitude of inhibition varied considerably among qPCR methods, with the permutation using an environmental master mix performing substantially better. Fivefold dilution was also effective at reducing inhibition in most samples (>78%). ICs were variable and somewhat ineffective, with 54-85% agreement between ICs and serial dilution.

CONCLUSIONS

  The current IC methods appear to not accurately predict Enterococcus inhibition and should be used with caution; fivefold dilution and the use of reagents designed for environmental sample analysis (i.e. more robust qPCR chemistry) may be preferable.

SIGNIFICANCE AND IMPACT OF THE STUDY

  Suitable approaches for defining, detecting and reducing inhibition will improve implementation of qPCR for water monitoring.

Using rapid indicators for Enterococcus to assess the risk of illness after exposure to urban runoff contaminated marine water

BACKGROUND

Traditional fecal indicator bacteria (FIB) measurement is too slow (>18 h) for timely swimmer warnings.

OBJECTIVES

Assess relationship of rapid indicator methods (qPCR) to illness at a marine beach impacted by urban runoff.

METHODS

We measured baseline and two-week health in 9525 individuals visiting Doheny Beach 2007-08. Illness rates were compared (swimmers vs. non-swimmers). FIB measured by traditional (Enterococcus spp. by EPA Method 1600 or Enterolert™, fecal coliforms, total coliforms) and three rapid qPCR assays for Enterococcus spp. (Taqman, Scorpion-1, Scorpion-2) were compared to health. Primary bacterial source was a creek flowing untreated into ocean; the creek did not reach the ocean when a sand berm formed. This provided a natural experiment for examining FIB-health relationships under varying conditions.

RESULTS

We observed significant increases in diarrhea (OR 1.90, 95% CI 1.29-2.80 for swallowing water) and other outcomes in swimmers compared to non-swimmers. Exposure (body immersion, head immersion, swallowed water) was associated with increasing risk of gastrointestinal illness (GI). Daily GI incidence patterns were different: swimmers (2-day peak) and non-swimmers (no peak). With berm-open, we observed associations between GI and traditional and rapid methods for Enterococcus; fewer associations occurred when berm status was not considered.

CONCLUSIONS

We found increased risk of GI at this urban runoff beach. When FIB source flowed freely (berm-open), several traditional and rapid indicators were related to illness. When FIB source was weak (berm-closed) fewer illness associations were seen. These different relationships under different conditions at a single beach demonstrate the difficulties using these indicators to predict health risk.

Comparing volunteer and professionally collected monitoring data from the rocky subtidal reefs of Southern California, USA

Volunteer-based citizen monitoring has increasingly become part of the natural resources monitoring framework, but it is often unclear whether the data quality from these programs is sufficient for integration with traditional efforts conducted by professional scientists. At present, the biological and physical characteristics of California's rocky reef kelp forests are concurrently monitored by two such groups, using similar methodologies--underwater visual census (UVC) of fish, benthic invertebrates, and reef habitat, though the volunteer group limits their sampling to transects close to the reef surface and they use a more constrained list of species for enumeration and measurement. Here, we compared the data collected from 13 reefs that were sampled by both programs in 2008. These groups described relatively similar fish communities, total fish abundance and abundance of the dominant fish species but there were some differences in the measured size distributions of the dominant fish species. Descriptions of the benthic invertebrate community were also similar, though there were some differences in relative abundance that may have resulted from the less detailed subsampling protocols used by the volunteers. The biggest difference was in characterization of the physical habitat of the reefs, which appeared to result from selection bias of transect path by the volunteer program towards more complex structured sections of a reef. Changes to address these differences are relatively simple to implement and if so, offer the promise of better integration of the trained volunteer monitoring with that of professional monitoring groups.

Assessing coastal benthic macrofauna community condition using best professional judgement--developing consensus across North America and Europe

Benthic indices are typically developed independently by habitat, making their incorporation into large geographic scale assessments potentially problematic because of scaling inequities. A potential solution is to establish common scaling using expert best professional judgment (BPJ). To test if experts from different geographies agree on condition assessment, sixteen experts from four regions in USA and Europe were provided species-abundance data for twelve sites per region. They ranked samples from best to worst condition and classified samples into four condition (quality) categories. Site rankings were highly correlated among experts, regardless of whether they were assessing samples from their home region. There was also good agreement on condition category, though agreement was better for samples at extremes of the disturbance gradient. The absence of regional bias suggests that expert judgment is a viable means for establishing a uniform scale to calibrate indices consistently across geographic regions.

Evaluation of rapid methods and novel indicators for assessing microbiological beach water quality

A broad suite of new measurement methods and indicators based on molecular measurement technology have been developed to assess beach water quality, but they have generally been subjected to limited testing outside of the laboratory in which they were developed. Here we evaluated 29 assays targeting a variety of bacterial, viral, and chemical analytes by providing the method developers with twelve blind samples consisting of samples spiked with known concentration of sewage or gull guano and negative controls. Each method was evaluated with respect to its ability to detect the target organism, absence of signal in the negative controls and repeatability among replicates. Only six of the 30 methods detected their targets in at least 75% of the samples while consistently determining the absence of the target in the negative controls. Among quantitative methods, QPCR for Bacteroides thetaiotamicron and Enterococcus detected by Luminex reliably identified all but one sample containing human fecal material and produced no false positive results. Among non-quantitative methods, the Enterococcus esp gene, the Bacteroidales human specific marker and culture-based coliphage were the most reliable for identifying human fecal material. We also found that investigator-specific variations of methods targeting the same organism often produced different results.

Faecal indicator bacteria enumeration in beach sand: a comparison study of extraction methods in medium to coarse sands

AIMS

The absence of standardized methods for quantifying faecal indicator bacteria (FIB) in sand hinders comparison of results across studies. The purpose of the study was to compare methods for extraction of faecal bacteria from sands and recommend a standardized extraction technique.

METHODS AND RESULTS

Twenty-two methods of extracting enterococci and Escherichia coli from sand were evaluated, including multiple permutations of hand shaking, mechanical shaking, blending, sonication, number of rinses, settling time, eluant-to-sand ratio, eluant composition, prefiltration and type of decantation. Tests were performed on sands from California, Florida and Lake Michigan. Most extraction parameters did not significantly affect bacterial enumeration. anova revealed significant effects of eluant composition and blending; with both sodium metaphosphate buffer and blending producing reduced counts.

CONCLUSIONS

The simplest extraction method that produced the highest FIB recoveries consisted of 2 min of hand shaking in phosphate-buffered saline or deionized water, a 30-s settling time, one-rinse step and a 10 : 1 eluant volume to sand weight ratio. This result was consistent across the sand compositions tested in this study but could vary for other sand types.

SIGNIFICANCE AND IMPACT OF THE STUDY

Method standardization will improve the understanding of how sands affect surface water quality.

Evaluation of optical brightener photodecay characteristics for detection of human fecal contamination

Detection of optical brighteners by fluorometry combined with ultraviolet light (UV) exposure has been proposed as an inexpensive method for detection of human fecal contamination, but has received limited testing. This study evaluated the approach in southern California by applying it to a variety of detergents, sewage and septage samples from the region, as well as to natural stream water as a negative control. The concept of using UV exposure to differentiate fluorescence from natural organic matter proved valid, as the method produced no false positives. However, the method failed to detect half of the detergents tested in natural stream water at 5 microL/L, due to its conservative thresholds. This study identified a method modification that provides greater sensitivity by taking advantage of differences in the shape of photodecay curves between optical brighteners and natural organic matter. This method modification resulted in detection of all detergents, sewage at 1:10 dilution and septage at 1:100 dilution. Several caveats for its use remain, including our observation that the optical brightener signal degraded rapidly in strong sunlight. Additionally, there was low sensitivity for some environmentally friendly detergents, which does not present a problem on a community basis where a mix of detergents are used, but could be of concern for assessing septic inputs from individual homes. Still, the method is simple to employ in the field, yields rapid results and is useful as a low-cost initial screening tool.

A sea change ahead for recreational water quality criteria

The United States Environmental Protection Agency is committed to developing new recreational water quality criteria for coastal waters by 2012 to provide increased protection to swimmers. We review the uncertainties and shortcomings of the current recreational water quality criteria, describe critical research needs for the development of new criteria, as well as recommend a path forward for new criteria development. We believe that among the most needed research needs are the completion of epidemiology studies in tropical waters and in waters adversely impacted by urban runoff and animal feces, as well as studies aimed to validate the use of models for indicator and pathogen concentration and health risk predictions.

Calibration and evaluation of five indicators of benthic community condition in two California bay and estuary habitats

Many types of indices have been developed to assess benthic invertebrate community condition, but there have been few studies evaluating the relative performance of different index approaches. Here we calibrate and compare the performance of five indices: the Benthic Response Index (BRI), Benthic Quality Index (BQI), Relative Benthic Index (RBI), River Invertebrate Prediction and Classification System (RIVPACS), and the Index of Biotic Integrity (IBI). We also examine whether index performance improves when the different indices, which rely on measurement of different properties, are used in combination. The five indices were calibrated for two geographies using 238 samples from southern California marine bays and 125 samples from polyhaline San Francisco Bay. Index performance was evaluated by comparing index assessments of 35 sites to the best professional judgment of nine benthic experts. None of the individual indices performed as well as the average expert in ranking sample condition or evaluating whether benthic assemblages exhibited evidence of disturbance. However, several index combinations outperformed the average expert. When results from both habitats were combined, two four-index combinations and a three-index combination performed best. However, performance differences among several combinations were small enough that factors such as logistics can also become a consideration in index selection.

Assessing ecological integrity in marine waters, using multiple indices and ecosystem components: challenges for the future

During the last decade, there have been substantial scientific advances in the development of indices that measure the condition of biological ecosystem elements in coastal and estuarine waters. Though successful, these advances were only the initial steps and a special session on use of indices in ecological integrity assessments was held at the Coastal and Estuarine Research Federation meeting to focus the field on the most appropriate directions for the next decade. The session identified four primary scientific challenges: (i) reduce the array of indices by identifying the index approaches that are most widely successful; (ii) establish minimum criteria for index validation; (iii) intercalibrate methods to achieve uniform assessment scales across geographies and habitats; and (iv) integrate indices across ecosystem elements. Where an explosion of indices characterized the last decade, the next decade needs to be characterized by consolidation. With increased knowledge and understanding about the strengths and weaknesses of competing index approaches, the field needs to unify approaches that provide managers with the simple answers they need to use ecological condition information effectively and efficiently.

Evaluating consistency of best professional judgment in the application of a multiple lines of evidence sediment quality triad

The bioavailability of sediment-associated contaminants is poorly understood. Often, a triad of chemical concentration measurements, laboratory sediment toxicity tests, and benthic infaunal community condition is used to assess whether contaminants are present at levels of ecological concern. Integration of these 3 lines of evidence is typically based on best professional judgment by experts; however, the level of consistency among expert approach and interpretation has not been determined. In this study, we compared the assessments of 6 experts who were independently provided data from 25 California embayment sites and asked to rank the relative condition of each site from best to worst. The experts were also asked to place each site into 1 of 6 predetermined categories of absolute condition. We provided no guidance regarding assessment approach or interpretation of supplied data. The relative ranking of the sites was highly correlated among the experts, with an average correlation coefficient of 0.92. Although the experts' relative rankings were highly correlated, the categorical assessments were much less consistent, with only 1 site out of 25 assigned to the same absolute condition category by all 6 experts. Most of the observed categorical differences were small in magnitude and involved the weighing of different lines of evidence in individual assessment approaches, rather than interpretation of signals within a line of evidence. We attribute categorical differences to the experts' use of individual best professional judgment and consider these differences to be indicative of potential uncertainty in the evaluation of sediment quality. The results of our study suggest that specifying key aspects of the assessment approach a priori and aligning the approach to the study objectives can reduce this uncertainty.

Water quality indicators and the risk of illness at beaches with nonpoint sources of fecal contamination

BACKGROUND

Indicator bacteria are a good predictor of illness at marine beaches that have point sources of pollution with human fecal content. Few studies have addressed the utility of indicator bacteria where nonpoint sources are the dominant fecal input. Extrapolating current water-quality thresholds to such locations is uncertain.

METHODS

In a cohort of 8797 beachgoers at Mission Bay, California, we measured baseline health at the time of exposure and 2 weeks later. Water samples were analyzed for bacterial indicators (enterococcus, fecal coliforms, total coliforms) using both traditional and nontraditional methods, ie, chromogenic substrate or quantitative polymerase chain reaction. A novel bacterial indicator (Bacteroides) and viruses (coliphage, adenovirus, norovirus) also were measured. Associations of 14 health outcomes with both water exposure and water quality indicators were assessed.

RESULTS

Diarrhea and skin rash incidence were the only symptoms that were increased in swimmers compared with nonswimmers. The incidence of illness was not associated with any of the indicators that traditionally are used to monitor beaches. Among nontraditional water quality indicators, associations with illness were observed only for male-specific coliphage, although a low number of participants were exposed to water at times when coliphage was detected.

CONCLUSIONS

Traditional fecal indicators currently used to monitor these beaches were not associated with health risks. These results suggest a need for alternative indicators of water quality where nonpoint sources are dominant fecal contributors.

Bacteriological water quality along the Tijuana-Ensenada, Baja California, México shoreline

This survey was part of a Binational Program (Mexico-United States) in microbiological water quality, with a goal to assess the shoreline bacteriological water quality from Tijuana to Ensenada, Mexico. Samples were collected at 29 sites (19 beaches and 10 outfalls), from the United States border to Punta Banda, Baja California, during summer (1998) and winter (1999). Total coliforms, fecal coliforms and enterococci were used as bacterial indicators. Standard methods were used for total and fecal coliforms, while the Enterolert quick method (IDEXX) was used for the enterococci. Compared with outfalls, the beaches exceeded water quality standards by a small percent, 25.3% in summer and 17% in winter. For outfalls, the percentage of shoreline that exceeded bacterial indicator thresholds had a minor value in summer (32.7%) than in winter (50%). Sites near wastewater discharges had the lowest quality and did not meet the microbiological water quality criteria for recreational use.

Comparison and verification of bacterial water quality indicator measurement methods using ambient coastal water samples

More than 30 laboratories routinely monitor water along southern California's beaches for bacterial indicators of fecal contamination. Data from these efforts frequently are combined and compared even though three different methods (membrane filtration (MF), multiple tube fermentation (MTF), and chromogenic substrate (CS) methods) are used. To assess data comparability and quantify variability within method and across laboratories, 26 laboratories participated in an intercalibration exercise. Each laboratory processed three replicates from eight ambient water samples employing the method or methods they routinely use for water quality monitoring. Verification analyses also were conducted on a subset of wells from the CS analysis to confirm or exclude the presence of the target organism. Enterococci results were generally comparable across methods. Confirmation revealed a 9% false positive rate and a 4% false negative rate in the CS method for enterococci, though these errors were small in the context of within- and among-laboratory variability. Fecal coliforms also were comparable across all methods, though CS underestimated the other methods by about 10%, probably because it measures only E. coli, rather than the larger fecal coliform group measured by MF and MTF. CS overestimated total coliforms relative to the other methods by several fold and was found to have a 40% false positive rate in verification. Across-laboratory variability was small relative to within- and among-method variability, but only after data entry errors were corrected. One fifth of the laboratories committed data entry errors that were much larger than any method-related errors. These errors are particularly significant because these data were submitted in a test situation where laboratories were aware they would be under increased scrutiny. Under normal circumstances, it is unlikely that these errors would have been detected and managers would have been obliged to issue beach water quality warnings.

A review of technologies for rapid detection of bacteria in recreational waters

Monitoring of recreational beaches for fecal indicator bacteria is currently performed using culture-based technology that can require more than a day for laboratory analysis, during which time swimmers are at risk. Here we review new methods that have the potential to reduce the measurement period to less than an hour. These methods generally involve two steps. The first is target capture, in which the microbial group of interest (or some molecular/chemical/or biochemical signature of the group) is removed, tagged or amplified to differentiate it from the remaining material in the sample. We discuss three classes of capture methods: 1) Surface and whole-cell recognition methods, including immunoassay techniques and molecule-specific probes; 2) Nucleic acid methods, including polymerase chain reaction (PCR), quantitative PCR (Q-PCR), nucleic acid sequence based amplification (NASBA) and microarrays; and 3) Enzyme/substrate methods utilizing chromogenic or fluorogenic substrates. The second step is detection, in which optical, electrochemical or piezoelectric technologies are used to quantify the captured, tagged or amplified material. The biggest technological hurdle for all of these methods is sensitivity, as EPA's recommended bathing water standard is less than one cell per ml and most detection technologies measure sample volumes less than 1 ml. This challenge is being overcome through addition of preconcentration or enrichment steps, which have the potential to boost sensitivity without the need to develop new detector technology. The second hurdle is demonstrating a relationship to health risk, since most new methods are based on measuring cell structure without assessing viability and may not relate to current water quality standards that were developed in epidemiology studies using culture-based methods. Enzyme/substrate methods may be the first rapid methods adopted because they are based on the same capture technology as currently-approved EPA methods and their relationship to health risk can be established by demonstrating equivalency to existing procedures. Demonstration of equivalency may also be possible for some surface and whole-cell recognition methods that capture bacteria in a potentially viable state. Nucleic acid technologies are the most versatile, but measure nonviable structure and will require inclusion in epidemiological studies to link their measurement with health risk.