Municipal bylaw to reduce cosmetic/non-essential pesticide use on household lawns - a policy implementation evaluation
© Cole et al; licensee BioMed Central Ltd. 2011
Received: 5 November 2010
Accepted: 25 August 2011
Published: 25 August 2011
Pesticide use on urban lawns and gardens contributes to environmental contamination and human exposure. Municipal policies to restrict use and educate households on viable alternatives deserve study. We describe the development and implementation of a cosmetic/non-essential pesticide bylaw by a municipal health department in Toronto, Ontario, Canada and assess changes in resident practices associated with bylaw implementation.
Implementation indicators built on a logic model and were elaborated through key informant interviews. Bylaw impacts on awareness and practice changes were documented through telephone surveys administered seasonally pre, during and post implementation (2003-2008). Multivariable logistic regression models assessed associations of demographic variables and gardening season with respondent awareness and practices.
Implementation indicators documented multiple municipal health department activities and public involvement in complaints from commencement of the educational phase. During the enforcement phases only 40 warning letters and 7 convictions were needed. The number of lawn care companies increased. Among survey respondents, awareness of the bylaw and the Natural Lawn campaign reached 69% and 76% respectively by 2008. Substantial decreases in the proportion of households applying pesticides (25 to 11%) or hiring lawn care companies for application (15 to 5%) occurred. Parallel absolute increases in use of natural lawn care methods occurred among households themselves (21%) and companies they contracted (7%).
Bylaws or ordinances implemented through education and enforcement are a viable policy option for reducing urban cosmetic pesticide use.
Growing concern has been expressed by environmental scientists, health researchers, clinicians, and the public about the widespread use of pesticides for lawn and garden applications regarded as "non-essential" i.e. not related to the growing of food, or "cosmetic" i.e. for aesthetic appearances only. These uses contribute to broad exposure to these chemicals as documented by environmental scientists in pesticide run-off in surface waters [1, 2] and contamination of groundwater intended for drinking . Human exposure studies have found pesticides among other household exposures  and documented pesticide residues associated with pesticide use in homes  and on lawns . Potential effects of widespread exposures to pregnant women or children in urban settings are a particular concern .
Health researchers have made links between household pesticide use and children's illnesses , including cancer [8, 9] and developmental impacts  from perinatal exposure. Although epidemiological studies are often limited in their ability to interpret cause or ascribe increased risks to specific pesticides, the evidence has been judged to be sufficient to prompt applications of precaution in legislation and regulation to address children's particular vulnerability to pesticides at both national [11, 12] and state  levels.
Cosmetic pesticide use behaviour is governed by a complex mixture of social and environmental factors, and may be difficult to influence at an individual level . Intensive consumer marketing of the ideal of "the perfect lawn" and of the pesticides needed to achieve it have fostered deeply-entrenched behaviours, neighborhood norms and even municipal ordinances requiring certain standards of lawn and garden care . US surveys have found between one half and three quarters of households use pesticides and/or fertilizers outdoors [16, 17] to create and maintain these outdoor spaces according to expectations, while in Canadian surveys prior to bylaw (ordinance) activity, approximately one third to one half of homeowners maintaining lawns and gardens reported using pesticides . Similarly, many lawn care and landscaping companies retained in urban and suburban areas apply pesticides routinely as part of their service packages offered to clients to maintain weed- and insect-free lawns.
In light of the complex array of determinants of householder use of pesticides on lawns, jurisdictional efforts have often begun with programs to reduce the non-essential use of pesticides on public lands (i.e. areas under the direct control of government). For example, between 1995 and 2002 Danish municipalities, with support from the national government, achieved a remarkable reduction of 78% in the tonnes of active ingredients applied in public areas . In a 2001 survey of 448 Ontario municipalities, more than one third did not use pesticides and nearly all had taken steps to substantially reduce or minimize pesticide use on public lands in the previous decade . Approaches taken by nine jurisdictions in the USA, Canada and Europe to reduce residential pesticide use either by households or hired lawn care companies were reviewed by the Canadian Centre for Pollution Prevention in 2004 . Reductions in pesticide use were estimated based on a combination of qualitative and quantitative data, and ranged from marginal (< 10%) to high (> 50%). However, the authors cautioned that "none of the communities had as strong and reliable data as [they] would have liked".
Municipal initiatives to reduce both public and private pesticide use through programs and policies are population-level health interventions that attempt to reduce health risks by changing the social, economic and/or environmental contexts contributing to those risks . Evaluation of municipal initiatives to reduce pesticide use is part of the growing field of population health intervention research in which the ways they bring about change, the value of the interventions, and their effectiveness are all examined.
This paper describes a case where a systematic policy exploration, subsequent bylaw enactment, public education process and enforcement were led by the public health department of a metropolitan North American municipality. In terms of stance, several co-authors have been active participant-observers throughout the process as staff of the health department (more "insiders") while others connected with the university have been involved primarily in evaluation (more "outsiders"). We aimed to document indicators of the policy implementation, which combined both environmental health protection and health promotion components. Our specific research question was "To what extent did resident attitudes and practices change during pesticide bylaw implementation, controlling for demographic and location characteristics?"
Policy & Program Development
Toronto is Canada's largest city and the province of Ontario's capital city. It has a population of approximately 2.5 million people, of which 25% is less than 20 years old, and 20% older than 60 . About half of Toronto's population was born outside of Canada. Just under 50% report a mother tongue other than English or French (the official languages). Income is distributed unevenly, and disparities between rich and poor are growing.
Administratively, the current City of Toronto was created in 1998 by the amalgamation of six former municipalities: the mostly "urban" former city of Toronto; three more "suburban" municipalities (Etobicoke, Scarborough, and North York), and two municipalities with a mix of urban and suburban areas (East York and York) . The only remaining agriculturally zoned areas are in Etobicoke, North York and Scarborough, although small scale growing of fruits and vegetables in home gardens and community garden plots does occur over the summer months in all former municipalities. Visible private and public space is dominated by pavement and grass/lawn coverage on which, historically, the majority of pesticides have been applied.
Public health matters are handled by Toronto Public Health (TPH) under the direction of the Toronto Board of Health (BOH). The BOH is made up of elected officials, citizen and school board representatives, with the Medical Officer of Health (MOH) as the Executive Officer. It sets public health policy and advises City Council, Toronto's main governing and legislative body.
In Toronto, reductions in pesticide use on public spaces began in the 1980s. Spurred on by concerns of both parents' associations and TPH staff, the Toronto Boards of Education discontinued pesticide spraying on school properties. With the support of environmental organizations (led by the Toronto Environmental Alliance), municipal unions, and staff from multiple City divisions, Toronto City Council adopted the MOH's recommendation in 1998 to restrict pesticide use on all City property. A 97% reduction of herbicide use on general parklands, sports fields and road sides was achieved by 2001 .
In 2001, the Supreme Court of Canada upheld the right of a municipality, Hudson Quebec, to restrict pesticide use , observing that a 'general enabling clause' in the relevant provincial legislation gave municipalities in Quebec the ability to make bylaws related to health and general welfare. The Ontario Municipal Act, 2001 granted municipalities general powers to pass bylaws regulating health and safety concerns when the provincial government does not have legislation governing the activity . Following the Supreme Court of Canada decision, the federal Pest Management Regulatory Agency has also acknowledged the role of municipalities in regulating pesticide use by citizens.
In this permissive federal and provincial context, active municipal councilors championed consideration of a bylaw, the Canadian equivalent to an ordinance. Pressure also came from environmental and health groups, e.g. Toronto Environmental Alliance, the Ontario College of Family Physicians and the Canadian Environmental Law Association. The BOH asked TPH to prepare a document that would generate public discussion on the development and feasibility of various strategies to reduce pesticide use in Toronto and inform policy development.
TPH staff reviewed and synthesized the evidence on potential adverse health effects of lawn and garden pesticides . Based on their findings, the resultant report argued for precautionary actions and for limiting unnecessary uses of commonly used pesticides. In addition, TPH incorporated information from a 2000 telephone survey regarding Toronto residents' awareness about, uses of and attitudes towards lawn pesticides  and a 2002 public opinion poll that gauged support for different options to reduce pesticide use . Whether they used pesticides or not, over three quarters of respondents to the poll supported restrictions on pesticides and welcomed information that would help them use safer alternatives.
Generation of policy options
TPH incorporated information from an environmental scan of initiatives in other jurisdictions into a policy document  with four options: A) public education only, as carried out in Seattle, King County ; B) voluntary compliance approach, as in most recycling programs; C) bylaw (all properties), such as Oregon state's Pesticide Tracking Law, also called a "right-to-know" Law  and D) bylaw (vulnerable populations only) as in Washington State's children's law around notification of pesticide spraying in schools  or New York's Neighbor Notification Law .
TPH retained external consultants to undertake a stakeholder consultation on these options in early 2002. They conducted a workshop which brought together 65 stakeholders from pesticide manufacturing companies, lawn care companies, golf course associations, community garden groups, regional conservation authorities, environmental non-governmental organizations, health care provider organizations, school boards, ratepayer groups and governments (provincial Ministry of the Environment, Environment Canada). Workshop results informed six evening public meetings held across the city in the spring of 2002. Approximately 400 people signed in at the meetings and engaged in lively, small group discussions moderated by professional facilitators. A follow-up stakeholder meeting examined the key challenges/barriers the City would face with either a voluntary industry-led initiative or some type of bylaw. Upon consideration of the consultation report, the BOH recommended that Toronto adopt a pesticide bylaw to best protect public health .
Policy enactment & Program design
In May 2003, Toronto City Council passed a bylaw that "restricts the outdoor use of pesticides on all public and private properties in Toronto." It applied to anyone who might use pesticides outdoors, including homeowners, renters, lawn care companies, golf courses and cemeteries . Pesticides composed of specific low-risk active ingredients such as soaps or oils, biologicals (such as nematodes) or acetic acid, among others, were exempted from the bylaw and had no municipal restrictions on their use (though federal authorities do place some use restrictions). In addition, certain uses of restricted pesticides were permitted under the bylaw: control of pests which infested property or uses related to health protection. Note, the pesticide bylaw did not govern the selling or buying of pesticides, as this falls under provincial jurisdiction. Crop Life Canada, a plant science industry trade association, challenged the City of Toronto's bylaw in court but their case was rejected by successive provincial and federal courts [38, 39]
Public Education and Outreach Campaign.
Means by which particular audiences were reached with appropriate information:
in spring and fall - when people are thinking most about their lawns and gardens - served to remind residents of the bylaw, to balance marketing of traditional pesticides, and to support community acceptance of natural lawn care. In collaboration with Toronto Water and Parks, Forestry and Recreation, 300-500 advertisements were created and placed in major newspapers, community and ethno-cultural newspapers, City guides and newsletters, family and lifestyle magazines, transit shelters and on recycling bins .
City of Toronto website
had the text of the bylaw, answered frequently-asked questions, included guidance for professional users, provided complaint forms, and made links to relevant information from other City divisions and community organizations. Given the ethnic diversity of Toronto, some material appeared in the City's most commonly spoken non-English languages (French, Spanish, Italian, Portuguese, Russian, Tamil, Chinese and Farsi).
Toronto Health Connection
staff responded to public telephone inquiries, processed complaints, sent educational material and provided basic advice on natural lawn care.
Brochures, fact sheets and lawn signs
were designed to appeal to residents at all stages of awareness and activity. They contained general information, lawn care and gardening tips, information on how to prevent and deal with specific pest problems; bylaw information; questions to ask a lawn-care company, and information about the lower risk pest control products with no restrictions on use.
Information in stores
as both restricted and exempted pesticides remained available for purchase and residents mistakenly assumed that products for sale were "approved" by the City. In consultation with retailers, a "Go Natural" in-store education program was launched in 2005. Go Natural brochures, tear-off sheets, staff aprons, posters and banners were voluntarily posted on store shelves or at cash registers and directed consumers to lower-risk products for certain lawn or garden problems.
with professional stakeholders, including landscapers, lawn care companies, arborists and other horticultural professionals to support compliance and their transition to sustainable pesticide reductions.
included 16 environmental and cultural organizations funded to deliver innovative outreach such as workshops, garden tours and radio shows in eight languages. Toronto Public Health also collaborated with academic and community partners to identify communication barriers and explore opportunities to improve multicultural outreach .
by City staff included expert advice through health promotion consultants, Public Health Inspectors, Parks, Forestry and Recreation staff and the Toronto Environmental Volunteers.
included both small community gatherings and large events such as Toronto's Community Environment Days, the Canadian National Exhibition, Canada Blooms, and the Toronto Renovation Forum.
Initial implementation costs projected for the 2004 season  were approximately CDN$220K covering seasonal staff time for both bylaw and education work, another CDN$150K for advertising and another CDN$70K for workshops, expert consultation and other expenses (total CDN$450K or approximately US$425K).
Implementation Indicator Selection
We also supported a structured literature review to learn from other experiences in documenting household pesticide use practices and evaluating initiatives to reduce such use . Building on this, we interviewed 14 key informants from a wide range of sectors as to potential indicators for evaluating bylaw implementation. The following five potential indicator domains emerged from the literature review and key informants: 1) Enforcement/Legal; 2) Education and Outreach activities, and associated community responses; 3) Economic; 4) Environmental testing; and 5) Medical/Public Health, including urine bio-monitoring and clinical visits.
Data on Enforcement/legal (1) and Education/outreach implementation indicators (2) were most readily available as TPH staff implemented the program. TPH tracks bylaw complaints and the details of complaint investigations through its Toronto Healthy Environments Information System (THEIS) database. TPH also tracked activities relevant to its education and outreach activities (as outlined in Table 1).
The potential economic impacts of a bylaw were an important concern expressed by key informants from landscaping and lawn care companies. Since actual sales data on pesticides or services were not available, we used data on companies in business available from Statistics Canada [(Business Register, Canadian Business Patterns (1998-2005) & (2001-2006)]. These provided a rough indicator of potential economic impacts before and during bylaw implementation (3).
Environment Canada, Ontario Ministry of Environment and Toronto Works and Emergency Services colleagues had done some short-term surface water testing from 1998 to 2000, particularly during high run-off events (4) . Unfortunately, the costs of systematic, regular, long-term surface water monitoring were un-supported at the time the bylaw was implemented. Further, we were unable to implement indicators for domain 5 for several reasons. For bio-monitoring, we were concerned that intra- and inter-individual variation could potentially swamp an exposure reduction effect, the substantial costs involved (minimally an estimated $125K annually over at least five years) were beyond municipal resources, and ethical concerns had been raised during the evaluation of environmental health interventions [44, 45]. We explored clinical data systems but those available were incomplete, focused on hospital visits only, and did not adequately identify pesticide exposure in routinely coded data, unlike pesticide exposure incident reporting systems specifically designed for such purposes which have proved very useful in evaluating reductions in other jurisdictions .
To track community responses via resident awareness and behaviour over time (domain 2), we turned to the Rapid Risk Factor Surveillance System (RRFSS), a set of ongoing monthly surveys designed to monitor community trends in health risk behaviours among the Ontario population. RRFSS surveys are administered independently by the Institute for Social Research, York University, and consist of questions organized into core and optional modules . TPH led development of optional "pesticides and lawns", "pesticide bylaw" and "pesticide reduction education" modules that were conducted on a monthly basis from 2003 to 2008. The repeated surveys were an appropriate evaluation tool given the phased in approach of pesticide bylaw implementation (See Figure 1). This design approximates the one-group pretest-posttest design most frequently used to evaluate the impact of health programs, though with more 'during' measures, given the phased implementation . Household selection was via random digit dialing procedures. A phone number was called repeatedly until either the survey was completed or the maximum number of 14 calls had been made, at which time the number was considered a 'dead' sample. Within households, the adult with the most recent birthday was selected with no substitutions of more willing household members. Attempts were made to encourage those individuals who initially refused to participate by calling them at least once after they first refused. Consent to participate was verbal, with no address, name or other identifying information collected (i.e. anonymous) as approved by York University's Research Ethics Board, Human Participants Review Subcommittee for generation and use of RRFSS data.
All interviews were completed in English, using Computer-Assisted Telephone Interviewing techniques, which greatly assists in expediting the data editing and cleaning process because logical and quality control checks can be programmed into the questionnaire design . Respondents were asked about either the current (for surveys conducted from April to October) or most recent past (for surveys conducted from October to following spring) gardening seasons. Although this may create some uncertainty in assignation of the relevant gardening season, it was required when surveys were administered in winter months when no gardening was occurring. RRFSS data had indicated that about 50% of households in Toronto had lawns. Because questions about pesticide use were only asked of this subsample of residents, an oversample was implemented in some seasons to ensure a subsample of sufficient size to allow for more detailed analyses of the data.
Socio-demographic variables available included: respondent's gender, pre-tax household income (twelve categories), respondent's highest level of education (four categories from did not graduate from high school to college or university degree) and household location within the City (as defined by the household's municipality prior to amalgamation). Missing data, in addition to item refusals or "don't know", varied from 0 (gender) to 27% (household income). Household size, asked in some years, was on average 2 adults, permitting the estimation of a low income cut-off (LICO) as CDN$27,601 . As this fell towards the upper limit of an income category on the survey ($20,000 to $29,999), all respondents in this category or the lowest (< 20,000) were designated as below the LICO.
For bylaw awareness, all respondents from 2005 on were asked "Some communities have bylaws that limit the outdoor use of pesticides, some are thinking about it and others do not. Do you think that the City of Toronto currently has a bylaw that limits the outdoor use of pesticides?" Further, respondents were asked "Have you seen or heard anything about the Naturally Green/Simple and Effective Lawn Care Campaign in your community? ...includes lawn signs, brochures, and ads in the newspaper which encourage people to avoid pesticides and try pesticide free methods." Responses (Yes/No) became the pesticide bylaw and Natural Lawn Care Campaign awareness dependent variables. Additional questions were asked to understand reasons for reducing pesticide use, using more natural methods and obtaining information on each of these, particularly among the 2005 and 2006 oversamples .
For household practices, across all years, respondents were first asked "Does your home have a lawn that you or someone else in your household is taking care of?" If yes, then "Did you or someone else in your household hire or pay a lawn care company to treat your lawn?" and, if yes, then "Did the lawn care company use any pesticides on your lawn to kill weeds or insects?" and "Did they offer to use any natural lawn care/pesticide-free methods such as aeration, over-seeding, hand weeding, or products such as corn gluten?" Similar questions were also asked of respondents with a lawn about applications by "you or someone else in your household" (except for natural lawn care methods in the first year of interest). These became the practices or use dependent variables.
Data distributions were analyzed with STATA/IC statistical software version 11.0 (2009). Individual level variables (gender, education, pesticide bylaw awareness and Natural Lawn Care Campaign awareness) were weighted to account for the unequal probabilities of selection of one-adult households . Two weights were created for gender and education (gardening 2003-2008), and for pesticide bylaw and Natural Lawn Care Campaign awareness (gardening season 2005-2008), to account for the different time periods in which the questions were asked. Oversamples were given separate values for gardening years, as demographic characteristics of these oversamples varied systematically from regular samples; i.e., more women, greater education, and different location distribution. For key practice variables, confidence intervals were calculated on the first and last year proportions. Bivariate associations were assessed with chi-square statistics.
We then constructed multivariable logistic models with gardening year as the primary independent variable of interest and demographic variables as covariate independent variables (to control for differences across years), with one awareness or use variable as the dependent variable in each model. As associations were observed between awareness variables and between them and gardening year (i.e. increased awareness as bylaw enforcement and education programs rolled out), variable selection was required. The latter examined associations between gender, level of education, income, location, and gardening year as independent variables and respondent awareness or household practice dependent variables. Given the mix of individual and household variables, we conducted sensitivity analyses to examine the effect of using weights that account for individual-level variables versus household variables, and weights that account for different time periods in which the questions were asked. These weights are available from authors upon request. Eventually we settled on application of individual weights as the most inclusive option. Changes in adjusted odds ratios (OR) with 95% confidence intervals were displayed graphically.
Relevant indicators of Toronto pesticide policy roll-out and program implementation.
Bylaw complaint investigations
Warning letters issued
Education & Outreach
Website - Pages of content
General information materials (postcard, brochure, pamphlet)
Plastic "pesticide" free lawn signs
Presentations at events
Go Natural retail participation
Fact sheets on natural gardening
Education/outreach - As can be seen in Table 2, the effort to make residents aware was substantial. In addition to those methods listed, city staff conducted 291 proactive information visits to sensitive sites, such as child care centers and hospitals, and all public and private golf courses and bowling greens. Informal feedback from the community helped identify the need for expert resources on plants and gardens not just lawns. TPH responded by partnering with the Toronto Master Gardeners to produce a series of fact sheets on natural care of flowers and vegetable gardens and promote the information via the internet, during lectures, community events and a telephone information line. Community feedback also resulted in new retail materials, information for the lawn care sector, and particular efforts with ethno-cultural partners .
Economic - From 2001 to 2006, the number of landscaping and lawn care sector businesses located in the City of Toronto grew each year, with an overall 30 per cent increase during the period, similar to the increases in companies located anywhere in the Greater Toronto Area (36%) and across Ontario (32%) .
Repeat Survey findings
Response rates across the six years of interest (2003-2008) ranged from 58% (in 2005) to 50% (in 2007). Explicit oversamples of those with lawns occurred for the 2005 (n = 355) and 2006 (n = 179) gardening seasons, resulting in an overall sample of 4,901 respondents.
Respondent* and household^ characteristics, by gardening season (n, %) (Rapid Risk Factor Surveillance Survey, Toronto).
(N = 4901)
(N = 608)
(N = 609)
(N = 1440)
(N = 777)
(N = 620)
(N = 847)
Gender* (weighted counts, wgtd %)
(n = 608)
(n = 607)
(n = 1453)
(n = 795)
(n = 614)
(n = 825)
Education* (wgtd counts, wgtd %)
(n = 608)
(n = 607)
(n = 1453)
(n = 795)
(n = 614)
(n = 825)
< High school
Missing, don't know, refused
< low income cutoff
≥ > low income cutoff
Missing, don't know, refused
Old City of Toronto
Missing, don't know, refused
Had a lawn^
Missing, don't know, refused
Hired a lawn care company^ [among those with lawns]
Missing, don't know, refused
Respondent* & household^ lawn care awareness and practices, City of Toronto, 2003-2009 All households (n, %).
Lawn Care Awareness & Practices
(n = 4901)
(n = 608)
(n = 609)
(n = 1440)
(n = 777)
(n = 620)
(n = 847)
Aware of pesticide bylaw*†(wgtd counts, wgtd %)
(n = 1452)
(n = 794)
(n = 614)
(n = 825)
(n = 3684)
Missing, Don't Know, Refused
Respondent* & household^ lawn care awareness and practices, City of Toronto, 2003-2009 Only households with lawns (n, %, 95% CI for key practices).
Lawn Care Awareness & Practices
(n = 2726)
(n = 333)
(n = 289)
(n = 896)
(n = 479)
(n = 308)
(n = 421)
Lawn care company applied pesticides^ †
49 (14.7%, 10.9 - 18.5)
19 (4.5%, 2.5 - 6.5)
Missing & Not Applicable
Household member applied pesticides^‡
82 (24.6%, 20.0 - 29.3)
47 (11.2%, 8.1 - 14.2)
Missing & Not Applicable
Aware of Natural Lawn Care Campaign*§(wgtd counts, wgtd%)
(n = 977)
(n = 531)
(n = 344)
(n = 456)
(n = 2308)
Missing, Don't Know, Refused
Lawn care company used natural lawn care methods^°
16 (4.8%, 2.5 - 7.1)
50 (11.9%, 8.8 - 15.0)
Missing & Not Applicable
Household member used natural lawn care methods^¶
131 (45.3%, 39.6 - 51.1)
279 (66.3%, 61.7 - 70.8)
Missing & Not Applicable
Among households that indicated that they had reduced their pesticide use (data not in tables), the primary reason given was for health or environmental reasons (33.7% average), followed closely by the pesticide bylaw (23.9% average) and that simply their lawn did not require pesticides (16.3% average) . While the pesticide bylaw was not the most influential factor, an upward trend (+5.1%) of citing the bylaw as the motivation was seen between gardening seasons 2006 and 2007. Among households that indicated they had changed towards increasing their use of natural lawn care methods, the primary influence was health or environmental reasons (42% average). The pesticide bylaw was cited as the reason by 20% of respondents. Among those never having used natural lawn care methods, the largest group (48.3%) reported not having much knowledge of natural lawn care practices or methods.
Logistic regression models of variables associated with respondent awareness or household practice outcomes, weighted with individual level variable weight (Odds Ratio, [Standard Error], significant coefficients bolded).
Respondent aware of pesticide bylaw
(n = 1804)
Lawn care company applied pesticides
(n = 375)
Household member applied pesticides
(n = 1863)
aware of Natural Lawn Care Campaign
(n = 1804)
Lawn care company used natural lawn care methods (n = 196)
Household member used natural lawn care methods (n = 1283)
Gender (Woman referent)
Education (completed post-2ndy referent)
< high school
> high school
Household income (≥ LICO referent)
< low income cutoff
Municipality (East York referent)
Old City of Toronto
Gardening period(referent year)
Pesticide bylaw awareness
Natural Lawn Care Campaign lawn care campaign awareness
We have described an innovative approach to designing and implementing a new policy involving regulation of outdoor use of pesticides for non-essential purposes. The policy gestation over several years, the substantial efforts to engage in dialogue and debate with the public and relevant stakeholders, the mobilization of adequate TPH staff resources and the widespread dissemination of information, both about the bylaw and alternatives, reached Toronto residents. By 2008, over two-thirds of respondents reported being aware of the bylaw.
On the enforcement front, residents were active in lodging complaints, but few actual prosecutions were needed. The specialized training for health inspectors and strong enforcement presence increased awareness and likely compliance. At the same time, the complexity of governance around pesticide use, with responsibilities at the national (registration), provincial (classification as to uses and sale) and municipal levels, left an opening for the unsuccessful court challenge and created additional user confusion.
Overall costs for city taxpayers were reasonable: in the most intense launch year about 450K/2.5 million residents or CDN$0.20 per resident per year, within the lower range of the expenditure ratios reported in the review by the Canadian Centre for Pollution Prevention . These were substantially lower than environmental tobacco smoke bylaw implementation and enforcement costs, where persistent conflict was greater [55, 56].
Resident practice changes
In a city where households already appeared to use pesticides less than other jurisdictions (only 15% company and 25% household application versus over 50% of households applying pesticides in other Canadian jurisdictions (Ipsos Reid, 2001, unpublished), significant further reductions in pesticide application were achieved. Comparing these falls in use is difficult given the different metrics used in the limited grey literature e.g. the drop in household contracted company applications can be framed as a modest absolute difference of 10% (14.7-4.5) or as a very large proportionate drop of 69% (10.2/14.7). Similarly for householder application, an absolute difference of 13% (24.6-11.2) or a proportionate decrease of 54% (13.4/24.6). The proportionate decreases would be comparable to the largest changes observed in the Canadian Centre for Pollution Prevention's review  including two other municipalities with bylaws - the very small community of Hudson, Quebec and the city of Halifax, Nova Scotia. Note that context can also influence such reductions, as comfort with pesticide use differed between rural and urban areas of Utah . The absolute differences we observed would be more comparable to those achieved in Seattle and Chesapeake Bay through education and outreach alone.
However framed, we may ask why reported use did not approach zero, despite use of the suggested multiple channels in risk communication . First, the bylaw permitted uses of some pesticides, which may be among those reported. Second, the continued availability of non-permitted products at stores may have led many homeowners to believe they were allowed to use them. Licensing of products is a federal mandate and the actual sales process a provincial one. Third, associations of the "perfect lawn" in suburban areas with higher socioeconomic status , the more status-conscious nature of a large urban centre, and the link to "men's" work in outdoor yard care are all strong North American cultural characteristics. Finally, Toronto's multi-cultural nature may have made it harder to reach the wide variety of communities who have different uses of outdoor space and whose perceptions of pesticides are influenced more by cultural practices than external information .
Increases in use of natural lawn care methods were not universal. This may be because alternatives to pesticides require different approaches and may not be as immediately effective. As in much health promotion, uptake of positive behaviours can be easier than relinquishing of negative ones. Corresponding changes among hired lawn care companies were modest (7.1%) perhaps attributable to the substantial investment such companies have in existing technology, and the difficulties in switching to different suppliers and techniques.
Challenges in Evaluation
Systematic evaluation of the effectiveness of pesticide use reduction efforts including bylaws poses particularly prominent challenges. Feasible, external, independent indicators for measuring changes in pesticide use and contamination over time are limited. For example, pesticide sales (and use) data remain unavailable especially at a municipal level, except within companies. Environmental testing was conducted prior to bylaw implementation but not funded long-term. It was later funded by the provincial government (to successfully assess effectiveness of its own province-wide ban) .
We relied primarily on self-reported householder data on practices. Illegal activities, including pesticide use restricted under a bylaw, are generally under-reported on surveys . However, householder data for all but the 2008 gardening season were collected prior to the time when residential users were subject to penalties under the bylaw, and much of the observed change occurred prior to that season. Desirability bias may also lead to over-estimation of changes in actual practices. Although this bias may have occurred with the shift in public perceptions towards use of pesticides on lawns being more socially inappropriate, such a shift would itself be a positive consequence of education and outreach efforts. There was also potential for recall bias, given that during the late fall and winter months respondents were being asked to report on practices that occurred a number of months previously. Being infrequent, pesticide applications may be more salient than other outdoor tasks, so some misclassification may be expected. However, this should be mitigated by the fact that such misclassification would not be differential across gardening seasons, as the same recall challenge would have occurred in 2003 as 2008. Other factors may reduce under-reporting, including the fact that the questions were asked as part of a longer survey with questions about many health-related topics, and that the surveys are anonymous and conducted over the telephone with an independent survey organization. On the other hand, that fact that some households reported pesticide use by companies they hired in later years indicates a risk of "over-reporting" as householders may not have been clear on permitted products or what was used.
Sampling via random digit dialling is increasingly posing challenges to representativeness with the increased use of cell phones. Further, telephone surveys face recruitment challenges as telephone advertising increases. Those achieved by RRFSS (> 50%) are on the high end, partly due to the extensive call-back procedures. Finally, conducting surveys only in English in a multi-cultural city may cause difficulties for less acculturated newcomers, though the costs of including multiple language interviewers in such surveys would be substantial and earlier ISR/RRFSS methodological work had found that the number of potential respondents 'non-functional' in English was much lower that the proportion for whom it was not their first language.
We were able to use a referent or comparison municipality in an interim examination of evaluation results for a report to City Council, showing less change in reported pesticide use observed in the community with no bylaw and smaller investment in public education . However, the Toronto policy development process was extremely high profile, with widespread media attention throughout Ontario, making it highly unlikely that another community, its environmental groups and the public would be without influence from the Toronto experience. Further, the comparison municipality did not continue repeat surveys to provide data across all years as would be needed for a more rigorous comparison.
Despite these potential caveats associated with our findings, the existence of repeated measures data prior to, during and post- bylaw and education implementation is a real strength. Further, corroboration by TPH staff observations during engagements with lawn care companies, store owners and community groups, that the intent and messages of the bylaw and education program were being understood and that stakeholders were actively seeking information on pest and weed control with methods other than pesticides, assists interpretation of the repeat survey data findings. We can understand this as an adequacy evaluation, one that primarily seeks to assess coverage . As in many environmental health interventions this one has face validity i.e. that less pesticide application will likely result in less environmental contamination and human pesticide exposure. Hence the assessment could be focused on program implementation and reductions in reported use, in a way that was highly relevant to the stakeholders involved, particularly the political representatives on the BOH and City Council .
Other Canadian municipalities have followed the lead of Hudson, Halifax and Toronto; by February 2010, an estimated 154 municipalities in seven provinces had pesticide bylaws . Municipal experiences with bylaw implementation were also important drivers for provincial legislation, prompting bans in Quebec, Ontario, Prince Edward Island, Nova Scotia and New Brunswick. The Toronto bylaw paved the way for broad acceptance by the public of stronger pesticide control legislation in Ontario even if it meant that pesticide products were no longer available for their personal use. It served to influence the "next step" in the evolution of public thinking about the use of pesticides. As part of a wider effort to reduce use of hazardous substances in the province, the Ontario-wide cosmetic pesticide ban, enacted on April 22, 2009, was more comprehensive in scope. It banned the sale of many common pesticides, limiting current exemptions to pesticide use, tightly restricting remaining uses and imposing larger fines and penalties, including imprisonment . Building on the long policy development and implementation work of Toronto, Ontario's was an efficient regulatory process, one that other states, provinces or countries could emulate . Many US states, however, have responded to the jurisdictional complexity with "pesticide pre-emption laws"  thereby removing the right of municipalities to pass ordinances on pesticide use.
As part of environmental policy implementation, we would encourage parallel efforts to evaluate impacts. In keeping with the growing emphasis on effectiveness  and public accountability , funding should be included for indicators in different relevant domains. Comparable reporting of both absolute as well as relative changes and controlling for relevant covariates would also be helpful. The same way that toxic substance release inventories in the US  and in Canada  have paved the way for our understanding of waste releases, we would urge the development of pesticides sales databases, as a key ingredient in tracking intentional chemical inputs to humans and our ecosystems. Coupled with implementation of better exposure incident information systems , they should facilitate more explicit evaluations of the impacts of environmental policies and programs.
List of Abbreviations
(Toronto) Board of Health
Low Income Cut-Off
Medical Officer of Health (for Toronto)
Rapid Risk Factor Surveillance System
Toronto Public Health.
Bienefeld M, Cole DC, Campbell M, Mee C, Vanderlinden L. Evaluating urban pesticide reduction strategies. CIHR funded Centre for Urban Health Initiatives Seed Grant. 2004-2005, $10,000. Toronto Public Health provided staff support for project development, implementation and evaluation. Vanita Sahni and Leslie Jermyn provided technical support during the project.
- Phillips PJ, Bode RW: Pesticides in surface water runoff in south-eastern New York State, USA: seasonal and stormwater effects on concentrations. Pest Management Science. 2004, 60: 531-543. 10.1002/ps.879.View ArticleGoogle Scholar
- Environment Canada: Presence and Levels of Priority Pesticides in Selected Canadian Aquatic Ecosystems. 2009, Ottawa, Ontario, [http://www.ec.gc.ca/eaudouce-freshwater/default.asp?lang=En&n=EF9EA08A-1]Google Scholar
- Brüsch W, Juhler R: Pesticider og nedbrydningsprodukter [Pesticides and their metabolites. Grundvandsovervågning 2002. Edited by: Jørgensen LF. 2002, Geological Survey of Denmark and Greenland. Copenhagen: GEUS, 57-74.Google Scholar
- Hertz-Picciotto I, Cassidy D, Lee K, Bennett DH, Ritz B, Vogt R: Study of use of products and exposure-related behaviors (SUPERB): study design, methods, and demographic characteristics of cohorts. Environmental Health. 2010, 9: 1-14. 10.1186/1476-069X-9-1.View ArticleGoogle Scholar
- Whyatt RM, Camann DE, Kinney PL, Reyes A, Ramirez J, Dietrich J, Diaz D, Holmes D, Perera FP: Residential pesticide use during pregnancy among a cohort of urban minority women. Environ Health Perspect. 2002, 110: 507-514. 10.1289/ehp.02110507.View ArticleGoogle Scholar
- Nishioka MG, Lewis RG, Brinkman MC, Burkholder HM, Hines CE, Menkedick JR: Distribution of 2,4-D in air and on surfaces inside residences after lawn applications: Comparing exposure estimates from various media for young children. Environ Health Perspect. 2001, 109: 1185-91. 10.1289/ehp.011091185.View ArticleGoogle Scholar
- Landrigan PJ, Claudio L, Markowitz SB, Brenner BL, Romero H, Wetmur JG, Matte TD, Gore AC, Godbold JH, Wolff MS: Pesticides and inner-city children: exposures, risks and prevention. Environ Health Perspect. 1999, 431-7. 107
- Wigle D: Child Health and the Environment. Toronto, New York, Oxford et al.:Oxford University Press, Chapter 7 epidemiologic evidence summary tables, [http://www.mclaughlincentre.ca/research/child_health/book/index.shtml]
- Infante-Rivard C, Weichenthal S: Pesticides and childhood cancer: an update of Zahm and Ward's 1998 review. J Toxicol Environ Health B Crit Rev. 2007, 10: 81-99. 10.1080/10937400601034589.View ArticleGoogle Scholar
- Garfinkel R, Perera FP, Andrews H, Barr D, Whitehead D, Tang D, Whyatt RM: Impact of prenatal chlorpyrifos exposure on neurodevelopment in the first three years of life among inner-city children. Pediatrics. 2006, 118: 1845-1859. 10.1542/peds.2006-0338.View ArticleGoogle Scholar
- Standing Committee on Environment and Sustainable Development, Government of Canada: Pesticides: Making the Right Choice for the Protection of Health and the Environment. 2000, [http://www2.parl.gc.ca/HousePublications/Publication.aspx?DocId=1031697&Language=E&Mode=1&Parl=36&Ses=2]Google Scholar
- Cifuentes E, Trasande L, Ramirez M, Landrigan PJ: A qualitative analysis of environmental health policy and children's health in Mexico. Environmental Health. 2010, 9: 1-11. 10.1186/1476-069X-9-1.View ArticleGoogle Scholar
- Zajac L, Sprecher E, Landrigan PJ, Trasande L: A systematic review of US state environmental legislation and regulation with regards to the prevention of neurodevelopmental disabilities and asthma. Environmental Health. 2009, 8: 1-12. 10.1186/1476-069X-8-1.View ArticleGoogle Scholar
- Jermyn L: Lawn and Order: A Review of the Literature on Effective Strategies for Reducing Outdoor Residential Pesticide Use. 2005, Toronto, ON: Centre for Urban Health Initiatives, University of Toronto, Accessed 10 Aug 2011, [http://www.cuhi.utoronto.ca/research/supportingdocs/PURE%20Project%20Literature%20Review%20(December%2016%202005).pdf]Google Scholar
- Robbins P, Sharp J: The lawn-chemical economy and its discontents. Antipode. 2003, 35: 955-979. 10.1111/j.1467-8330.2003.00366.x.View ArticleGoogle Scholar
- Robbins P, Polderman A, Birkenholtz T: Lawns and toxins. An ecology of the city. Cities. 2001, 18: 369-380. 10.1016/S0264-2751(01)00029-4. Accessed 10 Aug 2011, [http://www.sciencedirect.com/science?_ob=MImg&_imagekey=B6V9W-44J1CV2-2-9&_cdi=5909&_user=994540&_pii=S0264275101000294&_origin=&_coverDate=12%2F31%2F2001&_sk=999819993&view=c&wchp=dGLzVlb-zSkzV&md5=b37a6325dd08ac6ac97e0bad75e0ae49&ie=/sdarticle.pdf]View ArticleGoogle Scholar
- Henry N: Quest for lush lawns fuels debate over chemical safety. Toledo Blade. 2005, Toledo, OhioGoogle Scholar
- City of Ottawa: Pesticide Use and Attitude Survey. 2002, Ottawa, OntarioGoogle Scholar
- Kristoffersen P, Larson SU, Møller J, Hels T: Factors affecting the phase-out of pesticide use in public areas in Denmark. Pest Manag Sci. 2004, 60: 605-612. 10.1002/ps.890.View ArticleGoogle Scholar
- Ontario Pesticide Advisory Committee: Survey of Municipal Landscape Pest Control Practices. 2002, Toronto, Ontario, [http://www.opac.gov.on.ca/pdf/Totalreport.pdf]Google Scholar
- Kassirer J, Wolnik C: The Impact of Bylaws and Public Education Programs on Reducing the Cosmetic/Non-Essential, Residential Use of Pesticides: A Best Practices Review. 2004, Ottawa, Ontario: The Canadian Centre for Pollution Prevention and CULLBRIDGE Marketing and Communications, March, Accessed 10 Aug 2011, [http://www.ipminstitute.org/Articles/PesticidesBestPracticeReview-FINAL040324.pdf]Google Scholar
- Hawes P, Potvin L: What is population health intervention research?. Can J Public Health. 2009, 100: I8-I14.Google Scholar
- City of Toronto: Demographic information for the City of Toronto. [http://www.toronto.ca/demographics]
- City of Toronto, Toronto City Council: The Toronto Amalgamation: Looking Back, Moving Ahead. 2000, Speech by Roda McInnis Contractor, Director, Amalgamation Office, City of Toronto Delivered at Greater Toronto Area Forum), [http://www.toronto.ca/toronto_history/amalgamation/amal_speech.htm]Google Scholar
- Toronto Public Health: Strategy to Achieve a Phase-Out of Non-Essential Outdoor Uses of Pesticides. 2001, Toronto, Ontario, [http://www.toronto.ca/health/pesticides/pdf/pesticides_strategy.pdf]Google Scholar
- Supreme Court of Canada: Spraytech v. Hudson (Town), S.C.J. No. 42. 2001, Ottawa, Ontario, [http://scc.lexum.umontreal.ca/en/2001/2001scc40/2001scc40.html]Google Scholar
- McClenaghan T: Bill 111 - Ontario's new municipal act and pesticide bylaw powers. Canadian Environmental Law Association (CELA) Intervenor. 2001, 26: 1-2. [http://www.cela.ca/article/hudson-quebec-pesticide-law/bill-111-ontarios-new-municipal-act-and-pesticide-law-powers]Google Scholar
- Toronto Public Health: Lawn and Garden Pesticides: A Review of Human Exposure & Health Effects Research. 2002, Toronto, Ontario, [http://www.toronto.ca/health/pesticides/pdf/pesticides_lawnandgarden.pdf]Google Scholar
- Toronto Public Health: A survey of Toronto residents' awareness, uses and attitudes towards lawn pesticides. 2002, Toronto, Ontario, [http://www.toronto.ca/health/pesticides/pdf/pesticides_survey.pdf]Google Scholar
- Toronto Public Health: Public Opinion Survey for the Phase-Out of Non-Essential Pesticide Use: Final Report. 2002, Toronto, Ontario, [http://www.toronto.ca/health/pesticides/pdf/pesticides_bylaw_appendix_b.pdf]Google Scholar
- Toronto Public Health: Playing it Safe: Healthy Choices about Lawn Care Pesticides. 2002, Toronto, Ontario, [http://www.toronto.ca/health/hphe/pdf/playingitsafe.pdf]Google Scholar
- Tools of Change: Bert the Salmon: Promoting natural lawn care in the Seattle Area. 2002, King Couty, Washington, [http://www.toolsofchange.com/en/case-studies/detail/162]Google Scholar
- Northwest Coalition for Alternatives to Pesticides: Oregon's new pesticide right-to-know law and you. 2000, Portland, OregonGoogle Scholar
- Washington State Department of Agriculture: Washington pesticide laws and other related regulations. [http://agr.wa.gov/PestFert/Pesticides/docs/PesticLawsBooklet.pdf]
- New York State Department of Environmental Conservation: The Neighbor Notification Law, Rule and Regulation. 2000, [http://www.dec.ny.gov/chemical/8529.html]Google Scholar
- Toronto Public Health: Staff Report on Proposed Pesticide Bylaw. 2003, [http://www.toronto.ca/health/pesticides/pdf/pesticide_bylaw.pdf]Google Scholar
- City of Toronto: Bylaw No. 456-2003. To adopt a new City of Toronto Municipal Code Chapter 612, Pesticides, Use of. 2003, Toronto, ONGoogle Scholar
- Croplife Canada: "Gardening remains a crime as court upholds Toronto pesticides bylaw.". 2003, News Release, [http://www.croplife.ca/web/english/mediaroom/newsreleases/20031209release.cfm]Google Scholar
- Croplife Canada: "Smart cities will leave pesticides issue in hands of Health Canada scientists despite Supreme Court decision". 2005, New Release, [http://www.croplife.ca/web/english/mediaroom/newsreleases/20051711release.cfm]Google Scholar
- City of Toronto: Go Natural - Tips for Natural Lawn and Garden Care. [http://www.toronto.ca/health/pesticides/go_natural_tips.htm]
- Campbell M, Buckeridge D, Dwyer J, Fong S, Mann V, Sanchez-Sweatman O, Stevens A, Fung L: A systematic review of the effectiveness of environmental awareness interventions. Can J Public Health. 2000, 91: 137-143.Google Scholar
- Toronto Public Health: Implementation of the Pesticide By-law. 2004, Toronto, Ontario, Accessed 10 Aug 2011, [http://www.toronto.ca/legdocs/2004/agendas/committees/hl/hl040223/it006.pdf]Google Scholar
- Struger J, Fletcher T, Martos P, Ripley B, Gris G: Pesticide Concentrations in the Don and Humber River Watersheds (1998 - 2000). 2002, Ontario Ministry of Environment, Environment Canada and Toronto Works & Emergency Services, [http://www.ene.gov.on.ca/stdprodconsume/groups/lr/@ene/@resources/documents/resource/std01_079722.pdf]Google Scholar
- Resnick DB: Randomized controlled trials in environmental health research: ethical issues. J Environ Health. 2008, 70: 28-30.Google Scholar
- Resnik DB: Environmental health research and the observer's dilemma. Environ Health Perspect. 2009, 117: 1191-1194.View ArticleGoogle Scholar
- Stone DL, Sudakin DL, Jenkins JJ: Longitudinal trends in organophosphate incidents reported to the National Pesticide Information Center, 1995-2007. Environmental Health. 2009, 8: 1-8. 10.1186/1476-069X-8-1.View ArticleGoogle Scholar
- Elsbett-Koeppen R, Northrup D, Noack A, Moran K: Survey Methodology, Sample Representativeness, and Accurate Reporting of Population Health Statistics. RRFSS at Rapid Risk Factor Surveillance System Bulletin 40. 2004, [http://www.isr.yorku.ca/projects/bulletins/b40.html]Google Scholar
- Grembowski DE: The Practice of Health Program Evaluation. Thousand Oaks, California, USA:Sage. 2001, 72:Google Scholar
- Aday LA, Cornelius LJ: Designing and Conducting Health Surveys: A Comprehensive Guide (3rd edition). 2006, San Francisco: Jossey-Bass A Wiley Imprint, 119:Google Scholar
- Statistics Canada: Low income cut-offs. Ottawa, Ontario, [http://www.statcan.gc.ca/pub/75f0002m/2009002/s2-eng.htm]
- Rapid Risk Factor Surveillance System: Data dictionaries. [http://www.rrfss.ca/index.php?pid=14]
- Institute for Social Research York University: The 2008 Rapid Risk Factor Surveillance System (RRFSS) Technical Documentation. 2009, Oakville, ONGoogle Scholar
- Toronto Public Health: Interim Evaluation of Toronto's Pesticide Bylaw. 2007, Toronto, Ontario, Accessed 10 August 2011, [http://www.toronto.ca/health/pesticides/pdf/interim_evaluation_report_02262007.pdf]Google Scholar
- Jermyn L, Wakefield S, Bienefeld M: Preliminary Report of the Multicultural Yard, Health and Environment Project (MYHEP). Toronto, Ontario: Centre for Urban Health Initiatives. 2007, [http://www.cuhi.utoronto.ca/research/supportingdocs/MYHEP_Prelim_Report_Sept07.pdf]Google Scholar
- Toronto Public Health: Toronto's Environmental Tobacco Smoke (ETS) Bylaw - Implementation Update. Report to the Board of Health. 2003, Toronto, Ontario, [http://www.toronto.ca/health/pdf/boh_ets_bylaw_eport.pdf]Google Scholar
- Toronto Public Health: Toronto's No Smoking Bylaw (Municipal Code Chapter 709-Smoking) - Final Phase Implementation Update. Report to the Board of Health. 2005, Toronto, Ontario, [http://www.toronto.ca/legdocs/2005/agendas/committees/hl/hl051128/it003.pdf]Google Scholar
- Coppin DM, Eisenhauer BW, Krannich RS: Is pesticide use socially acceptable? A comparison between urban and rural settings. Social Science Quarterly. 2002, 83: 379-394. 10.1111/1540-6237.00090.View ArticleGoogle Scholar
- Fitzpatrick-Lewis D, Yost J, Ciliska D, Krishnaratne S: Communication about environmental health risks: a systematic review. Environmental Health. 2010, 9: 1-15. 10.1186/1476-069X-9-1.View ArticleGoogle Scholar
- Todd AK: Changes in Urban Stream Water Pesticide Concentrations One Year after a Cosmetic Pesticide Ban. Environmental Monitoring and Reporting Branch, Ontario Ministry of the Environment. 2010, Toronto, ON: Queen's Printer for OntarioGoogle Scholar
- Bienefeld M, Cole DC, Wanigaratne S, Whate R, Crosse E, Reffle J, Mee C, Vanderlinden L: Assessing the impact of a municipal pesticide use bylaw: a quasi-experimental evaluation. Epidemiology. 2007, 18: S149-Google Scholar
- Habicht JP, Victora CG, Vaughan JP: Evaluation designs for adequacy, plausibility and probability of public health programme performance and impact. Int J Epidemiol. 1999, 28: 10-18. 10.1093/ije/28.1.10.View ArticleGoogle Scholar
- Toronto Public Health: Final Evaluation of Toronto's Pesticide Bylaw and Summary of New Provincial Pesticide Regulation to Board of Health. 2009, Toronto, Ontario, http://www.toronto.ca/health/pesticides/pdf/bylaw.pdf and http://www.toronto.ca/legdocs/mmis/2009/hl/bgrd/backgroundfile-21099.pdf Google Scholar
- Anonymous: Private Property Pesticide Bylaws In Canada. 2010, Population Statistics by Municipality, [http://www.flora.org/healthyottawa/BylawList.pdf]Google Scholar
- Ontario Ministry of Environment: Pesticides Act. [http://www.ene.gov.on.ca/environment/en/legislation/pesticides_act/index.htm]
- Pralle S: The "mouse that roared": Agenda setting in Canadian pesticides politics. The Policy Studies Journal. 2006, 34: 171-194. 10.1111/j.1541-0072.2006.00165.x.View ArticleGoogle Scholar
- Code C: RISE Takes Bold Step. 2008, Lawn & Landscape Market Leadership, [http://www.lawnandlandscape.com/Article.aspx?article_id=621]Google Scholar
- van Erp AM, O'Keefe R, Cohen AJ, Warren J: Evaluating the effectiveness of air quality interventions. J Toxicol Environ Health Pt A. 2008, 71: 583-7. 10.1080/15287390801997708.View ArticleGoogle Scholar
- Charleston AE, Banerjee A, Carande-Kulis VG: Measuring success: the case for calculating the return on investment of environmental public health tracking. J Public Health Manag Prac. 2008, 14: 600-4.View ArticleGoogle Scholar
- United States Environmental Protection Agency: Toxics Release Inventory (TRI) Program. [http://www.epa.gov/tri/tridata/current_data/index.html]
- Environment Canada: National Pollutant Release Inventory. [http://www.ec.gc.ca/inrp-npri/default.asp?lang=en]
- City of Toronto. Advertisements. Toronto Water Services. Public Service Announcements. See "pesticides" in http://www.toronto.ca/wesads/index.htm#water
- City of Toronto. Pesticides portal. [http://www.toronto.ca/pesticides]
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.