The growing number of New Jersey residents opposing the construction of casinos in the northern part of the state has been troubling State Sen. Stephen Sweeney lately.

After winning a bruising political battle this year for a November 8 ballot referendum, North Jersey.com reported that Sweeney is “disappointed” at North Jersey casinos supporters for sitting idly on the sidelines as they watch their numbers fade even before the voting day arrives.

A poll conducted by Fairleigh Dickinson University PublicMind in June found that 58% are opposed to allowing casinos in the northern part of the state. A Monmouth University poll in June showed equal levels of support and opposition to the ballot question

“I think they sat back way too long,” Sweeney told The Record’s Editorial Board of the effort to persuade the public to approve the statewide ballot question, which the news agency quoted. “I’m really disappointed that people haven’t stepped up sooner. I always tell people, when you’re running a tough election [campaign], you don’t win it in September. You win it in February. You have to build up positive energy.”