New York City might not get its very first Denny’s after all. Due to the chain’s reputation for attracting late night drunks and miscreants, the condo board for a building in Manhattan’s Financial District has filed a $10 million lawsuit in New York State Supreme Court to stop Denny’s from opening up its first NYC establishment in the building’s retail space. The legal complaint accuses Denny’s of being “a fast food chain synonymous with a late night party atmosphere, as well as drunk, disorderly, violent and criminal conduct,” The Real Deal reports. Residents in the building also objected to the restaurant’s plans to be open 24 hours. “The smells would be a problem, but worse would be the crowd. They’re talking about 24 hours—that would be crazy,” says Kim Schraub, 36, who lives in the building. “It’s the worst fast-food restaurant, I think, that there is.” The board for the swanky building, which currently has an apartment for $1.45 million on the market, also protested Denny’s original plans to serve wine and beer at the NYC location. DNA Info reports that they withdrew their application for a full liquor license after receiving dozens of written complaints since there are already a number of nearby food establishments that serve alcohol. Despite this, Faith Hope Consolo, chairwoman of Douglas Elliman real estate, said the location is a perfect fit. “That neighborhood has always been kind of discount-oriented,” she said. “The 99-cent stores, lousy fast food, cheap clothing—it’s always been at the bottom.”