Rialto residents say they are at their wits' end as they are "disturbed" most mornings due to construction workers from the national children's hospital parking outside their homes.
Local group Respect Rialto has said some construction workers "intimidate" residents when they "park their vehicles, litter, use the streets of Rialto to change their clothes, socialise in groups, and consume drink and drugs".
Some residents have also claimed "there have been instances of urination on the street".
While there has been engagement between residents, the national children's hospital and BAM Construction - the contractor carrying out works at the hospital - locals protested on Monday from 5.45am to 8.30am to show they are tired of workers parking in the area.
Local Siobhán Geoghegan has been living there for 21 years.
"They rock up at 5am, they're playing their radio really loudly, they leave their engine running, they chat," she said.
"It's disturbing people and there's a number of people who have left the area as a result.
"It's been building up this whole year, it's been difficult."
She said the workers do not have access to parking and that BAM should take responsibility.
"Why doesn't BAM take responsibility for its contractors? Why does it facilitate them to just park where they like?
"Why were there no provisions for parking for the workers?" she said.
"We have really low car ownership but from Monday to Saturday we are overrun."
Damien Farrell, who lives with his family of five in Four Terraces, said parking is at a "premium".
"Parking is premium as it is, but they take up spaces that frontline workers and visitors of St James's use."
While the residents are currently liaising with Dublin City Council to put in place Pay and Display parking, Damien said some residents are concerned frontline workers will not be able to park in the area.
At the moment, there are up to 700 construction workers and Siobhán said by the end of the year the figure is expected to rise to over 1,000.
A spokesperson for BAM said the "health and safety of all stakeholders" in the building of the hospital is of "utmost importance" to the company.
"Given the scale and complexity of the project there has been a structured and well-run platform for engagement with the community and a mechanism to address all concerns.
"This includes regular meetings with all stakeholders, a dedicated point of contact for any issues and a telephone line for feedback.
"Minutes of all meetings are published and available for review."
They said the company "complies at all times" with obligations for the project, "including the latest public health directives and is reviewing these new concerns, which will then be addressed through the established channels."
Dublin City Council did not respond to a request for comment.