One asylum seeker who returned to the city said the premises in Crooksling was not fit for “animals”.
"There's no excuse for what the Government has done."
That's according to Baltinglass Cllr Gerry O' Neill, who said the Government was "wrong" to bus asylum seekers to Crooksling on the Kildare border.
He said locals are not in confrontation with refugees, but that a cohort of people turned up recently to start trouble.
He said conditions at the building are "not suitable for anyone".
"We have a beautiful site here, with over 40 acres of land. It was used as a facility for the sick and elderly of the area. It was a referral hospital from Naas."
He said what is happening at the site now is just "pure vandalism" by the Government.
A number of asylum seekers are back at a camp on Mount Street in Dublin after leaving the site.
Yesterday, the Department of Integration said around 130 people were staying in tents in Crooksling after they were moved over the weekend.
However, a number of others have returned to the city centre.
One asylum seeker who returned to the city said the premises in Crooksling was not fit for “animals”.
“On our first impression, we saw how miserable the situation was,” he said.
“It is not available to animals – we have nothing there."
“There is nothing there ready to use... we decided to go back to Dublin at once.”

29 New Jobs To Be Created As Chemist Warehouse To Open In Naas Tomorrow
Vulnerable Adults, Some Using Wheelchairs, Forced To Share Inaccessible Vehicles At Kildare HSE Service
“Grabbed By the Neck”: Founder Tells Kildare Today Why She Launched New Female-Focused Taxi Service
Just 75% Of Landowners On Board So Far As Uisce Eireann Submits Plans For Major Water Supply Project
Two Kildare Animal Charities Share €170k Fund As Animal Welfare Costs Continue To Mount
Call To Make Extended Christmas Train Timetable Permanent For Commuter Towns
Roadside Memorial Ban Proposal Criticised Over Christmas Timing
Man (30s) Dies Following Collision Involving Bus, Car And Pedestrian At Kishawanny, Carbury