Clarke claimed that some other hotels in Northern Ireland are also being used to house asylum seekers and that he was not aware of any of them having secured a change of use.
He added: “This issue isn’t just about the specifics of the need for proper planning approval. It highlights the lack of proper oversight and control in terms of the entire UK immigration system.
“The fact these hotels do not have the proper planning approval to house asylum seekers is merely a symptom of the overall problem.”
Speaking to BBC News NI on Wednesday, Clarke said he did not think “the public purse paying for hotels is appropriate”.
“So if these people are genuinely running from war-torn countries then disused army barracks sounds like a good option,” he said.
Antrim and Newtownabbey Borough Council said it had “no further comment to make at this time”.
Border Security Minister Angela Eagle said: “This government inherited a broken asylum system, at the peak there were over 400 hotels open.
“We will continue working with local authorities and communities to address legitimate concerns.
“Our work continues to close all asylum hotels by the end of this Parliament.”
The company that represents the Chimney Corner Hotel has also been approached by BBC News NI.