It is an issue exacerbated by immigration policies from the UK Government which are adding additional strain onto an already vulnerable system.
It is estimated that more than a quarter of care workers in Scotland are migrants.
Dr Jane Townson, chief executive of Homecare Association, told The Herald: “Not having enough care workers is a major problem.
“It risks some people being neglected in the community, having care reduced or withdrawn completely.
“It leaves them trying to manage on their own and it can often end up with them arriving in hospital.”
The UK Government has made changes to the criteria for “skilled workers”, while the right to remain rules could drive care workers away, it is claimed.
Read more:
Overseas recruitment for care workers ended in July, with the role removed from the “skilled work” category.
The Scottish Government launched a £500,000 scheme to attract adult social care workers who have been ‘displaced’ by the UK visa changes.
Displacement is caused by a crackdown from the Home Office on rogue employers sponsoring international carers, with these licences revoked.
It means international recruits on these work visas had to leave their jobs and find new employers who are willing to sponsor them short term, or they have to leave the UK.
UK Home Secretary Shabana Mahmood also announced proposals in November that would see workers on post-Brexit health and social care visas wait 15 years before they can apply for permanent status.
It was previously five years, with Scottish social care minister Tom Arthur warning the policies were “deeply concerning”.
Dr Townson, who spoke to The Herald for the Social Care in Crisis investigation, said social care recruitment challenges were particularly acute in Scotland.
She said: “There are workforce challenges everywhere, but in Scotland it is among the worst. It’s just very difficult to recruit, particularly in rural areas and the islands.
“There has been a heavy reliance on international recruitment and now the [UK] government has effectively stopped that.
“In the immediate term, things have not fallen off a cliff because there are still a lot of sponsored workers in the country but overtime that is really going to become an issue.
“Members everywhere are experiencing challenges with the Home Office, in terms of reviewing sponsorship licences.
“People that have got workers here doing jobs legitimately are not getting their licences renewed in a timely way, meaning that some of the care workers are going home or leaving.”
She said international recruitment provided “relief” to the struggling care sector but she said the “political rhetoric” is putting foreign workers off.
The organisation, which represents care at home workers, said: “Not having enough care workers is a major problem.
Read more:
“It risks some people being neglected in the community, having care reduced or withdrawn completely, them trying to manage on their own and it can often end up with them arriving in hospital.”
Caroline Robinson, director of the Worker Support Centre, a charity helping isolated workers in Scotland, told The Herald that some care workers become displaced “overnight” in many cases.
She said international workers are “being penalised” because their employers lost their licence.
“It’s an added barrier to redeploying those workers to parts of Scotland where there is a desperate need for care workers,” she said.
“We’re hearing there is a real desperation for workers but there are just impossible challenges.”
Social care minister Tom Arthur said it was important for the Scottish Government to stand against the changes and recognise the “huge contribution” international workers made to the sector.
A Home Office spokesman said: “We have seen unacceptable levels of exploitation and sponsor non-compliance in the sector, leaving tens of thousands of workers struggling to secure full time employment despite having the skills and experience. We are working with devolved governments to ensure those workers have access to vacancies across the UK.”
However Dr Townson also urged the Scottish Government to take more decisive action to prevent vulnerable people going into hospital because their social care package has failed them.
She accused the Scottish Government of “continuing to pour all available funds into the NHS”.
She said: “We’re not coping now so how are we going to as a society manage with some many people in our population being older and the government seems to be relying on unpaid carers, but they themselves are getting older and that means they come out of the workplace, so how is the economy going to grow if there aren’t enough workers?”
Homecare Association has called for a minimum price for an hour of home care to be set at £23.42 cover minimum wage for care workers and also expenses including travel, training, and basic business costs.
But she said 29% of public bodies in Scotland were not paying enough to cover direct staff costs at the minimum wage in local authorities across the country.