The CQC said patients told inspectors they were left anxious over badly-arranged visits, and personal care was rushed.
Amy Jupp, from the watchdog, said: “People told us their care calls were often late or cut short, leaving them waiting anxiously, (with) rushed through personal care like showering, or going without food and drink for longer than they should.”
She added that people were “seeing far too many different carers, with little continuity and no proper introductions”.
This made them feel “unsettled and unsure who’d be coming through their door”.
She said families had “lost confidence” in the service – which supports people with complex needs – and they could not get through to the office.
Silverjen Limited was rated inadequate and placed under special measures by the CQC.
The inspection in August had been prompted by earlier concerns over safety, treatment and staffing levels.
Silverjen Limited told the BBC it believed the measures it was putting in place would “re-establish the CQC’s confidence” in its service.
Follow BBC Surrey on Facebook, external, X, external, and Instagram, external and listen to BBC Radio Surrey on Sounds. Send your story ideas to southeasttoday@bbc.co.uk , externalor WhatsApp us on 08081 002250.