Its status among fans persisted through its long period of closure.
They continued to visit, taking selfies outside the site even when its windows were boarded up.
Mr Taylor, who has owned it for 30 years, said he had also been inundated with emails from fans all over the world asking when it was going to reopen.
“People have been asking to come in too, it’s just been non-stop, it’s a Mecca for Harry Potter fans,” he said.
“It’s tragic to think we have been closed for four-and-a-half years.
“The whole thing has been a bit of a emotional rollercoaster, to be honest, from day one of the fire until now opening the doors again.”
The part of the property which housed the cafe was owned by a company which went into liquidation shortly after the fire.
This held up the £500,000 refurbishment.
The new owners of the building have signed a 20-year lease with Mr Taylor.