At least Alexander Skarsgård didn’t make a bad first impression on Miriam Margolyes. She just didn’t remember him at all.

Skarsgård had to explain to Margolyes on a recent episode of The Graham Norton Show, on which the two were both guests, that they had met previously. At first, she was unconvinced.

“Well, I clearly made a strong impression on her,” Skarsgård said, then tried to jog her memory.

“I believe you own or used to own a condo in Santa Monica. Is that correct?” Skarsgård, 49, asked, as the audiences laughed about the situation. “Were you looking to rent out a room in that at one point?”

Get your daily dose of entertainment news, celebrity updates, and what to watch with our EW Dispatch newsletter.

In fact, Margolyes, who’s known for her role as Professor Sprout in the 2002 film Harry Potter and the Chamber of Secrets and Harry Potter and the Deathly Hallows: Part 2 in 2011, said she had been looking for a tenant when she went to England to shoot a film about the boy wizard.

So why hadn’t he taken it, the actress wanted to know.

“It was a gorgeous apartment, and I remember you were very charming,” he continued. “I think, in hindsight, I probably misread the cues, but I felt a strong sexual connection. I probably misread the cues, but I thought this could potentially get messy — if I get a room at this apartment, if I’m your tenant.”

“Darling,” Margolyes cut in, “I’m 84 and gay! I’ve been with my partner for 58 years.”

“Again,” Skarsgård deadpanned, “I probably misread the situation.”

The British actress teased that he was “talking out of your bottom.”

Miriam Margolyes in ‘Harry Potter and the Chamber of Secrets’ in 2002.

Warner Bros/Courtesy Everett Collection

More seriously, he said, “But I was actually there, and I do remember that we had a lovely afternoon, which you obviously don’t remember.”

Along with her important role in Skarsgård’s life, Margolyes has worked in film and TV since the ’60s, appearing in movies including The Age of Innocence, Baz Luhrmann’s Romeo + Juliet, Little Shop of Horrors, and Call the Midwife.

The funny conversation between Skarsgård and Margolyes spurred another celebrity sitting on Norton’s couch, Bridgerton actress Nicola Coughlan, to jokingly say, “Miriam, I’m your daughter,” as she hugged Margolyes, to which Skarsgård responded that he was Coughlan’s dad.

Watch the funny moment above.