The Chase star, who's also known as The Governess on the ITV quiz show, opened up about her Asperger'syndrome in a frank discussion with former EastEnders star Rita Simons.
It seemed to be a bit too much for the 60-year-old chaser who admitted back at Snake Rock: "I'm really close to saying I can't do this".
Hegerty was officially diagnosed with Asperger's in 2005, two years after first suspecting she might have the condition.
Fellow Chase quizzer Jenny Ryan defended Hegerty after a Twitter user suggested she should be able to cope with the show's pressures as she is "getting well paid".
When one critic on social media responded to Jenny's tweet with a comment that Anne put herself forward for the show and was "getting well paid", The Vixen (as she's nicknamed on "The Chase") continued: "Anne has Asperger's Syndrome which has a positive benefit on her quizzing ability but also means that a lot of things that us Neurotypicals don't think twice about are incredibly hard and stressful for her".
After her camp mates rallied round her, Anne soon cheered up, with Fleur adding "I feel like we all have to be there for her and the minute that we all rallied around her, she just felt so much better".
Judge at Christopher Watts’ sentencing says case is ‘most vicious’ he’s seen
In a blistering statement read to the court in Greeley, Colorado, Rzucek said: 'God only knows what happened that night. Chris Watts claimed he had called and texted his wife about three times that morning with no reply, he told KMGH.
Shaun Wallace, the show's "Dark Destroyer", tweeted Hegerty, saying: "We are all rooting for you!"
Before entering the jungle, Hegerty opened up to The Sun about how her condition will affect her time on the show and said the producers will be monitoring her behaviour closely. "I just couldn't quite get it together".
"I will understand "at this time I have to fetch food and water"- doing tha will make sense. but being usrrounded by people I can't get away from or those who talk all the time can be a source of stress".
She said: "Because you know there are people who don't always understand how it works or how to relate to me".
Anne explained how her Asperger's means she finds social interaction and lack of routine hard.
According to the NHS around one in every 100 people in the United Kingdom is thought to have ASD.