Louis Walsh 62-year-old entertainment manager has starred on the show since it began in 2004 and is said to be facing the axe from the series despite the show's boss, his close friend Simon Cowell, having promised him a "job for life" as judge on the competition.
Louis Walsh / Credit: FAMOUS
A source said: "Simon has accepted that Louis no longer has a job for life on The X Factor.
"His place on the panel is not guaranteed. He's unlikely to stay because we are actively looking at new options for his role.
"But you can never rule Louis out, because he is the great survivor of The X Factor."
It isn't the first time Simon, 55, has considered axing Louis from the line up.
In 2007 he briefly replaced the Irish-born star with Brian Friedman before recalling him to the judging panel after just a few days and appointing Brian creative director instead.
However, Louis is said to be in a "very different place" now and has no qualms about finally leaving the show as he could focus all his attention on his new boyband Hometown.
The source told The Sun newspaper: "He's been on the show for 11 years now and it's changed a lot, there's a lot of stress and heartache involved.
"If Simon decides it's his time to go, there's not going to be a big diva strop. Louis understands the situation."
However, it is believed Louis will remain on standby to return if the music mogul can't find someone to fill his shoes.
The insider added: "Louis knows that's the scenario because it's happened many times before."
Is Simon Cowell right to sack Louis or will he regret his decision? - Tell us below.
Tagged in The X Factor Louis Walsh