Simon Cowell wants to "poach" 'Big Brother's Emma Willis and Rylan Clark for a hosting gig on the 'X Factor.'

Rylan Clark and Emma Willis

Rylan Clark and Emma Willis

The 56-year-old boss is reportedly keen to snatch the well-loved duo from the Channel 5 programme as he wants to shake up the ITV show once again next year by bringing them in as replacements for Olly Murs and Caroline Flack.

A source told the Daily Star newspaper: "It would cause fireworks poaching Emma and Rylan off 'Big Brother' but Simon usually gets what he wants. He nicked Alesha Dixon off 'Strictly' to be a judge on 'Britain's Got Talent' and Rita Ora from 'The Voice' for 'The X Factor.' "

Rumours the music mogul is planning to drop Olly, 31, and Caroline, 36, once this year's show wraps up comes after the 'Dear Darlin' hitmaker made a number of on-air gaffes.

Last month, the pop star, who shot into the limelight after competing on the programme in 2009, sparked rumours the show was a fix after he told contestant Monica Michael she was going home before the official result was announced.

But it's not just the public questioning Olly's future on the 'X Factor' as he also believes his job hangs in the balance.

He said recently: "I don't know if me and Caroline will be back next series - we'll have to wait and see what happens. It's up to Simon Cowell and his guys to make that decision."