Rumors Persist: Mariah Carey, Nicki Minaj, Katy Perry May Judge 'The X Factor'

We first reported it as speculative rumor less than a week ago that "The X Factor" executive producer - and now, one of two remaining judges with Antonio "L.A." Reid - had set his sights on swapping out Nicole Scherzinger for Mariah Carey.

Suddenly, a few new wrinkles emerge: talk keeps coming that Cowell wants Carey, but one source very close to her claims that won't be happening, while others have tossed a few other Grammy-nominated names that Cowell may be considering.

A report by the U.K. Daily Mail from an unnamed source suggests "Simon wants noting but the best for 'The X Factor' - and Mariah is the best." Of course, it could also be suggested that when Cowell "wants the best," it's possible "the best" may mean "Scherzinger out by any means necessary." Before the former Pussycat Dolls singer was ousted earlier this week along with Season One U.S. host Steve Jones and fellow judge/"American Idol" panel alum Paula Abdul, both the reported reasons she'd leave and the possibles means were enough to make a list of either.

Scherzinger openly hated judging, for one thing. She couldn't deal with rejected contestants' grief and when she couldn't bear sending Marcus Canty home, that subjected more popular Rachel Crow to the fans' will and unfortunately, the ax.

"I'm used to being on stage and performing and singing for people and people cheering for me," Scherzinger said. "I am an artist first, not a judge first! The elimination process for me has been very difficult."

The rumored remedy was at one point a swap across the pond with U.K. "X Factor" judge Kelly Rowland, but that never materialized. Before being suddenly canned, Scherzinger already had a longtime in-progress solo album called Killer Love that she wanted finally completed. She's also set her sights on seemingly every young singing starlet's natural next evolutionary stage: more acting.

Meanwhile, Carey's husband and father of the pair's twins Nick Cannon claims she couldn't be less interested. "Why would my wife want to be on a show like that? For someobody who has a legendary career, I don't know why they would," Cannon is quoted by the Daily Mail as saying.

"His wife" should offer up a history lesson - one with some recent entries. As previously reported, Cowell had Carey reportedly lined up as a guest home-audition judge alongside him, but Hurricane Irene's machinations played havoc with Carey's travel and nixed that possibility.

Later, it was "X Factor" producers who declined Carey's $300,000 payment request to make a holiday appearance performing her retooled "All I Want For Christmas Is You" alongside Justin Bieber.

Nor does Cannon exactly directly address the rumor, per Pop Crush, that it was Carey who reportedly contacted Cowell when word started leaking that one way or another, Scherzinger wouldn't be back for a second season.

Still, even if Cannon's on the right side of things, it sounds like Cowell may have a Plan B. The Daily Mail reports that not only has Cowell considered U.K. "X Factor" host Dermot O'Leary to replace Jones, but one-time U.S. "X Factor" judging choice, U.K. "X Factor" alum and Cowell friend Cheryl Cole to fill one of the two vacancies alongside he and Reid. Also supposedly in Cowell's sights? Grammy nominees Nicki Minaj and Katy Perry.