Simon Cowell Quitting 'The X Factor' UK Edition?

First Cheryl Cole won't confirm her return to UK version of "The X Factor," now Simon Cowell too?

The mogul and infamous workaholic reportedly told someone at ITV that he will not be able to join the judging panel for this season of the British hit series.

Apparently even workaholics need a break.

Currently Cowell is running both versions of "Factor," producing both versions of "Got Talent" and is also working on ITV's new game show "Red Or Black." Even if he were to only be at the live tapings of "Factor" he would be required to shuttle back and forth from the U.K. to L.A. multiple times a week.

That's enough to tire anyone out, even Simon "Judge Dread" Cowell. This leaves execs across the pond in a bit of a scramble with auditions starting this month.

Speculation as to why Ms. Cole has not resigned leads us to believe that she may be joining Cowell on the American edition. If so, Cole, Cowell and record exec L.A. Reid would still be looking for one more judge.

A number of big names have been considered for the U.S. spot including former fellow "Idol" judge Paula Abdul.

ITV declined to comment on the rumors but it will be interesting to see who fills the vacancies in the U.K.