The Rays Own Roy Halladay's Soul

So I was talking with my friend tonight, right after Roy Halladay failed to get a win against the Rays for the third consecutive time within the last month. He didn't get the loss in this one unlike the other two and he pitched very well (1ER in 9 innings), but no matter what he can't beat the Rays.

Over the past two years he has fared quite poorly against the Rays in comparison to other teams, especially in the AL East, lets look at some splits

NYY 6-1/2.74

BOS 4-2/2.27

LAA 3-0/2.74

TEX 1-2/3.6

TAM 2-5/3.86

The only other team even close is the Rangers, and that is in half as many innings than what he has done against the Rays. He's only pitched 25 innings against the Rangers and 49 against the Rays, so this is better sampling of what he has done. 

Its hard to comprehend why he has such poor outings against the Rays. I think it all traces back to the stat that the Rays have the highest pitches against per inning than anyone else in the league. Even though they have some free swingers, the Rays make pitchers work and always seem to do this against Halladay.

I do realize 3.86 isn't too shabby, it's actually quite amazing. But it's about a whole run higher than his ERA in the past two years which was 2.78 in 2008 and 2.73 this year. 

My friend doesn't think that this is owning someone's soul, but I beg to differ. The stats themselves prove it. Even though 3.86 doesn't look like soul owning, I think in comparison to what he has done, especially against the better teams, it is. What do you think?