Jesse James, 46, was in the midst of adopting the five-year-old when he split from the Oscar winning-actress, 51, in 2010 after five years of marriage.
It was revealed he cheated on Bullock with multiple women, reported Female First.
"The painful part was about Louis, who we adopted. As bad as stuff was between us, we adopted a kid and things got kind of good for a little while and we had that kid to focus on, and, boom, it was over in 24 hours - gone, done.
James feels he should be given more credit for taking full responsibility for their divorce.
"The relationship part I was able to put (aside). I had to stand up in front of the media and take full account for what I did and I took it all. I took 100 percent of it right on the chin. Nobody does that. Everybody denies it.