Now if the author is bummed by the "mathematics" of SICP he sure will have himself handled pretty roughly by TAoCP :)
disclaimer: I haven't read SICP but as others have pointed out I doubt there's any significant math in it. I presume the author was referring to a heavy dose of informal reasoning.
TAoCP should be enough for anybody