Where did the heat from the Big Bang go?

It went, mostly, into the cosmic fireball radiation but because of the expansion of the universe, this radiation was redshifted into the microwave spectrum and is invisible optically.

Most of its energy was lost to the work expended by it against the gravitational field of the universe over billions of years.