Firstly thats you A/C compressor, yes it should have a belt that runs of the crank, it also should have a tensioner pulley there as well. This won't effect your heater only the A/C.
If you have no thermostat then you engine will probably be running cold, this will reduce you cars heating...