Useful read:
http://www.rcindia.org/multirotors/puller-propellers-using-pusher-propellers/Regarding heating, first line of action is to check if your motor is pulling more current than required. This could be due to:
1. Motor Jamming - should turn by hand freely with the rotor lightly snapping on at fixed positions
2. As per design - Maybe your motor and ESC are mismatched, maybe your motor is designed to pull more current than what the ESC is designed for. Use an ampere meter to check for current draw.
3. Overspeced Prop- Are you using the recommended propeller?
4. Overspeced battery - Are you using the recommended battery (2s/3s/4s)?
5. Inverted Prop - Since you've been fiddling with the propeller direction, are you sure that your prop is running in the correct direction, Leading edge should strike air - leading edge is marked by number written on prop - see link above
6. WOT - Are you running Wide open throttle all the time, on ground?