It will tear it up the concrete and the glue with stick to the metal when it heats up - this will not be good.
We use some stuff from the big box store called "Goof Off" to get some old adhesive off concrete left over from some VCT. Comes in a yellow 1 gallon container.
Put it on, let it sit long enough (<--this is the key), and scrape it off.
Don't get it on your arm or leg; the wire wheel would feel better.