You’re probably talking about ammonium nitrate specifically. And once you’ve made your explosive with it, you still need to make something to detonate it, since it’s pretty stable without that; it’s not like sweating dynamite.

ANFO was used to blow up the Alfred P. Murrah federal building in Oklahoma City, so the feds take that pretty seriously.