Place a redstone block behind the dispenser, then break it, and then break the dispenser as well.