My experience with drummers and backing tracks echoes everybody else's comments... and I'd add that the drummer tends to drown out the click track and take over the beat, leading the whole song down the toilet.

If I were to try this again, I'd get some kind of light that follows the beat of the click track, and everybody in the band could follow the light's tempo, which could never be drowned out.