The smallest damage I've noticed is probably 0.5. I'm sure the maximum you can ever scrape a wall is twice before losing 1hp... I don't think I've ever managed three scrapes before dropping by 1.

I've seen 2 scrapes = 1hp many times in my uploaded videos, but never any more... or perhaps they're just that much rarer?