It took me a while to get the hang of it but with practice I can now do barrel rolls pretty much whenever I want, and the real problem is firing them off accidentally at inopportune times
I play with an analog stick, so for me I just needed to get used to pushing to the full extent of the stick. For you, find a technique that works and practice