Ankit i have the exact same setup and the exact same problem.
If i cover one side of my phone with my hands or body it cuts out intermittently. If i keep my phone on my left pocket , same problem.
I honestly love the looks of it but it’s just so frustrrating. Reason why I’m moving to wired via SIMGOT EW300DSP
EDIT
I have to update, one of the comments mentioned using AVRCP version from default 1.6 to 1.4 , its waaay better now. Almost no stutters