XR ITK, climbing and gravity

Another day, another question : D
I am currently trying to implement climbing on the basis of the XR Interaction Toolkit samples.

I would like for the player to fall down when letting go of the climbing surface, so I set the continuous movement provider to immediate gravity.

However, this has the side effect that on certain climbing surfaces, for some reason, the player starts to fall down, just to get snapped back half a second later. Continuously.

How do I deal with this? I can't find any resources online except for the basic setup.

• is my general approach correct and the climbing surfaces are the issue?
• should climbing never be used with immediate gravity?
• looking at the documentation, only one locomotion provider should have access to the player at one time, so why is this even happening?

I hope someone can shed some light on this, I have no clue how to proceed