I have been playing with (rather terrorizing) jawfish recently. As you creep up on them they skillfully swim backwards into their homes, but if you go slow get close then race up on them I found they turn first then dart inside their holes.

This suggests to me that they are better swimmers going forwards than backwards...
Let me know if you try this what results you get.

I find these fish really amazing with the ghostly coloured skirt and their homes (holes) in the sand. Apparently they have one for the man one for the woman and a honeymoon suite ,so 3 holes. Thanks Dorte from tylls diving for that info.