...that look of sheer fear on his face is not a depiction of someone who could hold his own.
To be perfectly fair to Ryoga, no one has
ever come to a good end spurning a female (or in this case, occasionally female) "love interest". "Hell hath no fury..." and all that.