I guess I will be trying some tracking tonight. :)
I see the wobble you refer too and of course the GoPro distortion but the second shot in particular still looks pretty good to me. I've not tried the tracking yet on GoPro but I will refer to the Mocha AE tutorial that addresses just that and see if it works on footage distorted to this degree.
Eric