Welp... Looks like it won't work.. Protools seems to be very finicky..
Basically variable bit-rate of H.264 and also the AAC audio codec can really mess with the timeline / preview in ProTools.. it's not "Frame Accurate" as a codec.
Anyway.. it looks like you'll have to re-encode... my personal preference for a really small file (compared to others) is PhotoJPEG set to 98% quality.. (it looks stunningly uncompressed, and takes a fraction of the size something like animation or Motion JPEG might take)