Bumpmap giving me odd behaviour.

So I'm trying to get better at making game assets, and I'm at the texturing part now. All the UV's and everything is generated, except for the ones I'm baking to. But when I plug this generated texture into either bump>normal or right into the displacement it gets stretched and distorted as if the UV's are off. Texture looks fine in the regular output, so I tried baking it, opening it up as an image texture (which also looks fine with no stretching), but it still gets the same streched effect when using it as a heightmap, it makes no sense to me. I even tried deleting my other UV maps so I was only left with the one that uses this texture and nothing changed. Hopefully someone here with more experience has a clue what's going on and could help me get back on track. Here is an image to help explain.