IK without bones?

I've been messing around with constraints for a good while and I can't seem to figure out how to constrain these objects. My goal is to be able to control the latch with an empty as an IK point but I'm not sure how. Any advice?

http://pasteall.org/blend/index.php?id=48407