Found the fix for rotation, just move colliders to new empty objects. That look like a lot of repetitive work, so maybe so...

Found the fix for rotation, just move colliders to new empty objects. That look like a lot of repetitive work, so maybe some Tool for that would be nice. Hmm... Unity interface compared to Blender is just so immature...