Even shimming it would’ve been ok. McMaster car makes this super thin shims that work great .In my head at least, it's better to do what you did than to have it too thin and have to shim something like that.
This thing has plenty of meat on it though so it’s not even a thought