Wash the caliper up well and see if fluid still leaks from this area. Could just be overspill from hooking it up or bleeding the brakes.
If it is still leaking, then use the caliper as a core and go get a reman. You can get the caliper alone (no pad support bracket) for under $30 plus core off rockauto.com.