After doing some more reading I think I know what caused the leak. After having the other caliper replaced, they probably topped off the brake fluid. When I compressed the caliper piston the fluid probably had nowhere else to go. I guess my real question is whether or not I need to repair it at all, will the o-rings re-seat themselves or are they completely ruined, same for the boots?