Even with 2 weeks off I lost very little for my lifts.
That's normal. Two weeks off is probably just what the doctor ordered, and is necessary to heal up completely. Your lifts will probably go up past your previous numbers now that your body has been reset. Occasional breaks are necessary in order to keep progressing. Your body will tell you when it's time, and as long as keep your diet in check during those breaks you'll be fine.
Insert profound martial arts quotes or tough guy phrases here.