The Jizya wasn't universally a heavy tax, sometimes it was a meagre tax depending on the Sultan, place, and time period, and held a lot of exemptions for the poor, women, children, elderly, etc. Plus the tax was abolished near the end of the 19th century, although admitedly, the Ottoman empire only had about two decades to exist into this progressive policy. But non-muslims who served in the Ottoman military, during when the Jizya was still a policy, were excluded from the tax.