Actually, at the time Quebec was one province together with Ontario, so joining the Confederation would actually increase their rights to their own language and culture.
Their fears were rather that the central government would have too much power and if ever a conflict between the province and the Government shall arise, the province would loose