Many Black Republicans would lose their power, and most of the political power of the Republicans in the south rested on African-Americans votes. The 15th amendment was ratified primarily for that reason (not because they were anti-racist, they were just anti-Democrat).