Yes exactly. Whichever party has a stranglehold in a given state/county/whatever will object because ranked choice voting has the potential to allow previously marginal (or zero chance) candidates to be elected.

Democrats are not inherently more fair-minded than conservatives. Both parties’ (all parties, actually) first priority is to maintain power. Everything else is secondary to that.