>>527380974
They're completely opt-in.
Even after starting the duel, if they're too strong you can just run away from them, you're not locked into an arena or something.