pathfinder

I stumbled upon this and couldn't find any definite answers.

The Escape action states that you can use Athletics, Acrobatics, or your unarmed attack modifier. However, it specifically says that you use your modifier and not an actual attack. While fists have the Finesse trait, the regular attack does not - so am I correct in assuming that if you have a higher Dex than Str, that you can only use Dex with acrobatics, not with the unarmed attack modifier?