Agreed, as long as you don't overreach, blow up the scope of the feature, and slow down your team.

More likely if we need a large refactor or architecture change, I'd like to see an RFC, separate ticket, and consensus around the change.