The scale factor can be used to scale down (or up) everything that is not the actual pattern itself. Things like font sizes, arrow sizes, logos, scalebox, line width and so on.

It was specifically created to accommodate patterns for doll clothes and other situations where the text and snippets would become too large in comparison to the pattern.

You need to enable Expert mode after which you can find the scale setting under Advanced.