Complication layouts affecting each other

I’m trying to adding layouts to complications, so if the user picks any, things are still aligned.
Text only: text in the middle
Icon+Text and Text+Title: equally proportioned
Icon+Text+Title: Text is in the middle, the other two equally proportioned

I can’t seem to adjust one without affecting the other layouts within the same complication settings. Am I doing something wrong?

As far as I know the icon, text and title part for any complication is fixed so if you change the layout this doesn’t actually change the placement.