Make it so LP can only be spent on non-combat skills. But a certain % of LP gets added to a separate combat LP which can only be spent on UA/MC/MM.
Currently, it's actively bad to raise both crafting and combat skills on one character, since they compete for the same resource. There's still a bunch of reasons to raise alts, but alts shouldn't be a way to boost character development.