I usually hate when I see sign __ maybe because English is not my mother tongue. I tend to believe for us foreigners it is better to have two completely different terms.
Yes. For many non-natives, they have to get over the meanings of "up", "in", and "out" before proceeding, and the predictable questions of how one signs "up" versus signs "in".
If you're using an English language website, I think understanding the three words you mention (up, in and out) in context and as modifiers would be required before understanding any significant content. I don't believe the term 'sign in' is esoteric or difficult to grasp, as with its opposite 'sign out', and 'sign up' has a long, long, usage in English for subscribing to something, joining a group, etc.
Sign up is required to join the website, sign in is required to access the website later, and sign out is the opposite of sign in.
That said these questions are always difficult because differing cultures/usages/dialects, even within one language, can dramatically affect comprehension. So a site really has to be tailored to the particular audience it seeks - a site in the US, the UK or India might use very different terms depending on the particular content it covers. But if you're targeting native speakers of English in most idioms I'm familiar with I think the terms above are pretty clear, and made clearer by using the same verb; other choices make them sound like unrelated actions, which they are not.
These composed verbs, whose meaning depend on the modifiers, are definitely confusing.
You can go a long way without mastering them, and their meaning (assuming there's only one) isn't always easy to infer from the roots. Think of getting off, for example.
Some of the combinations are still not part of my passive vocabulary[1], and most are not part of my active vocabulary, because I can usually get away with synonyms.
For this scenario, "log in" and "register" offer the best syntactic contrast, and should be favored, IMO. "Sign in" and "sign up" require more thinking. Pet peeve of mine, actually.
[1] There was a vocabulary depth study posted here on HN a while ago, I was at the 95th percentile of non-native speakers, equivalent to the median of natives of my age.
Sign in/out/up in English correspond to actions you might take in your daily life (eg signing in to a visitors' book at a meeting), whereas most people would only have come across log in within a computer related context.
Many non-native English speakers primarily get in contact with English in computer related contexts since they live in a non-English speaking country and use English language websites.
This group of customers may be larger than the group of native speakers depending on your target audience. So optimizing for non-native English speakers living in non-English speaking countries is something which should be considered.
Not saying you are wrong but I usually don't need to stop and think when I see "login" but I always do whenever I see something else. English is kinda easy to understand, even a "pull" or "push" sign on a door is easy to understand but it doesn't get easier than having the handle only on one side of the door. I'd apply the same logic to "login", using whatever everyone is using even if it's not correct or making the most sense.
As a non-native English speaker I have to disagree here. Was using the web long before I could get those things right. And I can assure you many Swedes would fail to get English particles and prepositions right. And they are still able to use most English websites without much if any problems.
Getting particles (eg. "in" in "sign in") and prepositions right is one of the hardest parts of learning a new language. (Word gender for languages with that feature is another hard part.) You can understand almost everything of a website just from understanding verbs and nouns.
If they were unrelated, it would be a problem to have similar naming, but in fact they are all related actions.