Curiosity is when you're reaching out to find out about a thing (let's call it X) which you want to learn more about.

Feeling stupid is when you're confronted with an external you cannot understand why it works.

Curiosity can help push through feeling stupid, but you can be curious about something you won't struggle understanding it at all.