A question about Catholic Jesus's mother?

I'm guessing that everyone assumed Joseph was the father, or at least was willing to accept responsibility.