Are you changing your name? Don't think we're only talking about the wife - some states allow men to adopt their wife's last name, and some states permit civil union partners to change their names. Federal agencies generally don't recognize name changes for men after marriage which means the man would need to go through a legal name change authorized by a court.
What does it mean if your name is on someone else's bank account? It depends.