Can I be forced to answer a question in court?

I know that in the US, you can refuse to answer if you are the accused. If you are a witness, you must answer or you can be held in contempt.