Can I give my guinea pig a bath?

You can. You don't necessarily need to, but you can use some baby shampoo with nice warm water, ensuring that you dry them completely when they're done to ensure they don't get too cold.