Nothing bad at all will happen. It is all about personal choice and comfort. The only suggestion I'd make here is to wear a comfortable cotton bra or a camisole with a built in bra. There are no medical studies whatsoever that prove wearing a bra at night is unhealthy