You need to go to Publish > Web > Design > Chat window then click on the different chatbot’s messages sections to change the design :
Options appear on the right :
