You need to go to Publish > Design > Chat window.
Then click on the user bubble. You can change the font on the right :
Then do the same after clicking on the bot’s bubble :
