For future records,
I believe the issue was that the default read timeout (1.5s) might have been too little for 9600 baud. Since you increased the baud rate, it was sufficient after all. Let’s see if this issue occurs again and if the default need changing. Actually, with little arithmetic we could probably calculate the time it might take to send a single modbus frame in total.