Modbus - timeouts/CRC error

I’m using Modbus TCP with a Waveshare RS-485 Interface.
Most communication request are failing with the first try

Error was I/O error, so resetting the connection. Error details: net.wimpi.modbus.ModbusIOException I/O exception: SocketTimeoutException Read timed out [operation ID 45495df7-0c98-4541-b620-a8290af21e6c]

and

Error was I/O error, so resetting the connection. Error details: net.wimpi.modbus.ModbusIOException I/O exception: IOException CRC Error in received frame: 5 bytes: 01 03 02 80 01  [operation ID 8f324d4c-be3f-492e-b9b9-efc165d79625]

and once a day, even the third try is failing. What’s wrong here?