Maybe this is due to a wrong state format string in the item?
In the items metadata “State Description” set the pattern to %.3f %unit%
This should give your three fraction digits.
I do the something similar reading from modBus for momentary power and it works.
In my case the gain/offset is set to 0.01 W, pattern to %.2f %unit%