I think when you start looking back over previous days, you would still run into this problem with rrdj4. By design, it compresses and so averages old data.
You may need to consider another persistence DB (you can have more than one at the same time).