For me the arm64 image works without issues on a RPi 4 running Ubuntu 22.04.2.
I think the main difference between those OH versions is that Debian 11 is used as base image since OH 3.2 (instead of Debian 10).
Do other Debian 11 based images work properly for you?
The openjdk:11 image also uses Debian 11 and Java 11 so you could test if that works by just letting it print the Java version:
docker run --rm openjdk:11 java --version
If you run an old Raspberry Pi OS version as host OS it does not properly support time64. Java would also complain about this by printing “No monotonic clock was available”. But I would not expect this to be an issue if you run a recent bullseye based Raspberry Pi OS version.
Perhaps you can also post the output of:
docker info