I think you can do stuff like this with OrangeAssist - Google Assistant Integration.
My only comment is you’ve actually posted a while bunch of hard problems to solve even before you get to the voice conversation. Room occupancy is one of those problems that seem easy but often ends up being unsolvable, for example.