I could be wrong but I don’t think you can use them with your sitemaps. Habmin is mostly self contained and independent from your sitemaps. The only way they could work is if Habmin supports some sort of REST API that lets you request the Chart directly from outside itself.
I’d recommend reporting this problem as an Issue. It is clearly a bug in the charting servlet.
Finally, one more alternative is to use the following:
