From your nginx configuration, I guess you want to route requests based on URL.
For sitemap and static file, create a cluster with one member 127.0.0.1:81, then create a regex matching context, use that cluster as handler.
Create a cluster with members 192.168.0.4,192.168.0.3,127.0.0.1:81, use...