NP202Wn - Do I have to install the HomePlug Configuration Utility on every single computer?

No. The HomePlugs can be configured from one computer with one installation.