SCCM and 32-bit remoting : cannot load the module ConfigurationManager

Trying to avoid to have to install an administrative client everywhere.

The general idea is we want to pop up a selection grid to assign a client to a SCCM DeviceCollection.

I want to build a ps1 script that just connects to the sccm host and fetches the information I need and later have me add the client to the selected DeviceCollection.

Problem is it refuses to find the SCCM folder in "c:\program files (x86)\..", hence it cannot load the ConfigurationManager modules.

All involved computers are running Powershell 4.0.

Is this a bug ?

Do I  need to add extra pssession attributes so my connection can access "c:\program files (x86)\..", or for it to be able to load the ConfigurationManager modules.

Is there a workaround ?