Yes, i think you need to stop the process. However it's not very clear from the documentation:
"If Weighted_Remote_Sessions is set as the managing policy, running processes continue to be managed, even if the Windows System Resource Manager Management Status is set to STOPPED."
This would imply an apposite behavior of what you are describing.
I would definitely try to stop the service and observe the behavior
Both of the resources I am using don't mention the behavior you are describing: