You have assigned the users in the campaign while creating it. Now, you can use "Users" tab to unassign and assign the users in the campaign.
Figure: User Management
You have to perform the same steps here, which you have performed to assign or unassign users while creating the campaign.
Perform the following steps.
To unassign the users, select the users in "Assigned "Users" section and icon.