When you delete a role from Identity Repository -> Roles -> Delete Role, it should remove the role from all users. 
You need to remove the users from the role before inactivating the role so that the user does not have that particular access linked to the role. 

Also the role wont be entirely deleted. The role_name will be appended with "_deleted"