migration
Your jewellery is moving and your body is filling in the gaps it leave behind with tissue to avoid an open wound. It is VITAL not to clean this!
The most common cause of migration is sleeping on your new piercing, especially in the ears. Once the jewellery has settled into a spot that it isn’t being pressured to move from, the bumps will dry up and fall off on their own.
Don’t think that cleaning or soaking the bumps will help because it won’t!