In a small bowl, whisk together the mayonnaise, mustard, black pepper, and cayenne pepper until combined. Add the mayo mixture, pickled veggies, eggs and celery to the potatoes and stir gently to combine. Season with salt and pepper, to taste. Cover and refrigerate at least 30 minutes before serving. Can be made up to 2 days ahead of serving.