I have a family of carpenter bees in my patio stair railing (iron). I’ve just repainted it and that’s when I’ve noticed that they keep entering the pipe on one end with nearly cut green leaves.

Should yi actually be concerned about them? One of them did fly aggressively around me before when I kept banging on their pipe (unrelated to them being in their) but no sting.