You are correct. Let 'em grow. They are part of what makes a healthy reef aquarium. They have a fascinating way of capturing food. They send out a sticky mucous net. Particles in the water floating by will stick to the net. After a little while the net is drawn back and most everything, including the net, is eaten. This helps clean the water and in turn makes the aquarium cleaner.
Aloha,
Mark