What are these yellow caterpillars invading my plant? 
A: Genista Caterpillar

This is a Genista Caterpillar. They eat leaves on plants in the pea family. They eat in groups and spin webs to protect themselves from predators. The best thing to do is break open the webs and physically remove them. The birds like them.

Related Videos:
Caterpillars on Parsley
Bagworms: What Do You Do in the Summer?

Related Resources:
Genista Broom Moth / Genista Caterpillar
Genista Caterpillar on Texas Mountain Laurel