Ghost shrimp and Betta

Hi. After my old Betta died, I decided to leave the tank Betta-less
for a while. In the interim I got some ghost shrimp, because they
looked interesting. This morning I got another betta. However, I've
noticed the ghost shrimp being very agressive with the Betta - grabbing
onto his fins with their claws. He swims around violently for awhile
and eventually shakes them off. My question is, should I get rid of
the ghost shrimp, or just trust that the betta can take care of
himself?

I've put the shrimp in a small bowl by themselves for now, until I
decide what to do, but I don't want to keep them in there permanently.

Thanks,

-RN