Chewing Insect

The problem is likely chewing insects. Likely the caterpillar you photographed or could also be some type of beetle or grasshopper? Look to see if there are more- top and bottom of leaves, day and at night with a flashlight. If there are small black dots, these might be excretions for the insects. You can spray with an organic control effective against chewing insects such as Bt (caterpillars). insecticidal soap or Spinosad. Once the leaves and flowers are damaged, they will not recover but try to control future infestation. Bt is a contact insecticide and Spinosad has a 7-10 day residual. Spray Spinosad in the early evening after the bees have returned to their hives. Once the spray has dried on the plant it is safe for beneficials.