What is messing with my plants?

I keep seeing all theses spots on my leaves but no indication of what is making them. As the last photo shows, it seems ants are interested in the flowers, but I don't see any damage from them so far.