Sweet banana peppers go from green to red.

Hi

I'm growing some sweet bananas, which you're seposed to harvest while they are yellow, as far as I understand. But my peppers seems to go straight from green to red. I'm not sure if this in because of a lack of sunlight or what?

I've tried to taste both the green and the red ones, but they still taste very unripe and lacking flavor. Not how I imagined they would taste from the descriptions I've gotten at all.

Am I doing something wrong? Should I just let them mature fully? Do they loose allot of their appeal once they are fully mature/ripe?