Hey Thorkell,
Nice little town you have here.
I played a lot with seafarer and have run into similar problems many times.
Here are two things that greatly helped me to generate enough food: (even with ironman mod and harder settings)
-Don’t use a fishing pier to fish, but only fish for crayfish in the creek since you will produce fastly more food this way. (it is more micromanaging though)
-You have a high ratio of children to adults and since children don’t work you have more mouths to feed with less citizens gathering food. What helped me was to not build new houses too often so children grow up and then build new houses so you always have just a few children and grow your population a bit slower. It might take a bit of trial and error to find a balance that works for you.
.
