Hi Erik,
I would suggest it's the damper, not the springing.
While doing the testing for the set up for the modified steering stem springing /damping I found the Koni damper to be the hardest for small undulations/rough surfaces, to the extent it felt rigid compared to the others (standard, Armstrong, Thornton and AVO), while doing the testing I had a Koni on the back and found this was affecting the feedback I was getting from the front so swapped to an AVO on the back, by the way I weigh nearly 130kg so no lightweight.
But for real comfort I would suggest you changed to a fully sprung seat.