Have you tried merely placing a pillow behind your lower back.
I also find that office chairs these days "recline" too much.
I prefer to be able to lean back and NOT end up lying down.
My chair...no matter what levers I pull, push or turn, always tilts back when I lean back....and then I end up slouching. I wish it would remain upright.