I use File > Quit to close my browser and all of my windows restore just fine.

If Firefox doesn't restore all your windows on startup, try hitting ctrl+shift+n, that should reopen the last (non-private) window you closed. In my experience this works across sessions, as long as you don't erase the browser history.