Do a Desktop install and then do apt-get remove ubuntu-desktop; apt-get autoremove and poof, you're almost as lean on install as you would have been installing from the Server disc to start with.

If you've adopted Ubuntu Server 18.04, and you want to add a desktop environment, Jack Wallen shows you how with a couple of easy commands.