I went on a weekday on the later side -- definitely after 2P. I did wait, but it was only about 5-10 minutes.
This will probably die down in a few months. Remember when the first Beard Papa opened up on the UWS? The lines were down the block. It's much more manageable now.