Try Penzey's at Grand Central Terminal.
I get mine at The Spice House (online or Chicago).
While ginger is beneficial to health, the dried form is common in baked sweets (i.e. ginger snaps).
You could also try a Chinese supermarket since one of the best varieties of dried ginger is the China #1.