There's Summerstage in Central Park.
There's The Washington Square Music Festival.
I went to Madison Square tonight to see some bluegrass from the Kenny & Amanda Smith Band.
The music was great as were the sights of the park at sundown.
All of this music in the parks is free and I highly recommend it to anyone who lives in the Big Apple.