The City of Newburgh's mayor is touting what he calls a historic turnaround for the city and the return of a beloved festival