When was the first curve ball in baseball?

The first curve ball in baseball was in 1867.

Candy Cummings, pitching for the Brooklyn Excelsiors in April of 1867, threw a curve ball that brought him great joy, but caused concern for baseball traditionalists as unfair and cheating.