When was the first stolen base in baseball?

The first stolen base in baseball was in 1863.

The first stolen base of record. Ned Cuthbert of the Philadelphia Keystones ran from first to second before the ball had been hit. He was laughed at for his blunder. However, he indicated that there was no rule against it. Thus, the first stolen base in baseball history.