The author attempts to answer the question of the title of this article by dealing with the basis of baptism, and specifically infant baptism, as understood from the Presbyterian view. The main points of the arguments include baptism as established by the Lord Jesus, and its relation to the covenant of circumcision in the Old Testament.