Did the early church allow statues and images in church?

Protestants are against having statues and images and often quote Exodus 20:4, but Catholics and Orthodox Christians have beautiful statues and images in their church, but did the Early Church Fathers have statues and images in church and did they support the usage of images and statues in the church?