Thou shalt not make thee any graven image, or any likeness of any thing that is in heaven above, or that is in the earth beneath, or that is in the waters beneath the earth: 
Thou shalt not bow down thyself unto them, nor serve them: for I the LORD thy God am a jealous God, visiting the iniquity of the fathers upon the children unto the third and fourth generation of them that hate me, And shewing mercy unto thousands of them that love me and keep my commandments. (De. 5:8-10)
By John Calvin

Moreover, the rule which distinguishes between pure and vitiated worship is of universal application, in order that we may not adopt any device which seems fit to ourselves, but look to the injunction of Him who alone is entitled to prescribe. Therefore, if we would have Him to approve our worship, this rule, which he everywhere enforces with the utmost strictness, must be carefully observed. For there is a twofold reason why the Lord, in condemning and prohibiting all fictitious worship, requires us to give obedience only to his own voice. First, it tends greatly to establish His authority that we do not follow our own pleasures but depend entirely on his sovereignty; and, secondly, such is our folly, that when we are left at liberty, all we are able to do is to go astray. And then when once we have turned aside from the right path, there is no end to our wanderings, until we get buried under a multitude of superstitions. Justly, therefore, does the Lord, in order to assert his full right of dominion, strictly enjoin what he wishes us to do, and at once reject all human devices which are at variance with his command. Justly, too, does he, in express terms, define our limits that we may not, by fabricating perverse modes of worship, provoke His anger against us.

I know how difficult it is to persuade the world that God disapproves of all modes of worship not expressly sanctioned by His Word. The opposite persuasion which cleaves to them, being seated, as it were, in their very bones and marrow, is, that whatever they do has in itself a sufficient sanction, provided it exhibits some kind of zeal for the honor of God. But since God not only regards as fruitless, but also plainly abominates, whatever we undertake from zeal to His worship, if at variance with His command, what do we gain by a contrary course? The words of God are clear and distinct, “Obedience is better than sacrifice.” “In vain do they worship me, teaching for doctrines the commandments of men,” (1 Samuel 15:22; Matthew 15:9.) 5 Every addition to His word, especially in this matter, is a lie. Mere “will worship” ἐθελοθρησκίᾳ is vanity. This is the decision, and when once the judge has decided, it is no longer time to debate.

Excerpt from The Necessity of Reforming the Church, 1543

Westminster Confession of Faith, Chapter 21: Of Religious Worship, and the Sabbath Day

1. The light of nature showeth that there is a God, who hath lordship and sovereignty over all, is good, and doth good unto all, and is therefore to be feared, loved, praised, called upon, trusted in, and served, with all the heart, and with all the soul, and with all the might. But the acceptable way of worshiping the true God is instituted by himself, and so limited by his own revealed will, that he may not be worshiped according to the imaginations and devices of men, or the suggestions of Satan, under any visible representation, or any other way not prescribed in the Holy Scripture.

Westminster Larger Catechism

Q. 108. What are the duties required in the second commandment?
A. The duties required in the second commandment are, the receiving, observing, and keeping pure and entire, all such religious worship and ordinances as God hath instituted in his word; particularly prayer and thanksgiving in the name of Christ; the reading, preaching, and hearing of the word; the administration and receiving of the sacraments; church government and discipline; the ministry and maintenance thereof; religious fasting; swearing by the name of God, and vowing unto him: as also the disapproving, detesting, opposing, all false worship; and, according to each one’s place and calling, removing it, and all monuments of idolatry.

Q. 109. What sins are forbidden in the second commandment?
A. The sins forbidden in the second commandment are, all devising, counseling, commanding, using, and any wise approving, any religious worship not instituted by God himself; the making any representation of God, of all or of any of the three persons, either inwardly in our mind, or outwardly in any kind of image or likeness of any creature whatsoever; all worshiping of it, or God in it or by it; the making of any representation of feigned deities, and all worship of them, or service belonging to them; all superstitious devices, corrupting the worship of God, adding to it, or taking from it, whether invented and taken up of ourselves, or received by tradition from others, though under the title of antiquity, custom, devotion, good intent, or any other pretense whatsoever; simony; sacrilege; all neglect, contempt, hindering, and opposing the worship and ordinances which God hath appointed.

Q. 110. What are the reasons annexed to the second commandment, the more to enforce it?
A. The reasons annexed to the second commandment, the more to enforce it, contained in these words, For I the LORD thy God am a jealous God, visiting the iniquity of the fathers upon the children unto the third and fourth generation of them that hate me; and shewing mercy unto thousands of them that love me, and keep my commandments; are, besides God’s sovereignty over us, and propriety in us, his fervent zeal for his own worship, and his revengeful indignation against all false worship, as being a spiritual whoredom; accounting the breakers of this commandment such as hate him, and threatening to punish them unto divers generations; and esteeming the observers of it such as love him and keep his commandments, and promising mercy to them unto many generations.

Westminster Shorter Catechism

Q. 50. What is required in the second commandment?
A. The second commandment requireth the receiving, observing, and keeping pure and entire, all such religious worship and ordinances as God hath appointed in his word.

Q. 51. What is forbidden in the second commandment?
A. The second commandment forbiddeth the worshiping of God by images, or any other way not appointed in his word.

Q. 52. What are the reasons annexed to the second commandment?

A. The reasons annexed to the second commandment are, God’s sovereignty over us, his propriety in us, and the zeal he hath to his own worship.

Heidelberg Catechism

Q. 96.  What doth God require in the second commandment?

A. That we in no wise represent God by images, nor worship Him in any other way than He has commanded in His Word​

 

External Links:

The Scriptural Regulative Principle of Worship - G.I. Williamson

The Second Commandment - William Young

Principles & Parts of Worship - Sermon Series by Rev. G. Beers

Holidays – Purely Presbyterian