Charles H. Spurgeon on Psalms 116:19

In the courts of the LORD'S house: in the proper place, where God had ordained that he should be worshipped. See how he is stirred up at the remembrance of the house of the Lord, and must needs speak of the holy city with a note of joyful exclamation —In the midst of thee, O Jerusalem. The very thought of the beloved Zion touched his heart, and he writes as if he were actually addressing Jerusalem, whose name was dear to him. There would he pay his vows, in the abode of fellowship, in the very heart of Judea, in the place to which the tribes went up, the tribes of the Lord. There is nothing like witnessing for Jesus, where the report thereof will be carried into a thousand homes. God's praise is not to be confined to a closet, nor his name to be whispered in holes and corners, as if we were afraid that men should hear us; but in the thick of the throng, and in the very centre of assemblies, we should lift up heart and voice unto the Lord, and invite others to join with us in adoring him, saying, Praise ye the LORD, or Hallelujah. This was a very fit conclusion of a song to be sung when all the people were gathered together at Jerusalem to keep the feast. God's Spirit moved the writers of these Psalms to give them a fitness and suitability which was more evident in their own day than now; but enough is perceptible to convince us that every line and word had a peculiar adaptation to the occasions for which the sacred sonnets were composed. When we worship the Lord we ought with great care to select the words of prayer and praise, and not to trust to the opening of a hymn book, or to the unconsidered extemporizing of the moment. Let all things be done decently and in order, and let all things begin and end with Hallelujah, Praise ye the Lord.