Glory ye in his holy name - The original word rendered "glory" is the same word which is commonly used to denote "praise," and it has that meaning here. The idea is, In your praises let the main subject be the name of God - that holy name by which he chooses to be known. The Hebrew is, "the name of his holiness." It implies
(a) that we should rejoice in God - in his very name - in that by which he chooses to make himself known;
(b) that it is a special subject of praise and rejoicing that his name is "holy;" that is, that he is a holy Being.
This can be a subject of real rejoicing only to those who are themselves holy; but properly considered, one of the highest reasons for rejoicing in God is the fact that he is holy; that he cannot look upon sin but with abhorrence. There would be no ground of confidence in God if this were not so.
Let the heart of them rejoice that seek the Lord - That desire to know him; that come to praise him. Let their hearts rejoice - or, let them be happy:
(a) because they are "permitted" to seek him;
(b) because they are inclined to seek him;
(c) because they have such a God to come to - One so mighty, so holy, so good, so gracious.

Glory ye in his holy name - Show the name Jesus: exult in it - praise it. His name was called Jesus; because he came to save his people from their sins.
Let the heart of them rejoice - That is, the heart of those shall rejoice who seek the Lord: therefore it is added: -

Glory ye in his holy name,.... In the knowledge of it, as proclaimed in Christ; in being called by his name, and in having the honour to call upon his name; in the holiness of it; and in Christ being made sanctification as well as righteousness, in whom all the seed of Israel are justified and glory; as they may also of interest in him, and communion with him.
Let the heart of them rejoice that seek the Lord; while he may be found, and where he may be found; who seek him in Christ, and under the guidance and direction of his Spirit; who seek him with their whole hearts, diligently and constantly. The Targum is,
"who seek doctrine from the Lord.''
Such may and should rejoice in him, and in him only; and that always, as they have reason to do, even in their hearts, since they that seek him find him; and whether it be at first conversion, or afterwards, or when he has for a time hid his face; it must be matter of joy to them, even to their very hearts, to find him whom they seek.

Seeking God's favor is the only true mode of getting true happiness, and His strength [Psalm 105:4] is the only true source of protection (compare Psalm 32:11; Psalm 40:16).
Glory . . . name--boast in His perfections. The world glories in its horses and chariots against the Church of God lying in the dust; but our hope is in the name, that is, the power and love of God to His people, manifested in past deliverances.

Glory - Glory in the God whom you serve, as the only true God.