King David was feeling this way when the Holy Spirit breathed in him the words below. I've chosen to give the New English Bible translation, since I think it has the best poetry, even though I have made changes here and there. If you'd prefer an older translation, here is a good one. And if you'd prefer newer language, here's another good one.
Be gracious to me, O God, in Thy true love;
in the fullness of Thy mercy blot out my misdeeds.
Wash away all my guilt
and cleanse me from my sin.
For well I know my misdeeds,
and my sins are with me all day long.
Against Thee, Thee only, have I sinned
and done what displeases Thee,
so that Thou canst be proved right in thy charge
and just in passing sentence.
In iniquity I was born
and my mother conceived me in sin;
yet, though Thou hast hidden the truth in darkness,
through this mystery Thou dost teach me wisdom.
Take hyssop and sprinkle me, that I be clean;
Wash me, so I become whiter than snow;
Oh, let me hear the sounds of gladness,
let the bones which Thou hast broken dance for joy.
Turn away Thy face from my sins
and blot out all my guilt.
Create a pure heart in me, O God,
and give me a new and steadfast spirit;
do not drive me from Thy presence
or take Thine Holy Spirit from me;
Revive in me the joy of Thy deliverance
and grant me a willing spirit to uphold me.
I will teach transgressors the ways that lead to Thee,
and sinners shall return to Thee again.
O LORD God, my deliverer, save me from bloodshed,
and I will sing the praises of thy justice.
Open my lips, O Lord,
so my mouth can proclaim Thy praise.
Thou hast no delight in sacrifice;
if I brought Thee an offering, Thou wouldst not accept it.
My sacrifice, O God, is a broken spirit;
a wounded heart, O God, Thou wilt not despise.
Let it be Thy pleasure to do good to Zion,
to build anew the walls of Jerusalem.
Then only shalt Thou delight in the appointed sacrifices;
then shall young bulls be offered on Thine altar.
Glory be to the Father, and to the Son;
as it was in the beginning, is now, and always will be. Amen!
חָנֵּ֣נִי אֱלֹהִ֣ים כְּחַסְדֶּ֑ךָ
Holy Spirit / King David
tr. NEB, alt. MDS