Jamieson, Fausset and Brown on Jonah 2:4

4. cast out from thy sight--that is, from Thy favorable regard. A just retribution on one who had fled "from the presence of the Lord" (Jon 1:3). Now that he has got his desire, he feels it to be his bitterest sorrow to be deprived of God's presence, which once he regarded as a burden, and from which he desired to escape. He had turned his back on God; so God turned His back on him, making his sin his punishment.

toward thy holy temple--In the confidence of faith he anticipates yet to see the temple at Jerusalem, the appointed place of worship (1Ki 8:38), and there to render thanksgiving [Henderson]. Rather, I think, "Though cast out of Thy sight, I will still with the eye of faith once more look in prayer towards Thy temple at Jerusalem, whither, as Thy earthly throne, Thou hast desired Thy worshippers to direct their prayers."