thy - yours,
"inward man" - the real you, has theological meanings, can be understood as "dwelling apart in himself with God" after he recieved God
"drink him with the draught of thy inward man" - let him through the wonderful spiritual experience as his inward man follows God.