Off the derech

You may have heard the phrase "off the derech". It's used to describe someone who, though formally Orthodox, has left strict Orthodox observance - "derech" being Hebrew for "way" or "path". Now, as I mentioned last post, I'm not, nor have I ever been Orthodox - as anyone who sees that I am posting on the 8th day of Sukkot can attest! - but, philosophically speaking, can someone who has never been "on the derech" be described as being "off" the derech?