Link was alone. He wandered through Hyrule looking for someone--anyone to take him in, but was unlucky in his journey. Eventually he went back to the home he left so many years ago: Kokiri Forest. When he arrived he was shocked to find that the controversies hadn't actually reached the woods. No one knew about his adultery, no one knew about his addictions. He was free to start over. Free to ignite an old flame.
In these woods lived Saria, Link's childhood sweetheart and one of the Sages that helped him lock Ganondorf away. She still loved Link, even though she knew their love would be taboo. The Kokori are ageless, meaning that, physically, they still appear to be children even if, mentally, they're matured. Link, meanwhile, was physically in his mid-twenties, even though mentally he was still a teen. Scandalous, sure, but if you think about it, he was actually robbing the grave.
There he made his home, and eventually faded away--lost to the forest, to the trees, to the woods, and to time.