You might find some info here:
http://query.nytimes.com/gst/fullpage.h ... wanted=all
Some sites seem to point to Samuel Pepys as the author:
http://books.google.com/books?id=ZClQAA ... &ct=result
I also found this:
In the process of researching this, I came across a little poem about the four Inns. I saw several versions of it, and the one I’m quoting here, I think is from Howell’s English Proverbs of 1659.
Gray's Inn for walks,
Lincoln's Inn for a wall;
The Inner-Temple for a garden,
And the Middle for a hall.
It is in Howells', p.172 (with no source):
http://books.google.com/books?id=vOKyki ... #PPA172,M1