No, it is not in Philadelphia!  Doreen and I spent a wonderful day in Newport, RI during our time of study at Yale.  Here is a terrific overview of Newport and the library:

https://www.c-span.org/video/?438914-1/history-redwood-library-athenum