Brian Duffy, the company’s chief executive, reflects on growth, philanthropy and a new opportunity in jewelry.