Deep-pocketed buyers kept the luxury sector chugging along last year, as the overall market struggled under the weight of inflation and high mortgage rates.