The Tigers hooker collected his fourth senior cap as a 46th-minute replacement, by which time the Islanders, who included his Leicester colleague Seru Rabeni at centre, were down to 14 men.
France won 42-17 to follow their home win over Argentina a week earlier. Kayser has been retained in the squad for the final match of France’s autumn programme against Australia.
The Aussies also collected a second successive win, defeating England 28-14 at Twickenham.
Tigers flanker Tom Croft came through the full 80 minutes in his sixth senior Test, while club colleagues Harry Ellis and Toby Flood both collected their 20th caps as second-half replacements.
Marcos Ayerza also hit the 20-cap mark after coming off the bench with less than half an hour played in Argentina’s 22-14 win over Italy in Turin.
Geordan Murphy has rejoined the Ireland squad in preparation for their Test against Argentina, while England host South Africa on Saturday and the Pacific Islanders conclude their tour in Italy.