Virtual try-on for beauty uses a phone or laptop camera to overlay make-up on a live face, and AI shade matching estimates skin tone and undertone to recommend a foundation or concealer shade. The overlay is a solved problem in most respects. The match is not, because a camera does not measure colour: it reports it after white balance, exposure and screen settings have had their say.
So we design around calibration. The system checks lighting before it estimates, asks for a retake when the light is wrong rather than guessing, and recommends a shade with an honest neighbour (the next shade lighter or deeper) when the estimate falls between two. It is tested against the full depth of your range, with results reported separately for each tone band so a weak band cannot hide inside a good average.
The face is personal data under GDPR, and the EU AI Act prohibits using biometric data to infer characteristics such as race or ethnicity. We match on measured tone and undertone only, process images for the session, and do not store them unless the customer explicitly asks.