Lightness perception has mainly been studied with static scenes so far. This study presents four experiments investigating lightness perception under dynamic illumination conditions. We asked participants for lightness matches of a virtual three-dimensional target moving through a light field while their eye movements were recorded. We found that ... the target appeared differently, depending on the direction of motion in the light field and its precise position in the light field. Lightness was also strongly affected by the choice of fixation positions with the spatiotemporal image sequence. Overall, lightness constancy was improved when observers could freely view the object, over when they were forced to fixate certain regions. Our results show that dynamic scenes and nonuniform light fields are particularly challenging for our visual system. Eye movements in such scenarios are chosen to improve lightness constancy.