Children tracking dirt in on their feet?
Children playing in dirt/sandbox and throwing dirt/sand which then gets carried by wind?
The Dog? (yeah, always blame the dog! )
Uninvited animals cooling off/getting a drink at night?