Recognition Through Observation and Memory