Intrinsic and extrinsic effects on image memorability.

•Intrinsic differences in memorability exist at a fine-grained, within-category scale.•Image context and observer behavior predictably affect memorability.•Context effects are modeled using an information-theoretic framework.•Eye movements can be used to predict if an image will be remembered later.