ISA is a ruby gem for comparing screenshots over a testing session. We use it in combination with the device_api gem to capture screenshots during video playback tests and confirm that video is actually being played.
ISA uses ImageMagick to do the actual image analysis, but presents a simple interface that lets you concentrate on writing your tests.
It also generates animated gifs of the testing session, so we can visibly check any problems the tests find.