In the frame, there is always something, anything; it is all over the picture.
Thus, whatever seems to be all black or all white is not ever nothing. There was (is?) a referent, a piece of reality this part of the picture refers to.
In one of the most brilliant books on photography (Camera Lucida. Reflections on Photography), Roland Barthes understood that this is a crucial aspect when it comes to the nature of photographs.