You're just saving the system's memory to a different medium.

This isn't just limited to emulators.
Like the original Action Replay for the C64 that would let you save state on original hardware (which is a good way to skip loading a game from tape for an eternity)