That's all. Now, you can see that the color you've chosen is applied to the entire document.
If you want to revert, then follow the above steps and make sure to choose the "white" color in Step 4.
Remember that if the color you've selected is the default page color, then you can't see "Set as default" button. Instead of that, you can see "Saved as default" text.