How to clean your oven naturally. Spoon baking soda onto the yucky baked-on bits in the oven. Use a spray bottle and spritz the baking soda with water (don't douse with water, but don't be too skimpy either). Let it sit overnight and then wipe away with a sponge or paper towel. This actually broke-down the baked-on berry cobbler that was stuck to the bottom of my oven forever!!!