Wrapping my head around what Publishing means in simple english with an example

As usual, Michael & Walt have provided excellent info. 

I'll add one minor correction to what Walt said. Storyline used to put "- Storyline out" at the end of the folder name where the published files are. However, they stopped doing that after a recent update. Now, the folder will just be named as per the course title.