Thumbnails on Videos

I have added two videos into a lesson. Both just show as black boxes with the start arrow on them. Is there a way to put a thumbnail over it so it's more interesting than a black box? I've created t...