Widgets are small  blocks of content (sometimes static, sometimes dynamic) that you can put into Sidebars (usually along the side or in the footer of your site).  Widgets can list your latest posts, a menu of pages or other links, or any text/html/images you want.

To configure your widgets, go to Appearance->Widgets from the dashboard.