The Louisiana Capitol Building. Of course, the interior of this building is largely off-limits or terribly unexciting. You’ll see the reason for visiting upon your arrival. The capitol is surrounded by beautiful gardens, historic statues, and one of the nicest parks in the state with vantage points overlooking the Mississippi river.