Good morning... I just looked at the website and so far it looks good to me as well. The only time the right sidebar might float left is if the page has no content and that part simply collapses until content is added. As for the menu being vertical, not sure why it did that, but when setting up a website, best to create your own menu (a custom menu) from the WordPress menu editor (menu manager as I prefer to call it).
As for the cache etc... perhaps try as it was suggested, a different browser and see if that helps? Also get other people you know to visit your site and see what happens for them.
By the way, I like the colour palette you are using...has a very soft pleasant look and style to it.