I recently saw this paper: “Facebook Tracks and Traces Everyone: Like This!”
(download the PDF)
Short version
Every time you merely visit a site that displays a Like button, data is sent to Facebook which includes the address of the site you are visiting. Assuming you’ve also logged into Facebook, they have all the information they would need to associate these external page views with your Facebook identity.