I don't think you should be worried at all. Most women don't even know they're pregnant when they're 3 weeks along, so they are eating anything they want! I think now that you know you're pregnant, you should just start eating the things you know are good for you, and avoiding the things are bad (such as high fat junk foods). The foods you ate are not known to actually interfere with fetal development but may pose a higher risk of infectious disease than other foods or, in the case of caffeine, may be harmful in high doses. It is recommended that they be eaten in moderation or not at all during pregnancy just to err on the side of caution. Disease caused from eating soft cheese, consuming mercury in fish, or getting sick from bacteria in raw meat is not common, but avoiding those things from now on is still the best policy.