In Firefox 22.214.171.124 on OS X 10.4.10, verytime I open a new Firefox window, in addition to my Home Page, Firefox opens a bugzilla page. I close this, so it is not remembering an old state. It should not be there!
What are your settings in "Preferences.. --> Main" (When Firefox starts, Home Page)?
Ah. I see it there. Sorry.