652747 - 64-bit (Win64) Nightly [build 25-04-2011] crashes on launch in DLL Blacklist code with certain antivirus software installed

Status: RESOLVED FIXED

(Toolkit :: General, defect)

Description

[Marcio]

User-Agent:       Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.12) Gecko/20101026 BTRS35926 Firefox/3.6.12 ( .NET CLR 3.5.30729; .NET4.0C)
Build Identifier: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.12) Gecko/20101026 BTRS35926 Firefox/3.6.12 ( .NET CLR 3.5.30729; .NET4.0C)

Nightly [build 25-05-2011] crashes on launch.

Problem signature:
  Problem Event Name:	BEX64
  Application Name:	firefox.exe
  Application Version:	6.0.0.4132
  Application Timestamp:	4db5c66a
  Fault Module Name:	StackHash_dc48
  Fault Module Version:	0.0.0.0
  Fault Module Timestamp:	00000000
  Exception Offset:	fffffffff8d59bf0
  Exception Code:	c0000005
  Exception Data:	0000000000000008
  OS Version:	6.1.7601.2.1.0.256.1
  Locale ID:	1046
  Additional Information 1:	dc48
  Additional Information 2:	dc488564de4b7640fcee7eda3f2a14e4
  Additional Information 3:	4f09
  Additional Information 4:	4f09ee0e8f06a14d38e9e042245310da



Reproducible: Always

Comment 1

[Marcio]

Correct date build: 25-04-2011.

Comment 2

[(mostly gone) XtC4UaLL [:xtc4uall]]

Please try to get a Trace using Windbg
https://developer.mozilla.org/en/How_to_get_a_stacktrace_with_WinDbg

Comment 3

[Marcio]

Attachment: Debug File generated by WinDbg

Debug File [ firefox-debug_0df4_2011-04-27_01-43-07-240.log ] uploaded. Tnx.

Comment 4

[will]

Attachment: Debug File generated by WinDbg64

I am showing same crash report, I hope this Windbg helps

Comment 5

[timeless]

KMService.exe is suspicious

I think Comodo (guard64.dll) is more likely to be related....

Comment 6

[(not currently active) Ted Mielczarek]

So we're crashing in our LoadLibrary hook (which implements our DLL blacklist)

In attachment 528526 [details], it's by way of Breakpad calling LoadLibrary("dbghelp.dll"):
http://mxr.mozilla.org/mozilla-central/source/toolkit/crashreporter/google-breakpad/src/client/windows/handler/exception_handler.cc#258

In any event, bug 604302 just landed the day before this build, so this seems to be the most likely candidate.

Comment 7

[Makoto Kato [:m_kato]]

Marcio and will, what software do you install anti-virus or firewall?
Also, do you use Windows 7 x64 SP1?

Comment 8

[will]

Makoto,

I use Avast pro, I scanned for a virus, unless is zero day I'm clean.
Win 7 x64 sp1, yes. I tried using avast pro sandbox no good.
I am currently using Nightly 32bit version for win 64.

It works like a charm, I do some speed loss. 
I tried nightly 64 in safe mode no go, and profile editor, no luck.

Comment 9

[Makoto Kato [:m_kato]]

Also, if possible, run "windbg notepad.exe", then, could you type "u ntdll!LdrLoadDll l20" in WinDbg's command?

Please use 64bit version of WinDbg...

Comment 10

[Marcio]

(In reply to comment #7)
> Marcio and will, what software do you install anti-virus or firewall?
> Also, do you use Windows 7 x64 SP1?

Makoto, good evening,

I use:

   Windows 7 x64 SP1
   Comodo Internet Security Premium 64-bit

I removed Comodo and Nightly (64) works fine. Re-install Comodo e Nightly crashes again (on launch).
 
Now, I'm using Firefox 4 while Nightly not works.

Thank you,

Marcio

Comment 11

[Makoto Kato [:m_kato]]

Marcio and will, thanks for information!.  I will setup repro environment.

Comment 12

[Alice0775 White]

I also encounter the problem.

Regression window(m-c hourly):
Works:
http://hg.mozilla.org/mozilla-central/rev/d29e9cb9d0c9
Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:6.0a1) Gecko/20110423 Firefox/6.0a1 ID:20110424201254
fails(crash):
http://hg.mozilla.org/mozilla-central/rev/c062731105cf
Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:6.0a1) Gecko/20110423 Firefox/6.0a1 ID:20110424215054
Pushlog:
http://hg.mozilla.org/mozilla-central/pushloghtml?fromchange=d29e9cb9d0c9&tochange=c062731105cf


Using Windows 7 x64 SP1, Avast!6 pro.
It works if I disable "Behavior Shield" of Avast!6 pro.

Comment 13

[katrillionaire]

April 25,2011 build is where nightly first refused to launch.  April 27,2011 release does start in 'Safe Mode', but will not start in normal mode. I disbled everything i could and it still crashes in normal mode.  addons, extension and hardware acceleration. I didn't check to see if the april 25,2011 version started in safe mode, but i will assume it would have if i tried to.

Comment 14

[Makoto Kato [:m_kato]]

This crash cannot be resolved by Nightly's settings.

So, please don't post a comment like comment #13.  I already make sense the root cause of this bug...

Comment 15

[Makoto Kato [:m_kato]]

Also, dll block list doesn't work even if x86 version when Avast! (or Comodo) is installed.  About it, I filed bug as bug 653361.

Comment 16

[Ashu]

Makoto does this mean you'll back Bug 604302 back out? At least until this issue can be resolved I mean.

Comment 17

[will]

Makoto,

Do you still want me to run Windbg, with a log, for 
"untdll!LdrLoadDll l20" in debugging Nightly?

I will disable Avast to see if it creates problems then.

After that I will try to change to a different antivirus Avira.
I will see if the problem happens there too.

Comment 18

[will]

Makoto,

Do you still want me to run Windbg, with a log, for 
"untdll!LdrLoadDll l20" in debugging Nightly?

I will disable Avast to see if it creates problems then.

After that I will try to change to a different antivirus Avira.
I will see if the problem happens there too.

Comment 19

[Makoto Kato [:m_kato]]

Attachment: fix

Comment 20

[Makoto Kato [:m_kato]]

Attachment: fix v1.1

Comment 21

[Makoto Kato [:m_kato]]

Comment on attachment 529411 [details] [diff] [review]
fix v1.1

trace check is failure when first entry is jmp rel32

Comment 22

[tungstentide]

Avast's snxhk64.dll causes Nightly to crash. I hope this helps as i'm also stuck to using x86 Nightly now. Email me if u need information i can gather for u. Thanks.


Dump Summary
------------
Dump File:	WER7D38.tmp.mdmp : C:\Users\Paul\AppData\Local\Temp\WER7D38.tmp.mdmp
Last Write Time:	5/3/2011 12:37:54 AM
Process Name:	firefox.exe : C:\Program Files\Nightly\firefox.exe
Process Architecture:	x64
Exception Code:	0xC0000005
Exception Information:	The thread tried to read from or write to a virtual address for which it does not have the appropriate access.
Heap Information:	Not Present

System Information
------------------
OS Version:	6.1.7601
CLR Version(s):	

Modules
-------
Module Name	Module Path	Module Version
-----------	-----------	--------------
firefox.exe	C:\Program Files\Nightly\firefox.exe	6.0.0.4139
ntdll.dll	C:\Windows\System32\ntdll.dll	6.1.7601.17514
kernel32.dll	C:\Windows\System32\kernel32.dll	6.1.7601.17514
KERNELBASE.dll	C:\Windows\System32\KERNELBASE.dll	6.1.7601.17514
snxhk64.dll	C:\Program Files\AVAST Software\Avast\snxhk64.dll	6.0.1091.0
xul.dll	C:\Program Files\Nightly\xul.dll	6.0.0.4139
mozsqlite3.dll	C:\Program Files\Nightly\mozsqlite3.dll	3.7.5.0
mozcrt19.dll	C:\Program Files\Nightly\mozcrt19.dll	9.0.0.0
smime3.dll	C:\Program Files\Nightly\smime3.dll	3.12.9.0
nss3.dll	C:\Program Files\Nightly\nss3.dll	3.12.9.0
nssutil3.dll	C:\Program Files\Nightly\nssutil3.dll	3.12.9.0
plc4.dll	C:\Program Files\Nightly\plc4.dll	4.8.8.0
nspr4.dll	C:\Program Files\Nightly\nspr4.dll	4.8.8.0
advapi32.dll	C:\Windows\System32\advapi32.dll	6.1.7600.16385
msvcrt.dll	C:\Windows\System32\msvcrt.dll	7.0.7600.16385
sechost.dll	C:\Windows\System32\sechost.dll	6.1.7600.16385
rpcrt4.dll	C:\Windows\System32\rpcrt4.dll	6.1.7601.17514
wsock32.dll	C:\Windows\System32\wsock32.dll	6.1.7600.16385
ws2_32.dll	C:\Windows\System32\ws2_32.dll	6.1.7601.17514
nsi.dll	C:\Windows\System32\nsi.dll	6.1.7600.16385
winmm.dll	C:\Windows\System32\winmm.dll	6.1.7600.16385
user32.dll	C:\Windows\System32\user32.dll	6.1.7601.17514
gdi32.dll	C:\Windows\System32\gdi32.dll	6.1.7601.17514
lpk.dll	C:\Windows\System32\lpk.dll	6.1.7600.16385
usp10.dll	C:\Windows\System32\usp10.dll	1.626.7601.17514
plds4.dll	C:\Program Files\Nightly\plds4.dll	4.8.8.0
ssl3.dll	C:\Program Files\Nightly\ssl3.dll	3.12.9.0
mozalloc.dll	C:\Program Files\Nightly\mozalloc.dll	6.0.0.4139
shell32.dll	C:\Windows\System32\shell32.dll	6.1.7601.17514
shlwapi.dll	C:\Windows\System32\shlwapi.dll	6.1.7601.17514
ole32.dll	C:\Windows\System32\ole32.dll	6.1.7601.17514
version.dll	C:\Windows\System32\version.dll	6.1.7600.16385
winspool.drv	C:\Windows\System32\winspool.drv	6.1.7601.17514
comdlg32.dll	C:\Windows\System32\comdlg32.dll	6.1.7601.17514
comctl32.dll	C:\Windows\winsxs\amd64_microsoft.windows.common-controls_6595b64144ccf1df_6.0.7601.17514_none_fa396087175ac9ac\comctl32.dll	6.10.7601.17514
imm32.dll	C:\Windows\System32\imm32.dll	6.1.7600.16385
msctf.dll	C:\Windows\System32\msctf.dll	6.1.7600.16385
msimg32.dll	C:\Windows\System32\msimg32.dll	6.1.7600.16385
psapi.dll	C:\Windows\System32\psapi.dll	6.1.7600.16385
oleaut32.dll	C:\Windows\System32\oleaut32.dll	6.1.7601.17514
mozcpp19.dll	C:\Program Files\Nightly\mozcpp19.dll	9.0.0.0
xpcom.dll	C:\Program Files\Nightly\xpcom.dll	6.0.0.4139
uxtheme.dll	C:\Windows\System32\uxtheme.dll	6.1.7600.16385
dwmapi.dll	C:\Windows\System32\dwmapi.dll	6.1.7600.16385

Comment 23

[Eustachy Kapusta]

I don't have avast (i've eset nod) but i'm using comodo firewall x64 and my nightly x64 is crashing at start too

Comment 24

[WildcatRay]

(In reply to comment #23)
> cc: [e-mail] don't have avast (i've eset nod) but i'm using comodo firewall x64 and my
> nightly x64 is crashing at start too

FWIW-I uninstalled Comodo Firewall and re-enabled Windows Firewall (Win7 Home x64) and the 05-01-2011 build started up nicely.

Comment 25

[nikhosgarcia]

Has the patch been incorporated into the current builds? I've tried every build since 20110425, all of them crash the same way. I'm using the Windows x64 version, running Windows 7, fully patched but _not_ on SP1. I also run Avast.

Problem signature:
  Problem Event Name:	BEX64
  Application Name:	firefox.exe
  Application Version:	6.0.0.4139
  Application Timestamp:	4dbf1163
  Fault Module Name:	StackHash_dc48
  Fault Module Version:	0.0.0.0
  Fault Module Timestamp:	00000000
  Exception Offset:	ffffffff899ebc1c
  Exception Code:	c0000005
  Exception Data:	0000000000000008
  OS Version:	6.1.7600.2.0.0.256.4
  Locale ID:	1033
  Additional Information 1:	dc48
  Additional Information 2:	dc488564de4b7640fcee7eda3f2a14e4
  Additional Information 3:	dcd1
  Additional Information 4:	dcd101d8ab0eb3fe9ef707611feed2b0

Comment 26

[(not currently active) Ted Mielczarek]

This patch has not been landed yet. It will be marked RESOLVED FIXED when it has.

Comment 27

[tungstentide]

Attachment: TT Windbg64 Crash file

My crash file from the build last night.

Comment 29

[Daniel Crook]

I have also been getting this bug since around the first build mentioned here. I also use Windows 7x64 Professional SP1, with Comodo Firewall. (I use AVG anti virus too). 

This probably points to Comodo being the problem here?

Comment 30

[Vladimir Vukicevic [:vlad] [:vladv] (needinfo me, slow to respond)]

Comment on attachment 529411 [details] [diff] [review]
fix v1.1

huh, jmp 0, eh?

Comment 33

[Peter Lairo]

To avoid further duplicates, could someone please add "64-bit" to the Summary?

Comment 34

[Makoto Kato [:m_kato]]

http://hg.mozilla.org/mozilla-central/rev/d275b0e6e877

Comment 35

[M Henri Day]

My experience is similar to that of Daniel above : uninstallation of the Comodo Firewall allows me to re-install 64-bit Nightly and run it without it crashing. Re-installation of Comodo leads to 64-bit Nightly crashing every time I attempt to run it. 32-bit Nightly, however, is not affected at all....

Henri

Comment 36

[Rob Madden]

Still Crashing with the fix and Avast Internet Security.

Comment 37

[Rob Madden]

I figured out if I turn off behavior sheild in avast Nightly dont crash on 64bit

Comment 38

[Rob Madden]

One more thing I turned the behavior sheild back on in Avast Internet Security then I opened it up then I wne to realtime shield and clicked on behavior sheild 
then I clicked on expert settings. Then I clicked on trusted processes then I added C:\Program Files\Nightly\firefox.exe to the trusted processes and now Night 64bit dont crash anymore.

Comment 39

[M Henri Day]

I should mention that disabling my AV - Avira Antivir Personal, version 10.0.0.648 - had no effect whatever on the 64-bit Nightly build ; it still crashed whenever I attempted to run it....

Henri

Comment 40

[katrillionaire]

Not working with commodo disabled.  I'll try it with commodo uninstalled.  Works in safe mode but not in normal mode.

Comment 41

[M Henri Day]

Katrillionare, that was precisely my experience - simply disabling Comodo didn't suffice ; I had to uninstall it....

Henri

Comment 42

[Benedikt V]

The same with me, but after uninstalling it works.
Why is it marked as "Resolved Fixed"? I think it isn't.

Comment 43

[Rodolfo Andrade]

Nightly 64 crashes during startup. 
Windows 7 64-bit with Comodo Antivirus

  Problem Event Name:	BEX64
  Application Name:	firefox.exe
  Application Version:	6.0.0.4145
  Application Timestamp:	4dc7083a
  Fault Module Name:	StackHash_d2b4
  Fault Module Version:	0.0.0.0
  Fault Module Timestamp:	00000000
  Exception Offset:	fffffffff8b49aa0
  Exception Code:	c0000005
  Exception Data:	0000000000000008
  OS Version:	6.1.7601.2.1.0.256.1
  Locale ID:	1046
  Additional Information 1:	d2b4
  Additional Information 2:	d2b43f22f1243832b5d9a896886d4d36
  Additional Information 3:	fa15
  Additional Information 4:	fa1537c6bde13b2486c6a133ef61c3e5

Comment 44

[Marcio]

I updated with new version (build 20110508), but bug persists

Comment 45

[Ashu]

The fix should be in the 20110509 nightly. So you guys should chill until that nightly is out and then check back if the issue isn't resolved.

Comment 46

[M Henri Day]

Aashish, should this be interpreted to mean that the 64-bit Nightlies will work even with the Comodo Firewall installed ?...

Henri

Comment 47

[Ashu]

Well Makoto made a fix for this issue so I suppose that's what it does. We will know for sure when the Nightly is built and people have tried.

Comment 48

[Makoto Kato [:m_kato]]

(In reply to comment #43)
> Nightly 64 crashes during startup. 
> Windows 7 64-bit with Comodo Antivirus
> 
>   Problem Event Name:	BEX64
>   Application Name:	firefox.exe
>   Application Version:	6.0.0.4145
>   Application Timestamp:	4dc7083a
>   Fault Module Name:	StackHash_d2b4
>   Fault Module Version:	0.0.0.0
>   Fault Module Timestamp:	00000000
>   Exception Offset:	fffffffff8b49aa0
>   Exception Code:	c0000005
>   Exception Data:	0000000000000008
>   OS Version:	6.1.7601.2.1.0.256.1
>   Locale ID:	1046
>   Additional Information 1:	d2b4
>   Additional Information 2:	d2b43f22f1243832b5d9a896886d4d36
>   Additional Information 3:	fa15
>   Additional Information 4:	fa1537c6bde13b2486c6a133ef61c3e5

timestamp is old.  This fix is included from 2011-05-09 nightly.
Why can you wait next nightly package?  At least, you should wait 1 day.

Comment 49

[Marcio]

Makoto, good evening,

I'm installed build 20110509 and its works fine.

Thank you for your attention to that issue.

Comment 50

[nikhosgarcia]

Confirming that the fix has resolved the issue.
Build 20110509, Win x64, running with Avast.

Thanks Makoto :)

Comment 51

[M Henri Day]

The latest version, dated 2011-05-09, works for me as well, with Comodo Firewall installed. Thanks, Makoto !...

Henri

Comment 52

[katrillionaire]

Works for me also. Thanks Big M.