69360 - Mail client hangs while downloading messages from POP account

Status: VERIFIED FIXED

(MailNews Core :: Networking: POP, defect, P1)

Description

[Igor]

Build ID: 2001021811

1.  For a Yahoo POP mail account, using pop.mail.yahoo.com
   client settings:
     Check for Messages every 10 minutes
     Automatically download any new messages
     Leave messages on server
     Delete messages on server when they are deleted locally
     Empty Trash on exit
2.  Start the mozilla mail client
3.  Select the Yahoo account and click the "Get Msg" button
4.  Enter the account password in the popup box that appears.

Error-The client begins to download the messages from the server.  How many
successfully download depends on the number in the inbox, but ultimately it
hangs before it retrieves them all--usually two to five are left to be retrieved
before the it hangs.  It's not a true hang in that it eventually times out after
10-30 minutes, and you can still use the browser and other parts of mozilla but
it maintains an open connection to the POP server--try logging into Yahoo and
viewing the messages this way--it tells that the account is unavailable for a
while after the client hangs.  When the connection times out the messages can be
viewed via the web browser.

Regression:

This problem began occuring back on February 12 or 13 when I installed the first
version of the .8 release.  However this does not seem to be limited to .8 as
the problem persists in the current nightly I'm using today (build 2001021811). 

After the mail client fails to download (wait a long time 20 minutes to half
an hour sometimes--perhaps this has to do with the POP server timeout--not sure)
click get message.  The client again tries to retrieve the messages and finally
gives the following message:

"An error occurred while sending your password to the mail server.  You should
contact the administrator for this server or try again later."

After Clicking OK the previous message box appears again, after clicking OK a
second time the following message box appears:

"Could not log in to the mail server.  The server responded: command valid only
in authorization state.. Please enter a new password for
[e-mail]:

  <Text box>

<radio button> "Use Password Manager to remember this password"
OK CANCEL

If the password is reentered here the client trys to get messages but fails as
previously.

I tried with a new profile with an interesting result--I had 116 messages on the
POP server that needed to be downloaded 110 downloaded correctly but the
download hung on number 111.  

It doesn't seem to be a problem with the password as I was able to get all of
the messages under Netscape 4.76 without a problem.

I started the mozilla client from the shell with "mozilla -mail" to get the
output for the mail client only:

Registering plugin 0 for: "*","All types",".*"
Registering plugin 0 for: "*","All types",".*"
Error hiding AccountCentral page -> TypeError: accountCentralBox has no
properties
mailbox://[e-mail]
In ChangeFolderByURI uri = mailbox://[e-mail]
Error loading AccountCentral page -> TypeError: messagesBox has no properties

Gdk-CRITICAL **: file gdkwindow.c: line 716 (gdk_window_ref): assertion `window
!= NULL' failed.
mailbox://[e-mail]/Inbox
In ChangeFolderByURI uri = mailbox://[e-mail]/Inbox
Error loading with many headers to download: [Exception... "Component returned
failure code: 0xc1f30001 (NS_ERROR_NOT_INITIALIZED)
[nsIMsgFolder.updateFolder]"  nsresult: "0xc1f30001 (NS_ERROR_NOT_INITIALIZED)" 
location: "JS frame :: chrome://messenger/content/commandglue.js ::
ChangeFolderByURI :: line 220"  data: no]
In OnFolderLoaded for mailbox://[e-mail]/Inbox
In reroot folder
mRandomAccessEnumeratorHackLimit=-1


Using RedHat 7.0 Linux version 2.2.16-22 gcc version egcs-2.91.66 19990314/Linux
(egcs-1.1.2 release) XFree86 4.0.1-1 sawfish

Comment 1

[Colin Stewart]

I am also seeing this, both under linux build 2001021908 and under Win98 build
2001021820.  Mail hangs on the first message (of 11 in my case).  If I quit
Mozilla and start it up again the first message has been downloaded, but it will
not get the second.  Again this is on Yahoo, only using their UK server
pop.mail.yahoo.co.uk.

Comment 2

[atomicules]

I am also experiencing this problem accessing pop.mail.yahoo.co.uk since using
build 2001021502 for Mac OS 9.x.  I did not experience the problem under release 0.7

Comment 3

[Igor]

To be more specific I noticed the problem first after installing one of the
pre.8 releases I think it was pre.8-2 though it might have been as early as pre.8-0

Comment 4

[Navin Gupta]

Can anybody get an account on pop.mail.yahoo.co.uk. If we can get an
account it would really help us

Comment 5

[Colin Stewart]

Yes anyone can set up an account.  I've set one up for you for mozilla bug
testing, here's the details:

username: moztest2001
password: mozilla
email address: [e-mail]
pop server: pop.mail.yahoo.co.uk
smtp: smtp.mail.yahoo.co.uk

I've just tried downloading some messages from there, and it worked fine, so I'm
not sure how easy it'll be to reproduce the problem.

Comment 6

[Mike Krus]

I have the same problem with pop.mail.yahoo.com ...

Comment 7

[Igor]

A few observations:  I created a new mail account for [e-mail] in
mozilla using the same client that is causing my account problems.  Sent a few
sample messages and then retrieved them with roughly the same settings my other
account has, and downloaded several messages that I had sent to that account. 
The messages downloaded without a problem.  I also noticed that clicking the
stop button on my yahoo account after it has hung for a while successfully
closes the connection to the pop server so that I can immediately login to yahoo
without the delay I previously mentioned--this suggests that communication is
still occuring with the POP server--the mail is just not coming through other
than the first message as noted by another submitter.  

One question for those of you observing this problem do you have a large number
of messages on the POP server-I think I have 100+ (126 total) and as I noted it
downloaded about 111 before it hang when I recreated the account--could the
number of messages on the server matter?  I'm not a POP master so I'm not sure
about this.  Or could it matter the number of messages in the users Inbox on the
client?

Mmmm the plot thickens--I deleted a whole bunch of messages out of my
Inbox-packrat that I am I had 510 messages.  Interestingly when I clicked GetMsg
this time I successfully downloaded all of the messages that I had just deleted
from my box but then hung again with for the last 16--note it won't regrab the
deleted messages until you empty the trash can.

Perhaps this isn't all that insightful after all.  The download still hangs at
the same spot.  Deleting messages off of the server doesn't seem to have an
effect either--It does detect the right number of messages to download (states
15 on the bottom which is the correct number since I deleted one).

It doesn't seem to a problem with a specific message--I've deleted the one that
it is hanging on several times only to have it hang on the next one.  

I don't know if any of this will help but maybe it will for someone who knows
more about POP.  

Feel free to contact me if I can help in any way--this is a very annoying problem.

Comment 8

[atomicules]

In response to Igor's comments:
No, I do not necessarily have a lot of messages, sometimes less than 10.  I have
just checked again and Moz isn't detecting the right number of messages (It
detected 28 when I had 21 in my Yahoo inbox), however, this could be to do with
trying to download what it didn't complete before (I don't know if Moz would
remember stuff like this?).  Also Igor mentioned he was able to close the POP
connection with the stop button on Moz mail.  I have used this button before
when the hang occured and it did not close the connection for me, but
interestingly in the check I've just done, the stop button was greyed out,
whilst downloading messages

It gets weirder, it has just 'finished' downloading, well the status bar says it
is still receiving message 21 of 28, but it has downloaded all 21 messages in my
Yahoo inbox, even though it thinks there are more.

Seems like none of this is very repeatable.

Comment 9

[Sheela Ravindran]

colin,
Thanks for setting up yahoo account for testing.  I will try to see if I can see
this problem on my machine.

Comment 10

[Sheela Ravindran]

Can anyone of you who are using this yahoo test account tell me if you have
posted new messages and also have the preference 'leave messages on the server'
checked and also how many messages you see for this account.
thanks.

Comment 11

[Sheela Ravindran]

There has been so many bugs about getting messages in pop account but very
difficult to reproduce. I guess this is one of them too.  I set up this account
on my client and was able to download all the 21 messages that I posted to this
account.

Comment 12

[Igor]

I checked the messages on the server--it showed 21 and said it downloaded 21 but
I think it downloaded 23.  I had the leave messages on server option set as well
and it all downloaded without a hitch.  I hope it doesn't cause any problem, but
I had delete messages on server when deleted locally checked and I deleted them
and they got deleted from the server--So I owe Sheela one because I think she
generated all the ones I deleted from the server when I deleted them on my
account.  I'm exploring one other strange bug that may be related to this
one--for those of you that are having the problems downloading, do you have the
Delete messages on server when deleted locally option set? and are you leaving
your messages on the server?  And do you have the Empty trash on exit option
set? Personally I have the mail client delete the messages from the server when
I'm deleting them from my account.  I also have it empty trash on exit.  I'm
noticing some very strange things with the problem account, in that it seems
unable to connect and delete the messages on the account when I exit.  If I kill
the session and log back on I notice it gives me a notice that says something
like "Cannot establish connection with server" though it's not auto logging in
to the account--the only thing I can figure is that it's still trying to delete
the messages that it was unable to delete when I closed out the session.  If I
get messages after this point, it downloads all the messages deleted in the
previous session to the Inbox.  If I close the session after this and restart
the session once again all of the previously "deleted" messages are back in the
Inbox plus the extra copies downloaded from the previous session.  

This may be an unrelated problem, however I post it here after doing what I did
tonight because the new moztest account not only downloaded the messages
correctly, but also correctly deleted them from the server when I deleted them
from my inbox (I didn't see exactly when--if it was when I removed them from the
Inbox, or when I emptied the trash or when I logged back into the next
session--maybe somebody can tell me exactly how to know when the messages are
removed from the server).  Since I've never noticed these problems and am now
noticing them together, I'm wondering if they could be related--if not I can
certainly write up this other one, but I wanted to ask if anyone else is seeing
this behavior or their systems?  Also a simple regression to this would be to
try doing the same thing I did with the moztest2001 account only with the Empty
trash on exit option set to see if that makes a difference.  

Does anyone see this?  Could these two problems be related somehow?  Any other
info I can provide that might be useful?

Comment 13

[Sheela Ravindran]

Igor,
FYI, see bug 65630 which is deleted messages reappearing in the inbox.  And also
there is another bug which is messages are not getting deleted on the server
when you delete locally. But I cannot find it now.   

Comment 14

[Igor]

That would be bug 64311 probably--I wrote that one up a while ago.  I'm pretty
sure those problems aren't causal, though they could be sympomatic.  Over the
weekend, I setup my account on another Linux machine that hadn't had mozilla
installed on it before.  Retrieving the messages from the server resulted in the
same problem with the server hanging at roughly the same point as before.  

If I can help with my account I'd be happy to--is there someway that I can get a
dump of the POP transaction information? or other info that might help explain
what's going on here?

Comment 15

[Igor]

Both bug 64311 and bug 65630 are fixed and this problem remains so there seems
to be no significant relationship.  Most likely an unrelated problem. Has anyone
looked a code differences between the current code base and the pre-.8 release
(which is when the bug showed up?)  If it would help I can volunteer my mail box
for testing purposes for a short time.  This needs to be fixed!

Comment 16

[John Beatty]

It doesn't work on 0.7, either.  I just reinstalled it to double check.  It was,
however, working properly in 0.6.  For me, anyway.  On Win98SE.

Comment 17

[Sheela Ravindran]

*** Bug 72105 has been marked as a duplicate of this bug. ***

Comment 18

[David :Bienvenu]

here's how you get a protocol log for the pop3 session:
http://www.mozilla.org/quality/mailnews/mail-troubleshoot.html#imap 

if you could follow the instructions, look at the log, make sure it doesn't have
anything private, and then attach it to the bug report, we could get a better
idea of what's going on here.

Comment 19

[John Beatty]

I deleted all my old messages from the Yahoo server and Mozilla started
downloading messages properly.  This was about 5 days ago.  There were about 10
messages from February and about 8 from that day and one from the previous day.
 I tried downloading new messages first and it hung and then I deleted the old
ones (through the web page) and tried it and it worked, and has continued to
work properly since then.

Comment 20

[Igor]

I tried, unsuccessfully to get a log of my POP/IMAP session by setting the
variables as noted at
http://www.mozilla.org/quality/mailnews/mail-troubleshoot.html#imap  I use bash
so I converted the two environment variable commands to:

export NSPR_LOG_MODULES=IMAP:5
export NSPR_LOG_FILE=/home/Igor/tmp/imap_log

Running env | grep NS reveals that the variables are set as noted, yet when I
start up mozilla from the shell, start the mail program and attempt to retrieve
messages from the server, I don't get anything in the file.  Either something is
not working here, or nothing is getting written because no messages are being
sent.  If it is proper logging I would have imagined that it would record the
authentication/logon sequence--I see nothing--the file is empty.  (I've checked
the permissions on the file and it is writeable.  Also I tried it with and
without the file existing incase there was some problem creating the file. 
Without the file, it is not created, and with it in place nothing is written)

Any ideas why it's not logging? 

Comment 21

[David :Bienvenu]

You're using POP, right? Then, substitute "IMAP" with "POP".

so, export NSPR_LOG_MODULES=POP:5

Comment 22

[Navin Gupta]

A minor correction, use 

export NSPR_LOG_MODULES=POP3:5

Comment 23

[David :Bienvenu]

If POP3 is correct, then someone in QA (esther?) should fix the instructions on
the QA page.

Comment 24

[Igor]

It would be good if the QA page provided instructions for bash since it is as
widely used as the csh/tcsh shells on UNIX/Linux systemsand the default on many
Linux systems--and the superior of the shells ;)

Comment 25

[Igor]

Attachment: Log file for yahoo pop3 mail download session

Comment 26

[Igor]

A few comments on the previously submitted log file for a failed Yahoo Pop3
download session.  As already mentioned the program downloads one message--the
same one every time you connect.  From the log file it appears that this occured
when I hit the Stop button since it is the last thing in the log file.  I've
removed the message header and most of the body--the lines starting with
############### denote comments added by me, and mark the beginning and end of
the area where the one downloaded message was.  

If you need the header or other message information I can send that to you.

Comment 27

[esther]

Note: Mozilla page has been edited to include the "3" for POP3.  Thanks David!

Comment 28

[Navin Gupta]

So the problem here is that it does not retrieve all the messages 
from your account, and hangs.

Can you briefly describe the actions you performed that generated this
log and also your POP3 server settings. 

Comment 29

[Navin Gupta]

From the log it looks like you are leaving messages on the server. 
Also you might have already downloaded some messages before this session. 

The log looks fine to me. 

If you hit GetMsg() after hitting stop what happens ? 

Comment 30

[Igor]

In response to the settings and actions question--I've tried with a number of
different settings--all with the same result.  For the log file I had Pop
settings: 'Leave messages on server' and 'Delete messages on server when they
are deleted locally' set.  For the reproduction path please read my first
comment (i.e. the beginning of this thread)

For some reason the downloader stops downloading at a certain point in the
folder.  If I delete messages from the mozilla client Inbox they are not deleted
from the server.  When hit the Get Message button, the deleted messages are
retrieved again, however, the message retrieval stalls once it reaches the
"certain point" mentioned earlier.  

Hitting Stop followed by "Get Message" repeatedly, results with the same message
that it is hanging on being retrieved once for each  "Stop" and "Get Message"
sequence.

Logging in to the server and deleting the message that it is hanging on merely
results in the same behavior with the client hanging on the next message in the
Server Inbox.  

Comment 31

[Navin Gupta]

I don't know if writing to your inbox fails for some reason. You can download a
new nightly build from today because I checked in some code to "abort
downloading messages", if write to inbox fails. 

Comment 32

[Navin Gupta]

Sometimes the POP3 server gets into a peculiar state and response is always 
"maildrop busy". How should the client behave in such a situation ?

Comment 33

[Navin Gupta]

I have added code that will throw error messages received from the server.
Hopefully, this should help us to debug the problem.

Igor, Can you try downloading message with latest nightly builds ?

Comment 34

[Sheela Ravindran]

*** Bug 78043 has been marked as a duplicate of this bug. ***

Comment 35

[Igor]

I got the latest mozilla and tried getting my messages as requested.  As far as
I can tell there were no error messages posted from the server.  This is the
only output I got (and it only printed to the shell when mozilla mail started
up) nothing came after requesting my mail:

some errors though:

mailbox://<email_account_address_removed/Inbox
Error loading with many headers to download: [Exception... "Component returned
failure code: 0xc1f30001 (NS_ERROR_NOT_INITIALIZED)
[nsIMsgFolder.updateFolder]"  nsresult: "0xc1f30001 (NS_ERROR_NOT_INITIALIZED)" 
location: "JS frame :: chrome://messenger/content/commandglue.js ::
ChangeFolderByURI :: line 219"  data: no]


In addition I've attached the contents of the pop3_log for the session.  Not too
different than the last--though I noticed that for some reason it changed to
state 19 in the middle of the message that it hung on.  The other two messages
'successfully' downloaded were messages previously downloaded from the server
that I had deleted from my inbox, but left on the server.  For some inexplicable
reason there is a point at which the messages stop getting downloaded--those
downloaded before that point may be successfully redownloaded again--I made a
new account to try this out and found that it worked--downloading 75+ messages
before hanging on the exact same one as always.

thoughts?

Comment 36

[Igor]

Attachment: log file for debug session

Comment 37

[John G. Myers]

There may be a problem with dot stuffing or the like.  It would be helpful to 
see the message it hangs on.  This could also be triggered by the 
contents of the message before the message it hangs on.

Comment 38

[Navin Gupta]

Can you download messages using 4x ? This would help us in tracking in this 
problem, because the message retrieval code is essentially the same. 

Comment 39

[David :Bienvenu]

the code's very similar, but I wouldn't at all be surprised if 4.x works and
6.x/mozilla doesn't. The . handling code in particular is different.

Comment 40

[Igor]

This works fine under Netscape 4.x.  In fact I went back to 4.x once I started
having these problems under mozilla.  Currently I'm using 4.76 under RedHat 7.1

Also this does not seem to be a message specific problem.  If I login to
yahoo.com and deleted the message that it is hanging on from the server, it
hangs on the next message in the queue.  As mentioned earlier, all messages in
the Inbox download successfully to a point.  I have tried deleting all the
messages from the Inbox starting with the one where it hangs only to find that
it hangs on each successive message.  Even with all of these messages removed,
the mail client download will hang on the next message received.

Comment 41

[Igor]

By way of clarification--the last line of the message should read:

Even after removing all after the point where the mail download starts to hang,
the mail client download will hang on the next new message received.

For example, I can remove all the messages received after the message where the
download starts to hang so that there are no non-downloaded messages on the
server.  However, the problem will persist, with the download hanging once a new
message appears in the Inbox?  I hope that's clear.

Comment 42

[John G. Myers]

The problem is likely to be caused by the message *before* the one where it
hangs.

Comment 43

[Igor]

Ah Ha!  That did it, once I removed the offending message all the messages
downloaded without a hitch!--Now if I can just find a copy of the message that
was causing the problem, why would the message before the one where it was
hanging cause the problem?

Comment 44

[Igor]

I've found the offending message, however sending it to myself does not cause
the problem to recur.  Is it useful for someone to look at it, and in what form
and how can I get at it in that form.  It's no longer on the server since I had
to delete it to see if that would correct the problem.  Let me know what I can
do. I hope this helps us nail down the problem.  Right now I have a copy of the
message in my netscape mail, though I imagine its not the message itself but POP
info included with it that causes the problem, and resending it only copys the
text so what now? to track it down.

Comment 45

[John G. Myers]

We need to know what your particular POP server sends when downloading that
particular message.

We might be able to figure out something from the copy of the message that you
got in Netscape 4.7x.  You might be able to reproduce the problem by forwarding
that message to yourself.

Most likely the message has a line starting with a ".".  You might try sending
yourself mail which has lines starting with "." and you might also try sending
yourself mail which has lines containing a single ".".

Comment 46

[Navin Gupta]

I have tried both the cases, john mentioned and it worksforme. Igor, if you 
could attach the message, if not, tell us what the message looks like, so 
that we can reproduce the hang. 

Comment 47

[Igor]

I tried forwarding the message to myself, cutting and pasting the message text
into a new message and sending it to myself, as well as creating a number of
messages with leading '.'s in them,  but have been unable to reproduce the
problem.  The message itself as viewed in netscape does not have any leading
periods so I'm not convinced that is the real problem.

This is the message before the one it was hanging on.  I've included the message
with its headers (I just did View->Message Source in mozilla and then cut and
paste).  So here it is unedited with headers as displayed.

########Start message (no leading whitespace)
From - Sun Mar  4 13:07:27 2001
X-UIDL: 5c6a6b2d031e5936de2e279935fa5cc3
X-Mozilla-Status: 0001
X-Mozilla-Status2: 00000000
X-Apparently-To: [e-mail] via web5304
Received: from bflitemail6.bigfoot.com  (HELO bigfoot.com) (208.156.39.208)
  by mta229.mail.yahoo.com with SMTP; 08 Feb 2001 10:48:21 -0800 (PST)
Received: from fort-point-station.mit.edu ([18.72.0.53])
	by BFLITEMAIL5.bigfoot.com (LiteMail v3.00(BFLITEMAIL5)) with SMTP id
08Feb2001_BFLITEMAIL5_3567_125363726;
	Thu, 08 Feb 2001 13:49:40 -0500 EST
Received: from grand-central-station.MIT.EDU (GRAND-CENTRAL-STATION.MIT.EDU
[18.69.0.34])
	by fort-point-station.mit.edu (8.9.2/8.9.2) with ESMTP id NAA12229;
	Thu, 8 Feb 2001 13:47:56 -0500 (EST)
Received: from melbourne-city-street.MIT.EDU (MELBOURNE-CITY-STREET.MIT.EDU
[18.69.0.45])
	by grand-central-station.MIT.EDU (8.9.2/8.9.2) with ESMTP id NAA21544;
	Thu, 8 Feb 2001 13:43:12 -0500 (EST)
Received: from sarae (DEBAUN.MIT.EDU [18.154.0.57])
	by melbourne-city-street.MIT.EDU (8.9.3/8.9.2) with SMTP id NAA25244;
	Thu, 8 Feb 2001 13:42:54 -0500 (EST)
Message-Id: <[e-mail]>
X-Sender: hross@hesiod
X-Mailer: QUALCOMM Windows Eudora Pro Version 4.0.2 
Date: Thu, 08 Feb 2001 13:41:55 -0500
To: (Recipient list suppressed)
From: Hillary Ross <[e-mail]>
Subject: sloan phd application
Mime-Version: 1.0
Content-Type: text/plain; charset="us-ascii"

We are in receipt of your Sloan PhD application, which is complete.  You
will hear from us once admissions decisions are made.
##########End message (no trailing whitespace)

I'm guessing that it is a problem with the headers since forwarding the message
itself seems to have no effect.  Is it possible to reconstruct the message from
the info here and put it on a POP server and see if that reproduces the problem.
 Perhaps if someone else on the list has this same problem they could provide
their message source as well?  Does someone on the list still have this problem?

Comment 48

[John G. Myers]

The copy of the message in Mozilla does not necessarily match what was on the 
server.  A copy obtained from some other client, such as 4.7, might be more 
helpful.  What we really need is a POP3 log file.

Comment 49

[Igor]

Unfortunately I don't have a POP3 log file for the message that I deleted which
solved the problem.  The reason for this is that that message was downloaded
back on February 8 when the problem began occuring.  If I'd anticipated it
better I should have created an entirely new account and logged the output prior
to deleting the message to the server.  However, I didn't think of doing that so
I can't help here since I don't seem to be able to reproduce the problem.  Is
there anyone else on the list who is having this problem who could create a new
mail account, enable POP3 logging and download everything on the server until it
hangs and then provide the log file for the message before the one where it hangs?

At any rate here is the source for the previous message taken from Netscape
4.76, hope this helps:

#######Begin Message
X-Apparently-To: [e-mail] via web5304
Received: from bflitemail6.bigfoot.com  (HELO bigfoot.com) (208.156.39.208)
  by mta229.mail.yahoo.com with SMTP; 08 Feb 2001 10:48:21 -0800 (PST)
Received: from fort-point-station.mit.edu ([18.72.0.53])
        by BFLITEMAIL5.bigfoot.com (LiteMail v3.00(BFLITEMAIL5)) with SMTP id
08Feb2001_BFLITEMAIL5_3567_125363726;
        Thu, 08 Feb 2001 13:49:40 -0500 EST
Received: from grand-central-station.MIT.EDU (GRAND-CENTRAL-STATION.MIT.EDU
[18.69.0.34])
        by fort-point-station.mit.edu (8.9.2/8.9.2) with ESMTP id NAA12229;
        Thu, 8 Feb 2001 13:47:56 -0500 (EST)
Received: from melbourne-city-street.MIT.EDU (MELBOURNE-CITY-STREET.MIT.EDU
[18.69.0.45])
        by grand-central-station.MIT.EDU (8.9.2/8.9.2) with ESMTP id NAA21544;
        Thu, 8 Feb 2001 13:43:12 -0500 (EST)
Received: from sarae (DEBAUN.MIT.EDU [18.154.0.57])
        by melbourne-city-street.MIT.EDU (8.9.3/8.9.2) with SMTP id NAA25244;
        Thu, 8 Feb 2001 13:42:54 -0500 (EST)
Message-Id: <[e-mail]>
X-Sender: hross@hesiod
X-Mailer: QUALCOMM Windows Eudora Pro Version 4.0.2 
Date: Thu, 08 Feb 2001 13:41:55 -0500
To: (Recipient list suppressed)
From: Hillary Ross <[e-mail]>
Subject: sloan phd application
Mime-Version: 1.0
Content-Type: text/plain; charset="us-ascii"
X-Mozilla-Status: 9001
X-Mozilla-Status2: 00000000
X-UIDL: 5c6a6b2d031e5936de2e279935fa5cc3

We are in receipt of your Sloan PhD application, which is complete.  You
will hear from us once admissions decisions are made.
########End Message

Comment 50

[Brad Nixon]

Attachment: message sources and headers where problem occurs

Comment 51

[Brad Nixon]

I've created an attachment which contains the full message sources and internet
headers of the last message that was successfully downloaded and the first
message the Moz failed to download. I took this info out of Outlook Express.
Kind of disappointing to have to switch back to that since Moz mail has worked
pretty well for so long... :( Hope this helps. 

Comment 52

[Brad Nixon]

Can someone nominate this 0.9.1? This is a major problem for POP account users
(which I think is most people). Sorry for the spam.

Comment 53

[Navin Gupta]

Moving to mozilla 0.9.1. thanks for attaching the headers. 

Comment 54

[Navin Gupta]

I fwd' ed these messages to the server, after saving them in a folder.
I was able to download them successfully. It looks like we need an exact 
replica of this message on the server. 

Comment 55

[David :Bienvenu]

try edit msg as new and readdress them

Comment 56

[Navin Gupta]

Edit As New also doesn't help. I am able to download both the messages. 

Comment 57

[David :Bienvenu]

are you using the yahoo pop server for that test, Navin? That seems to be the
problematic one.

Comment 58

[Navin Gupta]

works with yahoo.co.uk pop server as well.

Comment 59

[scottputterman]

Moving to 0.9.2.  We're working on trying to find a reproduceable case.  If we
can find one in time then we can move this back into 0.9.1

Comment 60

[Navin Gupta]

Just updating that i had done test on both win32 and linux

Comment 61

[Sheela Ravindran]

Just updating the bug that I have also been trying to see if this problem shows 
up again. I created a new yahoo pop account. I created about 40 new messages to 
this account (pop.yahoo.mail.com) and was able to download all of them 
successfully. 
I have tried so far with two builds 05-22-08 and 05-23-08 builds on linux.  I 
did not hang on any message.  I will keep an eye testing randomly on the latest 
builds to see if I hang while downloading messages. I have sent different kinds 
of messages to this account and have had no luck so far.  

Comment 62

[scottputterman]

adding PDT+.  Kevin you had mentioned seeing this.  Do you still see this?

Comment 63

[kmurray1115]

I'm actually seeing a different error (login failed), so I won't morph this 
(long) bug with that problem. :-)

Comment 64

[Navin Gupta]

*** Bug 83740 has been marked as a duplicate of this bug. ***

Comment 65

[Navin Gupta]

Attachment: patch to try out

Comment 66

[Navin Gupta]

I have not been able to reproduce this problem. If anybody has a debug build and
can reproduce this problem, could try out this last patch, it would be nice. 

Comment 67

[esnible]

I created bug 83470 which is a duplicate of this bug.

I found the messages which trigger the bug were always ending with four ASCII
nuls (\0\0\0\0).  Check out my attachments under the duplicate bug.

I can reproduce this on Win2K with Moz 0.91 as well as Linux.

Comment 68

[John G. Myers]

That's bug 83740.  

This is arguably a broken server.  RFC 2822 prohibits NULs in messages.  Mozilla 
should probably strip them.

Comment 69

[Mike Young]

OK, I believe I am seeing this same bug. I can reproduce this 100% through my 
company's online store. 

We just decided to go with NS6.1 from NS4.76. Since my company wants a browser 
from "A reputable name" we had to wait until netscape released its preview 
release 1.

My company www.floralconceptsintl.com has an online store which sends a receipt 
when you purchase a product online. It also sends an "order arrival" notice to 
an email address at work reminding us to get the new order and process it. When 
I installed NS6.1PR1 (moz .9.1) These messages refused to be downloaded. Any 
other messages on the server after this one would not be downloaded. 

The issue that I see is that I can reproduce this at work and at home (2 
different ISPs) Both are POP3, and I have a POP log from my home account. (will 
attach)

I can also ask my boss if she will allow one of the netscape employees to place 
a test order so you can get one of these receipts. (I'm pretty sure she will let 
 one or two... e-mail me if you'd like to) (Or you could buy some nice dried 
flowers!)

I will also attach a copy of a receipt and an "order arrival" notice I was able 
to get through NS4. WHether this will help or not I don't know.

I hope this helps you all, and Please tell me if I need to post this also 
through the Netscape Feedback Center or a different bug report.

tested on NS6.1 PR1 and Mozilla 2001061404

Comment 70

[Mike Young]

Attachment: POP3 log. First time I let Mozilla timeout. Second time I hit stop

Comment 71

[Mike Young]

Attachment: a receipt email from NS4 that won't download in NS6.1

Comment 72

[Mike Young]

A note also, I can successfully download one of these receipts if I forward it 
from NS4. (Either inline, quoted, or attached) 

Also, If I close NS6.1/Mozilla and then restart it, I Will have the message in 
my inbox. however, Mozilla will not delete it from the server so it will 
download it again. and again. and again. If I close out of mozilla I can have 
many copies of the same message.

Comment 73

[esnible]

You are having trouble reproducing?

I have just created a Yahoo mail account holding a single message which
facilitates reproduction.

Create a new POP account in Mozilla 0.91.  Set the pop server to
pop.mail.yahoo.com.  The account name is test69360.  The password is moz69360. 
After creating go back and SELECT LEAVE MESSAGES ON SERVER SO THAT IF YOUR PATCH
WORKS THE MESSAGE STAYS ON YAHOO FOR THE NEXT GUY.

Click "Get Msg" and wait ten minutes for the timeout message.  There is a
message in the mailbox, but it will never arrive.  I have only tested this with
Linux but I'll bet money Win2k builds manifest as well.

Comment 74

[Navin Gupta]

thanks to esnible, I am able to reproduce it now. No ETA.

Comment 75

[Navin Gupta]

Attachment: proposed fix

Comment 76

[Navin Gupta]

As jgymyers points out that the server should not be sending any nulls. 
So the fix is basically to strip nulls from the buffer. I need review. 

Comment 77

[Suresh]

r=suresh

Comment 78

[selmer (gone)]

who is the sr= for this bug?

Comment 79

[Navin Gupta]

cc mscott who is the sr for this bug. 

Comment 80

[Scott MacGregor]

the risk is pretty high for this fix unfortunately as this is an extremely
critical and fragile piece of code used by all our mailnews protocols. The
change looks safe but we frequently break this cod when we change it. So history
isn't on our side. I think naving's done all the testing we can on it without
getting it out there so sr=mscott

Comment 81

[Christopher Blizzard (:blizzard)]

a=blizzard on behalf of drivers for 0.9.2

It's worth the risk and after staring at the patch for a while I couldn't find
anything wrong with it.  We'll be keeping an eye on it, though.

Comment 82

[Navin Gupta]

fix checked in. 

Comment 83

[Sheela Ravindran]

Used test69360 test account and the message that has problems downloading. This 
message hangs while downloading on all three platforms. Checked on 2001060508 
builds on win98,linux and mac.  

With build 2001062211 win98,
2001062206 linux,and 2001062208 mac, verified that the same message was 
downloaded with the above builds after the fix.  

Comment 84

[esnible]

Attachment: POP3 log of this problem using 2001062721 build.

Comment 85

[esnible]

Recent builds are successful in downloading the test69360 test message.  Yet,
the problem still occurs for me on other similar messages.

I tried to create another test case with a message content identical to the
message which appears in the POP3 log I attached, but my attempt did not
reproduce the problem.

I suggest that this bug be reopened.

Comment 86

[Sheela Ravindran]

Please don't reopen this bug. Ensible, If you are still having problems
downloading with a specific message please log a new bug. It could be because of
a different problem. This bug is too long already and it is going to make it
harder for someone to go through all this information. We can refer to this bug
in the new bug since this has lot of information.