Author Topic: Duplicated interlinked emails in mailbox folders (not GMail)  (Read 10281 times)

Rachel Ambler

  • Full Member
  • ***
  • Posts: 140
  • Responsis, plura interrogandi
    • Random Thunks
Duplicated interlinked emails in mailbox folders (not GMail)
« on: January 03, 2015, 09:33:43 pm »
Kostya,

Build: 1.5.1.12
Server: Smartermail Enterprise (CloudAccess.Net Cloudmail)

Reporting this on behalf of Ann; I'm not seeing this issue, she is though on both her phone (GSIII) and tablet (2012 N7), although for completely different emails on each device.

We've got some emails that seem to be identical copies of each other, e.g. you can mark one of them as read on the phone, perform a refresh, and the other will be marked as read as well. Delete one, the other is deleted.

Now, bear in mind it'll only be on her phone for this email. Her tablet will have the same issue for different emails but will show only one copy of the dupe on her phone.

So, now let's make this a little more wacky ; she found one instance a dupe on her phone, but 8 on her tablet, out of the 8 on the tablet, 5 were actually showing different time zone offset results  :o (1 hour difference between the two) - the one I looked at was from the West Coast and so was in PDT and we're on the East Coast so using EDT (this was from July, so Daylight savings was in effect). From what I could tell the SMTP headers on both were identical. Unsure why the dupes are showing the 1 hour offsets here.

So, now comes a caveat emptor; all these emails were before 10/16 - an important date to possibly consider because that's when I did a conversion to move her from GMail to Smartermail.

That said, if it were an issue with the underlying mail store inside Smartmail, then I'd expect the problems to be visible on both devices for the same emails.

Both devices had the old GMail config blown away and a fresh new Smartermail config setup made before downloading emails.

Not sure on what logging you want and from what point here so, let me know when I should turn logging on and what action I should do that would force logging of these emails (I'm going to take a guess and say I should just perform a refresh with logging on).

I fully expect that backing up the config, doing a Delete Data, restoring and re downloading will probably go a long way to 'fix' this, but it seems like an awful amount of work, besides, this fascinates me and I'd much rather we scalpel our way through this than dropping a nuclear bomb from orbit. 8)

NB: I have tried upping the limit of checked emails to 10,000 (or whatever the maximum is) in attempt to get AM to re-evaluate what it has stored, but that didn't seem to help any.

R
« Last Edit: January 03, 2015, 09:37:15 pm by Rachel Ambler »

Rachel Ambler

  • Full Member
  • ***
  • Posts: 140
  • Responsis, plura interrogandi
    • Random Thunks
Re: Duplicated interlinked emails in mailbox folders (not GMail)
« Reply #1 on: January 03, 2015, 10:16:12 pm »
Yes, but that does nothing to help fix whatever underlying issue there might be. Right now we've got forensic evidence that can be used by Kostya to diagnose the issue and see if a fix is needed or not.

Blow that away and he's got nothing.

I've not been in this game for 30 years now without learning that wiping everything is a last step resort in times like this.

Rachel Ambler

  • Full Member
  • ***
  • Posts: 140
  • Responsis, plura interrogandi
    • Random Thunks
Re: Duplicated interlinked emails in mailbox folders (not GMail)
« Reply #2 on: January 03, 2015, 10:28:43 pm »
Kostya,

FYI: I went ahead and turned on the mack-daddy logging, did a refresh, and sent the whole shebang off to you. Let me know if you didn't get it etc. and what else I can do to help.

R

Kostya Vasilyev

  • Hero Member
  • *****
  • Posts: 12740
Re: Duplicated interlinked emails in mailbox folders (not GMail)
« Reply #3 on: January 04, 2015, 10:20:37 pm »
Wow. Quite something, isn't it.

In IMAP, every folder is independent of all others in same account -- the spec even uses the term "Mailbox" to refer to folders.

How messages might be linked "behind the scenes" on the server is not visible via IMAP -- now of course we know about Gmail and its labels, and if the account's datastore is somehow corrupted, anything's possible.

I agree that it is strange that the issue is not identical on the two devices.

Now...

I understand that the content of each set of linked messages is identical, correct?

Also message headers -- when you do View -> Message headers in Aqua is identical, correct?

About the time difference -- by default, Aqua uses the "internaldate" reported by the server, not the Date header. This "internaldate" is a server-side message attribute, part of the IMAP spec, and it's "out of band" with respect to message content (just like read / unread / starred states).

I just found your debug log in my Gmail Spam folder, will take a look now.
Creating debug logs for diagnostics: https://www.aqua-mail.com/troubleshooting/

The official FAQ: https://www.aqua-mail.com/faq/

Лог-файлы для диагностики: https://www.aqua-mail.com/ru/troubleshooting/

Вопросы и ответы: https://www.aqua-mail.com/ru/faq/

Rachel Ambler

  • Full Member
  • ***
  • Posts: 140
  • Responsis, plura interrogandi
    • Random Thunks
Re: Duplicated interlinked emails in mailbox folders (not GMail)
« Reply #4 on: January 16, 2015, 03:36:21 am »
All's good now. Finally managed to put the test build on her tablet and got the other 8 emails taken care of.

Thanks for all your help on this!

Kostya Vasilyev

  • Hero Member
  • *****
  • Posts: 12740
Re: Duplicated interlinked emails in mailbox folders (not GMail)
« Reply #5 on: January 16, 2015, 03:12:03 pm »
I still think the origin of all this was at the server -- and sounds like it was importing old messages, specifically.

And then the screenshot you sent me where server search was returning headers for one message and content for another...

Almost seems like the server would return wrong UID values sometimes, maybe inconsistent or maybe not the ones that the app asked for.
Creating debug logs for diagnostics: https://www.aqua-mail.com/troubleshooting/

The official FAQ: https://www.aqua-mail.com/faq/

Лог-файлы для диагностики: https://www.aqua-mail.com/ru/troubleshooting/

Вопросы и ответы: https://www.aqua-mail.com/ru/faq/