Search Mail to include All Mail (Gmail) / Archive question
-
@mib2berlin cool - I am running that. will let you know result later many thanks as ever
-
i rebuilt it but no change I am afraid.
Still a fraction of the results showing up and from what I can tell none of the emails in gmail's "all Mail" - ie those without any other label or folder - are coming through.
I can't say for sure if there are others that are also not coming through - I couldnt be sure until I see the All Mails coming through - but I suspect that is the issue.
Is there something else I can try - I would really love to set this up - it is the reason I am switching to Vivaldi mail.
-
I wonder if it is related to the fact that I cannot archive to all mail.
In my other email application, it has been set up so that if I hit ARCHIVE, it basically removed all labels and sits in ALL MAIL - so all mail is being used as the archive.
If I then find that email in Vivaldi mail it has the archive symbol next to it.
but If I try to archive something in vivaldi mail it asks me to set up an archive folder.
So this suggests to me that may be I have not told vivaldi how to work with gmail's "all mail"
could these be related?
-
@DavyLJones
I am sorry, no further ideas.
Gmail doesn't respect any mail standards, they create there own, like Microsoft.
Gmail labels are not M3 labels, for example.
If you are used to use Gmail for all your mail activities I am not sure M3 will fit your needs.
Give it a week or something to get familiar with it. -
@DavyLJones My stored email is six accounts - four GMail accounts and two others. It's those six that make up the 19GB of storage. M3 uses less storage space than GMail for some reason - probably partly because it doesn't have folders, just a unified database that fakes folders by using labels in the headers.
It definitely searches the "all mail" folders from GMail accounts.
It only takes a few minutes to rebuild the mail search database. I've done that more than once.
-
@DavyLJones I just created a new profile (takes 10 seconds) and added my mostly unused GMail account to it without downloading all message data. Search works just for all terms I have entered.
Please just for testing create a new user profile and set up your GMail account there. Does the search fail just as in the profile you are currently working on? In that case - holy moly. No idea what's wrong. In case that works fine, something is borked in your profile.
-
So I think I have worked out what the essence of the problem is.
Gmail has a folder all called All Mail. It's not exactly a separate folder - it contains everything - stuff in the inbox, the folders, and stuff with no folder or label. Every email in my Gmail is in here.
The way I handle emails is that once I am done with them, if I do not want to file them in a folder I just remove the inbox label or folder and they get dumped into Gmail's All Mail. By default, when I hit backspace on Gmail the email simply has the inbox or other labels removed, and it ends up in All Mail, where I ignore it. The only time I ever access Gmail's All Mail is when I search.
In this way, All Mail acts like an archive.
Right now in one of my accounts All mail there are about 84,000 emails
Vivaldi Mail also has an All Mail folder for that account. But in this folder there are just over 1000 emails only.
So I don't exactly understand what Vivaldi Mail's All Mail refers to on the server.
I suspect Vivaldi is not seeing Gmail's All Mail at all - that is also why my searches don't find emails that have no labels, folders or stars.
So - is it possible for my to manually point Vivaldi Mail's All Mail to Gmail's All Mail? And if not, is there another way for me to help Vivaldi Mail to find Gmail's All Mail.
@WildEnte I will follow your steps next. (new profile)
@Ayespy Apologies if I didnt make it clear but I tried rebuilding the database but it has had no impact on the issue.
-
@WildEnte I made a new profile and added my gmail account - just one for now. I ran a search which on gmail pulls several hundred emails, all uncategorised (not in folders, not labelled, no stars).
I ran the same search on Vivaldi mail. It found zero messages.
-
@DavyLJones So I have tens of thousands in a given GMail account in "all mail" as well. Difference is, almost none of them are without any other folder label. The all are "inbox" or "sent" or some custom folder, except those that are in trash waiting to be permanently deleted. I have never systematically gone through deleting folder labels.
Do you have a folder in GMail named "Archive?" In order to download an email, M3 has to be subscribed to its folder. If it has no folder, it "doesn't exist." I suspect if you created a folder on the GMail server named "Archive" and shoved all those unlabeled emails into it, M3 would download, index, and be able to find them all.
-
@DavyLJones While I am setting up email accounts in M3, I instruct them to create an "Archive" folder on the server. It shows up on the server as [IMAP]Archive.
When I want to archive a GMail from the webmail interface, I have GMail "move" the email to Archive. That removes the existing folder label(s), applies an "Archive" label and moves it to that folder. All such emails are downloaded and indexed by M3.
-
I thought that might be the issue.
I would have to work out how to tell my other clients to work that way. I use two clients that specifically are designed for Gmail so they also by default archive in the same way gmail does - as in, to All Mail. One is Airmail for mac - I think I know how to do it there - and the other is Gmail's own email app for android.
-
You said:
When I want to archive a GMail from the webmail interface, I have GMail "move" the email to Archive. That removes the existing folder label(s), applies an "Archive" label and moves it to that folder.Is that something gmail does in a single click/button press? Did you have to set it up?
-
@DavyLJones It's in the email settings, but it is also presented when you are setting up an account.
If you check it now, I suspect it will set up an archive folder in all of your IMAP accounts.
-
@DavyLJones In GMail on line, you right-click an email or multi-selected batch of mails and select "Move" in the context menu.
You could do the same in M3, and it should have the same effect. But first, of course, it has to have been downloaded.
-
@Ayespy @DavyLJones I now also played with this a bit.
TL;DR: removing all "labels" in GMail adds an archive tag in Vivaldi, so in the Vivaldi Mail client I find those emails in the GMail account Archive subfolder, as well as in the All Mail and the GMail account root if I toggle the view filter for archived messages. So far all more or less as expected. But I did have to right-click folders in Vivaldi and choose "Rerun Filter for Folder" a couple of times, which is odd. @DavyLJones I recommend you do that once on all your GMail folders in Vivaldi, including the root folder.
Long version:
Steps:
I start off with an email in the GMail Web interface which is in Inbox, marked Important, and (as all emails) is also in all Mail.
GMail:
We see here that the email is marked important (yellow >> next to the Subject) and it's in the inbox folder (again to the right of the subject)Now Vivaldi - I (my mail address redacted):
The email header shows where the email appears in Vivaldi, and additionally it can also be found in the "root" account view. Marked by blue dots, I find the email here:
@DavyLJones said in Search Mail to include All Mail (Gmail) / Archive question:
The way I handle emails is that once I am done with them, if I do not want to file them in a folder I just remove the inbox label or folder and they get dumped into Gmail's All Mail. By default, when I hit backspace on Gmail the email simply has the inbox or other labels removed, and it ends up in All Mail, where I ignore it
When I hit backspace in GMail nothing happens. So instead, in GMail's web Interface I remove the "Inbox" mark (to the right of the email subject) - now Vivaldi stops showing the email in the Inbox view (as expected).
As a third step, in GMail's web interface I remove the Important label (by clicking on the yellow >> next to the Subject). So in GMail, I don't see it any longer in Inbox or Important. I see it only in All Mail.
In Vivaldi, removing the last of what GMail calls labels has now done two things: first, the email no longer shows in the "Important" folder (as expected). It still shows in the All Mail folder (as expected) BUT it has also received the Archive marker. So I only see it in Vivaldi in the All Mail folder when I have the "show archived" toggle selected, and it also shows in the Archive folder.
So I always have the email, but GMail's quirky nonstandard use of folders for labels also does a hidden archive tagging. I just notice that in the GMail Interface I have a custom [Imap]/Archive label that - I guess - Vivaldi created with the setting @Ayespy mentioned above "Add Archive Folder if Missing".
This all makes sense but I did have to "rerun filter for folder" a couple of times along the way. Seems like Vivaldi has some issue here.
-
@WildEnte Yes. It's known that removing labels moves an email in M3 to Archive. If course in order to do that, one must first have the email in M3 and it can only fetch it if it belongs to a folder on the server in the first place.
-
@Ayespy I removed the labels on the Gmail interface, not in M3.
I suggest hitting "rerun filter for folder" on the Archive folder in Vivaldi. That made a whole lot of emails appear here that weren't there previously.
-
@WildEnte Amazing. Were these emails that M3 already had, or ones it had never downloaded before? In other words, did you remove all folder labels and THEN fetch the emails, or vice-versa?
-
@Ayespy said in Search Mail to include All Mail (Gmail) / Archive question:
Were these emails that M3 already had, or ones it had never downloaded before? In other words, did you remove all folder labels and THEN fetch the emails, or vice-versa?
Hard to say because I hardly use the GMail account at all. I just noticed that the one email I used to test, after removing the labels in GMail, showed in the Gmail Root & All Mail folders with the Archive toggle enabled, but it didn't appear in the GMail Archive folder in M3. When I chose to rerun folder, 30 emails appeared in a previously empty folder. Most of that are unimportant notification emails from GMail, so ... have they not been fetched before? I didn't have IMAP logging on, can't say.
-
@WildEnte OK.
So I suspect those mails were already locally stored.
The way M3 gets an IMAP email is to access the folder on the server where it lives, to fetch it.
I can't say for sure whether M3 subscribes to "All Mail" on the GMail servers, or whether it even can, since the All Mail category has no folder label of its own. It includes all folders, but it also includes "folderless" emails. I do know that M3 does have an "All Mail" view for GMail accounts, but I'm not aware of that view including any emails that don't have, or have never had, an M3 folder label (inherited from GMail)
I'm going to have to see if I can run an experiment that tries to download folderless emails from a GMail account. Let me think on this...