yashsingh1/xdaforums huggingface dataset:
[Android Apps and Games] Dark_Eyes_:
I understand your reticence Marcel, but I agree with @fraschi51 that it would be useful to have some way of telling that a message was auto-classified. I intend to use it mostly for Spam, so it won't be clear if the message was moved there by the server or by FairEmail (unless looking at the log, but it's a dit tedious). Maybe have a specific color for the title if adding an icon is not an option? Not a big deal though, for now my interest would only be to help assess how this new feature performs. I guess it will take a few days before the table has enough information to start moving messages on its own. I agree that in the end, however the message ends up in Spam won't matter if it's correctly classified. Anyway, I'm thrilled to see this in action. Thanks again!
[Android Apps and Games] fraschi51:
Somehow I don't seem to have understood the automatic classification properly yet. I thought that it was there to move mails from the inbox to possibly better fitting topic folders. This would mean that you don't see such mails in the inbox anymore, but on the other hand you don't know in which of the numerous topic folders a new classified mail has ended up - unless you study all the lines in the log, because searching there is not possible either. But then you would have to check the option 'Automatically store classified messages' in the properties of all topic folders, because moving *all* classified mails into *one* (collection) folder doesn't help. Where am I making the thinking error, what is the correct intention?
[Android Apps and Games] M66B:
Your understanding is basically correct, but since this is an experimental feature, better start with one topic folder.

For classification to work, it needs to be enabled in the miscellaneous settings first. This will enable 'learning' mode.

For messages to be auto classified, which is automatically moving to the target (topic) folder on receiving messages in another folder (inbox), auto classification for the target folder needs to be enabled in the folder properties of the target folder.

By manually moving messages you 'learn' FairEmail where they belong. You can fast train by clearing local messages of a folder and synchronize the messages again.

You'll probably want to enable new message notifications for the target folder.
[Android Apps and Games] fraschi51:
Only there (in the target folder) or also in the inbox?
[Android Apps and Games] M66B:
Only for the folder(s) where you'll want messages to be move automatically to. So, probably not for the inbox.
[Android Apps and Games] fraschi51:
But if after a while FE learned from my manual moves which would be the correct topic folders (instead of the one collection folder), I still can't (except by turning on notification for each of those folders) determine which of them mails were moved to, can I?
[Android Apps and Games] M66B:
You can't directly see which messages were auto classified, but normally this will be the unread messages. I will think about a way to make this visible.
[Android Apps and Games] fraschi51:
'Unread' is not enough in my opinion ... e.g. I have many topic folders with many unread mails, because I have already read them in another account. Thanks for thinking about another way.
[Android Apps and Games] M66B:
Version 1.1441 is available on GitHub now and will be available.

Changelog/download:

Releases · M66B/FairEmail

Fully featured, open source, privacy friendly email app for Android - M66B/FairEmail

github.com

There is now an indication to show a message was auto classified, which will be used to prevent auto reclassification too.

If you are happy with the app, I would appreciate it if you reviewed the app in the Play store. Since the average Play store rating puts an emphasis on recent reviews, updating an existing review might be worthwhile too.
[Android Apps and Games] M66B:
The FAQ about message classification has been updated:

FairEmail/FAQ.md at master · M66B/FairEmail

Fully featured, open source, privacy friendly email app for Android - M66B/FairEmail

github.com
[Android Apps and Games] Dark_Eyes_:
So declassifying a message will remove the icon too?

Also, I guess messages in the Spam folder already moved by the server won't train FairEmail, right? That will make it a lot harder to train FairEmail to trash spam messages automatically because most messages end up correctly in Spam because of the server. Could it be done that new messages in an "auto-classified" folder train FairEmail, no matter who put it there? Maybe at least for the Spam folder.

I saw also that you added an option to prevent endless loop for Spam. Couldn't it be prevented by telling the server the message isn't Spam? I think this is possible with Gmail ("Report not as spam" or something like that). Maybe that's not possible through IMAP though. What do you think?
[Android Apps and Games] M66B:
Declassifying will not remove the "classified" indicator because it is used to prevent an endless loop too.

New messages in a folder, also the spam folder, will always train the classifier, regardless of how the message got there.

'Report not as spam' is not available via IMAP, but generally this is the same as moving the message out of the spam folder.
[Android Apps and Games] M66B:
Version 1.1442 is available on GitHub now and will be available in the Play store test program after Google's approval, which will take a few hours and sometimes a few days.

Changelog/download:

Releases · M66B/FairEmail

Fully featured, open source, privacy friendly email app for Android - M66B/FairEmail

github.com
[Android Apps and Games] heinhuiz:
Aha, so is that how messages still kept ending up in my spam folder, even after I deleted all rules myself? The classifier already got trained by messages that existed in the target folder before I turned on the feature. I have 'reset' the classifier by turning it off (and on) three times - let's see how it works.
[Android Apps and Games] M66B:
If you use the latest version, auto classified messages will be marked with a push pin icon.
[Android Apps and Games] M66B:
Version 1.1443 is available on GitHub now and will be available in the Play store test program after Google's approval, which will take a few hours and sometimes a few days.

Changelog/download:

Releases · M66B/FairEmail

Fully featured, open source, privacy friendly email app for Android - M66B/FairEmail

github.com
[Android Apps and Games] fraschi51:
Where we find the option to use local spam filtering?
[Android Apps and Games] M66B:
Tap the warning triangle just above the message text and there will be an option to enable the local spam folder. Note that this is just a shortcut to enable classification (miscellaneous settings) and auto classification for the spam folder.
[Android Apps and Games] M66B:
@Dark_Eyes_ the latest Android update does not fix language detection ...
[Android Apps and Games] Dark_Eyes_:
Thanks for letting me know, it was on my to-do list to check tonight. Very disappointing, can't believe we will have to wait for Android 12!
[Android Apps and Games] M66B:
I think it is pretty bad customer support, especially given that I reported this problem already in the beta test phase of Android 11.
[Android Apps and Games] M66B:
Version 1.1444 is available on GitHub now and will be available in the Play store test program after Google's approval, which mostly takes a few hours.

Changelog/download:

https://github.com/M66B/FairEmail/releases

Some changes caused reclassification not to work properly, which has been fixed with this release.
[Android Apps and Games] Surfinette:
I just updated my 5-star rating on the play store.

Thank you Marcel for the best and most feature-rich email client.

Happy New Year!
[Android Apps and Games] M66B:
Version 1.1445 is available on GitHub now and will be available in the Play store test program after Google's approval, which takes mostly a few hours.

Changelog/download:

https://github.com/M66B/FairEmail/releases

Searching on the server has been simplified by skipping the account selection when there is just one account and by automatically searching in the archive (all messages) folder for Gmail accounts.

The message classifier will now consider words before and after for a more accurate classification.

Please share your experiences with the message classifier.
[Android Apps and Games] zzz2002:
Installed 1445 turned on "classify messages".

Took a look at the note 163 "what is message classification" it mentions an option "Use local spam filter". Only I cannot find that option - where can I find it.

Everything seems to be working "perfectly".

TIA
[Android Apps and Games] fraschi51:
Read the post #17346
[Android Apps and Games] M66B:
Version 1.1446 is available on GitHub now and will be available in the Play store test program after Google's approval, which takes mostly a few hours.

Changelog/download:

https://github.com/M66B/FairEmail/releases

The message classifier has been improved, causing existing incompatible classification data to be reset. This means you'll need to train the classifier again.

Please share your experiences with the message classifier.
[Android Apps and Games] eff-:
Thank you for what seems to be an excellent app with excellent support, @M66B ! I moved over to FairEmail from K-9 Mail and bought the Pro version pretty quickly after trying it out for a while. Not sure if I need the additional features right now (although account colors seem convenient now that I think of it), but I wanted to show my support for a developer like you.
[Android Apps and Games] zzz2002:
Thanks!
[Android Apps and Games] M66B:
Version 1.1447 is available on GitHub now and will be available in the Play store test program after Google's approval, which usually takes a few hours.

Changelog/download:

https://github.com/M66B/FairEmail/releases

Besides a few small improvements, this version adds settings for the message classifier, which are documented in this FAQ.
[Android Apps and Games] fraschi51:
Couldn't it make sense to somehow take the criteria of existing filter move rules into classification? Then, at some point, it might be possible to dispense with these rules altogether, because they would automatically be executed correctly by the classification?
[Android Apps and Games] M66B:
I understand what you are asking, but I see no way to match filter criteria and classification because it works very differently (rules vs statistics).
[Android Apps and Games] Dijx:
Hi,

Background:

- I'm using shared inbox

- I have plenty of folders, some of them are enabled to be shown in shared inbox

- google accounts have IMAP folders (tags? labels?) called 'All mail', which do as the name says - shows messages from all folders, inbox etc.

- I also have threaded view enabled in fairEmail.

And now the issue: for messages in shared inbox that are not in folders (in inbox), I only see one message - and one line info below that there's a duplicate in [gmai]/all mail. But for messages in folers I'm seeing as a tread, i.e. one in [gmail]/twitter, one in [gmail]/all mail. So two taps in message, two taps to be back.

Bug, feature, misconfiguration? Is there any way to just disable [gmail]/all messages from further processing by fair Email? Like 'ignore like non-existant'?

Thanks in advance.
[Android Apps and Games] M66B:
Do you mean by shared inbox the unified inbox of FairEmail?

Can you please provide a few screenshots showing what you mean?

Just to be sure: are you using the latest version of FairEmail?

The duplicate message entry should only be there when opening the message from the archive folder (all messages folder).

Is the archive folder correctly selected in the account settings?
[Android Apps and Games] Dijx:
Yes, unified inbox of FairEmail. Latest version from GooglePlay (professional). Archive folder is set in account settings (dedicated imap folder created by me).

Here are the screens:

1. Twitter is in dedicated folder, lubimyczytać is not:

Lubimyczytać expands by itself once opened as expected, I collapsed it manually to show information about duplicate found in [Gmail]/All mail

3. And the twitter, same massage seen as duplicate in threaded view:
[Android Apps and Games] M66B:
Which folder is shown in the first screenshot?

What is the exact name of your archive folder?
[Android Apps and Games] Dark_Eyes_:
@M66B, I saw in the commit history that classification was a pro feature at some point and now it's free. I believe it really is a premium feature and could easily be made a pro feature again. Even local spam folder should be pro IMHO.

Anyway, just my 2 cents :)
[Android Apps and Games] Dijx:
The first screenshot is unified inbox, cointaining total of 4 accounts; account marked blue is gmail account with issue described, which has 20+ folders; several of those are synced and marked "show in unified inbox', one of those is Twitterinfo shown on 3rd screenshot . Two unblurred messages are those on next two screens. And yes, duplicates are filtered out (3-dot menu on the upper bar), enabling and disabling it has no effect, while in 'lubimyczytac' (2nd screen) I can see it as on 3rd screen when I disable filters for duplicates.

Archive folder is named 'Archiwum', which is literally 'archive' in polish and this exact word is used commonly in polish email services.
[Android Apps and Games] M66B:
I see a message in Odebrane with a duplicate (=same message) in [Gmail]Wszystkie

and a message in [Gmail]/TwitterInfo and another one (not the same) in [Gmail]Wszystkie

So, totally three different messages.

I don't see messages in Archiwum, which would be filtered from conversations, unless you open the conversation from the Archiwum folder.

Basically, FairEmail just shows how the messages are stored on the server and Gmail is a bit odd because it allows the same message in different folders (which is according to the IMAP standard not allowed).

So, I am still not sure what the problem is ...
[Android Apps and Games] Dijx:
On my screens, Wszystkie = All mail, a google's system label/folder representing all or nearly all messages in the mailbox, I suppose.

So: when message is filtered out by google soon after recieving and moved to Twitterinfo folder (is NOT in inbox anymore), it is seen double in FairEmail: once in Twitterinfo folder, one in Wszystkie folder. So, on the 3rd screen, it is exactly the same message, but FairEmail is *probably* seeing it as tread, not even a duplicate?

While on 2nd screen, message in in google inbox, not user's folder; FairEmail is also seeing it in two folders (inbox and wszystkie), but more/less correctly detects is as a duplicate and hides it gracefully with info.

In both cases, those are not even a duplicate - those are the same messages seen through two different endpoits (I suppose google's 'all mail' is something like virutal folder, a label presended as a regular IMAP folder to the clients), with the same messageID etc. Every single message put in any folder in google account is also visible in [Gmail]Wszystkie and AFAIK nothing can be done about it.

So - like you said - google allows showing the same message twice, but:

- why there is one FairEmail's behaviour for messages in inbox (detects dupe - OK), another behaviour for message in user's folder (seen as two differend messages, as a tread I suppose)

- why is it still happens even if synchronization is disabled for [Gmail]/All mail or/and folder is hidden? Perhaps an option like 'ignore folder and pretend it is not there' would solve that...

Moreover, I'm pretty sure that this behaviour is new... like FM's new release or me messing with configuration.

PS. I have no idea why are we talking about archive... I have no problems theither with moving messages to archive neither with seeing it where not expected.
[Android Apps and Games] M66B:
There were no recent changes related to this.

If you use [Gmail]Wszystkie as archive folder, please select [Gmail]Wszystkie as archive folder in the account settings: Navigation menu, settings, step 1, tap account, at the bottom.

If you don't, which is fine, messages in this folder will be shown and not filtered out because FairEmail will consider them as labeled (to speak in Gmail terms).

The messages will be shown individually if the message is only in this folder or as duplicate when the message is also in another folder. Folder = label for Gmail.
[Android Apps and Games] M66B:
Version 1.1448 is available on GitHub now and will be available in the Play store test program after Google's approval, which usually takes a few hours.

Changelog/download:

https://github.com/M66B/FairEmail/releases

The message classifier has partly been rewritten for a better result. The existing classification data is incompatible and will therefore be deleted. In other words, the classifier should be trained again.
[Android Apps and Games] M66B:
Version 1.1450 1.1451 is available on GitHub now and in the Play store test program after Google's approval, which mostly takes a few hours.

Changelog/download:

https://github.com/M66B/FairEmail/releases

A new folder option was added to enable/disable message classification. By default message classification is enabled for the inbox and spam folder only now.

Please see this FAQ for more information:

https://github.com/M66B/FairEmail/blob/master/FAQ.md#user-content-faq163

@Dijx thanks to @Ines* your duplicate message problem will likely be fixed now.
[Android Apps and Games] fraschi51:
BTW: Downloading from Github has been working very, very slowly here for some time at "normal day and evening" times - taking minutes or hours if it works at all. Maybe it is due to the country or the network operator ... Only in the early morning / at night the download works as usual in seconds.
[Android Apps and Games] ouzowtf:
Same, Telekom says it's an issue with bad peering from GitHub.

Via mobile data connection (Vodafone) it's faster, but not as fast as it should be.
[Android Apps and Games] O_DoC:
Hi,

must be region related only 'cause its working "as usual" here (reg and cell).

Good luck !
[Android Apps and Games] M66B:
Version 1.1452 1.1453 is available on GitHub now and will be available in the Play store test program after Google's approval, which usually takes a few hours.

Changelog/download:

https://github.com/M66B/FairEmail/releases
[Android Apps and Games] chris42too:
Would it be an option to allow

encrypted

google backups? I know the features state "No google backup", however on this mechanism some backup solutions, like seedvault rely as well. Handling google as an unsecure backend and enforcing client side encryption could be an alternative to completely denying the feature.

The seedvault app gives some links to the encryption part: https://github.com/seedvault-app/seedvault/wiki/FAQ#why-do-some-apps-not-allow-to-get-backed-up

and also an example how Transporter solved this: https://github.com/grote/Transportr/commit/4dc38f429f75909a088d8bd8a5b3b5ddd8030f71

I understand that there is a settings import/export, however that is a manual process.
[Android Apps and Games] M66B:
I don't want to app to depend on any Google features like this, which is why there is an in-app export/import. Moreover, Google backup has a limit of 25 MB, which is not always enough to backup everything.
[Android Apps and Games] chris42too:
It would not depend on it, just allow other options. Like seedvault where I can't see such limit on size, as I can use my own backend.

EDIT: to be more specific, it would just enable the android backup mechanism, of which google is one usage form, but also adb backups or seedvault.
[Android Apps and Games] M66B:
There are two backup options: files backup (maximum 25 MB) and key value backup (maximum 5 MB).

Data backup overview | Identity | Android Developers

developer.android.com

Since the database both stores configuration data and message headers, it will always be larger than 25 MB and storing all settings in 5 MB is not an option either.

As far as the documentation tells, the backup will always go to Google and there is not something like a custom backend.
[Android Apps and Games] chris42too:
Yes saw that as well. I guess as I have seedvault with my own backend that size issue was not apparent for me. Seedvault is registered as an extra backup transport and by that changing the target.

I guess the export/import is not collecting the message headers, hence you could write the export in a file and only add that as data to the backup configuration and restore from that on a new install.

For users that can't change the target a forced client encryption would be helpful to not leak data.
[Android Apps and Games] M66B:
Version 1.1454 1.1455 is available on GitHub now and will be available in the Play store test program after Google's approval, which usually takes a few hours.

Changelog/download:

https://github.com/M66B/FairEmail/releases
[Android Apps and Games] lordearl:
Is there a way of only displaying certain folders (ie. hiding some folders)?

I have a group of users that share a single mailbox and allocate individual tasks/emails to folders within the mail accounts, so we are looking for a way to only view the relevant folders for each user.
[Android Apps and Games] M66B:
Long press a folder in the folder list, select edit properties and there will be a checkbox to hide the folder.
[Android Apps and Games] heinhuiz:
It was even worse, see my edit. May you can make the default account setting part of the settings export?

---------- Post added at 10:50 PM ---------- Previous post was at 10:47 PM ----------

What does ACL mean in the Accounts list? just under the cloud symbol of my (now) default account.
[Android Apps and Games] M66B:
The export contains all settings (except the folder display names, which will be fixed).

"ACL" is a message from the email server. There is probably a file permissions problem on the server.

Edit: accounts and identities are imported with synchronizing off and an account cannot be primary with synchronizing off.
[Android Apps and Games] Oswald Boelcke:
@M66B - Marcel, fyi if interested. Mike Kuketz, for me one of the - if not even THE - protagonist in privacy in Germany did mentioned your FairEmail in his Microblog: https://www.kuketz-blog.de/fairemail-datenschutzfreundlicher-android-e-mail-client/

He's definitely monitoring all your "products" and has very positively reported about XPrivacy and NetGuard in the past, beginning of 2018 he very briefly mentioned XPrivacyLua, too.
[Android Apps and Games] ouzowtf:
Not as detailed as in your post, but I already mentioned that ;)
[Android Apps and Games] M66B:
Tomorrow I will likely work on FairEmail. First I will try to fix all reported bugs:

workaround for crash on vector drawables, which seems to be on some Sony devices only

crash on getHeaders

empty reply in some cases

crash on selecting attachment without storage access framework present

inconsistent search results

export folder display name

occasional underlining

anything else?

After that I will implement the promised features, which are:

browse on server setting per account

global enable/disable

anything else?

I will also look into improving IMAP IDLE to save on battery usage, I already have an idea for this.

I have one big new feature in mind, but I don't know if the day will be long enough. I want to change how messages are shown to a view of expandable (threaded) message(s). This will replace the current list of messages in a thread and the individual message view. This will not only make reading messages in a thread simpler, just expand the messages you want to view (which will mark the message as read) and scroll up/down, but will make it also possible to navigate to messages from a new message notification. Comments on this are welcome.
[Android Apps and Games] heinhuiz:
- settings export to include folder display names (don't know if there are any other omissions?)

Can't comment on the new thread view, I have to see it first.
[Android Apps and Games] M66B:
Folder display name export is added to the list of bugs..

Just imagine the current threaded message list with expandable messages. Expanding will replace the header by the full message view.

Take a look at NetGuard to see how expanding/collapsing app details work. It will be similar.