yashsingh1/xdaforums huggingface dataset:
[Android Apps and Games] M66B:
Version 1.1685 is available on GitHub now and in the Play store test program after Google's approval.

Changelog/download:

https://github.com/M66B/FairEmail/releases

@ctoecps you'll want to install this version

If you use an email account on a server with an invalid security certificate, I would appreciate it if you tried the quick setup wizard. There is new logic to get a similar domain name from the security certificate now and I like to know if this works as expected.
[Android Apps and Games] nadir husain:
Don't think any developer is going into such depth on any platform. Marcel you are amazing.
[Android Apps and Games] maybeme2:
I agree. This is an amazing app and you are amazing. That is the truth.

If that idiot reviewer really believed what he wrote how come he is still using it and updating his review? Something is fishy.
[Android Apps and Games] M66B:
I am amazingly stupid, so version 1.1686 needed to be released on GitHub and in the Play store test program, to fixed a crash which I caused by changing something and not thinking good enough about it. Maybe it was related to being late in the evening ...
[Android Apps and Games] nadir husain:
Didn't Einstein also make a mistake or two?
[Android Apps and Games] M66B:
His relativity theory still holds today, so, did he?

5 times Einstein was wrong | Astronomy.com

Physicists are constantly trying - and failing - to prove Albert Einstein wrong. We take a look at some of his biggest blunders.

astronomy.com
[Android Apps and Games] nadir husain:
FairEmail will also be around for many decades.👍
[Android Apps and Games] stillnoexpert:
First of all: On one of my phones I have Fairemail with a clone by AppCloner.

With the cloned app there is the following problem with the sent folder.

The sent mails remain locally in the folder, appear with gray font and are not synchronized.

What could be the problem?
[Android Apps and Games] M66B:
Dimmed (grayed) messages are not (yet) synchronized with the email server.

Try to pull down the sent messages folder.

I am assuming you are using the latest version of the app.
[Android Apps and Games] Android.Addiction:
I need to revisit the topic of the message classifier. I still can't get this thing to behave properly. That percentage value keeps creeping lower and lower (in the debug logs) so I keep having to adjust the percentage. At first messages I moved to "Inbox/Updates" from "INBOX" were 12% or so. Now they're 6%. I have yet to see a single message get automatically moved.

My first feedback is that this system is too complex. I think for end users, it should use a different configuration system. Instead of setting 2 percentages, provide a different mechanism to configure it like a single slider that controls how "strict" matches have to be: Strict -> Moderate -> Relaxed. In addition to that, it should maybe "learn harder". When I move a message from, say, `marketing@amazon.com` to my updates folder, next time a message from that same sender comes in, move it over. In a way this is sort of like automatically building filter rules.

As it stands, it's just too nondeterministic and difficult to understand. The percentages do not mean anything to me and feel arbitrary (because I do not (and quite frankly don't care to) understand the algorithm it uses to make decisions). I'd really love to see a way for this to be both simplified and made more deterministic and reliable. The idea of having smart message classification (similar to how Gmail does it) that is service-agnostic is incredibly valuable and I think it deserves the improvement!
[Android Apps and Games] fraschi51:
Here it is the same: apart from a few initially wrongly classified mails, no mail has been classified here, although the sliders are set to 5 % and 20 % and the classification is switched on for all folders concerned and the move option is also switched on for the destination folders.
[Android Apps and Games] stillnoexpert:
This does not change anything.These mails are not synchronized, but other sent mails from other devices are downloaded.

(The other (not cloned) version of Fairmail does not have this problem.)
[Android Apps and Games] M66B:
The question is why the messages in your Inbox and Inbox/Updates folder are not enough distinguishing. I don't know the answer to that because I don't know the contents of the messages.

The message classifier of FairEmail was specifically designed to deliver percentages, where 100 % means that a message is exactly the same as all messages which were classified before. In other words the message classifier is in fact 100 % deterministic.

So, the percentage says how similar a message is compared to the messages classified before for the same folder. The message addresses, subject and text are being considered for this.

If the percentage is low and decreasing, the messages are not very similar and the classifier won't be useful. In this case you can better use filter rules:

https://github.com/M66B/FairEmail/blob/master/FAQ.md#user-content-faq71

The message classifier isn't and will never be comparable to a neural network fed with a lot of data of a lot of people running on powerful servers (privacy!).

Suggestion: create some more folders and move similar messages to the same folder each time and see what happens with the percentages.
[Android Apps and Games] M66B:
Please check if the sent message folder in the account settings is correct.
[Android Apps and Games] Android.Addiction:
So to be clear, I don't think this thing needs to be "neural network" level complicated to justify simplifying it. I think that is still well deserved and my #1 feedback at present. It just needs to be easier to understand and make reliable.

I brought this up before but also not being able to delete junk out of my folders because it interferes with learning percentages is also a huge negative.

I feel like 6% is incredibly low (unless deleting messages has caused this) so maybe there's another issue. I do still see sometimes messages in my inbox saying "Loading body" (or something) when I open them, even though I have the "Fetch message text" option enabled in INBOX properties. Maybe that has to do with it: The body isn't getting downloaded when it should, thus affecting the percentages?

I also multi-select and move messages in bulk. Not sure if that has something to do with it. Sometimes I don't even open those emails first because I know early on they're in the wrong folder.

EDIT: Also if it helps, I'm happy to share the contents of some of these emails I'm moving.
[Android Apps and Games] M66B:
A little more about the percentages:

probability: messages with a calculated similarity percentage below this value won't be considered for classification.

difference: how distinguishing two classes need to be for consideration. Simply said, if the percentage is the same for all folders, no choice can be made.

Note that you can see the percentages in the main log via the navigation menu.
[Android Apps and Games] M66B:
Please try this: turn the message classifier on/off three times to reset the classifier data (there will be a confirmation of this) and make sure the message classifier is enabled for at least two folders and not for the inbox and the trash folder. After you have moved a few messages into the target folders, check what the percentages in the main log say.

Messages for which the message text isn't downloaded won't be classified until the text is downloaded.
[Android Apps and Games] stillnoexpert:
yes, it's the correct one. (like in Thunderbird)
[Android Apps and Games] Android.Addiction:
I think the issue is why the message text isn't downloaded when it should be. I'd like to figure that out. Then the classification won't get delayed.

I cleared classifier data as you instructed. I went to Inbox and disabled "Classify new messages in this folder". I kept classifier enabled (and auto move) for the "Inbox/Updates" folder (This is the only one I have so I couldn't enable it for two like you wanted).

I moved two XDA reply notification emails to "Inbox/Updates" and I saw in logs a single percentage around 64%, so it seems to be better.

If the issue is that INBOX had classification enabled, why is that allowed? Shouldn't that option be disabled at all times for Inbox?
[Android Apps and Games] M66B:
I wonder how easier to understand and reliable should be defined. If you want to have it work fully automagically, this would probably boil down to a trained neural network, "understanding" the meaning of the messages. Some call this "AI", which it isn't, but that is another discussion.
[Android Apps and Games] M66B:
By default inbox classification is enabled for spam filtering. So, for comparing messages in the inbox and spam folder.

Note that the classifier won't work with one folder target because there needs to be a comparison. You should be able to enable the classifier for the inbox too.

Not downloading the message text could be an explanation for your issue.
[Android Apps and Games] M66B:
FairEmail will attempt to upload local-only messages to the remote sent messages folder. I am not sure why that doesn't happen in your case. Are there any error messages? Is the account connected to the email server (check the icons in te navigation menu, see for an explanation the legend via the same navigation menu).
[Android Apps and Games] fraschi51:
I will wait until a mail arrives, which I think should clearly be moved to another folder, and then look for the percentages in the log.
[Android Apps and Games] Android.Addiction:
Automagically is a broad term. I think I'd be happy with it being easier to understand and abstracted a bit from the details (I consider the percentages an implementation detail). I was leaving the specifics up to you since you're more familiar with the feature and how it behaves, but I'll share some thoughts:

Make the match percentage visible in the email itself. For example, I open an email, click "...", go to "View Classification Data", a modal appears that shows the match percentage for each folder that has classification + move enabled. Show text in GREEN for matches, RED/ORANGE/YELLOW for classification that did not match. Example:

Marketing: 25.45% (Match)

Updates: 5% (No Match)

Family: 10% (No Match)

Instead of showing the user 2 percentage sliders, go with 1 slider that combines the values. Example: Strict (25%/75%) -> Moderate (15%/50%) -> Relaxed (5%/25%). You can add a toggle under Miscellaneous to show both sliders for the advanced users.

When a message isn't moved due to lack of match, have an option in that message to understand why. For example, show individual percentage matches for each field. Like:

Subject: 90% match

Body: 5% match

Reason: Body was too different

Make permanent and temporary deletions NOT affect the classifier (Once I move something and delete it, it still learned it). If it already does this, make that super clear to the user.

What is the benefit of the INBOX having classification enabled? All mail already arrives at the inbox by default and as I understand it, only the percentage it calculates after it moves to a different folder is what matters. If I'm right, hiding the classification checkboxes for INBOX makes sense to me.

Things like this would really go a long way to helping understand why things did or didn't happen. It would also help users understand how to reconfigure the classifier as needed. Not having to enable debug logs to see why messages didn't move helps. My biggest issues right now are:

I don't know what the percentages mean (even if you explain it, it still doesn't make sense). The values need to be dumber / easier to understand for the user.

I don't know if it's working or not (a folder needs to help a user understand why a message wasn't moved)

Ok before I thought you said to disable classification in the inbox. But I will turn it back on. So regarding my feedback above about hiding the checkbox for INBOX, maybe you should always permanently leave INBOX enabled. Even if they aren't using spam filter, because messages go there by default, it's the first point of comparison. I don't think corner cases are enough to justify having the option there which adds confusion IMHO.

How can we diagnose the downloading issue for message text? I can send you logs if you want after I see an email say it is downloading when it shouldn't.
[Android Apps and Games] Android.Addiction:
Another idea to improve. Consider these two scenarios for an email that is classified:

A message was moved that SHOULDN'T have been moved

A message was NOT moved when it SHOULD have been moved

False positives and false negatives, basically. In this case, you could add an "Fix Bad Classification" button for emails (supports bulk select and single mail view) that does the following:

Trains the current "simple" classifier setting (Strict, Moderate, Relaxed). For example. Say I have an email that was supposed to be moved but didn't because the percentage was too low. I also have Moderate selected in settings that starts at (15%/50%). When I click "Fix Bad Classification", it will decrease those percentages. You can calculate the amount to adjust based on how distant the percentages are from the current setting. So for false negatives (point #2), Moderate goes from (15%/50%) to something like (12%/40%) (Strict and Relaxed will need to be adjusted proportionally somehow as well). In that example let's say the classified percentage was 10%. It went from 15->12. If the match percentage was instead 5%, that's a greater distance so it would move the percentage even lower. Maybe something like 15->10.

Once the classification has been adjusted, move the email to the folder it should have gone to.

I posted this idea separately because it sounds incredibly complex to implement and there are probably corner cases (What if I have 3 folders where it was supposed to go, which one do you calculate it for?). I realize some of this might not be helpful or doable in those cases. But my goal right now is less about giving you good ideas, more about sharing my thoughts to help spark a better solution in your head (if there is one). Best I can do is share some discussion and hope it results in some meaningful path forward.
[Android Apps and Games] M66B:
Interesting discussion ;-)

I can add a dialog for classification data of a message, although if the message itself is already classified, it won't be entirely correct anymore, but still useful I guess. Storing the data is not a good idea considering the overhead (=battery and storage space usage).

Strict, moderate, relaxed will depends on the actual messages. For example, if a message text is always the same and only the sender is different, the similarity percentage will be high. So, there can't be a general strict, moderate or relaxed setting.

There is no percentage for individual fields, only for the message as a whole. I could add settings to enable/disable fields (addresses, subject, text), but that would only make things more complicated and besides that it going to look like rule based, like a certain address or a certain subject.

Permanent deletion will not affect the classifier, moving to trash will affect the classifier only if the trash folder is enabled for the classifier.

For spam filtering (inbox vs spam folder) message classification for the inbox needs to be enabled.

Regarding the downloading: please check if downloading message texts and attachments is enabled in the folder properties.
[Android Apps and Games] Android.Addiction:
Yes this is enabled already.
[Android Apps and Games] BreckZeBoulay:
Back to 1.88 stable for me.

The new way of displaying the messages and all the consequences on the unfied box and the management of single messages are too bad.

EDIT :

:fingers-crossed:
[Android Apps and Games] heinhuiz:
Don't worry, I love it already.
[Android Apps and Games] M66B:
Fine with me, but the new way of handling messages will not go away and only the latest version will be supported.

Remember why I don't want to release FairEmail in the Play store? I just cannot make everybody happy.
[Android Apps and Games] BreckZeBoulay:
As always you are the dev.

The sad thing is that simple works very well and it's replaced by something complicated.

I think most of emails are simple message, and the priority is given to multiple messages in thread.
[Android Apps and Games] M66B:
IMHO it has only become more transparent and simple, in the process adding new features, like navigating directly to a new message from a notification. FairEmail was always about conversations, see also the description. If you receive a lot of email, like me, conversations are essential to keep an overview.

I am not sure what your problem is, so please explain it in detail. Maybe it can be solved.

The thread view was always there and "just" opening a message was changed to expanding in place. Much easier and simpler in my view.

Note that single messages will be expanded by default in a future release. I cannot do everything at the same time. I have already been working for several days on this.
[Android Apps and Games] m0d:
The new view format is not bad. And, is not an issue.

Fairly straightforward.

Looking forward to single message being expanded

Also, if a message is selected either from mailbox folder or notification, it would be great to have it expanded as well if it is in a thread of more than 1 message, since that specific message has been clicked, (other messages in thread hidden is fine).

This is quite selfish. This is not what email is. There are specific apps for projects which might better suit your needs.

Multisharing and using Unread as priority should not direct development. There is already Star and many apps have labels (maybe you need to switch to an app that better supports labels).

I hope FairEmail, will be that an app for emails and not project managment, agile, or pair-programming.

Unread emails are not new emails. So they should npt be treated the same way. They are just that Unread. Having an unread email of 20days ago appear in notification because it suits your email-management-style is again selfish and leading development astray.

I suggest you fork this project and undo latest commits and you will have it exactly as you like, your own personal email-management thingamajiggy.

You can even keep it updated with other changes.

EDIT:

Besides, the proper way would just fwd it to yourself and it will appear top of the list new and unread. (And not unread somewhere in the heap of emails)
[Android Apps and Games] pedrud:
In the 1.93 beta, a couple of problems have been reintroduced:

* swipe to delete/archive does not work

* action bar (or whatever it is called) is now at top of emails just below the header and scrolls up screen, not at the bottom
[Android Apps and Games] m0d:
Swipe needs to be enabled in advanced menu in setup:

Swipe actions,

If you searched you will have found responses to both issues, though.
[Android Apps and Games] pedrud:
Thank you and apologies. I'm just on a short break at work and didn't have time (or think about it).
[Android Apps and Games] heinhuiz:
It is not selfish at all, at least not more selfish than the majority of the feature requests in this thread. I am is using a feature (like I call it) or a bug (what you consider it to be) to my benefit. Which one of the two it is, is not mine to decide.

Apart from that, marking messages unread to ensure that co-workers will also read it is not oppisong 'what email is'. On the contrary, it is one of the benefits of IMAP over POP3 and widely used in small teams.

Don't expect any more replies from me on this matter, though, before I start calling other people names too.
[Android Apps and Games] pedrud:
I have this enabled and it is still not working.
[Android Apps and Games] M66B:
Swiping will only work in the conversation view.
[Android Apps and Games] heinhuiz:
And it works, even with the message expanded.

Can you put the swipe action icon (archive, trash) to the top instead of in the middle of the message, where it is now? On longer messages it falls below the bottom of the screen. Alternatively, you could only let the header move when you swipe.
[Android Apps and Games] m0d:
As you wish, I was just discussing the matter..

As far as I can see, marking emails as read and unread works fine in app. So, it actually does exactly what you want. Mark read messages as unread!

However, wanting it to appear in "

new

email notification" is a bug. As it is not new email. It is an unread email.

You can always use this feature, as you like to call it, by forking and maintaining the project.

But, the issue is having an Email app to notify you for Unread messages is highly specific case. Where having a fork is more appropriate.

I am sure there are apps for small teams that handle situations better. Also messaging apps can also be used, save email as pdf share it to your small group.

These are solutions using non-specific tools.

But, this app already supports "marking messages unread to ensure that co-workers will also read it"
[Android Apps and Games] chantoine:
Sorry if this was discussed and answered before.

When I'm in a thread of mails, when deleting one, I think it would be better if the app stayed in the thread, with no return to the unified inbox after each deletion.
[Android Apps and Games] M66B:
Deleted messages are not part of a conversation anymore, so the only way would be to stay in the empty conversation, which seems not logical to me.
[Android Apps and Games] chantoine:
Even if the conversation is not empty ?
[Android Apps and Games] BreckZeBoulay:
This how

I

see the handling of emails. (some features are already in place, or will be in place, or are abandonned)

From the status bar :

- tap on the notification, open the app and directly see the message (the body, not only the title)

- swipe the notification, no particuliar action, just remove the notification (and message is still marked as unread)

- some actions can be done directly is the notification especialy delete

From the unified box :

- For simple message, keep the swipe actions delete/archive

- A tap on a simple message opens the message "totally" (the body of the message, not only the title)

- A tap on a thread opens the thread and then you can expand/swipe the messages

From the message itself :

Nothing to say :D

Dear Marcel, be sure that I have a lot of respect for your work (I can't do 1% of what you do). So work at your pace (which I find high) and develop your app as you wish.

But when some features/possibilities disappear while they were simple and worked well (like the swipe for simple message in unified box), I just give my opinion.

A few days ago I teased you to keep Fair Email simple, here I go again :p
[Android Apps and Games] M66B:
Trashed messages are shown in the trash folder only.

Deleted messages are gone forever.

If a message has some value to you, don't trash/delete it, but move it to a folder.
[Android Apps and Games] chantoine:
You didn't understand me.

Say I have a conversation with 3 mails.

I open the first one (bottom of the thread) find it of no use, and thrash it.

I think I should stay on the thread with the 2 mails remaining, and do not go to the unified inbox.
[Android Apps and Games] wimstefan:
Not too much for me.

I really like the explanatory text at the start.

The only thing coming to mind is that for me "Manual setup" is on par with the "Wizard" logically. So perhaps two buttons besides each other

[Wizard] | [Manual setup/Settings]

would make more sense?
[Android Apps and Games] M66B:
Version 1.1687 is available on GitHub now.

Changelog/download:

https://github.com/M66B/FairEmail/releases

IMPORTANT

The message composer was changed to load, store and display drafts in another, more consistent way. Of course this was tested, but edge cases might have been overlooked. Therefore this version should be considered as a somewhat experimental version.

This might affect:

Sending a message from another app

Editing existing drafts

Editing replied-to messages as (formatted) text

Editing a message as new message

Saving and loading drafts

Storing drafts on the email server

Please report any problem you discover, so it can be fixed.