yashsingh1/xdaforums huggingface dataset:
[Android Apps and Games] tliebeck:
SystemPanel 2.0.b10 now available in the beta channel.

Analysis section improved to use power usage and wake lock information to determine important issues. This feature is very much still experimental.

Enhanced Statistics Setup now offers setup options via ADB or with the companion Windows app (which is simply a tiny shell invoking ADB commands and verifying their outputs).

Updates to Live/Status page.

More battery data in Device/Power section.

I think the "Analysis" piece has great potential for everyday users to find problems with their devices. This version is a fairly big step forward, but it definitely needs more work. I'm curious to hear any opinions on it as is. Right now I think it's fairly informative but a bit complex. May/likely wind up with a tabbed format to provide a basic overview and detailed data.

The scores in "Analysis" are now calculated based on CPU usage, Wakelock usage, and reported device power usage. Android 6 devices only have CPU usage, while non-root Android 7 devices might only have Power/Wakelock data (though they hopefully will get CPU usage in a later release).

I may wind up adding more elements to this, e.g., multiplying by an additional factor if the app wasn't running in the foreground with the display on (the fact that I'm playing a 3D game and that it's draining my battery rapidly is relevant, but an app doing it silently in the background is more relevant).

This release has been initially uploaded to the beta channel. It will be placed in production soon assuming further testing proceeds well.

The beta channel is for those that want early access to new releases, you can opt-in here: https://play.google.com/apps/testing/nextapp.sp

The product itself is of course beta, but opting into the beta channel will get you new releases earlier.
[Android Apps and Games] scutworker:
Ignore
[Android Apps and Games] tliebeck:
I just rolled out a 2.0.b10.1 release to all. It's the same item as 2.0.b10 with one trivial bugfix from Google Play crash reports. The reported crash was from the batterystats system, and only occurred when the device provided broken data.
[Android Apps and Games] baris.m:
I'm getting a ton of "unaccounted" battery usage, though some apps do appear on the list. Is this a known issue with Samsung firmware?
[Android Apps and Games] schlimig:
I too am getting a tonne of unaccounted battery usage, on a Galaxy Note 3 running a custom ROM (Magma NX Note 7 port).

I have also downloaded the windows tool to enable enhanced stats, run it, it reported that it had enabled them but when I go to enhanced stats in the settings menu, it says "Not available on this device". Can anyone help with this? Am I missing some step here?
[Android Apps and Games] dimm0k:
[MENTION=2954544]tliebeck[/MENTION] first of all, wonderful app! I'm hoping you can help me demystify what exactly is counted as "processes" under "System Processes" in the Live view. Is there a way to specifically see all of these processes and only these processes? the reason I'm asking is because I have two devices, LGV20, where one is a backup and the other is a daily driver. the weird !@#$ that's driving me mad is that the backup device has pretty much all the apps I want to use (over 200+) installed, while the daily driver has the absolute essential apps I use, but after 3 or so days the daily driver starts getting very sluggish in response while the backup device has been up and running for over 20 days straight. mind you the backup device has what the daily driver has and I have tried using these same exact apps, but I have not found the cause of my problem. the only difference I can see using your app is that on the backup device there are approximately 5-600 processes under "System Processes" while the daily driver has over 1100+ processes. I feel this extra amount is causing the pain I'm feeling and any help would be appreciated!
[Android Apps and Games] schlimig:
I'm quite frustrated by this app. I paid for it to support the developer but there is no response to queries, either here or by contacting through Play Store. I can't enable enhanced stats, the app in this thread says it has worked but it doesn't. Virtually all of my usage shows as unaccounted so I'm really stuck here. This was supposed to help fix a problem, not add another one for me to deal with! I wish I hadn't bothered paying for it now :(
[Android Apps and Games] tliebeck:
If you can see "Unaccounted" usage in SystemPanel, then you have enhanced stats enabled. SystemPanel can only record what your device is reporting, and it's reporting "unaccounted". Unaccounted means the battery level dropped and the system isn't seeing corresponding resource usage anywhere (display, connectivity, processor use by apps, other hardware).

In my experience of using ROMs with SystemPanel, unaccounted use is generally application processor use. Stock firmware tends to report accurately. I think some ROMs simply aren't assigning any battery drain to app CPU usage. Saw this on a Note3 with Lineage 14.1, thankfully fixed a few weeks ago.

If you have root access, you can probably get a decent picture of what's going on by enabling root access in SystemPanel and watching processor consumption by apps over time.

Another option is to look at wakelock usage. Constant wakelocks can be a significant drain. On the devices I've tested, this does tend to wind up being reported in battery usage as well.

If you want a refund, just email android at nextapp dot com with your Play Order number.
[Android Apps and Games] tliebeck:
Sorry for delay in response...that is odd. Both are same phone and same ROM? Do both have cell service?

There's no option to hide non-system processes. There is an option to sort them by name (in menu), so the list will be more stable for comparison.

Definitely interesting that the DD has twice the process count, but would not pin its issue on that for certain. Is memory usage comparable on both?
[Android Apps and Games] dimm0k:
well the two phones are the LGV20, but different variants. One is the H918 (DD) and the other is the US996, with both having cell service and both on stock ROM aside from being rooted with Magisk. while stock ROM they are slightly different in version numbers. I was able to narrow down the possible causes as to why there were so many processes and thusly caused my device to be sluggish after a few days. I'm not exactly sure which apps are doing this, but I for some reason I decided to use 'top' to see what was going on except this time I ran it without any parameters and that listed everything. as I scrolled through I noticed a lot of 'grep' and 'sh' processes and killing those not only freed up my memory, but also made my device snappy again. that said, I did have two questions that I'm hoping you could answer.

1. being that I let SystemPanel2 use root, does having it open while I monitor things invoke an 'sh' process to acquire root? I don't know much in terms of processes and root, but it seems this should be normal?

2. is it possible to see what opened a specific process, whether in Android itself or in SystemPanel2?
[Android Apps and Games] Edjee:
In the latest beta the time is not readable between the graph's ( see pictures). Besides that is works like a charm:svetius:
[Android Apps and Games] tanago:
I don't have the "top apps" menu which tracks the % used by each process, how do I get. I'm running the app for about 3h now, non-rooted
[Android Apps and Games] gInx52:
After updating to Oreo, it seems some of the functionality like the cpu usage, processor display, etc. has disappeared. Is there anything that needs to be done on the user's end? I'm currently not rooted and I remember running an application to enable some of the functionalities after initial install. Do I need to do that again?
[Android Apps and Games] tliebeck:
Unfortunately CPU utilization in any form is not available without root on Oreo. They disabled access to /proc/stat entirely. Strongly disagree with their decision here.

You should still see battery stats recorded as before on Oreo. If you're not, you can use ADB to reset them. There should be a warning about enabling enhanced statistics on the main screen. I did see one case where this wasn't showing up. You can always manually re-enable them with:

adb shell pm grant nextapp.sp android.permission.PACKAGE_USAGE_STATS
adb shell pm grant nextapp.sp android.permission.DUMP

I am experimenting with monitoring CPU frequency as an alternative. Monitoring the CPU scheduler's setting of clock frequency should be a decent indicator of utilization...it's driven by CPU demand. SystemPanel currently shows "system load" as a replacement when /proc/stat is not available, but I find that data read. CPU frequency is actually stored by most devices in a very easy to process format, i.e,. time spent at each frequency state, so we can use just read/record those stats over time with almost no overhead. SystemPanel already shows a rolling average of this data, but it'd be put into plot form in live, history, and analysis sections.
[Android Apps and Games] tliebeck:
Sorry just noticed this was unanswered :(

In Android 7 and later, per-app CPU use is only available with root access due to Google disabling the ability to read anything in /proc.

If you enable "enhanced statistics" it will show long-term battery drain caused by apps, which generally correlates with CPU usage. It's certainly not a replacement, but can solve the same problems.
[Android Apps and Games] candiesdoodle:
Hi

Quick question - can i disable permissions for apps through this app? i dont see any edit action for permissions.

Am i missing anything.

Thanks.
[Android Apps and Games] candiesdoodle:
: my question was specifically for this perm..can't edit the apps which have this perm.
[Android Apps and Games] tliebeck:
You can edit some permissions if you have root access, but it's limited by Android. Additionally SystemPanel needs improvements in this area.

The explanation is kind of long....and apologies if it sounds like a rant... :)

First, Android is (in my opinion) very broken with regard to app permissions. In stock Android, there are two separate systems for controlling permissions, i.e., the standard Android 6+ user-granted permissions, and the legacy "App Ops".

After Android 6, many permissions, (i.e., calendar, camera, contacts, location, microphone, phone, storage, and SMS) must be explicitly granted by the user at runtime, and the user can deny them. The app can refuse to operate at all if the user elects not to grant the permission.

This happens only if the app targets Android 6+ in its manifest. If it doesn't, the app is automatically granted all permissions it requests. So bad apps just target Android 5.1 and they're good to go. The old apps can have their permissions revoked using the "App Ops" system, but they're granted by default.

LineageOS (and derivative ROMs) have a third system of permission management in the form of "Privacy Guard" to fill this gap. You can remove permissions there and apps are simply denied the capabilities without notice. E.g., deny contacts access to an app using Privacy Guard, and an app just thinks you don't have any contacts. Privacy Guard will let you disable the start-at-boot permission as well. Internet access can even be denied to apps, albeit the UI for it is in a confusing place (under data usage).

SystemPanel does have some permission capability, but it needs much improvement. Presently it only supports editing permissions from the "Permissions" tab of the apps view (you can't edit them from individual app listings).

SystemPanel also only supports displaying/editing permissions using the Android 6+ API. I have tried adding support for managing permissions using the legacy app-ops stuff...there's no documentation and the source code is just short of insane. There's certainly a way to do it though and I want to get it supported. Also want to add support for displaying the LineageOS-specific Privacy Guard state and internet restrictions.

So basically, SystemPanel needs a good bit of work here...I may even wind up moving the "Permissions" tab in to a new "Privacy" top-level section.
[Android Apps and Games] candiesdoodle:
Wow. Thank you so much for that explanation. feel enriched to have to have read it..

Going to closely follow the development
[Android Apps and Games] tliebeck:
SystemPanel 2.0.b11 now available in the beta channel.

Now showing top three power-consuming apps on home screen (when possible) instead of CPU consumption. Old behavior can be selected from UI settings.

Replaced in-app-billing system with less-crashy modified version from FX File Explorer. (The stock Google IAB code is not thread safe.)

Recording CPU clock frequency and System load average to database. These plots are disabled by default in the history screen on devices that support overall CPU usage monitoring (i.e., Android <= 7). They can be enabled via menu on history screen.

CPU clock frequency is now shown as a pie plot rather than a vertical line.

Added CPU frequency and load plots to Live/Status screen.

In free version, replaced Google-sourced ads with internal links for FX File Explorer download and SystemPanel Plus upgrade (these are displayed in place of other ads).

This release has been initially uploaded to the beta channel. It will be placed in production soon assuming further testing proceeds well.

The beta channel is for those that want early access to new releases, you can opt-in here: https://play.google.com/apps/testing/nextapp.sp

The product itself is of course beta, but opting into the beta channel will get you new releases earlier.
[Android Apps and Games] peterbonge:
On my Nexus 5X with Oreo there is a strange number at the end of the live block on the front page. It also has a strange line break. See screenshot.

And the new system load graph is always fully loaded and also has this strange (+0) at the end of the title. See screenshot.

And what unit has this graph?

And what about the graph for the battery temperature?

And the problem with the GSM signal? It still takes too much time to be shown on the live page.
[Android Apps and Games] dimm0k:
great app! any plans for more customizable time frames when looking through the History section?
[Android Apps and Games] tliebeck:
The system load average is not unfortunately not the best statistic to use to describe "system load", but it's the only one we have on 8+ without root at present. If the system were averaging 30% CPU use, the system load would be 0.3....except that every process waiting on I/O adds 1.0 to system load. Android devices typically have a eight to twelve processes waiting on I/O so your "no load" point actually winds up being in the 8-12 range. If you tap that +0, you can set the baseline so the plot will actually show meaningful data.

Cell signal strength is an even greater train wreck on Android. There are a few ways to get it, and each option has significant faults. As you've seen, the fault of the present implementation is that it takes a bit (because we have to wait for an update message). The method to directly query it is one of the most ridiculous APIs I've ever seen, and the methods to actually get LTE signal are hidden/undocumented (i.e., I have to call them using reflection). It's completely insane. The direct access APIs also return random garbage on many devices, notably most things Samsung has made.

Still need to record battery temperature.
[Android Apps and Games] Crescendo Xenomorph:
[MENTION=2954544]tliebeck[/MENTION] any chance to create PC-companion app to connect to this app via anything (usb/bt/wifi) to monitor the device while other app is in foreground?

or maybe web-based interface like FX's Web Access.....

make it Plus only feature ^^
[Android Apps and Games] tgp1994:
I'm sorry I missed your reply, I don't know why XDA didn't notify me...

I'm running Android 6.0, and I do have root (enabled in the app as well). I've tried the adb thing before but it's difficult when you can't reliably reproduce the CPU usage. That's why I was hoping SystemPanel would tell me. Are there any plans to include these other processes in the list at some point?
[Android Apps and Games] dimm0k:
[MENTION=2954544]tliebeck[/MENTION] any plans for more customizable time frames when looking through the History section? also, is there any way to get this app to use less RAM? I'm on Android 7.0 and according the the Memory Usage, this app consumes on avg about 388MB in the past 3 hours and 664MB for the max usage!
[Android Apps and Games] tliebeck:
The main problem here is the memory statistic you're seeing is "Resident Set Size" (RSS).

The RSS value includes any memory SystemPanel is using in addition to any "shared memory" used by supporting Android/system libraries it's associated with. For example, if SystemPanel were using 100MB for it's own code/data and associated with 100MB of shared libs, it's reported as 200MB of memory usage.

If another app is using the exact same 100MB of shared libraries, it'll be counted against the other app as well.

Just taking a look at an S7 Edge (stock, unrooted, "U"-firmware with no carrier bloat, some Samsung bloat disabled), the sum of all "RSS" memory values via the "top" command is 7.7GB. The phone is actually only using 2.1GB of it's 4GB of memory. This is because if four apps are referencing the same 100MB of memory, it counts as 400MB of memory in sum-total.

The screenshot below is of a terminal window and AndroidStudio. This is the result of running SystemPanel and navigating through each of it screens, i.e. going through the slide-out and then visiting each sub-tab. This is again on the unrooted S7 Edge. You can see Android Studio's report of memory usage in the red box at the bottom.

It peaks at about 40MB of memory.

Then in the terminal window, the output of top shows RSS in the upper red box. This command was started at the same time.

The RSS peaks at 567MB.

Seeing SytemPanel's RSS so high does tick me off, and it's disproportionately high compared to other apps that use about the same amount of real memory (e.g., FX File Explorer).

You can see the same internal heap memory statistics reported by the VM by opening SystemPanel and going to the Settings->About page.
[Android Apps and Games] dimm0k:
thank you for clearing this up and for the details on this Android issue! do you know of any way to determine the actual RAM usage of apps or if it's even possible on the device itself without using Android Studio on a computer?
[Android Apps and Games] pote2639:
Am getting a lot of unaccounted on my battery stats, is this tells me that something wrong with xiaomi firmware or rom?

RR 7.1.2 with mi 5s plus.

Edit: okay weird, it doesn't show unaccounted till I fully charged my phone. On normal usage it normally shows stat.
[Android Apps and Games] DAE51D:
Love this app first of all. Looks amazing, gives tons of data. I paid for it too to support.

* Desperately needs a CPU & Temperature meter in the top notification bar where the clock vs other symbols are in Android UI.

* Also "System Panel - Live - Running" never works! I did the PC way with the little exe to run. Says it's good, but app never shows anything.

Galaxy S7 Edge.

No root.
[Android Apps and Games] OldOldDev:
The app is looking great so far. There is one thing that's puzzling me though. Why is it showing a GSM signal when there isn't a SIM card currently in?

The only thing that I can guess is that because phones need to be able to make an emergency call, then it's showing the 'GSM signal' were I to make such a call.
[Android Apps and Games] Crescendo Xenomorph:
Unaccounted can be: your battery's drop...

Coz I got old Samsung Note 8.0 with drop battery (only 50% of original capacity can be used), it always shows unaccounted around 1800mAh.... But its only some 100mAh on my Mi5s Plus....
[Android Apps and Games] tliebeck:
SystemPanel 2.0.b12 now available in the beta channel.

New method of retrieving process listings for Android 8.0 devices with root access. This corrects issues specific to Android 8.0, which had very poor performance in SystemPanel previously.

Miscellaneous bugfixes.

This release has been initially uploaded to the beta channel. It will be placed in production soon assuming further testing proceeds well.

The beta channel is for those that want early access to new releases, you can opt-in here: https://play.google.com/apps/testing/nextapp.sp

The product itself is of course beta, but opting into the beta channel will get you new releases earlier.
[Android Apps and Games] jim45:
As per Google's new policy regarding apps' usage of accessibility services for functionality not related to ease-of-access, what will happen to the foreground app tracking feature? Is there an alternative non-root method to collecting that same information or will it be removed altogether?
[Android Apps and Games] tliebeck:
Usage view is extremely useful for those with addiction disorders. It uses the accessibility service to show the percentage of a day spent in individual apps and on the device in general. The only update that I believe needs to happen is to specifically note this fact.
[Android Apps and Games] simeoni:
SystemPanel2 beta does not show app usage details. Device OnePlus 2 with Delight ROM (Oreo).
[Android Apps and Games] Citadis:
Just upgraded to Android 8.0 on my Xperia XZ and now SystemPanel shows a permanent "Monitoring Active" notification. I know I can just block notifications for this app in Android settings to hide it but that's a dirty trick in my opinion, is there a way to hide the notification directly from the app settings?
[Android Apps and Games] klaust58:
On my Nexus 7 with Oreo, SystemPanel detects and shows only one CPU.

Love this app and use it for years now!

Gesendet von iPhone mit Tapatalk
[Android Apps and Games] tliebeck:
With Android 8.0, apps running in the background are required to show persistent notifications if they want to be excluded from being shut down. I think hiding it as you are is the only solution, but I need to take a closer look to see if there's any other option.
[Android Apps and Games] Citadis:
Ah I didn't know that, I understand now. Quite annoying to see Android becoming stricter and stricter with apps with every new version... :mad:
[Android Apps and Games] fivefour:
In the Usage section could you add "Since charged" and "Since unplugged"?

https://i.imgur.com/e4igQIC.png
[Android Apps and Games] tliebeck:
SystemPanel 2.0.b13 now available in the beta channel.

Bugfixes

Additional required text regarding use of accessibility services

This release has been initially uploaded to the beta channel. It will be placed in production soon assuming further testing proceeds well.

The beta channel is for those that want early access to new releases, you can opt-in here: https://play.google.com/apps/testing/nextapp.sp

The product itself is of course beta, but opting into the beta channel will get you new releases earlier.
[Android Apps and Games] uhi711:
The same on my Note 8, it never shows running processes, it keeps searching forever. View attachment 4374408
[Android Apps and Games] tliebeck:
You have to have root to show running processes past Android 7.0. I hope to implement support for recording longer-term CPU usage over time using the "dumpsys" method that is possible without root access, but the data source is far from ideal and appears a bit variable between devices.
[Android Apps and Games] uhi711:
Ok, thanks, I didn't know that root is required also to show running processes. I thought that the permission to read usage data access is enough. For the meantime I won't root the phone because it is still in its warranty period and with Samsung these days you can never know.