yashsingh1/xdaforums huggingface dataset:
[Android Software/Hacking General [Developers Only]] Zackptg5:
Big update for binaries - lots of updates, coreutils and patch updated to 9.1, wget2 updated to 2.0.1 and reworked mod version to be more like aria2 where you don't need to work about specifying cert path and such.

Also fixed bugs with updatedb in findutils so you'll want to uninstall and reinstall findutils for that fixed version - thanks to ohmybahgosh at github
[Android Software/Hacking General [Developers Only]] hsnhasantr:
Thanks, I installed it. Is there a Compiled zip file of the new version? I'm using Windows + Android and I don't know how to compile.
[Android Software/Hacking General [Developers Only]] Fif_:
Is Overlay Mount Fix still necessary with Magisk 24.3 on a OnePlus7 Pro running OOS 11.0.7.1 (latest)?

It was certainly necessary to with Magisk 23 in order to debloat product, but is it still the case with Magisk 24?

[Edit:] Apparently yes, Overlay Mount Fix is still needed on a OnePlus 7 Pro running OOS 11 and Magisk 24.3.
[Android Software/Hacking General [Developers Only]] Zackptg5:
Honestly no idea. I got rid of my OnePlus devices a long while ago and quit developing that mod because of that.

Changed bc binary from gnu to the galvinhoward bc
[Android Software/Hacking General [Developers Only]] gingerjoa:
Hi. Does the rootless V4a driver work on android 12? Got error 1, in TWRP
[Android Software/Hacking General [Developers Only]] Zackptg5:
V4A works with android 12. Rootless zip I don't know, haven't had fully working twrp on any of my devices in well over a year. Does your two have any limitations like not being able to mount certain partitions? Lots of the new twrps do. If so, zip won't be able to install properly
[Android Software/Hacking General [Developers Only]] Zackptg5:
Updated several binaries on ccbins. Of note, bashrc, installed with bash binary was updated along with terminal mods. This includes several fixes for A12 and magisk 25. I encourge everyone to reflash ccbins and reinstall bash to get latest versions of both :)
[Android Software/Hacking General [Developers Only]] Zackptg5:
Updated several bins including openssl. Recompiled all binaries that include openssl as a dependency (nmap, tcpdump, aria2, coreutils). I encourage everyone to remove and reinstall these binaries.

Wget2 has been giving me issues so it hasn't yet been updated
[Android Software/Hacking General [Developers Only]] xracerx123:
I managed to install cross compiled binary for android. When it type bash it says no shell found? what should I do?

bluejay@root:/bin # gawk
/system/bin/sh: gawk: inaccessible or not found

Nvm, I found it ccbins on command line.
[Android Software/Hacking General [Developers Only]] Zackptg5:
ccbins is currently broken on magisk v26+. Magisk mouning mechanisms were overhauled in that release so I'll need to make some changes to ccbins
[Android Software/Hacking General [Developers Only]] Zackptg5:
CCbins has been updated for magisk 26! Can now mount/unmount binaries and dependencies on the fly so you can now install/remove bins without requiring a reboot.

Any users still stuck on magisk < 26 will be upgrade to ccbins legacy - essentially the last version of ccbins. Ccbins legacy will not be updated anymore but should continue to work fine with pulling latest binaries and such
[Android Software/Hacking General [Developers Only]] BostonDan:
Zackptg5,

I do appreciate your work. I wanted to inform you that some of the binaries do not seem to be installed (I'm getting an error of read only file system for "touch"ing /system/bin on some of the binaries). I am not certain why this occurs on some of the binaries and not others.

Cheers,

B.D.
[Android Software/Hacking General [Developers Only]] Zackptg5:
Pushed a quick hotfix to the ccbins non-legacy zip.

For ccbins non-legacy, the zip must be flashed to update, it won't self-update due to the last version not being compatible with magisk v26+

Can you send a screenshot and the log in /data/local/tmp? Make sure you grab the log immediately after using ccbins and reproducing the error.

I'm assuming you're not on ccbins legacy right?
[Android Software/Hacking General [Developers Only]] diehard2013:
folks,

what is your preferred terrminal for using ccbins?
[Android Software/Hacking General [Developers Only]] Zackptg5:
Updated ccbins! Due to newer android versions locking down sdcard, I moved all aliases to in-house so terminalmods no longer dependency. Also added kernelsu support and updated some binaries
[Android Software/Hacking General [Developers Only]] bobpiesz:
Anyone else having issues running kitsune mask and using CCBINS? During install I get mount errors and it also causes a bootloop now if I install anything via CCBINS.

I'm not sure if it's CCBINS or kitsune..

I'm on version 26403 of Kitsune (I've attached it to this post)
[Android Software/Hacking General [Developers Only]] diehard2013:
can ccbins.zip be installed within magisk's own module manager (install from storage)?

thank you.
[Android Software/Hacking General [Developers Only]] jacko9000:
Zackptg5,

If you're still maintaining ccbins, for your reference, the latest Magisk Canary (27003) breaks it. Running ccbins gives a "Module not detected!" error message. Nothing else is displayed.

To resolve this, I returned to Magisk Canary (27002), ran ccbins (successfully this time) and restored the last ccbins config I had saved. Everything is now back to normal.

Regards,

Jacko
[Android Software/Hacking General [Developers Only]] diehard2013:
did you have ccbins issues with stable 27000?

my ccbins went crazy.

ccbins wrecking havoc · Issue #131 · DerGoogler/MMRL

it's the third time this happens. I download and install ccbins. reboot and finally go to shell and enter su. I run ccbins to install all binaries. Everything is installed succesfully, so I believe...

github.com
[Android Software/Hacking General [Developers Only]] jacko9000:
I've only had issues with specific ccbins binaries, namely bash, curl and sed. I reported these issues at the time and they were resolved.

Magisk Canary 27003 is the first Magisk where I've encountered the ccbins "Module not detected!" error. The same applies to Magisk Canary 27004 released a couple of days ago.

Otherwise, I haven't had any problems with ccbins since I started using it back in January 2022.

However, I have only ever installed the specific binaries I required from ccbins, which are bash, coreutils, curl, gawk, grep and sed. I have never chosen the ccbins "install all binaries" option in case it breaks my scripts (or indeed those of Android itself). Even before I started using ccbins, I was always wary of updating command-line binaries, especially text-processing utilities (e.g. awk, grep and sed), the bash shell utility, and the sqlite3 database utility.
[Android Software/Hacking General [Developers Only]] tutibreaker:
Here the recovery Log
[Android Software/Hacking General [Developers Only]] Zackptg5:
I can't replicate the error on my end and your cpu is armv8 so arm busybox included should work. I updated the readme for it link to the list of special binaries that may be needed. I don't have any samsung devices but maybe you need one of the ones listed for your device. Either way, not sure how to help you there
[Android Software/Hacking General [Developers Only]] HemanthJabalpuri:
[MENTION=6037748]Zackptg5[/MENTION]

With latest magisk

API is down to 17...

Can you please update unity and other mods like bash to API 17?...

Thanks
[Android Software/Hacking General [Developers Only]] Zackptg5:
Already updated bash. Unity test branch is updated as well. I wasn't going to make it stable since very little changed but I guess I can update it and some of the others today
[Android Software/Hacking General [Developers Only]] HemanthJabalpuri:
[MENTION=6037748]Zackptg5[/MENTION]

i need small help to compile <100kb binary file from https://github.com/divinebird/pacextractor ...

It shows 1 error when compiling .. I dont know how to fix it...

please help sir
[Android Software/Hacking General [Developers Only]] Zackptg5:
See you already fixed it. In case you're still interested, here's build script with fixed pacextractor.c file
[Android Software/Hacking General [Developers Only]] Zackptg5:
Updated bash binaries to 5.0.2. Finally got static arm64 binary now too thanks to [MENTION=7187684]ianmacd[/MENTION]!
[Android Software/Hacking General [Developers Only]] Zackptg5:
Based on what I learned with bash, I finally figured out how to compile coreutils 8.30 for android! However I only wanted cp and mv after I applied some patches to them so they'll have a progress bar functionality so they'll work for sure but no guarantees for the rest of coreutils (you'll probably need to tweak some things). See OP for link to build script (and yes I'll be using these in Unity)
[Android Software/Hacking General [Developers Only]] zputnyq:
Hi [MENTION=6037748]Zackptg5[/MENTION]

Thanks for creating usefull tools,

I've recently tried your kernel sepolicy patcher &

I get a problem using your kernel sepolicy patcher.

It said

mv: can't rename 'boot-new-signed.img': No such file or directory

Do I have to uninstall magisk first to make it works or with magisk is ok ?

I'm on xperia m4 stock 6.0.1 twrp 3.2.1-0 & nautilus kernel.

I can't sent the actual log Idk why. xda app give an error
[Android Software/Hacking General [Developers Only]] Zackptg5:
That's normal so don't worry about it
[Android Software/Hacking General [Developers Only]] Zackptg5:
Updated mods to unity v4.0!

Updated kernel sepolicy patcher to use magisk tools now so it should have better compatibility now

Added coreutils module :)

Added option to bash so you can replace android shell (mksh) with bash. If just normally replaced, this would break boot so it is instead a late-start service script that bind mounts bash over sh each boot
[Android Software/Hacking General [Developers Only]] jcmm11:
[MENTION=6037748]Zackptg5[/MENTION]

If I'm not mistaken then the coreutils module isn't supposed to generate links that would replace OEM modules. However the latest version [v1.1 (8.30)] is generating all 102 symlinks in /system/bin/

Pixel 3 XL, stock, Canary Magisk

Install was via Magisk and the install log showed nothing of interest.

- Copying zip to temp directory
- Installing GNU_Coreutils_For_Android_(with_Advcpmv)-v1.1_(8.30).zip
- Current boot slot: _a
- Mounting /system, /vendor
- Device is system-as-root
Archive: /data/user/0/com.UZTw5Y35DInko0Kb/cache/install.zip
inflating: post-fs-data.sh
inflating: sepolicy.sh
inflating: service.sh
inflating: system.prop
inflating: unity_install.sh
inflating: unity_uninstall.sh
inflating: busybox
inflating: busybox
inflating: util_functions.sh
inflating: install.sh
inflating: module.prop
inflating: uninstall.sh

Unzipping files...
*******************************************
*GNU Coreutils For Android (with Advcpmv) *
*******************************************
* v1.1 (8.30) *
* by zackptg5 *
*******************************************

- MagiskSU detected

- Installing
Installing scripts and files for arm64 SDK 28 device...

- Setting Permissions

*******************************************
* Powered by Magisk (@topjohnwu) *
*******************************************

*******************************************
* Unity by ahrion & zackptg5 @ XDA *
*******************************************
[Android Software/Hacking General [Developers Only]] Zackptg5:
It's supposed to generate symlinks for each coreutils applet but it should be installed to xbin if present. Only exception is mv and cp are symlinked to system/bin as well since they're the special advanced ones with progress bar and that won't break anything
[Android Software/Hacking General [Developers Only]] jcmm11:
xbin is not present
[Android Software/Hacking General [Developers Only]] Zackptg5:
You mean you have no xbin or is everything installed to bin? Can you add debug to the zipname, flash in twrp, then post debug log?
[Android Software/Hacking General [Developers Only]] jcmm11:
I have no xbin (which I think is becoming the norm with stock). I'll post the log in a bit
[Android Software/Hacking General [Developers Only]] Zackptg5:
Oh, ok. That's an odd trend. But if it's installing to bin, it should only create symlinks for coreutil applets when a binary of the same name doesn't already exist. Of a symlink does (like a toybox applet), then it'll still create the coreutils applet so that's by design. Coreutils ones are better anyways
[Android Software/Hacking General [Developers Only]] jcmm11:
Not so odd when you think about the fact that system is supposed to be strictly read only.

As far as overriding toybox applets - coreutils may be (usually are) better but in some cases may act differently which may lead to unexpected results since most things will be written expecting the toybox version. It's the same reason busybox doesn't override existing applets.

However if I know that's by design I can work with it.
[Android Software/Hacking General [Developers Only]] Zackptg5:
Updated bash to 5.0.7 and coreutils to 8.31 - sort and timeout binaries work now so coreutils is complete :)
[Android Software/Hacking General [Developers Only]] jcmm11:
Just installed GNU_Coreutils_For_Android_(with_Advcpmv)-v1.2_(8.31).zip

There's no sort or timeout module

/data/adb/modules_update/coreutils/system/bin:
[ expand nproc stat
b2sum expr numfmt stty
base32 factor od sum
base64 false paste sync
basename fmt pathchk tac
cat fold pinky tail
chcon ginstall pr tee
chgrp groups printenv test
chmod head printf touch
chown hostid ptx tr
chroot id pwd true
cksum join readlink truncate
comm kill realpath tsort
coreutils link rm tty
cp ln rmdir uname
csplit logname runcon unexpand
cut ls seq uniq
date md5sum sha1sum unlink
dd mkdir sha224sum uptime
df mkfifo sha256sum users
dir mknod sha384sum vdir
dircolors mktemp sha512sum wc
dirname mv shred who
du nice shuf whoami
echo nl sleep yes
env nohup split
[Android Software/Hacking General [Developers Only]] Zackptg5:
Lol. It's in the binary, I forgot to have the installer make symlinks for it. I'll upload a fix, thanks for pointing it out!

Edit: Uploaded fix
[Android Software/Hacking General [Developers Only]] Zackptg5:
So I got annoyed with crafting sed statements, testing them and making sure they work on linux shell, and then finding that busybox and toybox sed can't handle it. So I cross-compiled GNU sed for android, problem solved :)

I decided it'd be best to combine all of the GNU binaries I got going into 1 mod so bash, coreutils, and sed are all in one GNU-Utils mod now
[Android Software/Hacking General [Developers Only]] Zackptg5:
Added GNU awk (Gawk) build script and compiled binaries to my GNU Utils mod per [MENTION=4544860]osm0sis[/MENTION] suggestion :)
[Android Software/Hacking General [Developers Only]] Zackptg5:
So I decided to go ahead and cross-compile a good number of other GNU binaries I felt could be useful. As a result, I merged all of my build scripts in one, just like I did with the unity mod for them. Updated OP with it so feel free to check it out!

If you're a compiling guru or whatever and see room for improvement (which there definitely is), feel free to drop a comment here or on github or whatever
[Android Software/Hacking General [Developers Only]] jcmm11:
Any chance you could add the find command to this? (Apparently neither toybox nor busybox supports -empty, although toybox has it in --help)
[Android Software/Hacking General [Developers Only]] Zackptg5:
It's already added to the build script :)
[Android Software/Hacking General [Developers Only]] Zackptg5:
Assuming you have an arm64 device, here's the compiled binaries
[Android Software/Hacking General [Developers Only]] jcmm11:
Thanks. So next release I take it? It's not in the current release.

---------- Post added at 10:33 PM ---------- Previous post was at 10:32 PM ----------

That works. Thanks very much.
[Android Software/Hacking General [Developers Only]] Zackptg5:
Yup. Couldn't tell you when that'll be though. Thought I had it all working, then found that it made my op5t freeze about 10 seconds after booting so I have some investigative work to do.

I'm pretty busy with classes right now though so it may not be for a while :/

Here's the full list of what I have compiled currently that will hopefully make it to the next release: bash, bc (also includes dc), coreutils (includes advanced cp/mv - progress bar functionality), cpio, diffutils (includes cmp, diff, diff3, sdiff), ed, findutils (includes bigram, code, find, frcode, locate, xargs), gawk (GNU awk), grep (also includes egrep and fgrep), gzip (also includes gunzip and gzexe), ncurses (includes capconvert, clear, infocmp, tabs, tic, toe, tput, tset), patch, sed, tar
[Android Software/Hacking General [Developers Only]] jcmm11:
I see that locate is included. However updatedb is missing, which makes locate sort of useless ?

Not an issue since I don't really need locate, and wasn't expecting it. Just figured I'd mention it.
[Android Software/Hacking General [Developers Only]] Zackptg5:
I remember looking at that but wasn't sure if it was needed or not, I'll look into adding it, thanks!
[Android Software/Hacking General [Developers Only]] Zackptg5:
Here you go :)
[Android Software/Hacking General [Developers Only]] Zackptg5:
Added Curl binary mod :)
[Android Software/Hacking General [Developers Only]] Zackptg5:
[MENTION=4487388]jcmm11[/MENTION] and everyone else. Here's a test build for next version of GNU Utils. Lots of stuff has been added here and I haven't had time to test each binary to see if there are any issues (all I did was make sure that they run and compiled properly). Let me know if you find anything
[Android Software/Hacking General [Developers Only]] jcmm11:
Something screwy with the generated symlinks. See attached images.
[Android Software/Hacking General [Developers Only]] Zackptg5:
I had another tester report that too but I can't replicate it. Can you add "debug" to the zipname (like with any unity zip), reinstall it in twrp, and send the debug log?
[Android Software/Hacking General [Developers Only]] jcmm11:
Here you go. Looking through the log I noticed that all the link commands were like

+ /data/adb/modules/gnu/system/bin/coreutils '--coreutils-prog=ln' -sf coreutils $'base32
'

With the closing quote on a separate line. Since all the bad symlinks end with \r I suspect this is the cause of the problem.
[Android Software/Hacking General [Developers Only]] Zackptg5:
Aha! EOL got changed to windows endings on the coreutils_modules file. Try this one and see if that fixes it
[Android Software/Hacking General [Developers Only]] jcmm11:
Windows? What is this Windows of which you speak? ??

In any case it's all better now!
[Android Software/Hacking General [Developers Only]] Zackptg5:
Pushed v2.0 :D
[Android Software/Hacking General [Developers Only]] micgeb:
Updatedb don't work
[Android Software/Hacking General [Developers Only]] micgeb:
bash has a issue too
[Android Software/Hacking General [Developers Only]] Zackptg5:
I see what's up there, I'll look into a fix

I'm not sure what the problem is here. Is this a problem with the binary to a bug in the script you're running?
[Android Software/Hacking General [Developers Only]] jcmm11:
I was going to play with locate/updatedb but haven't gotten around to it yet. updatedb also uses a conf file, located in /etc/updatedb.conf

It also creates a database which is located, by default, in /var/lib/mlocate/mlocate.db , although this can be changed via command line options. Same is then true for locate, which uses the db created by updatedb.

So if you're going to try modifying some of the code you may want to address those items as well (make sure you modify help accordingly)
[Android Software/Hacking General [Developers Only]] Zackptg5:
Ya, that's what I'm seeing. I'll need to figure out all of the variable paths that'll need changed. It won't be for a while though cause I have medical boards coming up :crying:

I always have the build script on github if anyone finds something
[Android Software/Hacking General [Developers Only]] jcmm11:
Good luck on your boards! ? (I'm sure you'll do fine) ?
[Android Software/Hacking General [Developers Only]] micgeb:
No binary issue. It's a bash_profile or bashrc issue.

Only with root come this issue.
[Android Software/Hacking General [Developers Only]] Zackptg5:
Oh man, idk how I missed that. I completely forgot to add the bash rc files and stuff. I'll push a quick fix for that. Thanks for the report!

Edit: Pushed
[Android Software/Hacking General [Developers Only]] micgeb:
I have installed 2.1 and the bash/updatedb issue is not fixed.
[Android Software/Hacking General [Developers Only]] jcmm11:
bash is missing execute permission. Easy enough to fix, but . . . ?

what's your current issue with bash (after fixing execute permissions)?

As far as updatedb goes if you read his response to my previous post you'd see that this is not going to be an immediate fix so you shouldn't have expected that to be fixed.
[Android Software/Hacking General [Developers Only]] micgeb:
read my previous post
[Android Software/Hacking General [Developers Only]] jcmm11:
What device and what version of Android? Your problem isn't with bash. If you run bash and then run su you're no longer running bash, you're running the native shell (basically a Korn shell, mksh (MirBSD Korn shell)) which means you need to look at /etc/mkshrc

If you want to run bash as su you need to run su before invoking bash.
[Android Software/Hacking General [Developers Only]] micgeb:
I can run in the shell bash and this is loaded. Another magisk module with the name bash running good. I have a op6t stock with exposed.
[Android Software/Hacking General [Developers Only]] jcmm11:
I have no issues with bash at all. See image.
[Android Software/Hacking General [Developers Only]] micgeb:
I found the mistake. It's up to juiceSSH.

Is it possible to integrate the command ps into the module? The ps of busybox is not working properly. Thank you
[Android Software/Hacking General [Developers Only]] Zackptg5:
I don't think ps is a gnu binary. Can't you use toybox ps?
[Android Software/Hacking General [Developers Only]] jcmm11:
What are you trying to do with ps? Might be another solution, or try toybox ps. If you want to use -u toybox will work.

[MENTION=6037748]Zackptg5[/MENTION]

Found another problem (besides bash not being executable). clear returns an error 'terminals database is inaccessible'.

Might be better off just dropping this one. Toybox clear works just fine and even if you get it working you won't gain any additional functionality.
[Android Software/Hacking General [Developers Only]] micgeb:
toybox is the same with busybox. ps -ax is not working.

Really?
[Android Software/Hacking General [Developers Only]] jcmm11:
That would be "ps ax", not -ax. That's bsd style. x isn't an option in POSIX or Unix formats. See the man page.

Yes really. What exactly are you trying to get ps to show you?

For example if you're just trying to get ps to show you all the processes try "ps -A" or "ps -e"
[Android Software/Hacking General [Developers Only]] Zackptg5:
Hmm, clear works fine for me in bash
[Android Software/Hacking General [Developers Only]] jcmm11:
Not here. See image. Also coreutils (or any symlinks to it) gives a bad system call if not running as root. Works fine if you're root. Not a huge deal since I almost always am root in a terminal.
[Android Software/Hacking General [Developers Only]] Zackptg5:
I've seen this happen before but only on some roms. I don't know the cause but switching roms may solve the problem
[Android Software/Hacking General [Developers Only]] jcmm11:
I'm on stock Pie. Pixel 3 XL.
[Android Software/Hacking General [Developers Only]] Zackptg5:
Hmm. Can you send me a full logcat after trying to run it as root and not as root and try after setting selinux to permissive?

Then replace the coreutils binary with this one and see what happens?

I removed sort and timeout which are the 2 binaries that have causes this in the past
[Android Software/Hacking General [Developers Only]] micgeb:
It's now working. Ty.

With a mac ps ax is working.