yashsingh1/xdaforums huggingface dataset:
[Android Software Development] Shadow Of Leaf:
thanks again :good::good::good::good:
[Android Software Development] ItsMeShouko:
AOSP 6.0.1 (No Repo Folder Included) is locked! It's quite difficult to download using MEGA. Please provide the key.
[Android Software Development] MSF Jarvis:
We don't keep track of who's uploading what, especially when it comes to anonymous sites like MEGA. You can give me the exact manifest link along with the branch you'd like synced and I'll upload it tonight :)
[Android Software Development] ItsMeShouko:
Can you please upload AOSP 6.0.1 (No Repo Folder) in highly compressed archive? I don't know about manifest links... :confused:
[Android Software Development] MSF Jarvis:
:rolleyes:erm, that's what I said, I *will* upload it. I'll hunt down the latest revision and sync and upload, if you can't find the manifest
[Android Software Development] neonkat:
bump
[Android Software Development] MSF Jarvis:
cd <rom-dir>

mkdir ../<rom-name>-repo

export XZ_OPT=9e

mv .repo ../<rom-name>-repo/

tar -zcvf ../<rom-name>-no-repo.tar.xz .

cd ../<rom-name>-repo

tar -zcvf <rom-name>-repo.tar.xz .

Edit : Sorry [MENTION=5991747]neonkat[/MENTION], i missed a '.' in the last command, please add it whenever you use this little hacky script ;)

ProTip : put the following into this code block

function compress_rom () {

...

}

And replace all <rom-name> instances with $1 (I hope you use the ROM's name as folder name), and you have a perfectly automated rom source compression script ;)

Paste the code into ~/.bashrc and then type `source ~/.bashrc` to activate it.

Example :

compress_rom cm13 will assume the sources are in the cm13 folder in the current dir and will create cm13-no-repo.tar.xz and cm13-repo.tar.xz in the current directory.

Super inefficient, super effective (check my AFH ;))

Hope this helps,

MSF Jarvis
[Android Software Development] adityaupreti:
https://github.com/aditheking/Auto_ROM_Sources_compressor

put this script in home dir

open it and fix up rom sources dir and run script

you can use this script to compress rom sources ;)

Credits msfjarvis
[Android Software Development] MSF Jarvis:
You should have not kanged this post : http://xdaforums.com/android/software/sources-android-sources-highly-t3231109/post67614951
[Android Software Development] adityaupreti:
man this is not kanged i collected info from this thread and made a .sh to make it easy :p
[Android Software Development] MSF Jarvis:
Not funny. I have already suggested an even easier method inside the post which is easier to use than your kanged version.
[Android Software Development] khan_frd2002:
awesome works guys it have been great help,

can you guys upload temasek (cm13)
[Android Software Development] MSF Jarvis:
Sure, 12 hours or less:)
[Android Software Development] Shadow Of Leaf:
What about omni 6.0.1 can you upload it plz
[Android Software Development] MSF Jarvis:
:eek: okay fine
[Android Software Development] MSF Jarvis:
Currently compressing it with a new script

[MENTION=5991747]neonkat[/MENTION],

curl https://romcompressor.msfjarvis.me/ | bash

source ~/.bashrc # for being sure

romcompressor cm13 # or whatever is the folder name with respect to current dir

Should let you be able to use it. Just need some feedback :)
[Android Software Development] neonkat:
sure,will try to do that asap.(atm compiling cm)
[Android Software Development] MSF Jarvis:
Thanks, I'm also using it right now it's working as expected :)

It's on github but private repo until I am sure it works everywhere
[Android Software Development] MSF Jarvis:
omni-no-repo, 4.2 gb : https://www.androidfilehost.com/?fid=24591000424945730

omni-repo : Uploading, ETA 10 minutes somehow compression was very lousy (29gb to 27gb) so redoing it. Sorry :(

cc @regalstreak
[Android Software Development] neonkat:
alright i was compressing it but you are fast :p.anyways,no issues till now with the script,working like a charm.:)
[Android Software Development] MSF Jarvis:
As expected ;)

The install method is also pretty easy, no?
[Android Software Development] neonkat:
yep.just a simple copy paste and you are good to go.

maybe you can add an option to ask user what to compress because by default both repo and non repo are compressed.(just inn case i only want to compress non repo)
[Android Software Development] MSF Jarvis:
Yes definitely, that's a great feature addition.
[Android Software Development] skull(nj):
[MENTION=6552280]MSF Jarvis[/MENTION] can u pls upload xosp mm,du- caf and aosip mm repo and no repo both

If u upload it remove all kernel sources pls
[Android Software Development] :
[MENTION=6552280]MSF Jarvis[/MENTION] Can you please update CM12.1 sources as it is very old now. I need cm12.1 without repo as soon as possible. :)
[Android Software Development] MSF Jarvis:
I have XOSP-MM and DU synced, so that may help :)

Sure, but this may take a full day since there's a lot to be done as you can see :D
[Android Software Development] kjinx01:
Waiting for DU MM sources sir..
[Android Software Development] MSF Jarvis:
Go on, wait some more
[Android Software Development] :
Hmm. OK. Means you can upload today?
[Android Software Development] MSF Jarvis:
I will upload all sources today. I had rm -rf'ed XOSP since I could not make it boot for my device, will sync again
[Android Software Development] :
Thanks, I am waiting :)
[Android Software Development] MSF Jarvis:
du-m-20160711-no-repo.tar.xz - AFH - 3.9 GB

du-m-20160711-repo.tar.xz - AFH - 14.3 GB

CC [MENTION=5325978]regalstreak[/MENTION]

Next up : AOSIP

I soooo need my own posts in the beginning

---------- Post added at 09:50 AM ---------- Previous post was at 09:14 AM ----------

AOSIP repo & non-repo compressing, [MENTION=7255600]ShadowLeaf[/MENTION]'s cm12.1 syncing
[Android Software Development] MSF Jarvis:
aosip-mm6.0-20160711-no-repo.tar.xz -- AFH -- 5.1 GB

aosip-mm6.0-20160711-repo.tar.xz -- AFH -- 16.9 GB

cc [MENTION=5325978]regalstreak[/MENTION] [MENTION=7238955]skull(nj)[/MENTION]

[MENTION=7255600]ShadowLeaf[/MENTION], your CM12.1 sources are compressing right now, will take loads of time since I'm also building CM13 along side the compression.

edit : also syncing xosp now. currently server is building CM13, compressing CM12.1 and syncing XOSP-MM at the same time. That's how you define server abuse:good:
[Android Software Development] :
Haha, server is paining right now. Good to see xosp is compressing because yesterday it's final version was released with many changes. And cm12.1 was so old :)
[Android Software Development] MSF Jarvis:
CM12.1 still compressing, XOSP synced ages ago so compressing that too, will upload before tomorrow (too much work from school :crying:)
[Android Software Development] skull(nj):
Sir after downloading and extract -repo.tar.xy I have to sync it ??
[Android Software Development] neonkat:
just extract it,add your device tree to manifest and do a repo sync.

then follow the commands to build.(check guide by jackeagle)
[Android Software Development] :
Haha, I also have school work. Tomorrow my schools are reopening. Anyway thanks for cm12.1 :)
[Android Software Development] MSF Jarvis:
Still compressing I think, will upload when it's done :)
[Android Software Development] qoejohn:
what about AICP 6.0.1 :rolleyes:
[Android Software Development] MSF Jarvis:
If you'd not added those rolleyes I'd have considered it. No respect==no help

---------- Post added at 05:58 PM ---------- Previous post was at 05:49 PM ----------

xosp-mm-20160712-repo.tar.xz -- https://www.androidfilehost.com/?fid=24591000424946574 -- 9.5 GB

xosp-mm-20160712-no-repo.tar.xz -- https://www.androidfilehost.com/?fid=24591000424946575 --3.7 GB

cc [MENTION=5325978]regalstreak[/MENTION] [MENTION=7238955]skull(nj)[/MENTION]

I have deleted the older copies so the links in the OP won't work anymore.
[Android Software Development] :
I always respect and my sources get uploaded in a day. Thanks [MENTION=6552280]MSF Jarvis[/MENTION]. What about CM12.1
[Android Software Development] MSF Jarvis:
Uploading buddy, I had just opened Labs to tell you that lol :p
[Android Software Development] :
[MENTION=6552280]MSF Jarvis[/MENTION] Thanks buddy :) got link of sources .
[Android Software Development] MSF Jarvis:
cm-12.1-20160712-no-repo.tar.xz -- https://www.androidfilehost.com/?fid=24591000424946585 -- 3.7 GB

cm-12. 1-20160712-repo.tar.xz -- https://www.androidfilehost.com/?fid=24591000424946589 -- 9.9 GB

Edit: and of course, the mandatory, cc [MENTION=5325978]regalstreak[/MENTION] :D :p
[Android Software Development] :
I had started downloading 2-3 min ago. Got link before you poster here :) Thanks . You are the best. Without you development for me not possible
[Android Software Development] MSF Jarvis:
Oh, you've been monitoring my AFH profile, huh? Cool :laugh:
[Android Software Development] :
Na, I keep checking android file host homepage when you are going to upload sources.
[Android Software Development] MSF Jarvis:
Oh of course, yes that works too. Lemme know if you need something more.

Maybe I should just start my own thread rather than hijacking regalstreak's........
[Android Software Development] :
Hmm you should because on the main page I can't find updated sources whenever I need that :( I have to search all pages . Damm. But thanks :)
[Android Software Development] MSF Jarvis:
I'm pretty sure [MENTION=5325978]regalstreak[/MENTION] will figure out a way to get me access. He's expressed the desire earlier
[Android Software Development] khan_frd2002:
waiting for temasek cm13.0 :)
[Android Software Development] MSF Jarvis:
I'm so damn sorry, I totally forgot. Will do it today
[Android Software Development] MSF Jarvis:
Still compressing. Man, this takes time :crying::crying:
[Android Software Development] khan_frd2002:
no hurry man take your time and if not too much can you do AOSPA marshmallow too on Google Drive
[Android Software Development] MSF Jarvis:
Temasek CM13 done, uploading both repo and no repo together. AOSPA on Google drive ?? Not sure about that but I'll try.
[Android Software Development] khan_frd2002:
yeah Google drive, it gave me insane download speed compared to other
[Android Software Development] MSF Jarvis:
I know of a tool for that, I'll get it sorted. As for temasek, the uploads failed so I will redo them tonight and give you a link in the morning
[Android Software Development] MSF Jarvis:
temasek-13.0-20160713-no-repo.tar.xz -- AFH -- 3.5 GB

temasek-13.0-20160713-repo.tar.xz -- AFH -- 10.1 GB

cc [MENTION=5325978]regalstreak[/MENTION] [MENTION=4333809]khan_frd2002[/MENTION]
[Android Software Development] regalstreak:
Im soooo lost that i have tough time balancing stuff. Im asking a mid right away. Thanks for reminding lool

Ive asked them. waiting for reply.

[MENTION=6552280]MSF Jarvis[/MENTION] could you share your Telegram id with me so we could manage this thread more efficiently?
[Android Software Development] MSF Jarvis:
Me no use no telegram, you can send me yours, I'll add you as soon as I install it.

P.S. I see the notifications count and I do agree things have gone haywire :D
[Android Software Development] regalstreak:
Haha surely.

Mine is [MENTION=5325978]regalstreak[/MENTION] ofc.

I didn't quite check xda as I forgot to install tapatalk lol xD. #halogenOS
[Android Software Development] MSF Jarvis:
That day when I figure out how to add a person without knowing his phone number, life will be great again :crying::crying:

My id is MSFJarvis, add at will
[Android Software Development] zainifame:
[MENTION=6552280]MSF Jarvis[/MENTION] sir can i request crdroid kitkat source?

Thanks b4
[Android Software Development] zainifame:
link of manifest crDroid kitkat sir
[Android Software Development] DigiGoon:
I too will help you both to manage this, as I have got another laptop to run only linux, now it can sync 24x7. :D
[Android Software Development] :
Amazing news :)
[Android Software Development] DigiGoon:
Just search by the username, you'll get it. ;)
[Android Software Development] MSF Jarvis:
Solved earlier :) akhilnarang to the rescue.

No laptop sync better than my server!!:p 9 minutes FTW
[Android Software Development] zainifame:
[MENTION=6552280]MSF Jarvis[/MENTION] i hope u can snyc crdroid kitkat sir :) thanks before
[Android Software Development] MSF Jarvis:
Not happening, the manifest has fetch errors which I will not fix.
[Android Software Development] regalstreak:
Aah guys, we are going to make this thread better by having some rules and we be uploading to one common site as a common user. We will post he folder url on the op so everything is sorted out and updated always! Big thread update coming up!
[Android Software Development] MSF Jarvis:
That's not fair, I was going to farm the thanks :p

Anyway, when the new account is up, I will update all marshmallow (and lollipop?) sources older than two months. Go on, start the party :D

Edit: Erm, okay.... one month old. That's it :p
[Android Software Development] regalstreak:
Hahaha

Make a cron job to update them twice a month
[Android Software Development] MSF Jarvis:
Only non-repo, repo will be monthly
[Android Software Development] Startrek852:
[MENTION=6906625]zainifame[/MENTION] Here's the link to crDroid KitKat repo only: https://www.androidfilehost.com/?fid=24591023225178790 [3.0 GB] and crDroid KitKat non repo: https://www.androidfilehost.com/?fid=24591023225178791 [2.4 GB].

---------- Post added at 10:14 PM ---------- Previous post was at 10:08 PM ----------

I think all you need to do is

rm -rfv vendor/lge && repo sync

Make sure you

mka clean

before you start building again.
[Android Software Development] DigiGoon:
It'll take me 10 hrs to upload no-repo(approx. 4.2GB) ??

Sent from my Huawei Honor 7
[Android Software Development] zainifame:
[MENTION=6622051]Startrek852[/MENTION] thank's buddy :), and is that correct size "3.0 GB" for repo only crdroid source?
[Android Software Development] Startrek852:
You're welcome. And yes, 3.0 GB is the correct size.
[Android Software Development] zainifame:
ok, i just make sure that is correct before download :D
[Android Software Development] manuel651:
Paranoid android 6.0.1 marshmallow repo and non repo? Please:D

Pd: my internet conection sucks 2 days minimum to sync.
[Android Software Development] XDA-00:
Pls add LiquidSmooth 5.1.1 highly compressed.
[Android Software Development] regalstreak:
Wait until we get our ftp from afh. Then we gonna roll!

regalstreak
[Android Software Development] MSF Jarvis:
Read below
[Android Software Development] neonkat:
*we*

??
[Android Software Development] regalstreak:
Yea *we* = [MENTION=5325978]regalstreak[/MENTION] [MENTION=6552280]MSF Jarvis[/MENTION] [MENTION=5391886]DigiGoon[/MENTION]

Working as a team now!

If anyone would like to join they surely may.

regalstreak
[Android Software Development] MSF Jarvis:
Me [MENTION=5325978]regalstreak[/MENTION] and [MENTION=5391886]DigiGoon[/MENTION] are pooling resources and getting stuff up onto a single account to make sure people don't have to search all over the place incase regalstreak can't update the thread for a while

---------- Post added at 07:46 PM ---------- Previous post was at 07:43 PM ----------

And did we mention we've got a super cool script up at https://github.com/regalstreak/skadoosh ? Truly a team effort!
[Android Software Development] ShadowReaper1:
Broken Cm 13 source

Hey i downloaded cm 13 repo sources yesterday but they are broken it says "error unexpected end of archive" file was downloaded successfully and there were no disconnections during download process then i checked again and i saw that you have written cm 13 repo sources size 16gb but when downloading from afh it shows 11gb i am currently syncing cm 13 source and i would like to support and share it with you guys if its okay with you:o
[Android Software Development] neonkat:
try to compare md5 sum.
[Android Software Development] topet2k12001:
Success!

Hi [MENTION=6622051]Startrek852[/MENTION],

I ended up restarting from the top, lol...but still, thank you for your answer. :)

And...I was able to successfully build the custom ROM with working SIM cards! Both slots 1 and 2! Although it's "unofficial Cyanogenmod 12.1", I now have my first-ever, source-built custom ROM and based from the latest source code!

What I learned:

1. The repositories provided are already set up to work when you build it from source. So, no need to run the step of "extract-files.sh"! In my initial attempts, I was running the step of "extract-files.sh" and I think this is what caused my custom ROM t be build without the SIM cards interface.

2. When building, sometimes you would see some warnings. I did some research and I learned that when it comes to compiling, a "warning" is different from an "error". And an "error" may be more critical because it can cause the building process to stop. Initially I was too concerned with each and every "warning" that popped up and I had to research each and every one of them, hahaha!

New skill acquired!

Next steps for learning:

1. Learn how to customize a ROM to my liking (adding features, etc.).

2. Learn how to use Github: "fork" a repository, submitting changes ("commits"), etc.

3. Learn some Java programming (I already know how to de-compile/re-compile an APK, but I need to learn how to edit a de-compiled APK so that I can customize).

4. Learn some C/C++ programming (?)

5. Learn how to make my own "device tree" from existing ones (?) - my ultimate goal is to be able to build CM 13.0 for my device.

Thanks XDA...very wonderful community!
[Android Software Development] DevUt:
same situation buddy !

sorry , this is OT for the thread
[Android Software Development] regalstreak:
We have got our ftp details ?

Thread will be updated tomorrow

regalstreak
[Android Software Development] regalstreak:
No isnt ot. Read the title. Thos is called devxchange! :D

Not actually. You can do it both ways. The dev maintaining for your device hasn't yet updated the propriety-files.txt that contain the blobs list that you pull from the device. Or maybe you're on some different ROM or something.

*git not github. Github is a site. Git is the program.

Yes this is easy AF! Go for this. Just come changes in the existing tree and you're done.

At times, yeah.

regalstreak
[Android Software Development] topet2k12001:
Hi [MENTION=5325978]regalstreak[/MENTION],

Thanks for responding!

I was running his built/published ROM when I tried to build with using extract-files.sh, so I was almost certain it's not the ROM. The built was successful but there was no SIM card working. On the other hand, when building directly from the blobs from his repository (without pulling from the device with "extract-files.sh") the build was successful with SIM cards working. All flawless.

My intuition tells me therefore: I think it's more of the first reason you cited that caused the issue with my initial failed build attempts.

I checked his proprietary-files.txt online (directly viewing it from Github), and compared a downloaded copy of the same. It looks like for a few files, there are some line items that have a leading dash (-) before the path. I don't know if it was a typo or uncleaned entries, or if they were intentional/supposed to be there. I don't know much yet and I don't know if what I'm saying makes sense, again I'm just using my intuition. :)

The dubious lines look like this:

-framework/com.broadcom.fm.jar
-framework/com.broadcom.bt.jar
-app/btmultisim/btmultisim.apk:app/btmultisim.apk
-framework/btmultisimlibrary.jar
-priv-app/DualSimStatus/DualSimStatus.apk:priv-app/DualSimStatus.apk

...versus most of the other lines that don't have the dash before them, for example:

etc/permissions/com.broadcom.bt.xml
vendor/lib/libbtnv.so
etc/permissions/com.broadcom.fm.xml
etc/permissions/btmultisim.xml

Thanks, although I am aware of the difference; I really meant Github in my previous post. :)

Thanks for the words of encouragement. I have a question, though: do I have to find/acquire Marshmallow (or CM13) versions of proprietary files/blobs just to build CM13 for my device? Or can I use the blobs/tree from CM12.1?

Again, thank you for the response!
[Android Software Development] DevUt:
Those double dash means remove

You first build cm13 from cm12 tree and start solving all the errors that come
[Android Software Development] Startrek852:
Try to find a Marshmallow tree, blobs, and kernel for your device before building. Your device already has official Marshmallow so it shouldn't be that hard.
[Android Software Development] topet2k12001:
Hi [MENTION=7401277]DevUt[/MENTION] and [MENTION=6622051]Startrek852[/MENTION],

Thanks for your responses. :)

Oh okay. :) I see there are two approaches:

1. use CM12.1 blobs/tree to build CM13 and then troubleshoot from there

2. find Marshmallow blobs/tree/kernel and then build

For the first method suggested by [MENTION=7401277]DevUt[/MENTION], I actually tried that (use CM12.1 device tree to build CM13) but I stopped because I then decided I wanted to first learn how building works. So I built CM12.1. At least now I'm a bit comfortable with the process.

For the second approach suggested by [MENTION=6622051]Startrek852[/MENTION]: what I did is extract an official Marshmallow firmware (version 30A). Then I took at look at the proprietary-files.txt from mysteryjeans's device tree to know the blobs that are needed for building. Then from the extracted firmware, I located those blobs. I also forked the repositories of mysteryjeans to use as a working template, where I will upload those blobs that I found.

As for kernel sources, I found that there are a lot available for my device variant (usually it's the D856 but that's fine...even LG's Open Source website shares the same kernel sources for D856 and D858HK). Some CM13-based custom kernels available are Nebula and Exodus, to name a few. By the way I was able to build a Lollipop kernel of Exodus for the D856/D858HK so I think their Marshmallow version/branch will work as well.

As to the "double-dash", actually when I was trying to build back then with "extract-files.sh", those same lines are the ones causing the error. That's why I asked. Anyway, that's in the past now, but I just wanted to understand how the "extract-files.sh" script works.

Thanks again. Lots for me to do. I will report back!
[Android Software Development] ShadowReaper1:
Cm 13 source synced :)

Where should i upload it guys?
[Android Software Development] anbuchelva:
Hi Team,

The CM13 repo size isn't right. The thread says it is 16.6 GB and the download manager says it is 11 GB. Can someone please confirm, whether i can go ahead and download. Thanks!
[Android Software Development] ShadowReaper1:
Don't Download It Its Broken I Am Uploading A New One On GDRIVE
[Android Software Development] ShadowReaper1:
Update Cm 13 Repo Link

https://drive.google.com/file/d/0Bz_lttXDjwoLNkdlNDZJR2tBcVk/view?usp=sharing
[Android Software Development] anbuchelva:
can you pls specify the file size and the md5sum? thanks!
[Android Software Development] ShadowReaper1:
Somewhere around 11gb sorry i dont have md5 but it works and safe to download:D