yashsingh1/xdaforums huggingface dataset:
[Android] iurnait:
Processor: 2nd gen Intel i5-2430 @ 2.4 gHz (Does turboboost work in linux?)

Ram: 4 gb ram

OS: Lubuntu 12.04

Android: JB 4.1.2 - ParanoidAndroid 2.57

HDD: WD 5400rpm hdd

takes about 80-90 mins

not bad for a $400 laptop
[Android] myepicyear:
Yes, absolutely. Turboboost is OS agnostic.

Here is my setup and build times:

-Intel Core i5 3570K@3.4GHz/3.8 TurboBoost (I keep Turboboost off much of the time)

-8GBs of DDR3 1333MHz RAM

-1TB 7200RPM HDD

-Aftermarket Cooling (Cooler Master Hyper TX3)

Real build time without ccache: 48 mins max

Real build time with ccache: 23 mins min/28 mins max

I build CM10.1 w/ cherry picks, daily, and these times are always consistent,

I always do a clean build too.
[Android] giveen:
Thanks to all my donators, I got a FX 8350 which should drop my build times.
[Android] armada786:
If you could post your build times when you install it, I'd appreciate it. I'm getting a FX 8350 in the near future and I wanted to give building Android a go. I don't think my Athlon II X3 450 that I have now is going to make it easy.
[Android] daern:
OK, here's a build for you:

Build: full_maguro-user

Build type: clean ("build clobber" prior to build) but with warm caches

Build settings: ccache + j32

Hypervisor Hardware: Dell PowerEdge R720, 2 x E5-2670 2.6Ghz (Sandy Bridge), 192GB RAM

Hypervisor Software: VMware ESXi 5.1 EntPlus

OS: Ubuntu 10.04 x86_64

OS Spec: 16 vCPU, 96GB RAM

Storage: 4 x 600GB 15k local SAS, configured with hardware RAID5

Build time: 6 mins 17s

Notes:

I'm not actually an Android developer but an IT infrastructure architect and wanted something to stretch some new kit we've got in house. As a dedicated Android user, it would be rude to not give it a go... ;)

The build looks to be disk bound. New disks (*lots* of new disks!) are due for commission next week, so I'll have another go then when I start SAN tuning...
[Android] giveen:
On behalf of everyone here

I hate you.

---------- Post added at 02:54 PM ---------- Previous post was at 02:49 PM ----------

Old processor was a Phenom X4 20 running at 3ghz = 26 min

Fx-8350 at 4ghz = 22 minutes.

So now its down to my hard drive. I need an SSD for my out directory.
[Android] swerff:
I got a cyrix 266mhz, 512mb, estimated times?
[Android] daern:
Yeah, I can understand that ;)

I'm kinda intrigued to see how low you can get it with decent hardware alone though, so I'll let you know if I can get it better.
[Android] giveen:
I am think the ssd will be key
[Android] basketthis:
I think you will see better results with the ssd as the "in" directory. That is what I have experienced in my research and what I have read. The reason being that write speed on an ssd is not significant enough to make a difference. And you can burn out the drive much faster in terms of life span.

My suggestion: put your OS and source code on the ssd. Make Your out directory on your regular hdd. You should see great improvement. :):thumbup:

I think i still have you on gtalk. Message me when you get around to installing it. I'll help as much as I can. ;)
[Android] THEindian:
Hey guys, i was wonder if you guys could approximate build times for my laptop running the latest version of ubuntu, i want to make sure that i won't be burning it out before i go building stuff :D

I was planning on building CM 4.2.1

Specs:

Dell Inspiron 15R

i7 3632QM- Quad Core with HyperThreading- Stock at 2.2 Ghz capable of turboboost

8Gigs of ram

Standard 1TB Laptop HDD

Thanks a lot guys!
[Android] basketthis:
Wonder how much it costs to turbo boost a CPU. ;) j/k

You should be fine. I would estimate between 20-35 minutes build time depending on what you're building, how you're doing it, etc...
[Android] THEindian:
Turboboosting is 'pensive bro! :D

Thanks for the quick response, another question, do i count the hyperthreading as one of the cores and do make -j16?
[Android] basketthis:
Lol!

I think in your case it would be -j8 or -j9. -j16 might work for you. My guess is your gui will lag... Give it a try! Experimenting is the best way to find out! :)

It varies a little for everyone depending on different conditions. Reporting back your results is appreciated. :D

And don't boost too much, you'll blow it up! :p:p
[Android] giveen:
Using linaro cut my time from 22 minutes to 18.

Also I don't believe theindians build time will be 30 minutes. I am going to say an hour due to laptop hard drives tend to be slower and his processor is only 2ghz
[Android] THEindian:
It can boost up to 3.2Ghz

You're probably right about the hard drive but the processor benches higher than the 2500K (at stock freq.)
[Android] basketthis:
Please let us know your results from testing. Don't forget to test with and without ccache :):)
[Android] azoller1:
Yeah you guys get builds all less than an hour, yeah well me its about 7 hours, its painful

HP 3000 Laptop

1.66 GHz Intel processor i3 maybe lower

4gb ram

500gb hard drive

sync -j16

2.4ghz dual band Linksys router
[Android] romuloxiii:
Lol, sounds like my build time too...however mine is about five hours on first build but only 2.5 using ccache for subsequent builds of CM7. I use an old Dell Inspiron running Ubuntu 10.04 with a 2ghz processor 4gb swap and 2gb ram.

Upgrading to new laptop after tax return i hoe
[Android] giveen:
Try running only -j4

Also setup ccache and then configure it to use 50 gb
[Android] azoller1:
If I have only 90-100gb of space for Ubuntu how much ccache should I give it?
[Android] basketthis:
50. Always 50. It never fills up. I think the most I've seen it fill up is about 10gb...

You could always do more. The more you allocate, the faster the build, or so they say.... :)
[Android] basketthis:
Okay. I have seen 50gb fill up. It took 4+ roms using the same ccache to do it... Lol
[Android] basketthis:
Hoping to squeeze a little more out of my current machine here in the near future. Will update with any improvements. :D
[Android] andrewnelson23:
:what: wow. That's ridiculous.
[Android] THEindian:
make -j9

AOSP 4.2.2

Intel i7-3632QM

8GB-1600MHZ RAM

1TB 5400RPM Drive

About 1.5 Hours without CCACHE

Was able to build a 3.0.66 kernel within 3 minutes
[Android] maxrdlf95:
Core i7 3770, 32 GB RAM, normal HDD

make clean

and make d2att

Take less than an hour to compile :D
[Android] jamieg71:
AMD 8350fx

Asus Sabertooth 990

16G 1888 DDR3

CCache - 50G

make -j9 (it's useless and anti-productive to go more than +1 to your number of cores)

16-24 minute initial build for any CM based rom. 2-5 minute build for recursive builds.
[Android] whoshotjr2006:
Intel® Core™ i3-3217U Processor

4gb DDR3 1600MHz

500gb 5400 rpm sata hdd

ccache enabled set at 50g

linux mint 14 "nadia" 64 bit

jellybeer cm10.1 for primoc (htc one v) using brunch - 2h 43minutes on first build, no subsequent builds attempted. my first successful build (hopefully it boots)

not too shabby for a $350 laptop lol but i need to upgrade to 16gb ram (max for this lappy)

edit: 52 minutes on subsequent build with ccache still at 50g, afraid to try without ccache, i love the compile times im getting
[Android] THEindian:
HDD or SSD?
[Android] jamieg71:
HDD 2TB Seagate sata3

Sent from my EVO
[Android] Chromium:
I've got a Dell inspiron n5110 laptop dual booting Ubuntu 13.04 with win7.

6gb ddr3

Intel i5 2450 @ 2.5ghz (can turbo boost to 3.1)

100gb HDD partition

Takes me about four hours to compile cm10.1 without ccache.
[Android] pivoq:
Intel i7 3770

16 GB RipjawsX RAM

A clean build of PA takes

42 Minutes w/o ccache

22 Minutes with ccache (tmpfs)
[Android] rockingondrums:
I've got the Dell Inspiron N4110 with 6GB RAM, Ubuntu 12 LTS VM on Win 7 factory installed host, 45 GB fixed storage for the VM and my first compile was about 4 hours as well.

I had the VM at the time set to 2 GB RAM usage and 2 cores at 100%. I've now set it to 3 GB RAM and 3 cores at 100%. I'm hoping I can shave off as many minutes as possible haha.

I noticed something strange. When I used adb push to push the zip to my phone's external SD, it's average write speed was only like 4xx KB/s where on Windows it's significantly higher. I expected some decreased performance but this seems like quite a bit. Or maybe I just didn't have the fancy green progress bar to watch, like I do on Windows when I just move the file... Hm... External SD is like a class 6...

Another thing, I typed the command in the guide for CCACHE, but it didn't tell me how much was enabled. I see other people mentioning they have a specific amount of CCACHE set. What did mine get set at, if it even set? Is there a default value?
[Android] Chromium:
Hey i talked to you on the cm irc today :) Did you figure out why there are 2 zips?

I used to use a VM but i found it such a pain. I would really recommend installing it in a dualboot with windows 7.

As for the ccache you can set the amount that you want to use by doing this:

1. cd to the root of your source

2. run: "export USE_CCACHE=1"

3. run: export CCACHE_DIR=/path/to/where/you/want/to/store/.ccache

4. run: prebuilts/misc/linux-x86/ccache/ccache -M *#ofGBthatyouwant*G

Also a little update. I mentioned before that it took me 4 hours to compile...well that was just a rought estimate. I timed a couple of my builds (hint: use "time" before your build command so that after its done compiling it will show you the elapsed time) and now im getting just under 2 hours without ccache.
[Android] rockingondrums:
Oh hey :)

No, I did not. But I did flash the conventionally named zip, and it worked beautifully :D I'm going to randomly guess it has something to do with the build process. I also created a local manifest to remove Apollo, Email, and Exchange, ran a sync and saw that those 3 were sucessfully removed, so now I'm going to delete both zips and try another compile to see if it properly compiles without those zips.

I really despise dual booting, after my previous experiences. The VM stuff itself is pretty quick to figure out and is pretty seamless now, to my eyes anyway.

After my first build, Ubuntu warned me that I only have 400+MB. And after a reboot, that warning went up to 900 something. So I don't really have any room to adjust whatever my first ccache command accomplished (if anything). Thanks for the time hint. Would that be "brunch d2vzw time"? What's the exact syntax?
[Android] Chromium:
The time goes before the command. So it would be "time brunch d2vzw".
[Android] rockingondrums:
Ignore the PM I sent you. Just redid the build with the time command. I deleted the two zips and the img files, but left everything else. Here are my results:

real	48m4.103s

user	66m58.427s

sys	9m15.499s

Nice!
[Android] Chromium:
Nice. Its short because you didn't wipe your out directory.

If you want to do a clean build you can use "make clobber" to clean the out directory.
[Android] jetx2x:
AMD FX 8320 @3.7ghz

8GB DDR3 @1866mhz

1TB 7200 Rpm HDD

CM10:

real	36m32.114s

user	208m0.018s

sys	12m21.640s

NO CCACHE!

USED MAKE CLOBBER!

I'm a happy dev now... last machine was crap and took a full two hours or more :laugh::laugh::laugh:

Wondering if getting an SSD can further decrease my times
[Android] tzeus:
intel vs amd

First of all, is this is inappropriate post, please delete it, i just thought that here it would be seen by most of the devs i am trying to ask this question.

What would the difference be in terms of JB build times between an FX 8350 and a i5 4670 or i5 4770? I am trying to decide what to buy, and i don't really know if, intel deserves all the extra money. I don't plan to overclock, i have looked at the tests, but they are mostly gaming, and i want to know in terms of compiling in general and android builds in particular. I've read the thread, seen some guys with 8350, seen some with i7 / i5. What do you guys think ? Is i7 worth the extra 120$ it would cost me to buy it?

No fanboys or anything please.

thanks in advance.
[Android] jetx2x:
I honestly would go with the 8350... Cheap yet powerful... I'm not an amd fanboy but I am a fanboy of cheap... :p If you want to compare the performance of the Intel's vs the 8350/8320 just skim through this thread... That's kind of its purpose lol... I can't give you any other info except for in terms of gaming (it's a gaming powerhouse)... Hopefully someone with a little more insight will come along

Taptalked u see ... əəs n pəʞlɐʇdɐʇ
[Android] jamieg71:
I'm running the 8350fx and been building for some time. A good friend has a nice set up with an i7 third gen I think. Anyways, his compile times are consistently 3-4 minutes faster than mine. Clean builds I average around 20-40 minutes. With ccache I'm around 3-12. Pretty much same deal with his i7 except again the i7 is slightly faster. Not sure its so much faster it warrants the cost of the processor and MB.

Sorry kind of vague, a completely itemized cohesive answer would take more time than I've got atm. Hope that helps.
[Android] Paradoxxx:
Hi there, just found this thread, and was wondering if anyone could share their build script with time info in it, so I could try myself aswell, thanks! :highfive:
[Android] jetx2x:
Build script? All of the scripting is bundled with the source.... And your Linux distro should be bundled with the "time" command... Depending on which ever source you are working with the build command is different... First you run ". build/envsetup.sh" in terminal from the root directory of your source... Then for example you run "time brunch <device name>" if you are working with a CyanogenMod based ROM... For Vanilla AOSP source you use the make command rather than brunch I believe

Taptalked u see ... əəs n pəʞlɐʇdɐʇ
[Android] mo976:
If your concern outside of standard non gaming computer use is build time save money and get the FX if your doing Photoshop and heavy gaming and such then by all means spend the extra for the i7.
[Android] Paradoxxx:
Yeah my bad, I was kind of stupid, i had forgot about the "time" thingy.

Thanks anyway :)
[Android] psild:
META-INF

Where can I find the META-INF folder for base and port Roms?
[Android] pandasa123:
well first, this an irrelevant question.

second, in the root folder of the zip.

and now that i think about it, if you're concerned about folder locations, then you aren't in the right thread because source building doesn't have to worry about those things

imho, its better to build from source. i had a hell of a lot of trouble afterwards with porting folder by folder
[Android] NellyWhads:
Help Choosing -j** and debugging build speed

Hey there everyone,

I was wondering which -j** value I should use for my system:

i7 2600 quad core (8 virtual cores)

16gig ddr3 1600

ubuntu 13.10 (I know it makes little differece, but just putting this out here)

My build times without a -j value are somewhere betwee 6 and 8 hours....so to speed thing'sup I'd like to choose a working but speedy -j**

I've also enabled ccache in my .bashrc and .profile (added "export USE_CCACHE=1" to the end of both)

Thanks guys,

- NellyWhads
[Android] jetx2x:
16 should do the trick

Taptalked u see ... əəs n pəʞlɐʇdɐʇ
[Android] pandasa123:
Lol I use -j16 on my quad core 1.7ghz laptop with 4GB of RAM. Its still fine :P
[Android] jetx2x:
I use 8 on my quad... Used 16 on my 8 core

Taptalked u see ... əəs n pəʞlɐʇdɐʇ
[Android] NellyWhads:
See the thing is when I use -j16 I get a heap of build errors that I don't get when I use -j8...any ideas?

Is there something that is holding it back that I don't know about?
[Android] jetx2x:
No reason to get errors based on the j value... All it does is specify the number of simultaneous jobs to do... Don't know what to tell you there... Probably unrelated issues

Taptalked u see ... əəs n pəʞlɐʇdɐʇ
[Android] NellyWhads:
I'm not sure - I get lots of little errors that don't ever show up on make -j8,

I'll post em here when they show up :)

aside from enabling CCACHE and using a faster -j, is there anything else I can do to speed up builds?

I was reading something about emake being faster than gmake....any thoughts?
[Android] Androguide.fr:
I've always heard you get the best results with - assuming your CPU supports hyperthreading - the following simple formula (where N is the amount of physical CPU cores)

(N x 2) + 1

So in [MENTION=4975662]NellyWhads[/MENTION] case, mka bacon -j9 should be optimal (the 2600 does support hyperthreading).

Yet, this needs to be confirmed or infirmed, I'll do some experiments with the -j param and see how it plays out on the actual build time.

This leads to a variable which I didn't see discussed much in this thread, and it is whether you use mka or make to compile your builds.

Basically, make isn't optimized for multi-thread operations, so it shouldn't really matter if you build with make bacon -j9999, it'll still be slow as hell.

mka, on the other hand, is "make mated with a cheetah", and will use all available threads on the machine if you so want to (i.e using the -j parameter).

(Source: http://wiki.cyanogenmod.org/w/Envsetup_help#mka)

The build/envsetup.sh script temporarily adds mka to your $PATH, installation hassle-free, so take advantage of it :p

Anyways, here is my setup description and build time report :

CPU: i7 3930k (6 cores) OC'd @ 4.2Ghz

RAM: 16gb of Corsair dominator platinum 1600Mhz OC'd @ 1866Mhz

Motherboard: Asrock X79 Extreme 9 (LGA 2011 chipset)

Storage: OS, repo and out directory all installed on an Intel 520 Cherryville 180gb SSD (Read: 550 MB/s - 50,000 IOPS | Write: 520 MB/s - 80,000 IOPS)

OS: Ubuntu 13.10 x64, stock kernel

Building CM-11.0 for grouper (nexus 7), with a clean ccache directory (first build on saucy) :

mka clean && mka clobber
breakfast grouper
time mka bacon -j13

...

Package Complete: /home/androguide/Development/Android/Builds/CyanogenMod/target/product/grouper/cm-11-20140125-UNOFFICIAL-grouper.zip

real	49m3.687s
user	351m30.928s
sys	25m5.417s

I'll post results in a few other builds when my ccache is actually used, and I'll also try different amounts of threads for the -j parameters.

See attachments for screenshots of build times and hardware infos.
[Android] NellyWhads:
Thanks man! I didn't know about the mka command at all - I'll give it a shot on my next build

Also, I think I'll stick to -j9 for now, at least till I get stable results :)

My second question is, to enable CCACHE for all builds, do I add the export line to my .bashrc, or my .profile?

And lastly, is there I can make my build times show up like all of yours at the end of a build? (I'm not building CM)
[Android] Androguide.fr:
No problem, glad to help.

To enable ccache by default for all builds you need to add the following line in your ~/.bashrc:

export USE_CCACHE=1

You can also define the ccache directory location using the following environment variable:

export CCACHE_DIR=/path/to/your/location/.ccache

You should still need to enable and define the ccache size manually, I believe, I personally added the following alias to my .bashrc as well (where 50G is 50gb of space for your ccache) :

alias use-ccache='prebuilts/misc/linux-x86/ccache/ccache -M 50G'

That way when I sync a new repo I can just run use-ccache and I'm ready to go.

Sure, just prepend time to your command to, well, time it ^^

Example:

time mka bacon -j9

time is a standard bash utility, you can find the manpage for it here (or by running man time in a terminal) :http://man7.org/linux/man-pages/man1/time.1.html
[Android] koko98:
Believe me or not, my old Pentium E5220 (or something similar) takes upto 10 hours to compile a single build of CM11 for Nexus 7, even with ccache, but I'm soon getting an AMD Fx-8350

Enviado desde mi LT30p mediante Tapatalk
[Android] pandasa123:
I get in 2 hours on my i5 4gb with c cache now
[Android] jetx2x:
I have an Intel core 2 quad @2.4ghz... 6gbs ddr2... 2.5 hours for cm11 without ccache... 50mins with
[Android] chraso:
from searching this thread I found Intel is mostly faster then amd while comes to compiling.

but still any1 here who has intel centrino duo experience?
[Android] HTCDreamOn:
Just found this thread, very helpful. By Centrino do you mean Core 2 Duo? Centrino isn't a type of processor. I'm compiling CM10.1 on my laptop right now, it has a T7100 CPU [MENTION=4149147]1.8[/MENTION]GHz 2M cache, 2GB RAM, but I'll swap it out for a T7300 @2GHz w/ 4M cache. It's been compiling for ages(2 hours at least), but I don't know how much of that time has been me leaving it and coming back to find it's stopped at errors.
[Android] koko98:
How much will it take with an i7-4770K?

Enviado desde mi LT30p mediante Tapatalk
[Android] Paradoxxx:
Depends of ccache, ssd, ram disk etc. If you have none of them, count a hour more or less. Here with ccache, sad, /out folder as ram disk, 5Ggz, 15 minutes clean build time.

Envoyé de mon Nexus 5 en utilisant Tapatalk
[Android] koko98:
Ram disk?

Enviado desde mi LT30p mediante Tapatalk
[Android] HTCDreamOn:
Dell D630

Intel Core 2 Duo T7100 [MENTION=4149147]1.8[/MENTION]GHz, 2MB level 2 cache

2GB DDR2 RAM

Ubuntu 13.10, relatively unmodified (I.e. still unity, etc.)

Regular HDD

Used -j4 flag on make

Built AOSP 4.2.2, no ccache, completely clean build (make clean && make clobber just to be sure)

Here's the terminal output using time make otapackage -j4:

Real 233m57.241s
User 367m6.688s
Sys 33m33.225s

It takes ~100m Real with 30G ccache, and the kernel only takes about 7 minutes Real using ccache, around 30 minutes after make clean. Hope this is useful :)
[Android] koko98:
How can I use -jx option with brunch?

Enviado desde mi LT30p mediante Tapatalk
[Android] rppgaty:
Building cm 11 on an Intel i3-330M took around 5 hours, IIRC. (Didn't run time with it.)

Last time I built cm 10, it only took around 3 hours.

Build was for my p3113.

Anybody got a FX-8350 and built cm 11 on it?

How long did it take?
[Android] swerff:
12 Clustered 4x8core amds, seconds.
[Android] jjardinero.01:
First time compiling cm from source here. I am compiling CM11 in my Core 2 Duo 2.0 ghz laptop with 4gb of ram. Its now 7 hours compiling and still not finished. I read those make -jx something and have no idea about it. I was using brunch command. Can someone tell me how to use the make -jx command hoping to improve my compilition time. Thanks!
[Android] HTCDreamOn:
Core 2 Duo mobile :highfive: which one have you got, would he useful for comparison? Also I've only got 2GB of RAM so it'd be interesting to see what the bottleneck is. HDD or SSD also? On my T7100 + 2GB RAM + HDD I need to leave it overnight when I've started late afternoon so presumably it takes way longer for me.

-jx is the number of jobs x that can be run at once. I usually run -j4 although I don't know how effective this is because we don't have hyperthreading (although there must be some piping of some sort, we can obviously do more than 2 things at once). That said, because you're building CM11 you should use the command "mka bacon". Why? From CM wiki:
[Android] Azocan:
Intel® Core™ i7-3630QM CPU @ 2.40GHz

8GB ram

ubuntu 14.04

android 4.2.2

make clean & make clobber

lunch full_maguro-eng with galaxy nexus binaries from google

make -j6

took 55 minutes real
[Android] azoller1:
Intel Pentium CPU B950 2.10GHz x 2

4GB DDR2(3?) Ram

500GB HDD 5400rpm

Linux mint 17

building cm 11

from clean out

make otapackage no -j#

no ccache

start the build in the morning around 10 am usually finishes around 4pm

its reallly not that bad, i could speed it up though
[Android] ShinySide:
Read a couple pages and some of these are questionable... Haha

Anyways

AMD Phenom II 1055T hexacore @2.8ghz

8 Gigs DDR3

Mint 17

no ccache

running -j12

initial build about 50-60 minutes give or take what else Im doing on the comp
[Android] zwiebelchen:
OS: Ubuntu 14.04 Server, without GUI etc, just build tools

CPU: Intel Xeon E3 1230v2, 4x3,3 GHz (incl. HT)

RAM: 16 GB DDR3, 1600

SWAP: 32 GB

SSD: Samsung 840 Evo, 250 GB

100 GB CCACHE enabled, but initial build (CM11, Nexus 5):

time brunch hammerhead

real	66m52.757s
user	475m24.076s
sys	27m36.663s
[Android] KainXSS:
CPU: 3770K @ 4.5Ghz

RAM: 8GB DDR3 1600

OS: Ubuntu

HDD: Hybrid HDD

its takes me nearly 4 hours to build cm11, -_-
[Android] koko98:
Should be much faster, it takes me an hour with a 4700k @ stock 8gb DDR3 @ 1600 and a HDD.