yashsingh1/xdaforums huggingface dataset:
[HD2 Android NAND Development] bauner:
!!!!Attention!!!!

This is an Testversion !use at your own risk! in worst case a complete data corruption could happen! Make an Backup before you start!

In my V5 testrom with kernel alpha2 wifi seems only to work with static ip! Please give me some feedback if this occours on other roms too (The wifi dhcp issue was not kernel related! It was an permission problem in my rom!)

The 2nd testversion

only for users of my v4/v5a1 cwm rom is here:

http://xdaforums.com/showpost.php?p=10302658&postcount=1

The 2nd testversion

for all other MAGLDR CWM roms is here:

https://rapidshare.com/files/3354631926/io_test2_30.05.11_for_cwm_roms.zip (new version 30.05.2011 fix root permissions if su is in /system/bin)

(no need to update if you already use v2 and root is working)

mirror

http://www.multiupload.com/K6JGA7G616 (old v2! can break root if the su binary is in /system/bin!)

Test2 for cLK comes soon!

Changes Test2:

Slowdowns on long uptime / random reboots should be fixed

Ext4 now handles ext2/3 too

Removed delayed metadata write

The following files gets installed/replaced:

/boot/zImage

/system/etc/sysctl.conf

/system/etc/mke2fs.conf

/system/lib/modules/*.ko

And newest e2fsprogs in /system/bin/

For best performance on ext4 partition your rom should have sysctl.conf support

(This package should work on most froyo roms. But I did not test it on Gingerbread... Because of some user reports it seems that there are problems on gingerbread rom´s... Tomorrow I make some tests on a few gingerbread roms...)

With kernel 2.6.32 very bad ssd performance is a known problem...

I benchmarked my hd2 with the result that high I/O on sdcard causes very high iowait which can slow down the device performance (slow reaction/wakeup lag)

I did many many tests (different i/o schedulers, governors, vm settings, mount options, different block sizes) with nearly the same high iow...

I´m near to release a fix...

But I did many (sometime qick and dirty) changes in kernel src.

Now I have to find out what´s the related change...

You could help my by testing your device with the attached script and post the logs here to see if this affects all sdcard/kernel´s and possible other devices as the hd2

Here are a little preview of my attached logs:

With untouched kernel

User 0%, System 18%, IOW 81%, IRQ 0%
User 1 + Nice 0 + Sys 56 + Idle 0 + IOW 249 + IRQ 0 + SIRQ 0 = 306

209715200 bytes transferred in 61.567 secs (3406292 bytes/sec)

With modified kernel:

User 0%, System 23%, IOW 2%, IRQ 0%
User 2 + Nice 0 + Sys 75 + Idle 229 + IOW 9 + IRQ 0 + SIRQ 0 = 315

209715200 bytes transferred in 59.880 secs (3502257 bytes/sec)
[HD2 Android NAND Development] kam333:
sounds promising,

il give this a shot 2moro, n post logs, need a bit more details on how to test script
[HD2 Android NAND Development] bauner:
you need to have adb (android sdk) installed and working.

- download and unpack the testscript.sh.zip

- open cmd / Shell and go to the testscript.sh location

- type: adb remount

- type: adb push testscript.sh /system/bin/

- type: adb shell

- type: chmod 777 /system/bin/testscript.sh

- type: testscript.sh (you need 200mb free space on sdcard)

- the test takes about 1-2 min. Don´t touch your device!

- now you have an file iolog.tar.gz on your sdcard
[HD2 Android NAND Development] kam333:
Thanks for the details

Heres my iolog

Quick question, could this also help to reduced the lag after installing apks from sd card or the market?
[HD2 Android NAND Development] bauner:
That was one reason to start this work...

Thx for your test.

And I tougt my iowait is high and the write performance is bad...

If you want you can test again with changed kernel in a few days. But then you should send me an copy from /proc/config.gz that I can compile an kernel with your config to ensure its working with your rom.

And make sure to backup your complete sdcard before... If something is wrong it could cause an complete data corruption in worst case...
[HD2 Android NAND Development] kam333:
Ha... is mine that bad!?

its the thing i dislike the most about hd2, often takes 2- 3mins to settle after installing something.

i always keep a back up of my sd, so yeh id like to test your modified kernel, thnx

just a heads up... you might get a higher response if your title mentions "fix wake up lag" or even post in dev section.
[HD2 Android NAND Development] bauner:
your iowait is about 100 higher as on my tests and the you need 1m 54.26s to write 200mb which is about 50% of my results.

can you post the output of

- mount

- df

did you have many apps running in backround while doing the test?

what sdcard do you use?
[HD2 Android NAND Development] kam333:
sure, what are the commands to get the output?

im using a sandisk 16gb class 4, & have around 20 background apps running.
[HD2 Android NAND Development] bauner:
I use the same card...

connect your device to pc

and type: adb shell

next type: mount

(you can also write the output direct to an file on sdcard with this: mount > /mnt/sdcard/anyname.log )

and next type: df (or df > /mnt/sdcard/anothername.log )
[HD2 Android NAND Development] kam333:
Here's the logs

prob got more installed than i use tho :o
[HD2 Android NAND Development] bauner:
thx

your ext4 partition is mounted:

/dev/block/mmcblk0p2 /data ext4 rw,nosuid,nodev,noatime,nodiratime,commit=19,barrier=0,data=ordered,noauto_da_alloc 0 0

this should give you an very good performance on /data partition but with the risk of database/file corruption is higher if an unexpected shutdown (by removing battery on running device or system crashes) occur
[HD2 Android NAND Development] kam333:
cheers,

hope u get it sorted.
[HD2 Android NAND Development] bauner:
i´m getting closer...
[HD2 Android NAND Development] yugoport:
im a zero in comand lines in android/linux, i tested my 2 sd cards with crystaldiskmark, hope this info can be useful to you, having lags with 16gb kingston sd card:

-----------------------------------------------------------------------

CrystalDiskMark 3.0.1 (C) 2007-2010 hiyohiyo

Crystal Dew World : http://crystalmark.info/

-----------------------------------------------------------------------

* MB/s = 1,000,000 byte/s [SATA/300 = 300,000,000 byte/s]

Sequential Read : 7.055 MB/s

Sequential Write : 4.135 MB/s

Random Read 512KB : 7.066 MB/s

Random Write 512KB : 0.671 MB/s

Random Read 4KB (QD=1) : 1.780 MB/s [ 434.6 IOPS]

Random Write 4KB (QD=1) : 0.006 MB/s [ 1.4 IOPS]

Random Read 4KB (QD=32) : 1.821 MB/s [ 444.6 IOPS]

Random Write 4KB (QD=32) : 0.006 MB/s [ 1.4 IOPS]

Test : 500 MB [I: 31.2% (4.6/14.9 GB)] (x5)

Date : 2011/04/19 22:56:47

OS : Windows Vista Home Premium Edition SP2 [6.0 Build 6002] (x86)

16gb class4 kingston

-----------------------------------------------------------------------

CrystalDiskMark 3.0.1 (C) 2007-2010 hiyohiyo

Crystal Dew World : http://crystalmark.info/

-----------------------------------------------------------------------

* MB/s = 1,000,000 byte/s [SATA/300 = 300,000,000 byte/s]

Sequential Read : 2.184 MB/s

Sequential Write : 5.750 MB/s

Random Read 512KB : 2.182 MB/s

Random Write 512KB : 1.682 MB/s

Random Read 4KB (QD=1) : 1.535 MB/s [ 374.7 IOPS]

Random Write 4KB (QD=1) : 0.017 MB/s [ 4.2 IOPS]

Random Read 4KB (QD=32) : 1.077 MB/s [ 262.9 IOPS]

Random Write 4KB (QD=32) : 0.065 MB/s [ 15.8 IOPS]

Test : 500 MB [I: 76.4% (5798.1/7585.2 MB)] (x5)

Date : 2011/04/19 23:59:57

OS : Windows Vista Home Premium Edition SP2 [6.0 Build 6002] (x86)

daneelec 8gb class4

I´m using sd builds..
[HD2 Android NAND Development] white-energy:
Desire HD build compatible ?
[HD2 Android NAND Development] bauner:
I tested the changes until now only with my stock desire mod, but it should work for all roms
[HD2 Android NAND Development] happyhallsy8:
hey bauner i gave it a go using your dft rom and recieve this with no log after following your steps...

Card is a 16gb class 10 A-Ram card.

error is supplied in the attached pic:
[HD2 Android NAND Development] vlad48:
Don't know if it will help here is my log, using an SD RAM Desire HD build on class 4 Sandisk MicrosdCard 1 partition 32GB FAT 32
[HD2 Android NAND Development] bauner:
the problem is that the scipt can´t write to your sdcard

is your first partition fat32? can you access it from your phone? Was mass storage mode enbabled?

In adb shell you can type:

mount

and look at its output. you should see a line like this

/dev/block/vold/179:1 /mnt/sdcard vfat rw,........

if this line is present type

ls -l /mnt/sdcard

now you should see the directory listing from sdcard.

finally type

ls -l /sdcard

the output should be

..........sdcard -> /mnt/sdcard
[HD2 Android NAND Development] bauner:
thx for the log

what filesystem do you use in loopfile?
[HD2 Android NAND Development] vlad48:
Linux ext4, I think.
[HD2 Android NAND Development] happyhallsy8:
Bauner,

I get this as the output..

http://www.dcrcomputers.com.au/Untitled2.png

Card is a single 16gb Fat32 Partition with a 1gb data.img.

I can access it through android and was not in mass storage mode when connected to comp.
[HD2 Android NAND Development] epapas:
hello

I want to contribute but I don't know how to get this thing working. I ahve installed Android SDK and I am on Windows 7. Can you guide me through?

Thanks
[HD2 Android NAND Development] zach.antre:
Here are my logs.

:D

209715200 bytes transferred in 51.251 secs (4091924 bytes/sec)

I am using NexusHD2 (Android 2.3.4.) with tytung_r10 kernel (2.6.32).

I have removed some system apps that I don't use and in general it is a clean android build.

I don't use sd-ext partition

@epapas

download this and extract it anywhere you like. i.e. c:\android

Then download testscript.sh and extract it in the same directory (c:\android)

Enable debug mode in you phone and plug the usb

open cmd

go to c:\android

copy paste the commands from 3rd post.
[HD2 Android NAND Development] happyhallsy8:
bauner..

just swapped the rom over to the cwm v4 with 2gig data ext4 part with rest fat 32

wasn't working because of data.img for some reason.

Card tested was a 16GB Class 10 A-Ram Card brand new.

logs attached :)

209715200 bytes transferred in 36.749 secs (5706691 bytes/sec)
[HD2 Android NAND Development] happyhallsy8:
bauner...

ive also just noticed....

my wakeup lag has gone from...

2 - 18 seconds

down to

litterally milliseconds... seems lag may be a combo of screen type + type of partition / storage method.

edit: Sorry after testing while transfering my music back it seems to have come back intermittently which is still better than before
[HD2 Android NAND Development] epapas:
Thanks for instructions! Here's my log. I hope it gets fixed becasue other than that android ROMs are sooooooooooo cool.

I use 8gb class 6 sd with 1gb partition.

Thanks for working on that and don't forget the bounty mate.
[HD2 Android NAND Development] bauner:
here are testkernel screenshots from tap benchmark results on ext4 partition with enabled journal and original unpatched sqlite.so

mount options:

/dev/block/mmcblk0p2 /data ext4 rw,nosuid,nodev,noatime,nodiratime,errors=remount-ro,barrier=1,journal_async_commit,data=writeback,n oauto_da_alloc 0 0

result of time dd if=/dev/zero of=/data/empty.file bs=100000 count=2000:

2000+0 records in

2000+0 records out

200000000 bytes transferred in 28.417 secs (7038040 bytes/sec)

real 0m 28.52s

user 0m 0.01s

sys 0m 3.06s
[HD2 Android NAND Development] bauner:
A first testversion for users of my v4 cwm version is here

http://xdaforums.com/showpost.php?p=10302658&postcount=1

A testversion for other roms comes soon
[HD2 Android NAND Development] happyhallsy8:
bauner..

new log is attached.

OLD: 2048+0 records in 2048+0 records out 209715200 bytes transferred in 36.749 secs (5706691 bytes/sec) real 0m 36.78s user 0m 0.01s sys 0m 3.37s

NEW: 2048+0 records in 2048+0 records out 209715200 bytes transferred in 20.556 secs (10202140 bytes/sec)real 0m 20.57s user 0m 0.03s sys 0m 5.07s

OLD: User 0%, System 33%, IOW 66%, IRQ 0% User 1 + Nice 0 + Sys 104 + Idle 0 + IOW 207 + IRQ 0 + SIRQ 0 = 312

NEW: User 0%, System 38%, IOW 13%, IRQ 0% User 2 + Nice 0 + Sys 125 + Idle 151 + IOW 43 + IRQ 0 + SIRQ 0 = 321
[HD2 Android NAND Development] epapas:
So there will be an update package for every ROM? It's not dependent on the kernel that the ROM uses.

Waiting for update package for my Imilka ROM to test it.
[HD2 Android NAND Development] bauner:
the kernel gets changed by the update....

It should run on most roms. But without guarantee
[HD2 Android NAND Development] epapas:
I tested it on this ROM [13 APR][RAM HD] imilka's RAM Desire HD v2.0 [Des HD][A2SD][K:Raf1.9OC] .

Unfortunately it does not boot at all. Maybe I am doing something wrong...
[HD2 Android NAND Development] bauner:
the current test version only supports my v4 cwm rom!
[HD2 Android NAND Development] epapas:
Yes, I am aware of that. I was just hoping that I could already applied it in my ROM. Any ETA for the other versions?
[HD2 Android NAND Development] bauner:
tomorrow evening
[HD2 Android NAND Development] white-energy:
You mean like now?
[HD2 Android NAND Development] bauner:
right now... In 1. post
[HD2 Android NAND Development] epapas:
tested it on this ROM [13 APR][RAM HD] imilka's RAM Desire HD v2.0 [Des HD][A2SD][K:Raf1.9OC] .

Unfortunately it still does not boot at all. Is my ROM Gingerbread? Maybe the first time boot is taking more than usual?
[HD2 Android NAND Development] bauner:
I try this rom now...
[HD2 Android NAND Development] Elmo108:
are you aware of this thread?

i would suggest to talk to charnsingh and all the other folks there, since they are also trying to fix kernel-bugs. :)

here in the Q&A section its kinda out of sight. ;)
[HD2 Android NAND Development] bauner:
I tested [RAM HD] imilka's RAM Desire HD v2.0 [Des HD][A2SD][K:Raf1.9OC] right now with my kernel.

It worked without any problems...
[HD2 Android NAND Development] white-energy:
I'm trying it with Rafpigna's Desire HD build :) hope it optimizes it since its laggy sometimes :S

EDIT: it gives some wierd FC's on startup but later it becomes smooth :))

I think you should post this Kernel @ the Development place or whatever its called, since its a great work after all :) ;)

EDIT: Wakeup lag is now 1 sec (its not that instant) but i hope it gets lowered ;)
[HD2 Android NAND Development] sonrah:
I tried using the kernel but booting gets stuck at GO GO GO.
[HD2 Android NAND Development] bauner:
please post always the rom version...
[HD2 Android NAND Development] sbryan12144:
so is this a GB kernel? will it fix the graphical glitches?
[HD2 Android NAND Development] pyrorob:
nice kernel, im running it on cmylxgo's desire hd rom and have noticed a nice little boost in speed, there definitely seems to be less latency in everything from boot up, running apps to a lower boot up time, seems to be good progress. no overclock options thou, just stock speeds, overall since theres only room for improvements here, i cant wait to see whats next :)

(if and when i do see any issues arise, ill post them in here to keep you apprised)
[HD2 Android NAND Development] SkywalkerPD:
I think you mean this thread? ;)
[HD2 Android NAND Development] epapas:
So, I need to install your kernel? How do I do that? Can you guide me through?

Thanks
[HD2 Android NAND Development] q9650:
No. Just read through the threads. The graphic glitches will only be fixed when HTC releases the source code of Sense. No Source = No Drivers = No Fixes.

Did u wipe Dalvik cache before u flashed the Kernel? Do you still have the FC's? Did u try to fix perms? Thx :P
[HD2 Android NAND Development] Screemi:
it's great that there are still people working on improving our beloved hd2. imilca said that he will be working on the graphical glitches as soon as the gb sense sources are released (hopefully sooner than later).

there are a couple of devs working on very specific problems with the hd2 and the kernel. it would be great if this work could be coordinated in some way.

bluetooth - hci_get_route for devices like wiimote

missing source parts

usb host (desire hd and would be great to be ported to hd2)

just to mention a few.
[HD2 Android NAND Development] ricky886:
BOYPPC-SHIFTPDA_Desire HD A2SD V13

Stuck on GO GO GO

TMOS HD2
[HD2 Android NAND Development] Rando81:
can we get the kernel uploaded to another site pls, rapidshare is a pain :(
[HD2 Android NAND Development] prosumerhacks:
did you try furhter or just left it at that.... :rolleyes:
[HD2 Android NAND Development] bauner:
you only need to install the zip from 1. post in recovery
[HD2 Android NAND Development] bauner:
I try it soon
[HD2 Android NAND Development] Rando81:
Rom crawlingcity's UD 3.3 (gingerbread 2.3.3) (kernel tytung r9)

SD sandisk 8gb lvl2 ( with 1gb ext4 partition)

transfer time reduced from 99sec to 91sec after applying kernel :D

Edit: turning wifi on reboots the device
[HD2 Android NAND Development] ilijan:
all sense 3 roms reboot itself after lock screen are loaded...
[HD2 Android NAND Development] epapas:
Well I get stuck in GO GO GO screen no matter what I try.

I update with CWM recovery but doesn't seem to be able to boot. I updated with the zip from the first post related to "other ROMs". Befora I install I did Wipe Cash and Fix Permissions. Unless I should wait more in the GO GO screen.
[HD2 Android NAND Development] Kefir.net:
Really fast! But forces random reboots on MIUI official ROM :(
[HD2 Android NAND Development] bauner:
I quick tested it.

It boots without any problems on BOYPPC-SHIFTPDA_Desire HD A2SD V13
[HD2 Android NAND Development] bauner:
I did the same, and had no stuck on go go go screen
[HD2 Android NAND Development] Elmo108:
Darn! yeah that one, thx ^^'
[HD2 Android NAND Development] ForceField:
Is there another miror.I can't download from rapidshare

10x
[HD2 Android NAND Development] randasecret:
Please any mirror, rapidshare isn't working
[HD2 Android NAND Development] HannoSLM:
works nicely with imilka vivo gb sense 02, but there is no overclock ... do you plan to add it?

edit: after half an hour of use, unfortunately the phone begin restarting itself quite often with normal use - emails, browsing etc.
[HD2 Android NAND Development] nieves53:
Franks 1.4 roms reboots after turned wifi on then keeps rebooting.
[HD2 Android NAND Development] seanyuan62:
Please add different mirror for all other cwm users :)
[HD2 Android NAND Development] sbryan12144:
More mirrors

http://www.multiupload.com/NF71I9BR90
[HD2 Android NAND Development] bauner:
Tomorrow comes an 2nd testversion which should fix the random reboots and with removed delayed metadata writeback
[HD2 Android NAND Development] epapas:
Since I see that there are other that are stuck in the GO GO screen it seems that there is some step that some people not devs are missing constantly.

My setup is as follows:

sdcard 8gb class 6

ext2 1gb partition

EU Leo

I install the ROM (clean install)

I go to CWM then and install the zip (wipe cashm fix perms) and stuck on GOGO

My questions:

1. Do I have to wait long before GOGO screen goes away? More than 10mins?

2. Do I have to have ext4?

3. Do I have to put any kind of config file in the root?

Sorry for my ignorance, I admire you DEVs doing these kinds of things in LEO and I am just a follower. Plus the wakeup lag it's really annoying and the only problem in the android ROMs

Thanks in advance
[HD2 Android NAND Development] bauner:
your steps are right! but you don´t need to install a clean rom... so you can easier compare the performance....

1. It should not stay longer as before in go go go screen...

2. ext2 loop/partition and ext4 partition should work

I don´t know if I compiled this kernel with ext3 support...

3. you don´t need an special config file (only if your rom needs it!)

the stuck in gogogo could be fixed too in the version which is planed for tomorrow (could not try it, I only had the reboot issue in my tests...)
[HD2 Android NAND Development] bauner:
Here are a few benchmark results of my tests last night from Testversion 2 (realese later tonight or tomorrow morning)

Tested with my V4 rom (V5 Test2 = V4 + Testversion 2 kernel)

V5 Test2

Quadrant normal

Run1 1478

Run2 1752

Run3 1770

Quadrant under high cpu load (with "for i in `seq 4`; do yes >/dev/null & done" running)

Run1 1507

Run2 1516

Run3 1509

Tap Benchmark normal

Run1 2664

Run2 2671

Run3 2784

Tap Benchmark under high cpu load (with "for i in `seq 4`; do yes >/dev/null & done" running)

Run1 558

Run2 591

Run3 585

time dd if=/dev/zero of=/data/empty.file bs=100000 count=2000 normal

Run1 200000000 bytes transferred in 12.646 secs (15815277 bytes/sec)

Run2 200000000 bytes transferred in 13.477 secs (14840097 bytes/sec)

Run3 200000000 bytes transferred in 13.187 secs (15166451 bytes/sec)

time dd if=/dev/zero of=/data/empty.file bs=100000 count=2000 under high cpu load (with "for i in `seq 4`; do yes >/dev/null & done" running)

Run1 200000000 bytes transferred in 12.777 secs (15653126 bytes/sec)

Run2 200000000 bytes transferred in 12.361 secs (16179920 bytes/sec)

Run3 200000000 bytes transferred in 12.776 secs (15654351 bytes/sec)

And now the results of V4 (but only 1 run)

Quadrant normal

Run1 1340

Quadrant under high cpu load (with "for i in `seq 4`; do yes >/dev/null & done" running)

Run1 931

Tap Benchmark normal

Run1 2520

Tap Benchmark under high cpu load (with "for i in `seq 4`; do yes >/dev/null & done" running)

Run1 212

time dd if=/dev/zero of=/data/empty.file bs=100000 count=2000 normal

Run1 200000000 bytes transferred in 13.117 secs (15247388 bytes/sec)

time dd if=/dev/zero of=/data/empty.file bs=100000 count=2000 under high cpu load (with "for i in `seq 4`; do yes >/dev/null & done" running)

Run1 200000000 bytes transferred in 16.031 secs (12475828 bytes/sec)
[HD2 Android NAND Development] white-energy:
*Claps* *Claps*

Bravo! Bravo! =D really awesome!
[HD2 Android NAND Development] inf3rno1:
I cant wait till you release it! Ill be hitting f5 the rest of the night! :)
[HD2 Android NAND Development] bauner:
Now you can stop pressing f5 ;)

Test2 is online...
[HD2 Android NAND Development] bamer:
https://rapidshare.com/files/9930529...r_cwm_roms.zip

problem with the link for me
[HD2 Android NAND Development] bass122:
Just installed test2 on imilka's Vivo GB Sense v0.2

Boot in and shows the lock screen with very bright screen backlight.

After that automatically reboot.

Test twice the same.
[HD2 Android NAND Development] bamer:
maybe someone can post a mirror ?

because i can't download from the link given on rapid share :(
[HD2 Android NAND Development] arifqur:
Thanks for the keeping the torch burning.

However, can't seem to get it to boot on Imilka's GBSense/Vivo Typhoon's latest 3.2.6 and Tytung's 2.7.

Maybe this is not well suited for GB
[HD2 Android NAND Development] Rando81:
mirror link for those who cant download from RS

multiupload
[HD2 Android NAND Development] bauner:
thx for the mirror
[HD2 Android NAND Development] AlaneCzeQ:
Just Flashed your kernel on Stock Desire ROM.

Can confirm it is working, flashed via CWM and than wipe cache and fixed permissions.

testing now if everything works fine :)

Edit: Wi-Fi works fine, I still get a little bit of lag here and there, waiting for stabilize though and than we will see, wake up lag is about the same, this kernel seems more laggy when downloading stuff of the market. Now testing battery drain, will leave my phone for an hour or two and will see what kind of standby consumption I got. Using wi-fi and internet I got 200-250 which is amazing compared to Skinks Kernel giving me 400-500.
[HD2 Android NAND Development] bauner:
after doing some stress testing V2 looks very stable (expect the wifi dhcp issue).

I installed/deinstalled >50 apps with 2 on access scanners running and big wifi downloads in backround and did many reboots without getting any error/fc/data corruption on ext4 partition
[HD2 Android NAND Development] harpss1ngh:
What's the difference between this and other Kernels? What features does this Kernel have over, say Rafpigna's?
[HD2 Android NAND Development] TonyCubed:
Question, on WM 6.5, someone released a program that could would activate the HD2's FPU in which some cases it helped with performance, is this being used with Android?