yashsingh1/xdaforums huggingface dataset:
[Windows Mobile Apps and Games] malrok37:
I cooked the new version (1.01), and the problems I faced seem to be solved :D

Great job ShaDrac !
[Windows Mobile Apps and Games] ShaDrac:
Good to hear! :)

But...

@all:

There is still (atleast) one bug in V2 Beta 1.01 but it looks i've isolated it.

It's going to take a few days to solve that bug.

Hi sunsetdk,

The I.E. problems are probably related to the bug.

The lower performance is related to the order, you can still use order: 0 but then you can't sync notes (in the final release this is solved).

If you keep the order at 999 (or something high) make sure you use !Aman!'s fsreplxfilt tweak found here.

Hi jagan2,

Could you post your boot.rgu?

Hi bgcngm,

This sounds strange...

Are you sure that Extendir (1.06) is working?

You can test it with Preset Installer, if it's says your device is Extendir enabled, then everything should work...
[Windows Mobile Apps and Games] jagan2:
My boot.rgu

hi shadrac,

I have attached my boot.rgu modified from oemxipkernal.
[Windows Mobile Apps and Games] bgcngm:
I never got it working properly, not even with Extendir v1.06. Preset Installer tells my device is Extendir enabled. I've tried my phone dialer cooked in the ROM and also installed as a .cab with Preset Installer, but nothing works.
[Windows Mobile Apps and Games] sunsetdk:
Thank you SharDrac, I'll have a look at it.
[Windows Mobile Apps and Games] mondilv:
Bad idea, think.
[Windows Mobile Apps and Games] selyb:
been months since I cooked anything but IIRC, boot.hv, user.hv, and default.hv are not needed. I remember well that the data they contain is not preserved.
[Windows Mobile Apps and Games] mondilv:
May device/oem/kitchen depends.

For me this trick ( delete boot.hv) make unbootable Diamond & Topaz.
[Windows Mobile Apps and Games] sunsetdk:
Which program do you guys you to see memeory maps and which modules runs under which processes?
[Windows Mobile Apps and Games] bgcngm:
I've found something curious about this boot.hv deletion stuff... When using bepe's PRB, if boot.hv is deleted from OEMXIPKernel, a new boot.hv is generated (PRB builds new hive file based on boot.rgu), but this file is not present in the newly generated xip.bin file. Strange isn't it? Of course, that makes the ROM not bootable.
[Windows Mobile Apps and Games] vipa:
dotfred task manager to see the running processes -> long-clicking on a process -> click details and gives you modules used by a process

memory maps can be seen with this another program available here
[Windows Mobile Apps and Games] bobsbbq:
I have noticed a new weird bug with 1.06 version. Since google maps changed versions to 3.31 it will not work with Extendie enabled. Same with the new google maps 4.0. I get some kind of error right after installation and when trying to start it. The older 3.2.16 still works. I just wonder what could have changed that would now cause it to no longer work with Extendir.
[Windows Mobile Apps and Games] sunsetdk:
When using Preset Installer I can't work out how to get it to install on my storage card. Must of the cabs I have can be installed on the storage card without problems, but Preset Installer seems to allways install on the main memory. Anyone with an idea?
[Windows Mobile Apps and Games] mondilv:
Rebuild your cabs for new default install way.
[Windows Mobile Apps and Games] ShaDrac:
Thanks,

I will look in to it.
[Windows Mobile Apps and Games] ShaDrac:
In Preset Installer (step 2/3) you can select which apps/Mortscrips you want to install.

For each app/Mortscrips you have 3 options:

Don't install (not checked)

Auto install with defaults (checked)

Prompt during installation (grey checked)

If you select option 3 (grey checked) you will be prompted during installation of that cab/mortscript.

If the cab is created with options (like install location) it will prompt you. :)

Enjoy!

ShaDrac
[Windows Mobile Apps and Games] jagan2:
shadrac specifying dll trick didnt worked for me even i signed a dll and installed on storage card.

Help me any ideas? My drivers are conflicting if i dont remove serial32.dll my wifi would auto start on welcome screen even its status is off while cooking. Or if i dont remove bluetooth packages in sys same prob. And one more if i dont remove reg key for serial32.dll from oem lang same prob.

Note: removing any one of the above will solve my prob... extendir was the lat solution but its not working on my opal...
[Windows Mobile Apps and Games] sunsetdk:
How do you do this. I have been searching google and the forum, and all i find is that you have to get WinCE CAB Manager, or manualy by cabarc.exe. Is it not possible by perhaps using "ShaDrac's extendir cabs". I have tried to set the "Base installation folder" to blank and then set the "Installation folder 001" to a absolute path (\Lagerkort\Extendir\WinDir\Ny mappe) as my storage card is called lagerkort. But it refuses to install then. Also tried to set it to (Extendir\WinDir\Ny mappe) and still fails install

Thank you ShaDrac for you answer, but was looking for a way where I could automate it all (so I all cab's automatic install the right place)
[Windows Mobile Apps and Games] ShaDrac:
Hi sunsetdk,

I don't know if this applies to programs you want to install but:

In Extendir V1 there is a bug that files located at '\Storage Card\Extendir\etc.' wont show up in the '\Windows' folder.

In Extendir V2 this will be fixed.

But if the program already could run from the storage card (doesn't need to be in the Windows folder) then I don't know if it's possible to auto install (silently) a cab on your storage card. I've never seen an provision xml which does that. :(

But you could achieve the same with a mortscript that unzips a zip file in a folder on your storage card and add the reg entries :) but you lose the uninstall/update features of a cab. :(

After you created such mortscript you can add it to a preset in Preset Installer.

Good luck!

ShaDrac

edit: I've never tried this but if you would set the "Base installation folder" to '\.' (without the quotes) and then set the "Installation folder 001" to a absolute path (\Lagerkort\Extendir\WinDir\Ny mappe) ?

Let me know if it works!
[Windows Mobile Apps and Games] mondilv:
Try to rename "Ny mappe" to "Nymappe"
[Windows Mobile Apps and Games] bgcngm:
Well, I managed to solve this problem... but now, I have another one. I don't know if Extendir Cabs has some bugs or not, but for this package, I'm not able to create a good .cab. If I open the .cab file with WinCE Cab Manager, it tells that the generated file is not a valid Windows CE .cab.

Can you please check my package and test if it works for you?
[Windows Mobile Apps and Games] sunsetdk:
I found yesterday that cabs created with extendir cabs are not valid acording to WinCE Cab Manager. But I have several other cabs on my SD card which WinCE Cab Manager did not reconise as valid cabs, but they all install on the mobile with no problems. So I think it's WinCE Cab Manager that has the problem perhaps.
[Windows Mobile Apps and Games] bgcngm:
I guess you're right, sunsetdk.

It seems that the .cab installs perfectly despite the WinCE Cab Manager message saying that's not a valid file... It seems that WinCE Cab Manager can't be trusted anymore. :confused:
[Windows Mobile Apps and Games] sunsetdk:
Does the storage card have to be called storage card? Or is Lagerkort okay?

This worked. But it still asks for a location to install if you just run the cab, but when i picked the default which is also what prest installer does the cab files was indeed install on the lagerkort (storage card).
[Windows Mobile Apps and Games] sunsetdk:
.cpl

I tried to change SpbPhoneSuite cab file so that the files that normally go into windows goes into \Extendir\windir\SpbPhoneSuite. This works fine if I do not let the .cpl file go there. Have anyone else had the problem with .cpl files and extendir?
[Windows Mobile Apps and Games] bobsbbq:
How is the V2 coming Shadrac?
[Windows Mobile Apps and Games] bobsbbq:
Is there anyway to make the list in PresetInstaller Scroll?
[Windows Mobile Apps and Games] ShaDrac:
Extendir V2 Preview/Beta 1.02

I think this one is bug free (I hope :D)

Please let me know if it is or not.

If it is, then I wil implement the cache.

btw. The order (in boot.rgu) can be set to 0!

For this preview/beta I hardcoded that files/folders in "\My Documents" or it subfolders don't use the Extendir optimizations.

This will make notes sync while the order (in boot.rgu) is set to 0. :)

In the final release this is configurable with help of a configuration program/file.

Enjoy! :)

ShaDrac

fyi:
[Windows Mobile Apps and Games] tsalta:
The question is why we just cant install the driver by diferent way i mean via cab or to copy in windows because now if i wana try this driver i need to re flash witch mean not good idea .

Any info on that

Thanks

ShaDrac
[Windows Mobile Apps and Games] Farmer Ted:
The short answer is that the file system is loaded in early boot (it's pretty much the first thing loaded), and you need the registry keys loaded in the boot.hv, which is in rom and can't be adjusted post-cooking. Since extendir is a file system filter, you can't load it without getting the reg keys in the boot.hv; at least that's the way I understand it.
[Windows Mobile Apps and Games] epismax:
Thank you ShaDrac!

It looks like Extendir V2 Preview/Beta 1.02 is bug free and working correctly (I think :D, I tested it 5 hours.)

I will post if there is some problem.
[Windows Mobile Apps and Games] RoryB:
I have it working in my Wizard. Some notes:

Version 1.06 with 2MB cache worked in my Wizard.

Version 2b1.02 shows 2MB more RAM. I assume it is because you have 0MB cache right now.

V1.06 starts up fine and M2D version 1917 works fine. All my automated programming and startup works fine.

With V2 it was a little different. I had to go into today settings and start TouchFlo to get M2D running. I also had to start xTask and get xHook running even though they should autostart too. Smartskey too.

It seems shortcuts I have in zip files that should extract to \windows\startup do not show up. the files in the Extendir folders do show up.
[Windows Mobile Apps and Games] bobsbbq:
My observation on the new V21.02 beta. Still seem to have issues with manila and some mods for manila. If I cook in a plain fresh copy of the manila package no cfc compression then it seems to work ok. But if I use any of the manila mods I have been using the graphics get messed up. Other than the graphics phone seems to be working ok.
[Windows Mobile Apps and Games] BlackFriar:
I still don't know WTF I'm doing wrong as I can't access the [Extendir]->[Windir] folder. Anytime I try to add a folder, I receive this:

"cannot copy: file may not exist or can not be copied" error

I just recooked in 1.06 and it works; same files and folder hierarchy.
[Windows Mobile Apps and Games] ShaDrac:
Hi BlackFriar,

This happens (with some programs, for example through active sync) when there is a empty folder and you want to add files/folders to it.

Well I fixed it but I forgot to put the fix in... :o:D

I wanted to measure if the fix had any performance impact (which it didn't) but after the tests, I forgot to put it back.

Also I forgot to put the fix back for a file you sometimes see in the root named: "Vol:".

Hi bobsbbq,

I'm trying to figure out whats happening with cfc manila.

I can reproduce it (thanks to your kitchen :)).

@All:

Thanks for all the testing & feedback! :)

ShaDrac
[Windows Mobile Apps and Games] RoryB:
I still cannot get things to work automatically.

I tried adding a delay before starting customization - no good.

Tried a short delay between each zip file and reg file install - no good.

Other than that, it seems to work. Running v1.06 with 2MB RAM for now. Playing with PagePool. Down to 4 MB so far and no loss of performance I can tell. I do gain some RAM doing this.
[Windows Mobile Apps and Games] ShaDrac:
Hi RoryB,

I think the problems you have will be solved with Extendir V2 Preview/Beta 1.03.

Doing my final tests, so far it looks good.

I really like to know if this version solves your problems.

If it does then I will implement the cache, since the Preview/Beta 1 series have 0MB cache.

Extendir with cache will let you gain even more RAM since you can disable the windows cache. :)

ETA Extendir V2 Preview/Beta 1.03 2 hours.

ShaDrac
[Windows Mobile Apps and Games] RoryB:
Thank you, it will be tomorrow before I can try.

When the cache is added back, how do I disable the cache? I have FATFS set to 0 for now to allow windows to adjust it automatically. I have tried setting cachesize to 1024 and did not really see any difference. Is there a different way to disable it?
[Windows Mobile Apps and Games] Farmer Ted:
I'm pretty sure the cachesize registry key is dead; at least, at msdn it says that it is no longer used:

CacheSize: REG_DWORD
Obsolete
This value is obsolete.

Do not use in Windows CE 5.0 and later.

Do not use in Windows Mobile Version 5.0 and later.

Replace with FatCacheSize or DataCacheSize.

Indicates the size of the disk cache, in number of sectors.

I've played with it in boot.rgu, and it seems dead to me. I don't really see any changes with fatcachesize, either. I think that the datacache is the only one that does anything.
[Windows Mobile Apps and Games] ShaDrac:
The registry setting "CacheSize" is obsolete.

Replace it with "FatCacheSize" and/or "DataCacheSize".

If a value is set to 0 then windows choose the cachesize for you.

This will default for most devices to:

"FatCacheSize"=dword:100
"DataCacheSize"=dword:800

This means a FatCacheSize of 256 sectors and a DataCacheSize of 2048 sectors.

I'm not sure but AFAIK all cooked roms use a sectorsize of 2048 bytes.

So a "DataCacheSize"=dword:800 is 4MB data cache.

If you want to disable the cache completly, remove the complete line (in boot.rgu)

"CacheDll"="diskcache.dll"

btw. It's best to make all these changes in boot.rgu (XIP)

For more registry settings you can find them here on MSDN.

Enjoy!

ShaDrac
[Windows Mobile Apps and Games] bobsbbq:
So does this mean theat under :

[HKEY_LOCAL_MACHINE\System\StorageManager\FATFS]

"CacheSize"=dword:1000

We have to change it to :

[HKEY_LOCAL_MACHINE\System\StorageManager\FATFS]

"DataCacheSize"=dword:1000

Or are you saying the FATFS is no longer valid and we have to change only in this key:

[HKEY_LOCAL_MACHINE\System\StorageManager\Profiles\MSFlash\FATFS]

"FatCacheSize"=dword:200

"DataCacheSize"=dword:400
[Windows Mobile Apps and Games] ShaDrac:
Replace: "CacheSize"=dword:1000

With: "DataCacheSize"=dword:1000

And: "FatCacheSize"=dword:100

Your free to use a different dword value. :D

BUT:

When setting these values on[HKEY_LOCAL_MACHINE\System\StorageManager\FATFS],

You're setting these values on every FATFS volume since [HKEY_LOCAL_MACHINE\System\StorageManager\FATFS] is on global level.

If you specify these settings on [HKEY_LOCAL_MACHINE\System\StorageManager\Profiles\MSFlash\FATFS] then you're setting it only for that profile, in this example only for your root storage (storage memory).

Since profile settings have a higher priority then the global setting, it is possible to set an cache of 2MB for your storage card, 4MB for your root storage and 1MB for every other FATFS volume.

Enjoy!

ShaDrac
[Windows Mobile Apps and Games] bgcngm:
This will answer your question:

And I guess that this key will also disable windows cache:

[HKEY_LOCAL_MACHINE\System\StorageManager\FATFS]
"EnableCache"=dword:0

But now I'm a little bit confused... What's the difference between this windows cache and page pool?
[Windows Mobile Apps and Games] ShaDrac:
"EnableCache"=dword:0 Is the more cleaner way to do it. :)

About the page pool and windows cache (actualy disk caching): They both store data in the memory for fast retrieval.

But the "windows cache" only stores data for fast retrieval and buffer a write to disk. This cache is a copy from the original data. When data is needed it will be copied from the cache to where it is needed.

The page pool can only store read only data, but if a program is loaded in to memory (for example you start Opera), the read only parts are loaded in to the page pool (data/code), not a chunk of additional memory.

The program is then executed using the memory of the page pool.

So it's possible to start 3 programs and not to see your memory usage going up because those programs are using memory from the page pool.

After you close a program, the memory it uses from the page pool is not released, but it's free for an other program to use (overwrite), or when you start that same program again, it doesn't have to load itself from disk again since the data/code is already there in the page pool.

Thats why a to small page pool give worse performance.

Enjoy

Shadrac
[Windows Mobile Apps and Games] ShaDrac:
Extendir V2 Preview/Beta 1.03

Well I hope this one is really bug free. :D :D :D

Please let me know if it is or not.

If it is, then I wil implement the cache.

btw. The order (in boot.rgu) can be set to 0!

For this preview/beta I hardcoded that files/folders in "\My Documents" or it subfolders don't use the Extendir optimizations.

This will make notes sync while the order (in boot.rgu) is set to 0. :)

In the final release this is configurable with help of a configuration program/file.

Enjoy! :)

ShaDrac

fyi:
[Windows Mobile Apps and Games] epismax:
Bug Report

I found some file access, file read issue with Extendir v2 Preview/Beta 1.02

I run system backup with SPB Backup, and SPB backup report some problem. I think it is related with Extendir

According to SPB Backup log,

Unable to read

\cemail.vol

\Documents and Settings\default.vol

\mxip_notify.vol

\mxip_swmgmt.vol

\mxip_system.vol

\mxip_lang.vol

Access denied by process "NK.EXE"

\Windows\System\SQM\Sessions\PMWeek

\Windows\System\SQM\Sessions\Global

\Windows\System\SQM\Sessions\WordMobile

I hope Extendir v2 Preview/Beta 1.03 doesn't have this issue. I will try it.

BTW, I don't have graphic issue with CFC Manila.
[Windows Mobile Apps and Games] bobsbbq:
Wow, I think this is the Version. :D:D

I have it installed and all manila mods without any issues. I will continue to test further and report back.

Great work shadrac.

PS. Shadrac cachefilt.dll is needed for Documents tab in new manila. Unless we can figure a way around it. My copy speeds increased 40% without cachefilt.dll but Documents tabs gives a SD card not found or is full.
[Windows Mobile Apps and Games] seatone:
Hi ShaDrac :)

Thank you for your nice work, extendir is a very effective and useful idea!

I'm a little bit confused about you wrote :o

As I know, if we set "DataCacheSize"=dword:800 that means a data cache file of 2048 sectors and 1 MB not 4 MB...

Am I right or do I mess something?

Keep up your good work!

Cheers,

/s1
[Windows Mobile Apps and Games] ShaDrac:
Hi bobsbbq,

About cachefilt.dll, I'm guessing that your SD card is formatted with a cluster size greater then 4kb.

Try format it with a cluster size of 4kb.

Lot of problems with SD card exists if they are formatted with a cluster size greater then a virtual memory page size.

This is problem appears when a program try to read unbufferred data from storage.

But as a workaround, since it's hard to ask from all your end-users to format there SD card with a clustersize of 4kb (because they think everything works ok),

Apply the cachefilt.dll only to the profile of the SD card, and remove it from [HKEY_LOCAL_MACHINE\System\StorageManager\FATFS\Filters].

Enjoy!

ShaDrac
[Windows Mobile Apps and Games] ShaDrac:
Hi seatone,

I'm not completly sure about this, but I think since the first Touch series of HTC, the sector size of our root storage (storage memory) is 2048 bytes, while the sector size of most SD cards is 512 bytes.

When you have a "DataCacheSize"=dword:800, we would have a cache size of 2048 sectors.

On a root storage with a sector size of 2048 bytes, would translate to an cache size of 2048 * 2048 bytes = 4MB.

With the same "DataCacheSize"=dword:800 on a SD card, we still would have a cache size of 2048 sectors.

But an SD card with a sector size of 512 bytes, would translate to an cache size of 2048 * 512 bytes = 1MB

Enjoy!

ShaDrac
[Windows Mobile Apps and Games] wobbu:
Was trying to cook this fantastic package in, but ran Preset Installer and it reported that Extendir was not enabled. Noticed that free memory dropped by 4MB though, is it a sign that Extendir is in fact working?

Thanks and keep up the excellent work,ShaDrac! :)
[Windows Mobile Apps and Games] bobsbbq:
If preset installer does not recognise it as a Extendir enabled device then no it's not working. Give some more detail and I'm sure we can help.
[Windows Mobile Apps and Games] lapy:
hello ShaDrac, i read your first posts, but i'm not sure to understand well. Has this driver any effect on files cooked in rom? (eg. Manila)
[Windows Mobile Apps and Games] bobsbbq:
I will give it a try I think it is formated with 32kb now.
[Windows Mobile Apps and Games] ShaDrac:
Hi RoryB,

I think that those changes will work.

Previously you would have a cache size of 64kb,

And now with an "DataCacheSize"=dword:1000 you would get an cache size of 4096 (dword:1000) * 512 bytes = 2MB.

I also saw that you have

[HKEY_LOCAL_MACHINE\System\StorageManager\FATFS\Filters\CacheFilt]

in your boot.rgu.

I asume that you also have this line somewhere near the end of your boot.rgu

[[B]-[/B]HKEY_LOCAL_MACHINE\System\StorageManager\FATFS\Filters\CacheFilt]

The second one with the minus sign removes the first entry.

You will gain memory and speed by removing CacheFilt since it is a very bad implementation of file cache by using memory mapped files.

While setting "EnableCache"=dword:1 to be "EnableCache"=dword:0 works to disable the cache (which is only interesting for testing purposes, or when the cache is added to Extendir V2),

It's better to remove "CacheDll"="diskcache.dll".

If you set "EnableCache"=dword:0, diskcache.dll won't create any cache BUT it is still loaded by the storage manager and every instruction/read/write to disk will go through the diskcache.dll.

If you remove "CacheDll"="diskcache.dll", diskcache.dll won't be loaded by the storage manager, the chain to the disk will be shorter, faster and will consume less memory.

Enjoy!

ShaDrac
[Windows Mobile Apps and Games] ShaDrac:
Well, actually...

I never thought about it but...

Hi wobbu,

If you have CacheFilt in your boot.rgu and it's loaded,

And you have Extendir also added, with an Order for example 999, well atleast with an higher Order than the Order of CacheFilt.

PresetInstaller will say that the device is not Extendir enabled.

CacheFilt starts writing to the disk after 5 seconds and when your device is not doing anything.

When Preset Installer checks if the device is Extendir enabled it creates a file in \Extendir\Windir and tries to read that same file through the \Windows folder.

But since CacheFilt starts writing 5 seconds later, the file can't be found in the \Windows folder since it was not written to disk yet.

I think it's best to remove CacheFilt, even on ROMs that don't use Extendir.

But if you really want to keep CacheFilt...

Set the order of CacheFilt higher then the order of Extendir.

If you are using the (latest) Extendir V2 Preview/Beta 1.03 then it's best to set the Order of Extendir to 0.

Enjoy!

ShaDrac
[Windows Mobile Apps and Games] RoryB:
I did not have [-HKEY_LOCAL_MACHINE\System\StorageManager\FATFS\Filters\CacheFilt] so I need to add that and see what happens. I am currently changing these values over one at a time to see what happens and will test ver 1.03 later today.
[Windows Mobile Apps and Games] bobsbbq:
Or just removing the line would be the same right? What is the purpose of the line with the - in front of the key? To remove it am I right, or does this serve another purpose?