yashsingh1/xdaforums huggingface dataset:
[Windows Mobile Software Development] bepe:
but means to implement a new filesystem to it ... so will take some time

Know much more about XIPs now ... so I can implement compression

... and it would support all xip's (last xip dump tool only suported FE 03 00 EA ... but that was wrong)
[Windows Mobile Software Development] !Aman!:
not a problem, take as much time as you need :D

offtopic: bepe, when can we expect the new PRB because i'm sure you might be aware that current version has some problems with some WM 6.5 OEMs. also the new kitchen that you were working on, is it near release?
[Windows Mobile Software Development] bepe:
I needed a break from the other project, that is why I'm working on this.

About the state of the GUI project...

I started with the GUI, but then realized that the actual prb.exe is need to be reworked.

So the GUI is on hold and new prb.exe is in progress.

new prb is different to all that u know.

- working with dsm files again

- it will take packages and output xip.bin and imgfs.bin... no dump folder anymore

-- this will make the whole thing much much faster

-- the xip.bin is now 100% (binary) identical to the one MS is creating using the CE PB

-- sure there are options to remove rgu and dsm files, but default is to make a working package structure that would even allow ULDR to work

-- imgfs.bin ... this is driving me crazy... MS is using so a strange way for the layout that I'm not able to recreate it... already give up on trying to make a 100% identical imgfs... but I can make a good one

- it will work with a xml file describing the hardware like PB does (xml example: http://blog.csdn.net/TheGameIsFives/archive/2009/01/13/3771422.aspx) ... don't worry, will be easy with a tool that created the xml from a os.nb

- NOR device will be supported

- will support XIP(execute in place) for NOR devices

all this is much work, and I can not tell a date yet because I have other things like studdying and family also... sorry

after the prb.exe is done, I'll continue the GUI that can then work with dsm files then too and that will give much better posibilities
[Windows Mobile Software Development] !Aman!:
good to hear that... we all can surely wait, for this will be yet another masterpiece ;)

PS: if u need beta testing, i would love to be a part of it.
[Windows Mobile Software Development] utak3r:
mmm.... the checklist is simply great :D

And as for the build number - keep in mind it's not always the same number: XIP and IMGFS... even in official ROMs.
[Windows Mobile Software Development] uhery:
if an extract file inside the imgfs folder has always the same build of the OS that i'm working/extracting .... :D

ok ... if i'll use/check different OS ... i'll pay attention ... i'm so careless!!! :(

thank you ... thank you again for your beatiful work!!! :)

ps.

could be possible create an output name folder for the "wildcard" extract files? :o
[Windows Mobile Software Development] ctyy:
I have tried to extract a nbh files in two way.

NBHextract DIAMIMG.nbh
NBSplit.exe -kaiser 00_OS.NB
ImgfsFromNb.exe 00_OS.nb.payload imgfs.bin
Dump_PKG.bat imgfs.bin

NBHextract DIAMIMG.nbh
Dump_PKG.bat 00_OS.NB

Both way got all the files in SYS\MSXIPKernel plus with a .ROM file.
[Windows Mobile Software Development] bepe:
ow... sorry

yes, that is because the rom is a cooked rom that does not have all dsm files anymore

my tool needs the dsm files to create packages

there is no way to creat packages without dsm files...
[Windows Mobile Software Development] bepe:
no, is not possible ... I can't name the folder *bla*, because '*' is not allowed

but there is an -out option where you set the output folder, using this it is possible to make a bat file asking for wildcard and output folder
[Windows Mobile Software Development] yonn1981:
off topic sorry,

Any news on the new GUI of the platformrebuilder ? :D
[Windows Mobile Software Development] DaveShaw:
Read back, this thread isn't that long.

@bepe, wonderful work as always, looking forward to what the new PRB brings.

Dave
[Windows Mobile Software Development] c_shekhar:
yet again the power of bepe packed into tools...

Thanks a lot bepe...
[Windows Mobile Software Development] 12aon:
Is this tool able to dump emulator roms as well?
[Windows Mobile Software Development] :
good work on this one, keep up the work, and keep up the work on the IMGFS, i know that is a B!tch to understand, there is a real lack of documentation on it, but keep it up. I know you and da_g will be albe to get it soon.
[Windows Mobile Software Development] sonblack:
It's great.

Thanks bepe for sharing and your hard work.
[Windows Mobile Software Development] nposix:
Any chances for an updated imgfsfrmdump? thanks
[Windows Mobile Software Development] ai6908:
Holy Sh*t! This is so awesome, now I dont need to dump the whole ROM to extract the packages I want! Thanks bepe!!!
[Windows Mobile Software Development] bgcngm:
Does this means that all devices will be supported, not only HTC? :)
[Windows Mobile Software Development] DaveShaw:
PRB already supports some non HTC devices. I don't know which, but from this post I'm guessing one's with NAND.

Dave
[Windows Mobile Software Development] makeveral:
Very good job Bepe!

thanks :)
[Windows Mobile Software Development] fards:
fantastic work Bepe, yet again!

with da_g nbimagetool and the old oem2ext dropped into \bin and a couple of messy alterations to the .bat it makes a fantastic standalone drag and drop dumper for nbh files!

For those of us too lazy to press more than one button, this one sorts into oem and ext straight away..

@ECHO OFF

if "%~1"=="" goto :error

set path_exe=%~d0%~p0bin
set path_arg=%~d1%~p1

cd /d %path_arg%

"%path_exe%\nbImageTool" -c "%~1"
"%path_exe%\ImgfsToDump" -b -t OEM os.nb
"%path_exe%\oem2ext.exe" "%~d1%~p1\IMGFS\OEM"
pause
goto :EOF

:error
echo Usage: %~n0%~x0 ^<file^>
pause
[Windows Mobile Software Development] bepe:
ImgfsToDump v3.2 Beta

New beta is online, enjoy the nbh support and the XIP extraction part :D
[Windows Mobile Software Development] makeveral:
wow bepe!! you are my idol! :p

gonna try it and report if i find something!

thanks again :)
[Windows Mobile Software Development] 12aon:
if you remove the "ImgfsTo" from the exe name you have already got a more fitting name ;)
[Windows Mobile Software Development] bgcngm:
Hello again, bepe.

I tried ImgfsToDump v3.2 to extract my device XIP in a hope to solve the PRB crash with my nk.exe. Now, instead of errorlevel -1073741819, I get this:

PLATFORMREBUILDER Copyright (c) 2008-2009 bepe Feb 15 2009 22:53:49

Building for old kernel!
Build: Premium
Locale: 0409

Preparing release structure...
... done!

Collecting standard packages and initializing hives...

Error: 0x80000005
'C:\DX900 Kitchen\\ROM\XIP_WM6.1_21055\OEMXIPKernel\nk.exe\imageinfo.bin'
While reading file!

ERROR! (errorlevel: 1)
Press any key to continue . . .

Well, it happens not only with nk.exe imageinfo.bin:

Error: 0x80000005
'C:\\DX900 Kitchen\\ROM\XIP_WM6.1_21055\OEMXIPKernel\cecompr.dll\imageinfo.bin'
While reading file!

It seems that XIP extraction is not working fine for me... :(
[Windows Mobile Software Development] adwinp:
[suggestions]

1: add a -x switch in order to choose whether to extract XIP or not (default, extract)

2: may be a good idea to integrate an optimized version of imgfsfromdump?

3: posted a while back in DFT about PRB not respecting rgu hierarchy (tweaks get randomly overwritten by OEM rgus while creating the hives (default.hv and user.hv), so I still need to create hives with the help of the old buildos, then move to the new dump.
[Windows Mobile Software Development] hzcun:
Thank you! I downloaded.
[Windows Mobile Software Development] afeng11:
how to recreate .Reloc section for modules that process by new PRB?thanks
[Windows Mobile Software Development] sanychlxg:
hi, bepe.

can you add *.dio support to your ImgfsToDump.exe?

Thanks in advance

P.S.sorry for my poor english
[Windows Mobile Software Development] bepe:
thanks, will check that ... possible I have a bug somewhere
[Windows Mobile Software Development] bepe:
1 yes, will do that

2 too much work for now, and will continue prb.exe when this is done

3 I dont have this problem ... while building in prb.exe you see a list of packages, this is the order used for the hives... it is based on the shadow order of the OS ... you really should use this shadow order
[Windows Mobile Software Development] bepe:
no, it's NOT possible to recreate them
[Windows Mobile Software Development] bepe:
could u PM me a link to such a rom?
[Windows Mobile Software Development] 12aon:
Bepe I have been looking into emulator rom's which are in .bin format. We have a emuKitchen to whip up a a home made .bin rom, but it just renames the .bin to .nb dumps it then on rebuild renames it back.

Is it possible to create native support for these emulator .bin roms, or is that asking for to much. I'd be more than happy to upload some .bin roms,

12
[Windows Mobile Software Development] bepe:
Check PM please
[Windows Mobile Software Development] Nixeus:
Waaaaw Bepe !! Thanks a lot for this good release !!

A gain of time , it's very very great !!!
[Windows Mobile Software Development] c3ro:
amazingly fast! great done.

this tool is almost perfect! i may ask what features you still want to add?

possibly oem2ext integration, but that is easily done by .bat modifying (or could this format interfere with new designed GUI?)

possibly extracted XIP also as xip.bin output

possibly generated logfile

things that are easily done by yourself, just a cherry on top of this automated tool.
[Windows Mobile Software Development] bepe:
- oem2ext is a really ugly tool ... it's working with the names of packages. only working for HTC and only as long that they do not change the names of the packages. New gui and new PRB.exe will also support EXT packages, just that they can have a dsm file now

- will not add xip.bin, what would we need it for? ... but I forgot to extract the romhdr.bin :$

- Log file ... ummm.... no... log is on screen, you can redirect that to a file if you need it
[Windows Mobile Software Development] c3ro:
makes all sense, altough havin' xip.bin as a single file feels more comfortable when you share, but using rar/zip or .7 is also fine :D theres always a way ;)

all in one, nice to see progress.
[Windows Mobile Software Development] bepe:
new beta is online
[Windows Mobile Software Development] !Aman!:
and it works great again :D

EDIT: no, its not.. modules in imgfs only have imageinfo.bin files :(
[Windows Mobile Software Development] afeng11:
bepe,you are great!waiting for you new PRB,it will support my O2 XDA Flame(NOR Flash),thank you again!
[Windows Mobile Software Development] bgcngm:
Something got broken between 3.1 and 3.2 (beta and beta2)... The S00X files aren't being extracted, i.e. modules only have imageinfo.bin. It was working fine in 3.1.

By the way, can you please add support for SRPX compressed XIP sections?
[Windows Mobile Software Development] afeng11:
bepe,can you help me to port O2 XDA Flame xip automatically?buildxip(version 0.54) can't process it correctly.
[Windows Mobile Software Development] c_shekhar:
Why do I fail to run this application on my PC XP??:confused:

I always get "unhandled win32 exception occured in imgfstodump.exe"

I have

DOTNET framework 2.0

DOTNET framework 3.5

MS visual c++ 2008 redistributable -x86 9.0.30729.17

MS visual c++ 2005 redistributable -x86

Whereas all the other imgfs tools are running without any problem.

What am I missing? :confused:
[Windows Mobile Software Development] bepe:
uploaded ImgfsToDump_3.2_beta2-fixed.zip for the module problem
[Windows Mobile Software Development] bepe:
Could u upload me that rom?
[Windows Mobile Software Development] bgcngm:
Thanks. It works fine now. :)

Have you seen my previous request? Will you try to add support for SRPX compressed XIP sections? ImgfsToDump only finds IMGFS partition in my OS.nb file because XIP is SRPX compressed. To dump XIP, first I have to use osnbtool to extract xip.bin (which is automatically uncompressed) and only then ImgfsToDump can process it.
[Windows Mobile Software Development] bepe:
yes, I'm on it. Just studying that compression format.

This latest beta should already find it... but don't try to extract it... not working!
[Windows Mobile Software Development] c_shekhar:
It is happening with all the diamond ROMs whether self cooked or anybody else's.

very much confused really....
[Windows Mobile Software Development] bgcngm:
Hehe. Even if I wanted it wouldn't work. The latest beta crashes when it finds my XIP partition.

I reported that the module issues were fixed, but that was because I tried ImgfsToDump directly in my imgfs.bin. :)
[Windows Mobile Software Development] bepe:
ok, I'll try it when I'm back home from university

could u give me one link to a rom that u are sure that it has this problem?
[Windows Mobile Software Development] bepe:
hm... ok, much work to be done before leaving the beta status :D
[Windows Mobile Software Development] Blackdragon_860:
bepe: failure here:

Collecting standard packages and initializing hives...

Error: 0x80000005

'ROM\XIP\MSXIPKernel\busenum.dll\imageinfo.bin'

While reading file!
[Windows Mobile Software Development] bgcngm:
Ahh, at least I'm not the only one with that problem... :p And you had extracted a HTC XIP, right? I've already reported that problem. I think bepe is also working on it.
[Windows Mobile Software Development] c_shekhar:
here is the link to yozgatz's ROM -->

http://rapidshare.com/files/295914896/Gen.Y_D2_R4.1A_WWE.7z.html

I have analysed that the problem is with LZX ROM whereas if the same ROM is cooked in XPR compression then your tool works fine...

I hope this clue gives you some help...
[Windows Mobile Software Development] bepe:
new beta is online, but still needs much testing
[Windows Mobile Software Development] bepe:
(LZX roms are not suported yet)
[Windows Mobile Software Development] c_shekhar:
I didnot know that. It is not mentioned in the first post also. May be you add that as well in the course of time.:)

My ignorance....
[Windows Mobile Software Development] bgcngm:
I've just tested it and seems to work for me. It detects my compressed XIP partition and extracts fine.

I will do further tests. :)
[Windows Mobile Software Development] heineken78:
Hello Bepe!

First of all thank you very much for making such brillant programs for cummunity!

I have 2 small questions regarding your software I use.

1) Can you make utility such as imagesfromdump, thats making image file not cutted or same size like that was before dump.

2) Im using your old BuildOS, thats doesnt handle so good for new 6.5 with many files. Do you have newer version of it or if you can recommend another build-OS utility?

thank you for your attention!

Dmitry
[Windows Mobile Software Development] udK:
That's because you are trying to reloc a module that the .reloc section was removed.

You did a dump of the XIP from a ROM built with bepe's platformrebuilder, right?
[Windows Mobile Software Development] udK:
I did a test with the v3.3 BETA2, first feedback;

using Dump_FILES__XIP.bat or Dump_PKG__XIP.bat all the imageinfo.bin, .p7b, .hv, .nb0, .nls, .dsm and .rgu are missing.

(tested using Official Rhodium v1.86 ITA - nbh)

Output:
[Windows Mobile Software Development] udK:
Using Dump_PKG_SYS_XIP.bat extract only MSXIPKernel, MSXIPKernelLTK, WinCENLS_WWE from the XIP section (all the imageinfo.bin, .p7b, .hv, .nb0, .nls, .dsm and .rgu are missing) and the SYS was not dumped.
[Windows Mobile Software Development] alesscam:
HI UDK

I have tested on rom official 1,59 Blackstone and Dump_FILES_XIP.bat works well

I have reconstructed all xip with Dump_PKG_SYS_XIP.bat and Dump_PKG_OEM_XIP.bat and the rgu and dsm there are
[Windows Mobile Software Development] udK:
As I wrote to bepe, I think to have some troubles with my PC here in office so don't take my test as real, I will try to do the same test when I'm at home.
[Windows Mobile Software Development] bepe:
was just chatting with udK, it looks like his office PC has a problem

Hidden files are not shown even with the option enabled

don't think anyone else has that problem ... if yes, then please tell me
[Windows Mobile Software Development] alncool:
Hi bepe,

I have the same problem here. I did not have this problem with v3.1. I'm also running the tool at my office but i don't have any restriction on the system. I'm admin on my workstation.

Anyway thank you for your great tool !

AlnCool
[Windows Mobile Software Development] DaveShaw:
They're not system files are they, it's a seperate option to show them?

Dave
[Windows Mobile Software Development] alesscam:
but Dump_PKG_SYS_XIP.bat extract only MSXIPKernel, MSXIPKernelLTK, WinCENLS_WWE

Dump_PKG_OEM_XIP extract OEMXIPKernel and LangDB

and i think that is right
[Windows Mobile Software Development] alncool:
Oh man you're right !

I was a bit confused about the name ... i Thought it would also dump the whole SYS but it only concern the XIP section ..

Well I'm gonna take another coffee ... I'm not yet awaken :D

AlnCool
[Windows Mobile Software Development] alesscam:
:D.....

No problem...good coffee

we are here in order to help us

and to help bepe in its optimal intense activities
[Windows Mobile Software Development] bgcngm:
Yes, they have the system file attribute. As a matter of fact that files have ASHR attributes.

Everything is working fine for me, also in my work laptop. Are you sure you have Folder Options set to "Show hidden files and folders" and not "Hide protected operating system files"?
[Windows Mobile Software Development] DaveShaw:
I know that ;). That's what I was hinting at.

Dave
[Windows Mobile Software Development] udK:
Ok, tested again on my home PC and every things is fine.

Thank you bepe.
[Windows Mobile Software Development] bgcngm:
Yeap, seems to be working fine. Now, if LZX compressed IMGFS partition support is added, this tool becomes perfect. And I would really suggest to change the .exe name. Hehe :p
[Windows Mobile Software Development] bepe:
ok, LZX working now ... TODO: change the exe name... hmm... should have done it before uploading :$... ok, lets do it when it's final again
[Windows Mobile Software Development] mbarvian:
hi bepe!

thanks for this great tool, as always ;) I was wondering if you could redo imgfsfromdump.exe, because it keeps spitting out errors in prb on random files sometimes :(

thanks!
[Windows Mobile Software Development] bgcngm:
Amazing work, bepe.

Now, I'm eagerly waiting for the new version of PRB that will hopefully work fine with my nk.exe. :)
[Windows Mobile Software Development] c_shekhar:
Some headway but still not fully functional.

It is randomly stopping inbetween( say at c*** or j***) by giving the unhandled error.
[Windows Mobile Software Development] bepe:
I dont have that problem here...

I've tryed it with this rom:

was able to extract all files directly from nbh
[Windows Mobile Software Development] c_shekhar:
Strange!!!!

I tried it on my office PC and yes, there is no problem. I shall have to look into my home PC, what is wrong there...
[Windows Mobile Software Development] bgcngm:
I've also tried to dump that ROM in both my home and work laptop and it worked fine. You may have any problem in your home PC.

By the way, bepe. Today I was going to dump a new ACER M900 ROM and I experienced a strange problem... When I try to dump XIP and IMGFS PKGS (-b switch) from the OS.nb, I get this:

If I try to dump only the files, then it's fine...

I did tried to extract xip.bin and imgfs.bin from the OS.nb (using osnbtool) and then use ImgfsToDump directly in these files, but if I use the -b switch, it crashes.

You can download the xip.bin that I'm trying to dump from here: http://www.4shared.com/file/143867205/fb16cfa1/ACER_M900_XIP.html.

P.S.: Here's a suggestion for the new name of this tool: DumpROM.
[Windows Mobile Software Development] bepe:
The OEM packages of that xip do not contain a valid cert... this was a problem, because the tool checks the cert to see if the package is OEM or SYS

... lets assume that MS is able to create a valid cert ... so all invalid certs are from OEM

this new xidump version has this logic ... so it will be able to dump it

about the name ... I decided to name it xidump ... dumprom did already exist

'x' stands for XIP ... 'i' for IMGFS :D
[Windows Mobile Software Development] bgcngm:
Well, thanks for the fast reply. It works with that xip.bin, but still doesn't work with this one: http://www.4shared.com/file/143919021/546ac5d2/ACER_X960_XIP.html. Packagebuilder 3 also crashes with this OEMXIPKernel .rgu.
[Windows Mobile Software Development] c3ro:
i have no problem in dumping this xip.bin on xidump 1.0

attached are the extracted files.
[Windows Mobile Software Development] bgcngm:
The problem is not when dumping the files, but when using the -b switch (to dump packages), as before. ;)
[Windows Mobile Software Development] erickwill:
Rugal and others expert guys has indicated you

Dear Bepe,

Rugal, moderator of Eten forum, and many other experts, has indicated you as the only person that can figure out my XIP problem.

We all had tried all possibilities that we could or had knowlodge.. so I am asking kindly for you help..I have a Pharos Traveler 117 device, it's flash.bin file is here http://www.4shared.com/file/140939253/bd89afaa/dump.html

I am trying to cook a rom using the original rom files from original site and after flash the new rom the device get in a loop in the startup screen or just doesn't starts.. and doesn't goes ahead..I belive that it could be some XIP or OEM issue.. some problem to extract or organize them.. but I don't know exactly what it could be.

Please.. I really need your help to figure this looks impossible issue out.

Cheers,

Erick
[Windows Mobile Software Development] adwinp:
In my opinion, you shouldn't have gotten rid of the -o (output folder) option.

It comes in quite handy.
[Windows Mobile Software Development] endymion2k5:
Hello Bepe,

Many thanks for this nice tool, it almost works flawlessly. Today ive tested two roms, one being HTC original and one being Custom. Both extracted fine with good results. There is one minor flaw within xidump at this point i believe.

xidump (at least for me) always shows:

OS:
16512.5 (Build: 1600) MSXIPKernel

Ive checked this against "SysVersion" and it does not match. It always seems to be 16512 on the roms that i have tried.

The roms i have tried today were the new surfaced "21872_Diamond_CHS" original rom. The custom rom can be found here: http://xdaforums.com/showthread.php?t=507672

Thanks in Advance,

EndyMion
[Windows Mobile Software Development] hdubli:
Hello Bepe,

Thanks for tool.It now dumps romhdr.bin from Asus and acer os.nb.However using the kitchen with platformbuilder, i get this errot "Instruction at 0x0040645f referrenced memory at0x00000000.The memory could not be read"

Can anyone pls explain what am i doing wrong.

Redist_DPI_192

Phone_dpi_192_resh_480_resv_640

PhoneRedist_Lang_0409_DPI_192

Redist_Lang_0409_DPI_192

Phone_Lang_0409_DPI_192

PhoneRedist_Lang_0409

CommonNonEA

Bluetooth

Bluetooth_Lang_0409

INTERNETSHARING

OEMDrivers

OEMDriversHigh

OEMMISC

OEM_DPI_192

OEM_Lang_0409

... done!

Processing extended packages...

... done!

ERROR! (errorlevel: -1073741819)

Press any key to continue . . .
[Windows Mobile Software Development] DeadMan2k:
Platform rebuilder can't build you xip, wait fix from Bepe, or use XIPPort
[Windows Mobile Software Development] bgcngm:
That's a known problem and I think that bepe is already aware... At least, if he had read my posts over DarkForcesTeam forum. This happens with certain NK's. In order to have sure, just replace your nk.exe with one from HTC and see if this happens. ;)

Hopefully this issue will be solved in the next version of PRB and that's why I'm eagerly waiting for it. :)
[Windows Mobile Software Development] hdubli:
Thanks bgcngm and deadman2k.

I will wait for the tool as there is only one hope to cook with native 6.5 nk.exe

i can build xip, but is there a way that the whole process just reallocattes the dump and i can build imgfs.bin..pls help?