yashsingh1/xdaforums huggingface dataset:
[HTC EVO 3D] Compusmurf:
Yes, the CIQ crap was discussed when the Evo came out and it was discussed in the Evo Shift forums for awhile.

Earliest thread discussing the IQFD process was Aug 2010 but no real action was taken.

So knowing it was on the previous ones, I'd already assumed it was on the 3d.
[HTC EVO 3D] daneurysm:
I am not surprised that there is logging. In fact I would be shocked if there weren't. Also, if that chart is 100% accurate some of those I actually am fine with (Google Checkin and HTCfeedback.apk specifically), but when I heard about cIQ I was incensed...to hear about all of this going on is absolutely fncking unfuriating.

Scummy. Truly. The new e-economy is obviously based on tracking you and your habits. The collecting of this data isn't the evil part but what is likely happening with it afterwards....and there is absolutely no transparency about this process even occurring. It would take a Judgement Day level act of God to reveal what they would like to do with this information...your information.
[HTC EVO 3D] wase4711:
Well, as much as I hate this kind of hidden intrusion into our personal lives, I must say that its not surprising that this happens, and, frankly, all of our "online" behavior is probably tracked by someone, no matter what they "disclose" in advance..

Remember, we live in the post 9/11 era, and, it seems like being watched in some way shape or form is much more commonplace and "justifiable" than it was 10-20 years ago..

Sad state of affairs....
[HTC EVO 3D] daneurysm:
It was happening already and it was going to happen more. That load of horse-**** about "living in a post 9/11 world" is just a very convenient weapon to wield. It is sickening that it works so effectively on people. Appeal to their emotions. You might as well, their intellect is broken anyway.

...color me jaded, we're in the minority bro...
[HTC EVO 3D] brolz:
Yea I had no clue until I read your thread.
[HTC EVO 3D] wase4711:
agree completely, bro..kinda ironic this stuff is coming to light right now though..
[HTC EVO 3D] sniperkill:
You know, it would be one thing if we could opt-out, and that would put an end to the services. But HTC themselves stated," if you opt-out, we will protect your data by encrypting it (something close to that). What that tells me is that even if we opt-out, they will still collect our data. So what good is an OFF switch if their still going to collect our data? I want it to be like if we opt-out, the services no longer run! I'm NOT okay with my data being collected. As it stands right now, they collect it whether we like it (opt-in opt-out) or not!

My vote stands by Trev!!
[HTC EVO 3D] life64x:
I was not aware and thank you. I remember on the synergy thread about calculator had it also..wtf!! My next question is why do they need this level of detail? Raises my blood pressure just thinking about it. Thank you again.
[HTC EVO 3D] TrevE:
From what ive seen so far, the people who DID know about logging, knew about it from a source outside of HTC. We are a pretty technical savvy group here and still alot didnt even know. I hope HTC will make it clear to us with a real on/off switch, give us details / show us data that comes from this, but thats never going to happen
[HTC EVO 3D] daneurysm:
Every single bit of information they can collect on you (anonymous or not) is valuable to a company for a number of reasons. On the technical side troubleshooting and debugging. UI design likely as well. For marketing it's helpful to know what apps you love and what apps you avoid. When you use certain apps, how long you use apps...all of that is very valuable to them for their future attempts at separating you from your money.

...and then if there is non-anonymized data the value of said data skyrockets. Sure, if it is anonymous they can still tie it together with a few details and figure out who you are...but with an actual name voluntarily attached to the data it is now insanely valuable. Location data. They can tell when you are at the store, sell that data to other companies and aggregate that data. You use your debit card at the store, your bank sells that data and it gets aggregated with the other data. Use your grocery store value-card? They sell your data. Now there is a profile out there that details what you buy, at what location, the route you travel to get there, how you pay, any apps you used in the process, calls you've taken. This is a very valuable bit of marketing data...and it is also a shocking assault on your privacy.

I'm not a tin-foil hatter. This is happening. Already. Right now. On your phone, on your computer, on facebook, on google, probably even on XDA. The "like button" follows you around the internet, clicks are logged, how much time you spend on a page is logged, where you go on the internet, when, for how long, what you spend, where you get gas, the kind of car you drive, how often you get oil changes, the kind of porn you prefer, etc etc etc etc etc.

It's all out there. Already. Has been for years. Google has been very good in this regard. Facebook sells your information to advertisers...Google only sells your eyes. But Google+ demands real names...GoogleWallet is another scary proposition.

Am I being paranoid? No. This is all documented fact. Does this mean the end of the world? Mostly no, it's for harmless marketing. Does this mean it is totally harmless? Absolutely not, just wait for all of this data to fall into the wrong hands and you decide that for yourself...if you think drug tests and credit/background checks are ridiculous for getting employment, insurance, housing or credit just wait until every word you've ever said online, every product you've ever purchased, every website you've ever visited and every type of porn you've ever cranked one off to becomes a part of that....and then one day your medical history will inevitably become linked and then some true evil is let out of the bag...some things in your life should never know about other things in your life, especially your bank, insurance company, medical insurer and employer....there just aren't enough checks-and-balances remaining to keep things from being unfair if we hit that point.
[HTC EVO 3D] VoX_XDA:
I'm back! And thanks for your diligence on this stuff Trevor. I know you've worked tirelessly on this. Your efforts are outstanding.

I for one will NEVER purchase another HTC device simply because of this nonsense. who does HTC think they are? Apple? lol :eek:
[HTC EVO 3D] cobraboy85:
****. thread/
[HTC EVO 3D] guitardoc64:
There was none of this in the shipped ROM. It was applied in the 2.3.4 update. The depth of this MALWARE is a real disappointment and shocking. I see this as a breach of any reasonable expectation of privacy, and it will affect ANY future purchases. The logging and depth of private information reported is what most would see as a trojan, virus or other identity theft malware. In this case it isn't a bad app download. It's the whole ROM. I hope that HTC takes this seriously, and I hope they can handle the negative publicity. :mad:
[HTC EVO 3D] snovvman:
Exactly. In fact, many of these items [and or their predecessor] were discussed even before 8/2010 but no in-depth action was taken. I am glad that TrevE is digging deep. Transparency is the key here--at least we should be told plainly what is being collected and be given the option of opting out.

Another related concern, actually, are all the CPU, data, stability, memory, and battery overheads these processes consume. It would appear that our phones can be much more efficient without them.

Cheers TrevE.
[HTC EVO 3D] life64x:
You bring up valid points. I knew we changed when about 5 years ago, a friend of mine in a human a resources department for a large firm and I had lunch and he was mentioning a candidate for a position that perfect for him. He checked the guys myspace page for more info about him! All college grads here should be careful what they post or not post in social web sites, it could it come back to haunt them in job interviews. I guess the real headline is welcome to 2011.
[HTC EVO 3D] poweroutlet:
Treve, your research in this area is highly appreciated by all of us Evo 3d users. Thanks a lot. I like many here was not aware of the level of logging going on until you posted it in the dev thread.
[HTC EVO 3D] MCLFLN:
Mik

Hi TrevE,

first time I personally heard of this logging was when aamikam started removing it in his original Evo roms back before the Evo 3D was launched. I don't see him posting on XDA much anymore but he is still around. It might be worth contacting him just to check and see if he found anything that you haven't.

Thanks for all the hard work,

MCLFLN
[HTC EVO 3D] dewman01:
No Clue. Would like to op out also. That is probably why my Brand new phone's battery only lasted 5 hrs then completely dead. I only made 1 call and received email.
[HTC EVO 3D] sgt. slaughter:
When you think about it really its needed by them to keep up with the handsets and make the user experience better overall.

Without logging and reports being sent and gone through they are conpletely blind to the main uses of the device. Though this could be done through polls and questionaires too I guess. I assume it helps sprint/htc cater to users needs quicker. Ie once they see most users use facebook on phone they can know then that they could look into deving a facebook app better than the market one and things like that.

Now the other part it helps them is for bug reporting and fixing things that hurt the user experience. The log needs to.be collected so when something does happen it takes you only a few clicks to.send it iff to htc directly for them to debug. This cuts down the time it takes them currently to fix bugs as now you have to take time to get on htc site and email them describing the prob, then they have to duplicate it and track down the fault to fix. For random bugs this could take forever to find and fix this way.

Also works for sprint to find network issues quicker pissibly if they notice a phone at gps location X not using tower X they would see either an issue with radio/prl/or even tower the problem.

All in all I think its good for the regular user who stays stock and uses the phone normally.

Now the other side of it is trusting them to use the info in a non harmful way. Which im sure in this day n age everyone is more leaning too initially. But if you ever worked in a corp environment with your web monitored you already submit to this kinda stuff since they know each click you make on the desktop and each site you visit and program you run too.

I do however think that you should be able to participate in these logging and reports individually and opt out/in the ones you want to. Which is the big problem with the way it is currently run. Hopefully that is something they change in the future and make the process smoother and more user friendly.
[HTC EVO 3D] guitardoc64:
All very good points with regards to troubleshooting the device and network.

The negative impact on device performance and personal infomation collected/reported to me is the main problem.
[HTC EVO 3D] hamn2eggs:
My concern here is protection of PII (personal identifiable information).

HTC states that they protect our information by encrypting it. However, it's not done until that data is in their hands, that means a man in the middle attack (or any number of other attacks for that matter) could be launched, and your data would be collected by a potentially hostile party.

We know it's not encrypted beforehand because TrevE's extracting it quite handily. Now, I would have much less of a problem with my data being anonymized (yes, I know that's not a real word) and encrypted when stored on my device, a secure connection/tunnel created to Sprint/Google/HTC/God/Whomever, and then uploaded through said tunnel. However, it's not.

Our data is collected, stored, and sent out unecrypted over cell towers, which we all know is the single most secure form of transmitting highly sensitive data.

I don't even mind my usage patterns being tracked. I mean, I've come to expect it. It's the world in which we live. If you've ever paid with a credit card or a check, your purchasing habits have been shared the world over - it's how companies know when to stop producing certain products or what to build next in a line of consumer products.

But at least before the boom of the internet, when my information was sold or shared with other companies, it was done discretely - paper changing hands - with a nice paper trail that could be tracked a lot easier.

It's time for HTC/Sprint/Google to start encrypting our information while stripping out personally identifiable/phone specific information or for real opt-out options. I know flashing a ROM with these logging systems mitigated, but that doesn't help those who devices that aren't yet S-Off.
[HTC EVO 3D] os10:
never heard of this before, thanks.

so, is it ok to freeze or uninstall these APKs then?

i'm on 2.3.3, I can find all these programs except CIQ .. i don't see anything like it in the apps list, or find HTCIQagent.apk, or find /system/bin/IQFD or IQD as per the diagram.
[HTC EVO 3D] guitardoc64:
Its not in the 2.3.3 Rom like it is in the 2.3.4 update.

Sent from my s-off Shooter!
[HTC EVO 3D] J3STUR:
I heard about one of those APKs collecting info thru twitter, but I didnt know how much dept there was to it. Thanks Treve for helping us see this. So what can we do about this? I know you have taking out something in synergy rom but how can we fully protect our infomation being sent out?
[HTC EVO 3D] wase4711:
Don't use cellular phones...

Apple and RIM are just as guilty...
[HTC EVO 3D] ch1naski:
I wasn't aware. I don't like or trust it, especially as it coincides with the "htc unlocked bootloader" they gave us...which requires that we register with then that we unlocked our bootloader. Hmmm. Seems to me that they want to know what we are doing with our phones. I bought it. It's mine. None of their business.

Nandroids are for sissies.

Bang.
[HTC EVO 3D] str8upx:
I cant believe people are surprised by any of this.
[HTC EVO 3D] guitardoc64:
I'm not surprised, appalled but not surprised.

Sent from my s-off Shooter!
[HTC EVO 3D] TrevE:
ive updated the diagram in post1 with a more understanding of whats where so everyone can get a better idea of how intertwined all these things are. Also have found one more service responsible for logging htcs data and have updated with that.

Thank you everyone for your input, i want to make sure we have a clear side one way or another on what people think on this/ if anyone was aware. Keep it coming
[HTC EVO 3D] TrevE:
bumping looking for more responses to poll. I will be looking for a response from HTC or EFF soon and want to make sure theres some good statistics :)
[HTC EVO 3D] guitardoc64:
Another bump to help out.

Sent from my EVO 3D with Tapatalk pro!
[HTC EVO 3D] chefdave12118:
Just flash cm7 ;) ..

Sent from my unrooted Galaxy Tab.
[HTC EVO 3D] guitardoc64:
Yeah, we can do that. That's not the point. The point is HTC building spyware into their ROMs, and whether folks were aware of it.

Sent from my EVO 3D with Tapatalk pro!
[HTC EVO 3D] Bromar:
I agree that isn't the point. BTW How hard you think it would be for a disgruntled employee of sprint or HTC with access to said information to use it improperly. Selling numbers and emails is big game, ESP. When they are already tied to usage data $$$$ . Not only that but someone slight them somehow turn down a date oh what's this I see your using an Evo 3d lets go back and check said GPS location at said time and date and find out who you are. Wake up people u can be tracked by a frigging photo on your facebook. I for one consider this a class action type severe invasion of privacy violating. Last time I checked I don't think the patriot act enabled companies authority ...yet
[HTC EVO 3D] guitardoc64:
I was waiting for someone to mention the patriot act. Made all this tracking happen,IMO.

Sent from my EVO 3D with Tapatalk pro!
[HTC EVO 3D] TrevE:
http://www.xda-developers.com/android/htc-responds-once-again/

*sigh* im writing up a full response now to this, look for more later. Logging does not shut off, CIQ has its own privacy policy? where? HTC checkin is more than FOTA, its taking our recovery logs each install and shipping them out before the ui even starts. Blah. So many unanswered questions this still brought up, more later
[HTC EVO 3D] Khaneliman:
I remember seeing the processes running when i first started using task killers a long time ago.. definitely wasnt fully aware of what was being sent.
[HTC EVO 3D] SpyFi:
Wow

Great research and +1 thanks! I never really knew what was logged and thanks for including the .apk. I will definitely be following this thread.
[HTC EVO 3D] davezilla17:
Wow. Thanks for your research. I didn't have a clue.
[HTC EVO 3D] TrevE:
Everyone i have made an app to verify htcs most recent statement on logging up here- http://xdaforums.com/showpost.php?p=17612559&postcount=110

I will be adding in features so you can see what type of stuff im looking at on the phone in the backend. I can tell you none of this disables on stock, but feel free to test it all for yourself
[HTC EVO 3D] Visionikz03:
you think HTC is the only manufacturer logging data?

try this on for size http://radar.oreilly.com/2011/04/apple-location-tracking.html

"Sprint Nextel has even set up a dedicated Web site so that law-enforcement agents can access the records from their desks—a fact divulged by the company's "manager of electronic surveillance" at a private Washington security conference last October. "The tool has just really caught on fire with law enforcement," said the Sprint executive, according to a tape made by a privacy activist who sneaked into the event. (A Sprint spokesman acknowledged the company has created the Web "portal" but says that law-enforcement agents must be "authenticated" before they are given passwords to log on, and even then still must provide valid court orders for all nonemergency requests.)"

The statement above is from this article http://www.thedailybeast.com/newsweek/2010/02/18/the-snitch-in-your-pocket.html

Haven't u guys seen "Enemy of the State?" U thought that NSA crap was all hollywood?
[HTC EVO 3D] Lanaka:
No, didn't realize the SCOPE of the logging that was going on. But I DID suspect something was running in background. The phone keep on awakening for no apparent reason, and 'system' processes that kept on draining battery, unusually high cpu loads during times when the phone was supposed to be 'idling.'
[HTC EVO 3D] Sad Panda:
Trevor, I hope you read every last reply so you see my thanks. Thank you for the countless hours you have put into this.

I was never CLEARLY told what logging or to what extent there was. I was sure there might be some amount of data mining being done but even that I was never given the option to opt out. I frequently will opt in to help provide data to increase the future developing efforts, but in this case I wasn't given the option to opt in or out, and certainly NOT TO THIS EXTENT.

As you have stated over and over, the big point here is very very simple. Most of us are willing to allow some data collection but unless it was deep deep inside some EULA we weren't given any choice, it was either except or not use our devices. Furthermore there has been absolutely ZERO transparency in the process. As we continue into an age driven by information it is a two way street. To get information from us we must also be given information, and the ENTIRE process must be black and white, no ifs, and, buts, completely transparent process or none at all.

Thanks again for your countless hours, again the statistics of this poll support your claim, we had no option to choose yes, or no and still use our devices regardless of that independent decision.
[HTC EVO 3D] solver404:
Judging from many of the replies to this Slashdot article, the unwashed masses still don't get it, but it is getting out there a bit more at a time.

Thank you Trevor.
[HTC EVO 3D] Sad Panda:
Yeah reading the replies of the posted article is disturbing. Google has nothing to do with this. In fact its openness is what prevents this. Try finding this on the closed off source and debugger for iPhone. Google is against this kind of thing (without your knowledge), and the government has unsuccessfully tried forcing them to track who searches for what and give that info up to the government. Google collects analytics but they are the most transparent about it. The more open and transparent google gets the more of a fan boy I get towards google. I do not usually have brand loyalty, but again, the more open and transparent google gets, the more honest they get, the more I will buy buy buy google to show my support, and it's my own way of sending the message of what I will and won't tolerate as a citizen and consumer.
[HTC EVO 3D] ngravatt:
i work as a network admin for a company that allows users to bring in their phones and connect them to a segment our our network that allows limited internal access and access to the Internet. Main reason is so users with their phones can have email anywhere in the building, like during meetings.

But back to the point, you will be amazed at how much data these phones send without you knowing. I can 'monitor' the network at our connection to the Internet.

while connected to my wi-fi network, my phone sent 46.74 MB of data between 8 am and 5 pm, and that does not included any data sent to or from my email server (since that traffic does not go over the Internet).

I didnt watch a single Youtube video yesterday, but my phone sent/received 14 MB of data to IP address 208.117.249.78. A whois says this is owned by 'Mountain View Youtube Inc'. So its Google i guess. Another 13.5 MB of data was s/r to IP address 208.117.226.100. Same IP address owner. 6.36 MB of data sent to IP 173.194.31.119 (Google),

I did actually update google maps to the latest version and then looked at the layout of my local airport, so that can account for some of the data. But of the remaining traffic, all of it was s/r to the following Google IPs:

74.125.227.47, 74.125.227.39, 74.125.227.63, 74.125.227.33, 173.194.64.132

A large amount of data was s/r to facebook also. I am pretty sure this is just the facebook app updating my 'friends' profile pics and status updates, even though i did not once launch the facebook app, i understand that it provides that info when you link an account to a users facebook profile and when they call you, it displays the picture and whatever they typed last in facebook.
[HTC EVO 3D] dannytill:
Flipz brought this to my attention back in April on Fresh Rom for the OG Evo which he 1st removed CIQ from

here's the link to his 1st time disabling/removing CIQ:

http://geekfor.me/evo/23/fresh-evo-4b3/
[HTC EVO 3D] Akasa Fox:
I was aware of the logging, except not to this extent, I just as well assumed that CIQ did as they said they did, NOT logging my SMS, Phone Calls, and Web data.

Guess I was wrong in believing a company like this.

I hope they pay, and pay dearly.
[HTC EVO 3D] retross03:
Well It's Already Happening

If you go over 5 GB ON SPRINT data watch what happens! The info snatched from these devices serves ONLY the purpose of the motive of proft.
[HTC EVO 3D] GrimReaper24:
I knew the permission's it required were rather bad and that if you tried to stop it would crash the phone and you had to root and flash a rom for the most part to get rid of that crap...
[HTC EVO 3D] oohaylima:
Was not aware at all. Would use the poll, but that stuff doesn't show on the app.
[HTC EVO 3D] GrimReaper24:
That was why I rooted among all that bloatware.....