skysight-inc/HackerNews huggingface dataset:
Those interested in public sentiment in NYC can check out the 3,800 people who are organizing on Facebook for pro-science policy that respects medical freedom, https://www.facebook.com/groups/203524481709348

Unlike the EU health pass, the NYC health pass does not have a provision for negative tests or proof of recovery/immunity. CDC recommends testing, since vaccinated people can be infected and the vaccine suppresses symptoms, so they won't know to self-isolate, https://www.webmd.com/lung/news/20210729/cdc-reverses-guidan...

> Even if they’re not showing symptoms, fully vaccinated people should “get tested 3-5 days after exposure to someone with suspected or confirmed COVID-19 and wear a mask in public indoor settings for 14 days after exposure or until they receive a negative test result,” ... “Our updated guidance recommends vaccinated people get tested upon exposure regardless of symptoms,” CDC Director Rochelle Walensky, MD, told The New York Times
"Last year, when a far-right conspiracy theorist attacked a BBC cartoon...."

lol. You mean Nassim Nicholas Taleb? Who is probably better known than Ms. Beard?

Good Lord, is there any reason to even read a newspaper anymore? They're all just propaganda pamphlets.
Also perhaps of interest is https://openopps.com/ and the team at https://spendnetwork.com/.
Thanks! That Dragon Cancer and Everybody's Gone to the Rapture seem very interesting.
> It means they can be subpoenaed for that information.

They regularly are, and they regularly give up customer data in order to comply with subpeonas[1]. They give up customer data in response to government requests for 150,000 users/accounts a year[1].

[1] https://www.apple.com/legal/transparency/us.html
The National Center for Missing and Exploited Children, a “private” nonprofit created by the US government and primarily funded by the Department of Justice.
Except FedBizOps has fully transitioned to sam.gov
Security researchers and hackers routinely look at the code on the device, though.
Mary Beard is absolutely not "a fraud" just because you disagree with her view on diversity. (fwiw I also don't particularly like that tweet of hers, but come on.)
We already have that. It's called "fraud", but the definition of "profit" is not terribly loose.
NY state does require you to identify yourself to police upon request. You don't have to carry a document to achieve that, however.
1Password and Dropbox being on Electron seems absurd.

Regardless, you kind of hit on the point - Slack & VSCode are basically non-optional, maybe for other people it's some other combo. Pop, on the other hand, only has potential to be "non-optional" for collaborative work. Thus, given that real-time collaboration is not the standard way of working, being a resource hog on the level of "non-optional" apps means you will be shut off first for most users.
There is a clippy lint, pedantic and allowed by default, that warns about passing a large type by value.

https://rust-lang.github.io/rust-clippy/master/#large_types_...

The default threshold is 256 bytes: https://github.com/rust-lang/rust-clippy/blob/1fc1aee7be6e7e...

So you might use that as a rule of thumb. But officially, "Generally speaking, if your type can implement Copy, it should." https://doc.rust-lang.org/std/marker/trait.Copy.html#when-sh...
> All of the slippery slope arguments have already been possible for nearly a decade now with the cloud.

Not only has it been possible for a decade, it’s been happening for a decade. Every major social media company already scans for and reports child pornography to the feds. Facebook submits millions of reports per year.
Clinical Psychology is just one part of the field of Psychology but even there can be progress in many directions - better diagnosis, less reported issues due to better prevention, less side-effects from treatments, or just pure metrics like higher life satisfaction, less suicides etc.
Sure - but if you are going to write blog posts / articles - and all you can say is based on the lawyers I talked to apple is committing child porn felonies, that is just unacceptable.

At least HN should flag these and get these taken down. Over and over the legal analysis is either trash or it's clear the article author didn't understand something (so how can lawyer give good advice?).

These conversations become so uninteresting when people take these extreme type positions. Apple's brand is destroyed - apple is committing child porn felonies.

I would have rather just had a link to the apple technical paper and a discussion personally vs the over the top random article feed with all sorts of misunderstandings.

And in contract law there are LOTS of legal articles online - with folks name on them! They are useful! I read them and enjoy them. Can we ask for that here where it matters maybe more?
The bulk of the CSAM hash database comes widely circulated images, available on sleeze dark web websites (and historically on sketchy porn sites just on the web).

So someone need only find a collection of likely included images and compute their hashes and publish it.

The attack works just as well even if the attacker isn't sure that every hash is in the database, they just need to know enough likely-matches such that they get enough hits.

Consider it this way, some attacker spends a couple hours searching for child porn and finds some stuff. ... what kind of failure would the NCMEC database be if it didn't include that material?
I disagree with this sweeping assessment, and I prefer to calling a service like this an "agent", "assistant", or "delegate". This is because technology cannot solve most human and social problems, but they can help as a delegate in dealing with complexity so you can focus on other things worth your time and interest.
Judging the extremes rather depends on deciding where the center lies.
Does it mean that even more surveillance is a good thing?
Life is Strange season 1 is one of my favorite games. And the soundtrack is excellent.
The thing that's shocking to me is that Google, Microsoft and all the big names in tech have been scanning everything in your account (email, cloud drive, photos, etc) for the past decade, without any noticeable uproar.

Apple announces that it is going to start scanning iCloud Photos only, and that their system is set to ignore anything below a threshold of ~30 positives before triggering a human review, and people lose their minds.
Apple says they expect to use 30 as the threshold.
feel free to go ahead and opt out.
> What is Rakuten?

A Japanese tech conglomerate.

> Why is it on all my Samsung TV's?

Because Samsung have no shame and will gladly ruin their own products for a quick buck.
To me at least, when nudging in gaming is associated with monetary payments to the company, it is not for my benefit, mental or otherwise. There's a difference between loot boxes and season passes and it's up to us to understand that.

A well laid out payment structure when it comes to gaming is the best way to distinguish this.
I've played around with this (https://jtree.treenotation.org/designer/#standard%20iris)

I don't think you can make a breakthrough through syntax alone. I think you've got to integrate some type of live semantic schema, something like Schema.org. If I used "bsv" and didn't just get a slightly better parsing experience but also got data augmentation for free, or suggested data transformations/visualizations, et cetera, then I could see a community building.

I think perhaps a GPT-N will be able to write it's own Schema.org thing, using all the world's content, and then a BSV format could come out of that.
That's true. You could scan the file and see if there are any other types of double quote escaping happening, but if there isn't any that wouldn't help either. It's also negated by the multiple formats in the same file point.

So, yeah. Can't really be done without making too many assumptions that will break later.
Yeah, that would've been optimal, but it's also a lot more work, so I decided to use cable channels in the end.
According to that Wikipedia link (and my own NZ knowledge) that is quite incorrect on NZ being either the only other country or even as liberal. Essentially the same as Australia and less permissive than dozens of other major, larger nations.
Apple has declared in interviews that the slope shall not be slipped, but you're indicating that they chose this specifically because they can slip that slope.

How did you determine that their intentions contradict their words? Please share the framework for your belief, so that we're able to understand how you arrived at that belief and to evaluate your evidence with an open mind.

(Or, if your claim is unsupported conjecture, please don't misrepresent your opinions and beliefs as facts here at HN.)
I couldn't agree more. The GWAC / IDIQ referenced above attempts to do both (increase competition with pre-qualified companies and limit the number of primes that have access) but in the end it's still a limiter to competition.

This all said, there some valid reasons to limit. For example, if the Department of Education wants to buy 1000 laptops and there were 5,000 responses to the opp there is a significant lift/cost for reviewing and responding to each of these. What is more cumbersome for the government is when one of the 'losers' protests the award. This halts the delivery of the computers to the customer as it goes through a 3rd party (still gov) review. In the end, the original awardee generally gets the ability to sell the computers but by this time they are now 18-24 months old... This is a complicated system governed by a few thousand pages of rules called the FAR (federal acquisition regulations).
Wow, that's great to hear! Please do let us know about the random hiccups at hello@pop.com, since the long tail of issues is surprisingly long in this product space, and so we really appreciate any feedback that can help us improve.
> If not, the only thing you'd enjoy are media targeted at pre-schoolers and young children.

Oh come on, you know I wasn't talking about that kind of challenge.

There are two things:

1. Pieces that are more challenging to read/watch because the story is deeper and the challenging read is required to tell that story.

2. A piece that purposely makes it the story harder to follow, or is otherwise really difficult to follow, without adding much depth.

I was clearly talking about #2.

"In fact, the plot isn't impossible to follow – it's just extraordinarily difficult without a pen, a notepad and a pause button to hand." - The article

That's just stupid, and absolutely falls into #2. It's a crime drama.
Why the worst parts of work can't easily change
your trust in the system is charming
> On the other hand, the fade-to-black ending of The Sopranos was, in my opinion, a total violation of that contract. Nowhere did they setup that kind of ambiguity.

I respectfully disagree. One of the qualities of "The Sopranos" was exactly that things weren't always spelled out explicitely. Also, I did not really find the ending to be extremely ambigious. I mean, it is pretty clear what happened.
Being smart isn't good enough. One must also be motivated, be willing to put in the effort, and not be discouraged by repeated failure.

I had a friend once who was very smart. He was always starting new projects to make money, and always quit at the first or second obstacle.
Author of linked article neglected to mention how he voted on Brexit.
fedbizops with community linkage. neat
The Guardian would only appear extreme to those who's world views have fallen off the other side.

A simple question helps get things back on keel:

"Do you care about other people beyond those that directly benefit you?"
The process of making accusations and arrests is not automatic.

The Apple system sends flagged photos to reviewers, and if the reviewers find them suspicious, they send them to the poor souls at NCMEC, who will compare the flagged photo with the original illegal photo that's supposedly a match, and inform law enforcement if they are in fact a match.

Nobody will get cops at their door because somebody sent them a grey blob image.

The process that's being "automated" is merely an automatic flag that initiates a several-step process of human review. Apple isn't rolling out robocops.

Seriously, what are the "disasterous consequences" that you envision? What is the sequence of events where a hash collision leads to any inconvenience whatsoever for a user?
Since it is a serialization format, Avro's types are its wire types. However, the primitive types are just a subset of the types that Avro supports.

Based on these comments, my best guess is you got the idea that Avro was for encoding JSON because the schema declaration is encoded in JSON, but that's not nearly the same as the data model. There are some terrible implementations of Avro libraries out there that use JSON as some kind of middleware, but that's not how Avro actually works.

If there's a type model it is derived from at all, it's the Java type model.

"byte" is not a valid type in Avro. There is only "bytes", and the domain model reflects this. You can't work with individual "byte" of a "bytes" object.

Default values are encoded in the schema, and so that does limit what kind of default values you can have, but again this is a limitation derived from the schema being defined in JSON, and how the schema language was defined in general. So your defaults have to be represented as JSON literals, but they don't even necessarily share the type of the JSON literal (e.g. a field defined as: '{"name": "foo", "type": "long", "default":1}' does not have the same default value as '{"name": "bar", "type": "int", "default":1}", because "foo" has a default value that is a long while "bar" has one that is an "int"). Note that "default values" are a property of the type, and only apply to elements inside complex data types. JSON has no such equivalent concept.

Avro's type model does have an arbitrary precision type that doesn't correlate to anything in JSON: the "decimal" logical type.

You aren't required to use a JSON decoder to decode Avro documents, nor are you required to use a .avsc file. The Avro schema file is just the standard way to represent a schema. If you have the schema, you don't need the file. JSON schema files are one of the poorer choices in the Avro design, but you'll notice that the schema is defined the way it is specifically so that it can cover a type model well outside of JSON. You'll also notice the names of types in Avro don't directly correlate to names of types in JSON.

* The \u0000 thing is a bug in avro tools, but there is nothing about the spec that prohibits having \u0000 in your strings.

I feel like in general this is like a retcon exercise, where you've reached a conclusion and are drawing evidence to prove it, while ignoring the information that contradicts. I spoke with Cutting a fair bit when he came up with Avro, and I can assure you, while the schema language does very intentionally use JSON, Avro is not a representation for JSON types.
The link doesn't load for me. It appears to be some kind of archive website - what was the original link?
Her shows too easily slip into Historian's Fallacy.

It pays the bills I guess, but there's always something untowards about TV intellectuals. It's like getting your science news from Neil deGrasse Tyson.
The main problem with AMP is that everything loads from Google's servers... so it is not worth using even if sometimes it can be faster (Google itself should probably use it instead of their javascript mess that slows down everything for no reason).
I've really enjoyed using Luxonis's OAK-D camera. First Kickstarter I've gotten, and does what they said it would. They have a very active Discord channel as well.
> Probably a lot, in fact.

> In 2020, FotoForensics received 931,466 pictures and submitted 523 reports to NCMEC; that's 0.056%. During the same year, Facebook submitted 20,307,216 reports to NCMEC

https://www.hackerfactor.com/blog/index.php?/archives/929-On....
No - this is actually done supposedly as part of biz dev.

So your own firm may cover some costs if you have something to say. If you found someone to pay for you to do an analysis or offer your thoughts - you'd be in heaven!
Also have to agree: I don't see how this could originate from engineers. Every engineer I've spoken with at the company I work for has been mortified by this insanity.
Running a Side Business as a Programmer: The Story of LaterForReddit
The tl;dr is they captured trade routes and trade posts that generate a significant amount of money, one example being illegal trading of gas, I guess from Iran to other places, going around an embargo (it didn't specify exactly what was illegal). This would be 100s of millions a year in total.
Doesn't the Michigan area get cold during the winters? There are many reasons why pipes are underground, even in hotter climates freak weather incidents do happen.
Realistically, because if they don't have something to scan for it, countries / EU are going to require them to provide a backdoor to scan it. There are already proposals in the EU to that affect.
Interesting analysis. The same reasons why it is difficult for LGBT people to form a state appear to also be why they are easily discriminated against across cultures.
Well Steve Jobs was the one that resisted PRISM and gave the middle finger to NSA.
> "How can you use it for targeted attacks?"
> Just insert a known CSAM image on target's device. Done.

Yes, but then the hash collision (topic of this article) is irrelevant.
”the analyzed code is not the final implementation that will be used with the CSAM system itself and is instead a generic version”

So they are already running a generic version of this system since iOS 14.3?
Why is the solution to create an entirely new format rather than try to more rigidly enforce the a single CSV standard?
> It is also deputizing museum workers, gym owners, restaurant waitstaff as identity checkers. restaurant waitstaff as identity checkers

Every gym I've ever been a member of requires you to validate your ID. You either swipe your membership card (which has your personal information tied to it), or provide your license to get into the gym. If you can't provide either, they aren't letting you in the door.

Every restaurant in the US is already supposed to validate your ID when you order an alcoholic drink. Bars won't even let you in the door without showing an ID.

I don't think anyone is happy this is required, but when people that are unvaccinated decide to put others at risk because they don't want to be inconvenienced, this is what happens.
> I just don't understand how they acted this way at all.

There's a simple answer to this right? Despite everyone's reaction, Apple genuinely believe this is a novel and unique method to catch CSAM without invading people's privacy. And if you look at it from Apple's point of view that's correct: other major cloud providers catch CSAM content on their platform by inspecting every file uploaded, i.e. total invasion of privacy. Apple found a way to preserve that privacy but still catch the bad people doing very bad things to children.
My bad @dang. I honestly read it over the weekend and it sounded familiar but didn't think to to check HN before submitting.
In a certain sense it is cryptographic because the original CSAM images remains secret. While the hash is not useful for maintaining integrity it still provides confidentiality.

Edit: this is apparently not true as demonstrated by researchers.
Hire for polynomial degree, not slope! But watch for negative coefficients, particularly on the highest powered term.

Wow, this shit writes itself.
That's easy: perverse incentives.

1. Secure by default makes for a higher barrier to entry. It's human nature to want to keep barriers of entry low for your life's work. (I have similar thoughts around copyleft licenses being better for the users but hard to sell to the creators.)

2. Security is "available" to anyone savvy enough to clear all the hurdles to secure the system, so the creators feel justified to blame the user.

3. The product is developed with an assumption that something outside the product is supposed to provide security. For example, the Go.CD devs (excellent product otherwise) scoffed at the idea of improving their crappy password hashing (single round of SHA256 with no salt IIRC), instead suggesting that I should wrap the service in some other, safer authentication mechanism.
Maybe the implementation is difficult to put into layman’s terms, but the high level goals - scanning the devices for child porn - most definitely is not.

I’m not buying the “engineers were left unbridled” argument, I think there just have been a level of obliviousness in much wider a part of the organization for something like this to happen.
I intentionally didn't say anything about the engineers/ICs at Amazon. Amazon does some things incredibly well, and their culture and practices have clearly delivered some impressive results. It clearly has a number of good employees. I have friends as well as former and current colleagues who previously worked there. They're good people.

My comments were centered on the company's management structure, performance incentives, and business model.
Why prefer your owned device tattling on you to Apple looking at data you give them on their servers?

The reason people don't like this, as opposed to, for example, Dropbox scanning your synced files on their servers, is that a compute tool you ostensibly own is now turned completely against you. Today, that is for CSAM, tomorrow, what else?
Krita is one of those open source tools that astounds me with its professionalism and the phenomenal quality of its output. I am no visual artist, but I've seen many people produce just gorgeous pictures with it -- it really highlights my own inability! I feel that Krita has surpassed commercial offerings in this area (i.e. Corel painter) but I'm really too inexpert to tell.
Thank you for a first hand report. All that makes sense - you clearly can't and shouldn't "pass around images" even in the office - so fair that it is super strict once something is confirmed as X.
I recall one of my old Phones could dump SMS messages as CSV. I wanted to be build and interface that would let me search through my messages.

Turns out when you have data that contains both commas and quotes things get screwey real quick. You could have quoted data like:

123,ABC,”,””,456

Where ,” is column data.

I think that standard method is to double quote the field, but the dump sure wasn’t doing that for me, plus what happens when the data is something like abc””,?
I always found it wild that reading an ebook in the UWP Kobo app on my quad core, 16GB RAM laptop with a SSD is a slower worse experience than using a 1GHz single core eInk reader with a microSD card for storage. Legitimately takes it longer to load the same book.
That sounds like the problem of badly formatted CSV, not a problem with CSV per se.

If you stick to one delimiter, and that delimiter is a comma, and escape the delimiter in the data with double-quotes around the entry, and escape double quotes with two double-quotes, well, you have written CSV that is correct and looks correct and will be parsed correctly by literally every CSV parser.
Please don't take HN threads further into flamewar, and definitely not on the most flaming flamewar topic of the moment.

https://news.ycombinator.com/newsguidelines.html
You're conflating two different things.

Universal healthcare is proposed because stuff like GoFundMe isn't a sensible, effective, or equitable approach to funding medical costs.

Proof that it works is already readily available, in Europe, Japan, Australia, etc., across a variety of different delivery methods.
> Time to retire the CSV?

no ♥
Personal attacks will get you banned here. No more of this, and please don't take HN threads further into flamewar either.

https://news.ycombinator.com/newsguidelines.html