skysight-inc/HackerNews huggingface dataset:
Note this comment[1]. It partially overlaps with my comment[2] on the earlier submission of the original article being discussed on StatModeling.

[1]: https://statmodeling.stat.columbia.edu/2021/08/18/coronaviru...

[2]: https://news.ycombinator.com/item?id=28222266
There is a definite demand for some import format that you can trivially edit - CSV excels at this right now and JSON isn't that bad. Binary dump formats definitely do have a time and a place but there is also a separate need for trivially human readable formats.
If you are descending a learning gradient you don't need every step to be perfect. You just need the general progress to be along the gradient. If science is even a little bit more right than wrong, theoretically it will follow the gradient over time (with some wiggles).

I don't think anyone would argue that more than 50% of scientific publications or findings are flawed.
Hey there, I'm a bit surprised to see this reposted. I'm the original author.

I don't think it requires perfectly spherical humans in a frictionless office, but it does require everyone to have the same incentives in place.

When I wrote this, I worked on a pretty well aligned team with a very short power distance. If you're in a truly adversarial position, you probably need to take a different tact, or find a new role.
FYI there's a few NSFW photos in there, and scrolling through will load ~20 MB of images.

Very cool collection though, I liked the astronaut selfies - I think NASA’s Curiosity Mars rover selfie deserves to be included! [1]

[1] https://mars.nasa.gov/resources/25757/curiositys-selfie-at-m...
Something just occurred to me. If this goes forward, and then Microsoft and/or Google copy it, then we might see lawmakers expecting it. If that becomes the case, then it'd be yet another barrier to entry (in addition to a cop on every phone.)

Isn't that where we already with things like Article 17 of the EU's Copyright Directive?
This seems like a common deflection, but get back to me when either company puts programs in my pocket that scan my data for crimes and snitch on me to authorities.
Because he actually understand privacy better than 99.9% of people in Silicon Valley. He is also a product person who understand how users feel. Compare to current Apple which is "still" trying to give me a technical explanation of what is and what's not.
Apple’s device surveillance plan is a threat to user privacy – and press freedom
“I don't know why people expect art to make sense. They accept the fact that life doesn't make sense.” -- David Lynch
For me personally, memory usage has been a big concern with the growing number of Electron apps. CPU usage on well-behaved Electron apps in idle seems mostly negligible or at least not significantly worse than on native apps.

But memory is a different story. I don't always get to work with machines with "enough" memory, so I don't keep any apps with a larger memory footprint (let's say anything above 50MB) running longer than necessary. More often than not I will try to just use the web app, which will at least not load "yet another copy of Chrome". Where feasible I will also simply switch to an alternative.

Not to backseat engineer too much, but maybe you could look into a smaller native component that can run in the background to listen for incoming "calls" and only loads up Electron (or maybe a native webview) when the user wants to actively use the app.

All of that said, it looks like you have a solid product and I wish you success with it.

EDIT: It appears that a year ago when your product was still named screen, I also provided some feedback which you acted upon swiftly, so I'm optimistic you'll figure this out as well :-)
Update: The latest results now have second-preimages that are other photos, not just noise. https://github.com/AsuharietYgvar/AppleNeuralHash2ONNX/issue... They still look pretty bad, but attacks only get better!
Why are Linux-based operating systems considered safer than Windows?
No worries! It's fine to repost a story after a year or so anyhow (https://news.ycombinator.com/newsfaq.html).
NSA PRISM was and illegal and warrantless text analysis and search system for most communications on the Internet, collected all communications without bothering to filter at all, and had no protections in place to prevent people from randomly searching and reading content out of human curiosity.

Apple's CSAM implementation protects the user against algorithm defects, does not expose the user to legal trouble until they have at least 30 human-verified visual matches of CSAM content, and occurs on-device using a small set of confirmed and audited signatures to ensure that CSAM scanning requires a central system only for verifying the unverified, blurred, positive matches.

I would hesitate to compare Steve Jobs' views on PRISM to his likely views on something that is so clearly opposed to it in so many ways. So I do not yet understand your viewpoint that Apple CSAM scanning and PRISM would have been treated equally by Steve. Help me understand?
Their product is the ad-section above the search results.
It was obvious from the beginning that the privacy nonsense was a convenient excuse to cover for their poor (especially at the time) cloud offerings compared to competitors like Google.

I assumed they pivoted to focus on privacy, but clearly it was just a marketing department innovation rather than a core value (as their marketing department claimed).
Yes, that Lost.
It's so egregious, see https://tesla.com/autopilot:

"The person in the driver's seat is only there for legal reasons."

Can't believe what they've been allowed to do until now.
Can AI help design our mascot?
It's important to keep nefarious stuff on the server side because eventually someone will reverse engineer what's on the client side.

Imagine if Apple had done this on the client side without telling anyone, and later it was discovered. I think things would be a whole worse for Apple in that case.
Apple's attempt at podcast subscriptions off to a messy start
Unreliable narrator is something different. How do you know the narrator is unreliable in the first place? Because the story includes enough information to contradict them. The narrator is unreliable, but the author is not—you're relying on the author to subtly inform you that the narrator can't be trusted. That's a device which goes back much earlier, at least to the romantics. What we're talking about here is different. "Unreliable author" might be a good name for it though.
The AMP project allowed Google to dictate how ads can be served, and host publishers' pages themselves. Don't forget Google is a tracking-based advertising company.

It was very convenient that these things could be bundled in a package with some webdev best practices, a JavaScript framework, and marketed as a (questionable) speed improvement.

I've worked for a publisher that abandoned serving their own fast no-JS article pages in favor of half-assed AMP pages full of slow iframes, because Google favored any use of AMP over actual page speed. It took Google many years to ease that AMP favoritism.
We had something that largely worked, the fairness doctrine.

https://en.wikipedia.org/wiki/Fairness_Doctrine

Was removed in 1985.

That wasn't perfect but was considerably better than what we have now.

It seems to be a 'new' idea that there isn't really objective truth - it's all just opinions. Clearly that isn't the case many things are knowable and provable.

Also there are countries, organizations and individuals who are operating in bad faith. That they are knowingly spreading often fairly easily disprovable lies.

If they do so they should be sue-able. There should be the options to constrain them legally by the government through due process.

Also we have this odd situation where 'news' often doesn't mean 'news' it's opinion pieces presented in the style of 'news'. That's not confusing by accident.

Oh and we have a traditional media that has it's business model disrupted where most of the (costly) analysis originated, to tech media company's who claim to just be a 'conduit' even though they manipulate what you see via black box algorithms. And they take no responsibility for spreading lies and misinformation. Their economics are around clicks/attention. They don't pay for investigative reporting. They attention economy gets really fired up with outrage clicks.

Bottom line is there should be significant repercussions for knowingly spreading lies and disinformation.
well depends while corona vaccinate-priority (right word?) was underway it was possible to send a FAX! to the healthcare insurer (not everybody allowed that) and you would've gotten a certificate for your priorty. I mean... fax is most often not encrypted. also deutsche telekom still does not support SRTP for sip (for most of their contracts, if you want SRTP you need to have a pretty expensive business contract), besides that they killed of analog phone lines, thats just stupid and most often if you have a sip trunk or some kind of cloud pbx you would need to pay double to get it...
How have switchers resolved video calls with extended family? FaceTime seems to be the standard now.

I'd have to convince everyone to create a Google account for Meet or similar free video calls.
Omnisend; Ups and Downs of the Software
Sounds fun! Thanks!
As someone who works for a company in the finance sector that provides services that several large banks, funds and financial institutions use - I can say with almost certainty that CSVs won't go away anytime soon. Most of our data sharing from and to these companies is via CSV files.
It's definitely an interesting category right now - I've been following Citus and Vitess with interest for a while since they let you use PostgreSQL and MySQL respectfully with magic sharding sauce.

I haven't actually tried either yet - like you I'm waiting for more success stories (plus I don't currently have any problems that warrant that approach).

Slack adopted Vitess a few years ago.
>CSV is actually horrible at parse-time vs. other data formats

I find this really hard to believe given it's a simple enough syntax. And parsing is usually not the limiting factor, usually fast enough to not be noticed alongside interpreting or loading the source data. Every (much more sophisticated) compiler I can think of uses a linear parser based on this assumption.
Yes, it can be turned off. https://www.macrumors.com/2021/08/05/apple-csam-detection-di...
https://en.wikipedia.org/wiki/Embryonic_development
To be fair, xlsx came out with Office 2007, so it's not exactly 'new' anymore. Perhaps at this point it's reasonable for 'excel file' to mean the one that's been the default for 14 years?
It's like talking to a mathmetician. You just can't.
https://www.economist.com/international/2021/06/12/social-me...

It's already decided for us in indirect ways through influence on social media. Why bother censoring information when huge swaths of people will do it for you? Most of the public in the world, let alone USA are puppetted by algorithms and belief system of Silicon Valley. A person's brain has inputs and outputs. Inputs are overloaded with popular trends, social media posts, constant attention seeking and addiction culture fostered by these companies. Independent thought if it goes against the mainstream will get characterized as 'political' or worse 'misinformation', ultimately get shunned.
No, this is what happens when politicians see an opportunity to get on a soapbox.

What bars won't let you walk in without showing an ID? Maybe a college town, but it is rare elsewhere.
10 paragraphs with nothing.
This stuff is exactly why I loved statistics in college!

The frustrating thing is, there is no way to verbalize the meaning of this data, without immediately being labeled a 'bigoted right-winger'.

People just don't want to hear it. I tend to believe all people have the capability to understand this nuance. Unfortunately, they openly refuse, because it contradicts their perceptions.

It's honestly kind of scary.
- Primes are incentivized to participate for a number of reasons. First, it provides a way for them to efficiently manage their own processes--Getting out of Outlook and providing transparency internally. As well as the automation tools we reference.

The incentive for the primes to participate in the network, in the beginning, is competitive advantage. Primes are always trying to get new/more manufacturers/resellers/distributors to work with them. They can use Govly as a selling point similar to how insurance brokers might use their "easy to use employee portal" to differentiate themselves.

- As far as organizing contracts and contractors to identify relevant partnerships, there are a few ways we're thinking about this. One will be to tie award data to primes and allow people to analyze the award data of opportunities that would have been relevant to them in order to identify strong partners. On the other side, primes can use the analytics we surface with their data in order for them to identify up and coming product types/technologies/manufacturers in order to find new, cutting edge partnerships.

- We actually just got off a call discussing ratings/reputation. This is particularly interesting when manufacturers/resellers are deciding which primes to use. Prime A might be cheaper but has a history of paying late, while Prime B is more expensive but pays quickly. Ratings and reputation can play a big role here. This also changes the incentives of primes as the network grows because if more and more manufacturers/resellers are finding their contacts on Govly, there will be FOMO.

- The first step to supporting companies to learn how to sell to the government is education content. Once we're funded, part of the plan is to dedicate time and money creating accessible content for this purpose. We'll also manually facilitate connections in the beginning and work on ways to productize those connections so that a new manufacturer (broadly used to describe anyone selling to the gov) will be able to more easily identify partners/contacts who can help them through the process.
well, I guess neither of us is a member of same ethnic group as Taleb. For him that was personal
From https://tesla.com/autopilot:
"The person in the driver's seat is only there for legal reasons."

Can't believe what they've been allowed to do until now.
> How about emergency vehicles broadcast on 5Ghz their intended route (for the next 300 meters)

How would the vehicle know what the driver intends to do in the next 15-30 seconds (depending on speed)?
How would you know if it's a CSAM collision? I don't believe that database is publicly available anywhere, for obvious reasons.
> other major cloud providers catch CSAM content on their platform by inspecting every file uploaded

That is very unlikely. Most likely they compare some hash against a database - just like apple.
> On another note, I have seen small no-name labs published impactful scientific results, and then went back to stealth mode again. It's super cool. Science labs, unlike a business entity, should not be measured by recurrent revenue and growth.

Did the individual contributors stay at these labs?
Hubspot Review, the Features, Pros, and Cons
You can make extra-long USB connections with USB-over-fibre products like [1] (if you've got the money)

[1] https://www.amazon.co.uk/FIBBR-Cable-Female-Active-Extension...
I agree. Keeping only 10% of the laws is a fine start.
Medications in streams are good right? At least fish will be healthy. /s
This is a good point. We definitely want it to be a no-brainer for people to keep Pop running. One idea may be for us to look into relinquishing resources while running in the background, which could be a best of both worlds solution.
Having an "explanation" that it's all pointless magic is not an explanation.

I suspect that the writers originally had a coherent story arc, but the show was so successful they had to extend, extend, extend it, which produced the incoherence.
CSV is perfectly fine for bring data from one App to another App. Is is easy. Everybody can fix things with any editor. You can paste files together, you can seperate files after x lines. Of course not everything is perfect .. and Microsoft made it even worser in the german office. The seperator is not even "," it is ";". The author writes about problems with dates .. i think we everybody saw excel translate dates to funny floats and so on. His problem with the date format is not a csv problem. The official standart is just not accepted in dayli life. Americans have anyway the most terrible ways to write dates. There is everything lost ..
CSV is almost perfect for the usecase to bring data from one app to another without trouble.
Nope, that's just me remembering wrong. Deleted those two words, thanks for the correction :)
Every human institution is flawed, which imposes costs, but costs needn't bankrupt the enterprise. Every business is flawed, but some succeed (YC could tell you something about that). All software is flawed. The only solution - the only means to success - is to minimize the flaws and to find solutions that deliver positive returns on the investments. Democracy itself is very flawed, but works; so does science. (That's not an excuse for the flaws or a reason to accept them.)
Ahh, I could see some being distracted about that. Suppose one can just set a "status" of "available" or "focused/away" to be able to be pinged or not.

Good to hear that most of the infra is built out to support this feature!
Howdy, I was the author of this a lifetime ago.

Having been on a nebula project with a timeline once or twice, you're right, this is definitely a trap to avoid.

I'd love to hear an example of how you've negotiated it.
> The whole discussion seems to center around what Apple intends to do on-device, ignoring what others are already doing in the cloud. Isn't this strange?

Very strange. Especially when this on-device technique means that Apple needs to access far less data than when doing it on the cloud.
What, exactly, are you trying to protect from?

The idea to duplicate RealSense cameras isn’t novel. There are already several similar products on the market and several more open source alternatives.

> But if the product already exists and is proven to work and to solve a real and valuable problem, it would be quite risky to just show the solution to angels, investors, incubators, or VCs.

Common beginner mistake, but it’s not actually true. VCs and investors invest in businesses, not products. Your product may be novel in some ways, but it’s not going to generate any money unless you can build a business around it.

If you want to get this somewhere, you need to start building a business around it. Your hardware isn’t really worth much, other than maybe saving someone some NRE if they’re trying to build a similar project.

What does your business (not product) offer that they can’t already get from starting with an off the shelf OpenCV product? You need to answer that question and validate it with real customers.
An in-memory b-tree or one stored on disk? The first one should not be a huge amount of work over implementing, say, a red-black tree. But sorting out the disk storage is hard (and in the end, you've just written a database!)
I would also like to welcome the new user to HN and thank them kindly for their first-hand account of the RV life.
But you can tho…
It’s really unpopular inside the fruit company. I’ve not spoken with a single engineer in Cupertino who thinks this is a good path. There has been radio silence from management on how to address this. It almost feels like they want this to fail. In the past management has given us resources and talking points we can use with our friends and family. Not this time.
US taxpayers already pay for someone else's healthcare. That's the effect of a government that only pays for 1/3 of healthcare that costs 3x as much - that the US government currently spends as much on healthcare as socialized systems do.
use CLIP to generate a title for each piece of art, followed by a description with GPT, and it is ready for exhibition
Foveon sounds great in theory, but it doesn't deliver IMHO. It can achieve parity in terms of pixel level sharpness and color at the lower ISOs, but picture quality breaks down very quickly even at moderate ISOs.

https://tinyurl.com/yyrndzkk

https://tinyurl.com/t9nnadc
At least Google does.

https://protectingchildren.google/intl/en/

> CSAI Match is our proprietary technology, developed by the YouTube team, for combating child sexual abuse imagery (CSAI) in video content online. It was the first technology to use hash-matching to identify known violative videos and allows us to identify this type of violative content amid a high volume of non-violative video content. When a match of violative content is found, it is then flagged to partners to responsibly report in accordance to local laws and regulations. Through YouTube, we make CSAI Match available for free to NGOs and industry partners like Adobe, Reddit, and Tumblr, who use it to counter the spread of online child exploitation videos on their platforms as well.

> We devote significant resources—technology, people, and time—to detecting, deterring, removing, and reporting child sexual exploitation content and behavior. Since 2008, we’ve used “hashing” technology, which creates a unique digital ID for each known child sexual abuse image, to identify copies of images on our services that may exist elsewhere.
Privacy means “you pay for the device so we don’t sell your attention to advertisers.” That’s it. There’s no protection against state level actors (Pegasus, CSAM scanning, etc.).

If your threat model includes being the target of someone who will plant child pornography on your phone, you are already fucked. And no, Apple isn’t suddenly going to scan Chinese iPhones for Winnie the Pooh memes. They don’t have to. China already has the 50 cent party to do that for them, on WeChat.

Basically everything everyone seems to think is just around the corner has already been possible for years.
> So his analysis was, anything you get in the field of medical experimentation, biomedical development, and this is going to be true of any field, there’s like five labs total in the world that are really good at what they’re doing and doing really cutting edge work. And this is true of quantum computing; pick any field for advanced technology you want.

That's also true for software engineers. A handful of 10x can carry a company a long way.
Modern Treasury (YC S18) is hiring engineers to build the future of money movement
> I mean, not sure what you expected -- it's China.

It's Apple. They have confirmed it themselves that China didn't put this pressure on them.
But who was complaining about google and microsoft doing the cloud scanning?

I don’t mind my one drive being scanned for “bad stuff”, I very much mind my personally owned data stores being scanned, with no opt out.
a possible next step > add a motion sensor to *swipe fwd/back the artworks. using a smooth pixel morphing blended transition.

*or when toilet flushes ;-)
I have a feeling this post may be agedlikemilk worthy in the not so distant future...
Bayer filters are 50% green, 25% red, 25% blue for consumer devices.

The reason is that green actually captures much more of the luminance information, and our eyes have a much better luminance resolution than color resolution.

Tangentially, it's why the so-called YUV 420 (chroma subsampling) is so effective, where it's effectively encoding Y (luminance) data for every pixel (in a block of 4), but U/V (chrominance) only for every pair (or quad, someone correct me) of pixels.

There are examples online of pictures [1] with their luminance resolution decreased: you can immediately see the pixelation, and of their chrominance resolution decreased: you can barely tell the difference.

[1] https://en.wikipedia.org/wiki/Chroma_subsampling#/media/File...
That's what they're saying, the key difference is Apples happens on your device, not theirs.
Links for August
Never. As long as it is what they want to do, have at it.