skysight-inc/HackerNews huggingface dataset:
Just about every accepts that it's reasonable for some government collected information to be kept private. FOIA requests exclude "personnel and medical files and similar files the disclosure of which would constitute a clearly unwarranted invasion of personal privacy". https://www.ecfr.gov/current/title-21/chapter-I/subchapter-A...

In this case it was for "student-level data that detail the demographic information and the performance records over time of California’s 5.8 million students but without any names or identifying information. That data is the gold standard for accurate research. A partnership contract details the department’s commitments and researchers’ responsibilities, including strong assurances they will have security protections in place to protect students’ privacy and anonymity."

The thing about this sort of data is, removing PII from the dataset doesn't make it fully or even sufficiently anonymous. If there's only one Pacific Islander student in the Shasta Union High School District then it's easy to figure out who that is by coming it with other public data.

Quoting https://en.wikipedia.org/wiki/Differential_privacy :

] Statistical organizations have long collected information under a promise of confidentiality that the information provided will be used for statistical purposes, but that the publications will not produce information that can be traced back to a specific individual or establishment. To accomplish this goal, statistical organizations have long suppressed information in their publications. For example, in a table presenting the sales of each business in a town grouped by business category, a cell that has information from only one company might be suppressed, in order to maintain the confidentiality of that company's specific sales.

The clear justification for keeping this information private is that the government won't get sufficiently useful data without this promise. The United States Census Bureau released "confidential" information about draft evaders and Japanese-Americans; if you think they might do that again, perhaps you'll lie about some of the questions.

People who receive this sort of information are required to take special care to maintain the needed level of anonymity.

There's of course no reason why this should be used to muzzle researchers for completely unrelated fields.
I dread seeing your threads as it flags a significant amount of time has passed. (This is the fourth one I've seen) Tangible passage of time! Thanks for doing these btw.
I did some consulting on this WAAAAY back in the day.

In the case of education, good enough anonymization often isn't really possible. A lot of information about school students is public -- yearbooks are gold mines, as are results from extra-curricular activities such as sports, class notes about whether/where they went to college or first jobs after college, etc. Still more can be purchased. As yet more can be inferred from public data (eg home address, rough estimates at parental income, etc.). This was back in the day. I'm sure now it's much worse.

Most of the questions you want to ask about education are about treatments and outcomes. If these treatments (eg extra-curriculars) and outcomes (eg attended college, graduated HS, etc) are public then you can often figure out which student corresponds to each supposedly anonymous data-point.

Maybe not perfectly. But way more than you would think. It's like the statistics version of those little logic puzzles from grade school -- "Four people have red hair. Five are girls and two are boys. Billy and Sally are chewing gum. Boy gum chewers have brown hair. No one over 5 has red hair. Sally is 4. etc. etc. etc. Match each person's name with their hair color.". You sort of figure out a small set of data points, then look at the results of the paper and reverse engineer some statistical calculations, and then a surprising amount of the others start falling into place.

We didn't have a name for it when I did this work, but the basic point was "if you publish the dataset everyone will know little Johnny Table's test scores and GPA". Today this is called a reidentification attack.

(I don't really know enough about the topic to have an opinion on the article per se, but "just publish everything" is definitely not a workable solution :))
CLEAR led a flyer carrying ammo under a false name to TSA, sparking probe
It does seem more like satire.
Is it reasonable to expect that Apple has invested a similar amount of money in their project?

Presumably a fair amount less considering that Apple hasn't shipped anything to date.
That argument is used by utilities to defang the utility commissions!

Big companies only understand pain, but they don’t systematically feel pain unless you’re able to inflict it. Every fine reduces someone’s bonus, so you want the incentive to encourage resolution under pressure - otherwise, if you get fined no matter what, there’s no incentive to act.

Works the same way with services contracts. If you force the provider to price penalties into the P&L as a matter of course, you’ve lost the ability to compel behavior. Companies internally incentivize loss avoidance.
I think that's part of the point. They don't focus on mastering a handful of dishes so they don't have the best of anything. At the same time they make an acceptable version of a wide variety of dishes. They are a great option if you're in a group that can't agree on what kind of food to get because almost anyone can find something they'll be okay with on the 20 page menu.
And they want to do nothing. That’s a silicon valley thing all along. The negative externalities of these massive scale business models are pushed to society.

The scale and lack of security design is the cause of them. The mass scams on marketplace, the payment fraud, the harassment, the swatting, etc.

If we forced these companies to meet sane standards (especially visible in fintech) and customer service, oh no, they couldn’t do so many stock buybacks anymore, what a tragedy.
That's only part of the story. Cray spent a lot of time architecting an I/O system that could keep the CPU fed. So peak and sustained performance were closer than a lot of systems.
Either way it's not free. The US do that because they reckon this is ultimately beneficial to them.

In any case, the US are 'giving' military aid to Taiwan and this seems part of it:
https://www.defensenews.com/congress/2023/04/06/pentagon-to-...
There's a webapp called Boil the Frog that does exactly this!
BlackBerry (2023)
yeah whitecollar IT gigs are generally OT exempt
I guess it would be one of the two blades. Likewise, a pant would be one of the two legs of a pair of pants.

Maybe a single mathematic would be a single concept/subject, like arithmetic or algebra?
Moving single digit volume of sales and "solving" obesity are two orders of magnitude different things.
What do you mean? As I said before Monetal doesn't store or transfer user data, and that's why you don't need registration, it's completely anonymous. It collects just analytics data just for purpose which features are used more frequently and which I can drop. I don't plan to end support for it, I am using it myself)
The person they're replying to who said "one month".

One is singular.
The ads are so obnoxious and unskippable that I prefer to close the tab even at the price of missing to watch educating and substantive content. No, I'm not going to buy Youtube Premium.
You can go further south than Houston and find much nicer weather. Heredia, which is a suburb of San Jose, Costa Rica, is much closer to the equator than Houston, but it is in a much rainier part of the world and it is at an elevation of about 3,000 feet. You can live there all year round without having either heat or air conditioning in your home.
Except eternal damnation, allegiance with a supernatural being, lakes of fire, etc.
> Can't we extend this argument to eliminating basically all static typing?

No, because static typing exists in all sorts of places. This argument is primarily about cases where you're exchanging data, which is a very specific use case.
That is what I assumed as well, until one day I got hit by a bug involving Extension Mechanisms for DNS (EDNS). Never knew it existed. All of a sudden DNS was failing and could not understand why. Took me a long time to fix the issue.
I get a sense it's like a digital ID that enslaves everyone
Track the trackers together: Ghostery opens up its adblocker library
> Per the placard over the Tron pinball machine at the Pacific Pinball Museum, the licensed arcade games made more money than the original Tron movie!

That might be due to movie accounting. There are times the producers of the movie have an incentive to make sure a movie has little or no profit, even if it does okay at the box office. For example when someone other than the producers will contractually get a percentage of the net proceeds of the movie.

It's not a great example (I have no idea about his specific motivations), but one example of how to tweak those knobs is when Kubrick's films had to use special equipment that was literally only available from a single company. A company that Kubrick happened to own, and could decide how much it charged the production. You can see how anyone involved in the production who had a piece of the film's net would have the size of their piece impacted by however many millions went to Kubrick's company.

(there's a play in which greedy producers joke about how "there is no net!" but I can't for the life of me remember much about it beyond that joke)
I mean... Spotify tracks a bunch of cool (algorithmically measured) sets of metadata for each song. Basically the ones you have on this site. And there are APIs to retrieve them for any song, and you can use them all as arguments for search. I don't see why you wouldn't be able to find a thing in between two things.

Keep in mind that the actual accuracy of those metrics is debatable. They are cool... But mostly for funzies, or for approximate sorting in 3rd party tools.
Of course, one of the problems with the idea is that it endorses throwing innocent others under the economic bus. It's nice that they want to "speed through" that part -- but it still boils down to advocating harming people who aren't consenting in exchange for the possibility (not guarantee) of something better for later generations.
While you are right about the active light sensor, it is likely that the sensor really works in the infrared.

The green laser beam must be in addition to the infrared beam, with the purpose of allowing a human to choose the aiming spot.
Eek! Even worse!

And now I know I can't count!
Capability, not capacity.

https://en.wikipedia.org/wiki/Capability-based_security

https://capnproto.org/rpc.html#distributed-objects

The idea really goes way beyond security and RPC. It's hard to explain concisely but it's sort of a way of thinking about software architecture.
Another cool probabilistic programming language is Turing[0] in Julia.

Had fun using it when working my way through the statistical rethinking series.

[0]: https://turing.ml/
Unlike browsers, which can (for now) still be swapped out solely on individual preference, the network effects are real for messaging platforms. This means that currently Signal is more broadly useful than Matrix clients.

Hopefully this can change some day, and Matrix (or something like it) will become ubiquitous. But it was a slog for Signal to gain even its small market share, despite its better usability and lower barriers to entry.

For lack of a better alternative, we "standardized" on Signal as the de-facto secure messaging system that is outside of the control of ad companies, and it will take time to rectify that.
Seems to ask for quite a lot of data:

> Your email
> The type of Spotify subscription you have, your account country and your settings for explicit content filtering
> Your name and username, your profile picture, how many followers you have on Spotify and your public playlists

> Take actions in Spotify on your behalf
> Create, edit, and follow private playlists
> Create, edit, and follow playlists
They may be referring to the research of Brian Wansink, who was exposed a few years ago for at the very least shoddy research practices and at worst active data manipulation [1, 2, 3]. A large body of his work centered around how to rearrange school lunchrooms to promote better dietary decisions. His advice quite literally includes placing healthy food first [4].

[1] https://www.wsj.com/articles/a-cornell-scientists-downfall-1...

[2] https://web.archive.org/web/20180307074049/http://www.timvan...

[3] https://www.buzzfeednews.com/article/stephaniemlee/who-reall...

[4] http://www.brianwansink.com/for-school-lunches.html
You're moving goalposts, friend. What you're suggesting and what OP are suggesting are in two completely different categories of disclosure extent. I don't think anybody here is suggesting that no data should be available to the public.
If there's anything special about HN participants, it's that many of them are slower than most at recognizing crypto scams. How many blow-ups does one need before adjusting one's priors on the legitimacy and utility of crypto? FTX, Celsius, 3arrows, TerraLuna, Binance, MtGox, etc. The list goes ever on.
Do you have evidence for this claim because I don't remember Mr Ronald Reagan being gay when he ignored AIDS for years in office.
This is fascinating. When I was a kid I came across these very code books for Master Lock combination locks. The kind that every kid has on their locker.

The book came from a friend of a friend of a friend and was really a stack of photocopied pages from a book. Photocopied so many times that many of the combinations were blurry beyond legibility.

When it did work though it was incredible.
Argh. I undid the first auto-correct from "barcafes" and it still got me!
Is anyone shipping AI products that DO NOT contain hallucinations? I thought that was pretty much a given.
Thank you so much! Your response was really encouraging.

I'll add stack descriptions to the jobs listed (just today, one interviewer asked me about that too :-) I've tried to focus more on responsibilities / achievements, but I agree that specifying stack is important too.

Re: education and age – good points, answered here in more detail https://news.ycombinator.com/item?id=36910311
It seems to have enough people that it has some legs. I am really looking forward to a web version of it, but otherwise enjoy it, despite some growing pains.

Edit I'm here: https://www.threads.net/@davidnwelton

Edit2 If I think about it some, the biggest drawback about Threads for me is swapping one egocentric billionaire who is rapidly going off the rails for another who is, for the moment, more stable, but has still accumulated a godawful amount of wealth and power. Mastodon seems like the alternative if you really hate that kind of setup, but... it doesn't seem to have much traction.
World-first cinema capable of measuring audience response to open in Bristol
> but it is such a bad fit that Confluent created a whole additional piece of infra called Schema Registry [1] to make it work.

That seems like a weird way to describe it. It is assumed that a schema registry would be present for something like Avro. It's just how it's designed - the assumption with Avro is that you can share your schemas. If you can't abide by that don't use it.
What an interesting thought. Maybe the increasing amount of entities I get to interact with that do less and less to bring that prove goes to show how relatively unimportant being human will be.
Would absolutely love this.
> I guarantee that the recruitment process and negotiation process was more involved than a phone call.

I suppose, but do you think that was more than 9 hours? Because 9 hours is only 1% of their time.
No sponsorship is required for the spouses of those in E-1, E-2, E-3, and L-1 status, or spouses of those in H-1B status who are in the green card process and it's generally easy for companies to hire workers from the five countries with their own visas (Australia, Canada, Chile, Mexico, and Singapore). It's also generally easy for companies to hire those already in H-1B status - that is, to "transfer" the H-1B to their company. It's also generally easy for companies to hire those with PhDs (often via the O-1). It's also generally easy for companies to hire those in F-1 OPT and STEM OPT status but these workers will require sponsorship to continue working and this sponsorship usually takes the form of the H-1B visa, which requires going through the H-1B lottery, a very messy and uncertain program.
I would add

- making handling of forking to the background and log rotation not a task of the program itself, instead of making every program (or worse, a bespoke wrapper shell script) do it.

Because such things are non-trivial and demand reasonably many man-hours of otherwise "trivial" projects.

Granted, you don't actually need systemd to do such things (for example, runit can do such things, and runit is available under busybox and therefore almost universal in most GNU/Linux distros), but I think it was systematic distro/systemd that enforced such new paradigm.
You don't know what a ponzi scheme is. You're describing speculative markets, which have always existed, and must exist for any sort of economic stability to occur.
As of the last time I was close, flatbuffer usage is or was near ubiquitous for use in FB's (ha ha, go figure) mobile apps, across Android and iOS at least.
Weird labelling - when I first saw "kits" I was briefly hopeful about getting a Jetson-style version of a Habana Gaudi accelerator.
If they're all derived from a single source then isn't it possible it could be reversed? Or at least a relationship deduced? Given enough per-platform IDs
Honestly the conversation of AI researchers on climate science seems so superficial and removed from reality of climate change. It's like they are trying to solve a drought by capturing condensation on a glass of cold beer.

https://ourworldindata.org/emissions-by-sector

The major emissions sectors are agriculture, transportation, cement and metal, energy usage in primary sector for thermal processes.

For someone who seems to have dedicated their lives to climate and AI solving energy intensity of deep learning isn't even relevant let alone a factor in emissions, also better climate models aren't the solution for reducing emissions.

We need not only new tech but a new socio-technical system for reduction of emissions. Rice cultivation, cement, waste, heating of houses in northern latitudes all generate sizeable quantum of emissions what's AI going to do there to solve these?

Optimization can squeeze some gains but we need revolution in fundamental science and engineering capabilities to quickly discover, synthesize and scale the manufacturing of new materials whilst rewiring the every elememt of the the supply chain to support such transition. This is a problem for AI- yes, but is this where bulk of climate AI research is focused on? Sadly not!

What is more motivating and upbeat though is the fact scientists from traditional engineering domains are increasingly discovering AI. SciML work by Chris rackauckas PiNN by karniadikis, neural operators by anima Nvidia are some of the best forays into this space. I have not mentioned the frentic research happening in AI and microbiology which can be a game changer in invention of biotechnology solutions for climate change.

Yet sadly none of this is ever mentioned or covered in climate AI related conversations.
Is there a public Torrent of the entire collection?
Another approach could be to work for 25 years at full time then 25 doing nothing, instead of 50 years part time.

I've heard this approach called FIRE - financial independence, retire early.
I don't agree with this article. I think DNS is something few people take the time to learn, but it's not actually hard to learn. One of the great things about DNS is that the system itself will tell you about it's internal state in response to queries. It's very easy to inspect a DNS server for a known zone and understand how it works, and there's very good tooling that's free and widely available to do this (like dig).

It's always been a big surprise to me that my DNS expertise is what seems to be most memorable for a lot of folks I've worked with through my career, when I don't believe I know anything mystical or special. DNS is extremely well standardized, the most common server and client implementations rigorously follow the standard, and it's very easy to inspect with free tooling. It just takes some effort and time to learn, but it's not really hard.
There's an Isaac Asimov story from the 50's that I wonder if you've read. It's called "Blank!"

In the story the scientist takes a friend forward 22 hours, but outside the time machine door there's nothing. Total darkness.

The friend asks if the scientist forgot the movement of the Earth and the galaxy, but the scientist assures him that no, that motion has been accounted for.

Instead it appears they've arrived between quantum periods, stuck forever out of phase with ordinary time like an elevator stuck between floors and frozen by the lack of momentum.

I ask because that's the first story I read that drew attention to needing to travel in space to keep up with the planet.
About 15 years ago there was a cute flash game where you had a little cube world that was a puzzle to grow into a bigger fancier environment by clicking on trigger points in the correct order.

I have no idea what it was called, and can’t describe it well enough to search for it if it still exists. Every couple of years I try.

Resources like this give me hope that little gems and works of art from the past will live on, even if the underlying tech is gone.

Edit:

Wow, this time I found it: https://www.eyezmaze.com/grow/cube/

HTML5: https://www.eyezmaze.com/sp/2016/08/growCube.html
Original: https://www.crazygames.com/game/grow-cube

HN is just serendipitous
I'd like to elaborate on the points.

First I believe it is extremely difficult to teach these skills and more to teach them "right". Because you can only teach by showing how you do it, so it totally depends on the teacher's experience (i.e. it is a "double" luck question -- the student needs to be lucky to get a teacher to teach these skills, and lucky to get a right teacher).

In addition the student has to learn the skills when they are still young, otherwise it's not going to make any significant impact. Sure you can learn the skills in the 40s but then it's going to be a lot easier and impactful if you figure them out when you are 10 (trust me I saw those people).

So eventually it's a triple-luck question.
I've had about 6 different interviews these last couple of months, and none of them gave me leetcode type questions. The closest I got was code snippets where I had to explain what was going on, or very easy fizzbuzz type coding questions.
We have a great plethora of binary serialization libraries now, but I've noticed none of them offer the following:

* Specification of the number of bits I want to cap out a field at during serialization, ie: `int` that only uses 3 bits.

* Delta encoding for serialization and deserialization, this would further decrease the size of each message if there is an older message that I can use as the initial message to delta encode/decode from.
What you can work and what you can bill are two different things. I know of a few people that charge their rate from the minute they leave on a trip which is basically the min they put down their phone after accepting the contract to the minute they get back. However, they are all doing emergency, the company is losing tens of thousands per hour on the low end until this is fixed, kind of things.

In practice it’s equivalent to charging a higher hourly rate, but it makes billing simpler for these kinds of contracts.