skysight-inc/HackerNews huggingface dataset:
This is fascinating!

Back in 2015, I'd architected and deployed a system for a AAA game that handled 24B events/day on launch without breaking a sweat, and supported 200ms round-trip ingestion-to-aggregation SLAs with no windowing (the protocol and ingestion layer did most of the heavy lifting: sequentially ordered _guarantees_ on events even when loadbalanced/connection migration meant no need for windowed batch ordering)... but the scenario for which it was designed was cut and we ended up using it for just 15m slices. :eyeroll:

Still, it was used by a dozen+ games, including a few more AAA titles, and still in use today, and portions of the tech have been cannibalized into other products. I still get the occasional inquiry about memory fencing or memory boundaries on Console X for the 5-15μs event generation API (improperly aligned memory could cause interlocked increment corruption!).

Annnyways:

I had an opportunity to chat with one of the founders at Snowflake in 2017? 2018? for a few hours. I tried to convey how imperative I felt true-realtime time series engines would be critical moving forward, an the reception was rather lukewarm. If they had been as excited as I, it'd have been one of the few opportunities to pull me away from my dream job.

I still feel the world will need this architecture, as we start moving towards more ML/AI driven decision making, and that the company which can get traction will be in a pivotal position moving forward.

Sometimes I wonder about feeling pressured to shift into Data & Applied Science to stay at that org (there just didn't seem to be vertical opportunities in the dev track). I excel in this job too, and I love what I work on... but dang sometimes I feel that the architect career path had even bigger impact potential. It was a fun couple decades. :P
Gender stereotypes can explain the gender-equality paradox
You want foreigners for diversity of workplace and ideas, for their different perspectives, for their direct exposure and intrinsic knowledge of their home countries, for the different expertise taught at their different schools...
OP's post is a long string of personal attacks against Timnit so this comment is pathetic and hilarious. The entirety of this site is just worshiping at the altar of technosupremacy and comments in this thread have put that reality on full display. I am not surprised by the cowardice on display, but I am surprised by the uniformity.
I would be remiss not to mention that Sixteen Tons was a Merle Travis song, recorded for the bona fide classic album[0] Folk Songs of the Hills. Both songs are classics, but the Travis version deserves to be heard.
https://www.youtube.com/watch?v=3I15_KUsOzs

0: The album was released in 1947 prior to the introduction of the 12" LP, so it was originally released as a literal album of multiple 78rpm singles. It is one of the first concept albums.
https://en.wikipedia.org/wiki/Folk_Songs_of_the_Hills
Tens of thousands. The web site OpenSecrets has lists:

https://www.opensecrets.org/federal-lobbying

The even have their own trade association:

https://www.taforum.org/creating-a-new-trade-association/

Setting one up is easy; you just incorporate. Influence ranges from "zero" to "able to get meetings with Congresspeople on important committees". The meetings are the important part. You can't actually bribe your way to power, but you get to tell them what you want and how that benefits their constituents.

That's easy for an airline, which employs a lot of people and impacts travel for everybody. They use a group to speak with one voice and (perhaps more importantly) know who to talk to (which isn't just elected representatives but also the decision making people at in the executive branch).
I think you're beating down a strawman you created. Nobody is against accessibility for disabled.

The problem is that there were no standards around this policy and it was abused without any clear indication that it helped anyone. There is also little clinical evidence that ESAs ameliorate patient symptoms, and much less that they help around travel.

Policies around ESAs, like anything, require effort to implement and support, and therefore need good evidential support ... instead of an emotional appeal.
Facebook SWE does have positions. There is a generic SWE role they hire a lot of recent grads into, but there are many bespoke positions. In my case, I was hired at Google onto a specific team via a bespoke role ("Test Engineer, Site Reliability Engineering") that was distinct from the general Test Engineer role. I interviewed with the team that I would be working on.
I'm not surprised by this at all.

I used to work in the US at at a large international bank with headquarters overseas that preferred having employees from the same country as HQ. We would advertise a position, internally or just to alumni networks of unis there. Once we interviewed people and knew who we wanted to hire, there would be a delay because HR would have to advertise the position publicly for at least a week (or two, I forgot), and then we could proceed officially with the hire.
I mean I think people will work harder for ~2m in vested RSUs and comp over 4yrs than getting kicked out of the US. Maybe that’s just me personally.
It's about all the mundane people who didn't die as babies. In earlier centuries, the life expectancy at birth (which is the metric that's about 35 years for that period) is dominated by the relatively high childhood mortality, all the many babies dying within the first days or weeks, and is very different from the expected lifespan of adults.

For example, here's a dataset on USA historical life expectancy https://www.infoplease.com/us/health-statistics/life-expecta... - if we look at the 1850 data, then the average life expectancy at birth is 38 years but that does not mean that people live until 38, as a the life expectancy for a random 20 year old man is 40 more years, so people (who didn't die in early childhood) lived (on average) to the age of 60, not 38.

There's data from Roman Empire where life expectancy was 25 years at birth, but life expectancy is average 53 years upon reaching age 25 - so the intuitive metric "how long do adults live" is twice as large as the technical life expectancy at birth.

Here's an archived resource that goes into more detail https://web.archive.org/web/20070713083310/http://www.plimot...
It’s bi-modal. Big companies playing nice and using the law as intended pay well. Smaller companies and body shops abuse the process: I’ve seen H1B jobs advertised via legally required notices that were tens of thousands less than what I was being paid for the same position/experience.
> The way it was explained to me is that if the EMH is true, then looking at fundamentals is pointless because all the fundamentals are already priced-in, which leaves nothing but price and volume data left to analyze.

So, TA proponents believe that market forces, economics, political and social trends, etc, are all instantaneously absorbed by the market - but "double tops"[1] and "hanging mans"[2] and "three black crows"[3] are all low-hanging fruit that the elite can take advantage of?

I'm usually pretty open-minded, but I can't make myself see anyone believing this non-ironically.

[1]: https://www.investopedia.com/terms/d/double-top-and-bottom.a...
[2]: https://www.investopedia.com/articles/active-trading/040914/...
[3]: https://www.investopedia.com/terms/t/three_black_crows.asp
Addressing the root issue means reforming immigration laws to be far more permissive in all aspects. Which is a win for immigrants because they no longer can be threatened with losing their job and deportation, meaning they won't work for far lower wages than citizens. That's also a win for citizens, as now their aren't competing with an underclass forced into worse working arrangements. And it's also a win for companies, as they don't have to try to find local talent before hiring an immigrant.
My wife is a medical provider and she had a patient once ask her to write a release for her "emotional support chicken". Yeah; this was being abused.

In case you're wondering; no, she didn't write the release. The people scamming the system (drug seekers, etc...) realized pretty quickly not to go to her because she won't give them what they want.
Delta allows pets in the cabin. Was your dog too big or something?
Only 4.25% of the world's population lives in the US. It's mathematically impossible for all the best people to already live here.
I'm gonna guess that a fair amount of people has a clue what it looks like, but since it is illegal, few folks are gonna talk about it at family dinners. Lots of people can guess what non-dangerous cocaine use looks like, though: I mean, is once a month dangerous use if you do a reasonable amount when you do it, assuming you are otherwise healthy? Can you not warn folks that you might find yourself wanting more cocaine after doing a bit of cocaine and offer tips for dealing with that?

Are there ways to make cocaine use safer? Yes, of course! Legalisation will help greatly (you'll know exactly what you are getting and we can standardize strength like we've done with alcohol). We can also educate folks in a variety of ways. Offer free help to folks that do find themselves addicted. I'm going to guess folks wrote about it more indepth before it became illegal as well.
How are these firms doing today?
Anecdotally, +1. They were the highest offer in my recent round of interviews (Amazon and Google were lower, by 10-12%). (I'm a US citizen, if that is useful information.)
Nobody is asking that warehouse workers or store clerks be paid ridiculous amounts like $120k/yr, a fair liveable wage will do, failing that a lot of the problems would be resolved if such companies scaled back whatever policies they have that lead to news stories like Amazon workers peeing in bottles because they can't take toilet breaks, but as neither of these things happen you get exploited workers who naturally want to unionise.

It's also not that feasible to pay developers $120k/yr as the rest of the world has found out, America manages it for a number of reasons and because of this you likely won't see developers unionise any time soon even if you guys do have some very questionable contracts.
My IBS worsened and for several months I had recurring constipation and some abdominal pain keeping me awake in the night. I tried changing diet and several medicaments but no change. When starting Alflorex symptoms eased after a few days and were totally gone after a week. They say it typically takes longer. Can’t say it wasn’t a coincidence of course.
Apple hasn’t locked down the Apple Silicon Macs to prevent a non-Apple OS from being installed, so maybe?

The main issue is driver support, since graphics, networking, etc. is all Apple proprietary hardware.
>Heroin is not cool at all, nobody does that willingly.

Last I heard, heroin induces pleasure and euphoria. People do use it willingly.
21M is the basis of bitcoin for most hodlers.

Any fork or decision by anyone to change this 21M number means that for me (and most hardcore bitcoiners I know) the chain which sticks to Satoshi's 21M becomes the REAL bitcoin chain.

21M is non negotiable. If it doesn't have 21M, it simply isn't BTC.
People praise Solaris all the time. I've tried several times to watch it, but it's just unbearably dull.
Was it perhaps for a more consumery-type use-case instead of business? Issuing (and Treasury) are mostly focused on building for businesses at this moment (but are also expanding the number of use-cases). Could you email me at edwin@stripe.com and I can take another look?
Show HN: Building a baby registry doesn't have to suck
Mom of a 1.5-year-old here. When I was pregnant, I spent over 40 hours researching items for my baby registry. After all that time, I accidentally bought a mini crib. Did you know that you can’t return nursery furniture because of safety regulations in the U.S.? Cool. The experience in preparing for my daughter was frustrating, time-consuming, and information overload.

I want to change this and simplify it.

So I built Poppylist.

To ensure all future parents spend significantly less time researching every baby product under the sun, I developed a Parent Type quiz that’ll match each person with their respective parent type: The Minimalist, The Environmentalist, The Practical, or the Tech-Savvy Parent. Based on your parent type, users receive a corresponding baby registry checklist (each list has less than 50 items). I built the quiz in Typeform.

I learned a lot while developing the quiz and talking with other parents. For example, most people will spend 30+ hours researching their products only to register for items referred to them by trusted friends. So every single product that we recommend has been sourced directly from parents.

I am transparent about what I’m building, and my goal is to simplify this process for all future parents. So please let me know what you think & if you have any questions. My parent type quiz is just the start for what I want to build.

We can raise our children with less stuff, and the process of preparing for them doesn’t have to be so complicated.
AVX2 also causes various degrees of thermal throttling depending on which chip you're using, such as Haswell. AVX-512 on Ice Lake (client) however is quite good and causes very little throttling versus its sustained speeds (e.g. my Ice Lake laptop @ 3.6GHz or whatever it is). Ultimately you have to do benchmarking yourself and if you care about inferences/sec you'll have to think about this stuff.

That said, AVX2 support would also be cool simply because it's more readily available to use on more platforms, not just my laptop...
They're trying to monetize WhatsApp through their Business API. They have a directory of Business Service Providers that can provide API access and integration services. Their partnership model is very convoluted and flawed, though, and it's hurting adoption.

https://developers.facebook.com/docs/whatsapp/
But how many football fields wide was it, and how many olympic swimming pools could you pour into it before it was full?
Definitely, I like to know the writers have the whole story mapped out prior to even starting the show before investing time into it.

I got burned once by Lost when I was much younger, and hope to not make that mistake again.
I'm making an assumption that facebook only wants to hire what they perceive is the top 1% (Or some other number) of programmers regardless of background.
> On a C64, you boot into bare basic

Come on. I think you're remembering the past with rose colored glasses. I loved my C64 in the 80s but it was not user friendly, compared to say an iPad running playgrounds.

This is what is was like when things worked.
https://dfarq.homeip.net/load-commodore-64-games/

When things didn't work...
Eh. I think there's some legitimate concern that AI isn't fair to marginalized groups for a variety of reasons.

Dataset bias is only one way this occurs, though. Even if you include more colored faces, you still may be taking pictures with a camera that doesn't capture as much contrast. Or even if you retrain, you may have chosen model structure to optimize behavior in a biased dataset. Or... if you're considering the cost of misidentification by a facial recognition system used by, say, police, you need to be sure that you take a perspective that applies to society as a whole and not to your own interactions with police.

It's perfectly reasonable to say "AI is worsening the experience of minorities in various ways" and to differ with responses that assume with slight additional care in curating datasets that the problem will be completely solved.
It's not just for existing. Pets can and do cause a lot of damage. They can urinate on the floors or walls, leaving odor that is very difficult to remove. They can chew up or scratch up doors, walls, floors. A pet can easily do thousands of dollars in damage in a one-year lease term. Of course not every pet does this but you don't know in advance.

On the other hand landlords compete for tenants. So they may want to allow pets but impose a surcharge for the potential damage.
I’d hire any h1b out of FB if they wanted to leave. Will even pay market rates. Market is very tight on software engineers.
> there are significantly-more-legitimate targets

Yeah, this is giving me the feel of a very tailored lawsuit - it is media-friendly, unlikely to be systemically disruptive, and I'd call it extremely likely that it is settled for a press release and no meaningful change.

> I honestly can't believe that this has made me defend Facebook.

I'm going to go take a shower, too.

Also, I wonder what C19 does to H1B visas over the long term. I expect my company to announce permanent WFH at some point, keeping a much smaller physical space for exec meets and whatever.

It may well be that the demand for physical presence H1Bs drops significantly in tech firms.
Then the companies begin to fire employees that they find are part of this system and hire organizations like the Pinkertons to infiltrate and destroy your business resource system.
I know it's totally unrealistic, but I really wish it was economically viable to run an airline that was 100% first class and had great customer service and a strict "no babies or assholes" rule. I can't afford to charter a plane for every flight, but I would definitely pay 50-100% over a regular first class ticket to never have to deal with the annoyance of flying on any major US carrier.
From what I know, there is basically only one thing they care about. Proven track record of making money and beating the market. Nothing else really counts. Except for young graduate quants - you need a degree from top tier school.
Intel Debuts 2nd-Gen Horse Ridge Cryogenic Quantum Control Chip
> To tie this back to AI, it would mean that as long as your models produce racially biased results, they simply aren't ready for deployment or publication. Go find better data until your work is no longer liable to inflict harm on anybody.

Well, the disagreement is about publication. Yann LeCun himself said that "The consequences of bias are considerably more dire in a deployed product than in an academic paper."[1]

Why would it be wrong to publish research based on biased data?

[1] https://twitter.com/ylecun/status/1274790777516961792
tell hn: today is 10 years since repeal of dont ask dont tell
.
H1B's should be reserved for subject matter experts, innovators, field experts - as opposed to every shmuck with a masters or bs degree in CS or engineering.

All those consulting firms like Tata Consulting Services are gaming the H1B process, middle manning the employees, and in result Facebook, Home Depot, and others hire them for 1/3 or 1/2 less.
It's a reference to these "positions": 'However, the PERM process requires an employer to first demonstrate that there are no qualified and available U.S. workers for the position that the employer plans to offer to the temporary visa holder.'

I.e., not really new positions, as the temporary visa holder is already in said position.
Views help with this.

Write one view for selecting customers, with all the joins, sub-queries and case-when logic.

Then select from this view order by birth date, and select from the same view by sex.

Yes, the limit/offset paging clause will be duplicated, but all the joins, sub-queries and case-when stuff can be DRY'd in a single view.
No, she didn't say that.

She said she may set a date in the future for her resignation.

That is non-committal and non-specific. Your characterization is inaccurate.
Remove duplicates in an array using JavaScript Set
This is nice. How does it compare to something like a polynomial based representation like in [1] (used by the old keyserver gossip network)? I find Bloom filters more intuitive to reason about, but [1] does mention them as prior work and seems to think its scheme outperforms them.

[1] http://dx.doi.org/10.1109/TIT.2003.815784 http://ipsit.bu.edu/documents/ieee-it3-web.pdf
Nexus Channel Core: The Next Generation of Off-Grid IoT
"Are unions armed protection?"

Historically, yes, sometimes.
The PLAin Truth About the Commodore 64 PLA' at World of Commodore 2017
What's crazy about the M1 is that you can run the MacBook Air at 100% for a little under 10 minutes before it throttles. That's a breakthrough compared to Intel chips.
No, Elixir strings are coated with PTFE, not PFAS. These are two entirely different substances.

PTFE is a polymer, often referred to by its most well-known brand name Teflon. Over decades of use, there is zero evidence of any health effects whatsoever from PTFE, the only exception being when it's heated to around 500 deg F. In everyday use it is completely inert and harmless.

PFAS is a generic term describing a family of fluorinated chemicals. Evidence is piling up that many of these have serious and long-lasting health effects. Some PFAS chemicals are used as the monomers for making PTFE, but once the PTFE is made, the constituent monomers cannot be released except by extreme heat.

All that to say, your coated guitar strings are completely safe. Certainly safer than the teflon-coated pans I cook on every day.
I think you’re missing the point here. Companies are abusing H1B to find cheap workers who can’t leave.

The whole point of H1B is to get smart and talented people to the US.
Why is it Amazon’s problem that they have no alternative?

If Amazon went away, would their situation be better or worse?

I believe that as a society we must ensure that people have enough money to live, but why should the employers on the bottom of the skills spectrum be forced to bear the brunt of it?

Every employer should be required by law to provide a safe workplace free of discrimination and harassment. But hiring unskilled workers at a market wage doesn’t make you a bad actor.
> They typically give out offers higher than other employers in SV.

That's putting it lightly. You can earn in the ballpark of 125%-150% of MSFT/GOOG (not sure about AAPL) in Seattle, all bonuses and incentives considered. On Blind, Facebook employees seem pretty open about focusing on their salary above everything [evil] Facebook does, and I would be lying if I haven't considered bending my morals for that paycheck (because it is absurd).
If the system sounds crazy it’s because it’s being used for a job it was never designed to do. The H1B system was marketed to the public as a temporary skilled worker visa. Mostly by executive fiat, it was turned into a de-facto permanent immigration mechanism. The whole system makes much more sense if you look at it in terms of the original purpose: to allow temporary workers to work in fields where there is a shortage, but who will mostly go home at the end of the 3- or 6-year period.
Want != will != should.

I want to sit on my ass and watch netflix all day. I don't actually sit on my ass and watch netflix all day despite wanting to and technically being able to.
> They use the same, obviously dishonest tactics, like only advertising positions in the classified sections of local newspapers, where no one would ever look for them.

As stupid as it sounds, that's not their decision. It is a part of the PERM process that the employer has to follow. I've started in a different comment here, the rules are extremely outdated.

I believe the relevant section is §656.17 Basic labor certification process Section (f). (you'll have to google it, I couldn't find a good source with a direct link)

It quite literally says "newspapers".
Yes, from the original github report: "Analysis on a random sample of 521 advisories from across our six ecosystems finds that 17% of the advisories are related to explicitly malicious behavior".
I think this would be a docs.rs or lib.rs feature, I used to think crates.io was that place but it is not.

I could see there being all kinds of scans of dependencies, like enforcing test coverage, builds and tests passing on certain platforms (risc-v, wasi, etc).
How to Declutter Your Digital World