skysight-inc/HackerNews huggingface dataset:
The index is tiny, not even a terabyte. Right now it's a few hundred gigabytes for ~20 million URLs. But it's stored in an extremely dense binary format.

Honestly you may just want to roll your own solution for storing a ton of files. If you don't need a general-purpose filesystem, but an append-only archive with extra metadata, then you can cut a lot of corners. Like if you have a file system that is fixed-size and append-only, you can build it in a way no off-the-shelf stuff can.

This line of thinking is a large part of why my index is so small and fast. I have a lot of special built data-structures that are built for their exact use case. Like a fixed size append-only hash map that uses mapped memory and can in theory be larger than the system memory. Very good for a search engine, absolutely useless almost everywhere else.
>Heck, I'd even pay for it!

I usually donate to FOSS projects I use since you can't pay for them in the traditional sense but I still want to support the developers. KDE is my favorite thus far.
I don't really think it matters. If you do the damage of a small nuclear bomb in the middle of an expensive part of the city ... it would take a conglomerate to pay for the damage done here, never mind the cost in lives.

And one thing they told me in a legal course was "you can't get blood from a stone, and trying too hard can be pretty expensive".
I think it was a satirical answer, that GC can indeed be used for even hard real time systems (though in this case it is a specific hard real time JVM implementation that has a maximum allowed time to spend on GC). Contrary to what many thinks, hard real time is not about speed, but predictability. And calculating even I don’t know how many missile paths is computationally not too hard, compared to eg. even a computer game.

But to answer your question, there are cases where the JVM is used without GC and it runs for a day, and gets restarted at night. Afaik some bank does it for some form of HFT.
Ah funny. This summer my 5 y.o. nephew was playing with some cars at my parents' house. Then I immediately recognize most of them: I was playing with them when I was his age in the 70s, and they're still going strong :) (some are Matchbox, some Hot Wheels, but most are Majorette).
UltraSeedBox (Crappy Internet where I live) - Spotify - Infuse Pro - iCloud

I paid yearly for the following: Bear - Drafts - PDF Viewer - 1Password - Playstation Plus - Banktivity - Email and Domains
heh, every time I have a good idea, Cloudflare always implements them later.
Show HN: Price transparency in healthcare (putting healthcare prices online)
Those mercenaries are in the first tier of reserves anyway and it wouldn't be their choice but army on mobilization.
The data suggests a regularly scheduled set of boosters over time?

Is this because the vaccines are short acting? Is it because they are not targeting the virus properly? Or is this because of virus mutations?

If we had better vaccines targeted to the current mutations, would they require so many boosters?

When will we get a new vaccine that is targeted more to the current mutations circulating?
I’m pretty sure for every mail chimp employee that wishes they had pushed for stock compensation, that are scores of other startup employees that wish they had not taken stock in lieu of cash in now worthless start-ups.

People just need to own the choices they make.
Commercialization being the operative word.

Nuclear research is nice, but doesn't help one bit compared to building reactors even with 50-year-old tech.
> Nature doesn't care, life will continue to exist
Well, maybe it won't.
We managed to kill 41% of insects on earth in over the past 10 years.
Source Sanchez-Bayo & Wyckhuys, Biological conservation, 2019
United States Broadband speed ranks 12th according to SpeedTest Global Index
Have you ever googled, bro?

>> After the collapse of the USSR, economic reforms were not fully implemented in Uzbekistan, conditions for the development of medium and small businesses were not created, corruption took root, and unemployment increased. Many wonder: if it is better now than in the past, why have about two to five million Uzbek citizens left their country in search of work?

via bbs.com (!!!) https://www.bbc.com/russian/international/2014/10/141015_uzb...

.. and where do you think they migrated to, from their country that is on its way to Middle Ages? To Putin's dark regime's Russia, nowhere else, working there as construction and road workers etc.

You've got a good chance to compare your reality with real reality, my friend.
Apple giving into Russia proves CSAM assurances cannot be trusted
I don't think it's vigilante culture. People value order and organisation and this coupled with the direct nature of communication, feel completely within their right (I would say feel duty bound) to say "hey, you're not supposed to do that".

It is also custom here to voice one's opinion in extreme precision or detail. "Hinterfragen" question things, criticise, always down to the details. Not in an emotional way but very in a very matter-of-fact sense.

So think of it from the perspective of "if the rule is that you don't cross on red, then why are you crossing on red? It's against the rule". It's not personal at all.
As a LEO network Starlink should have latency comparable to terrestrial connections. I've signed up and they say they'll service my area in "Fall of 2021." And I can see LANL from my house, so it's worth checking.
Who knows about correlation or causation, but programming and humility go together. Training people to always ask the questions:

- How do I know that this is true?
- What would otherwise have to be true for this conclusion to follow?
- How can I bisect this process to test a hypothesis?

So much wishful thinking and jumping to conclusions could be avoided if programming (and debugging more specifically) is a training to viscerally understand the scientific method.
Yes, this would also be very reasonable public health policy.
> It is, as far as I know, the only cross-distro package format that is designed to be cross-platform (desktop, server, IoT) and with built-in sandboxing. Moreover, it is feasible to base a distro off of snap alone (Ubuntu Core, designed for IoT).

It is not really cross-distro though, since different from Flatpak, Snap assumes many features to be enabled for sandboxing to work (like AppArmor [1]): https://wiki.archlinux.org/title/Snap#Installation. Flatpak only assumes, AFAIK, user namespaces support on Kernel.

[1]: This can be really problematic if your distro is using other MAC like SELinux, since while they're really not designed to run together.
I haven't decided if I agree with the comment you're replying to, but this isn't a fair summary of it. Either engage with it or don't but posting a caricature doesn't exactly raise the level of debate around here.
My approach to founder sales
I agree that it feels unnecessary and uncomfortable.
There might be a reason why he chose this vs plain text or template, not sure.
Casually suggesting that Apple should pull out from all authoritarian countries is both funny and naive
but this is an image resizing service, right? shouldn't you be uploading the highest quality original source?

I would've thought the workflow for these would be to upload a high quality source, and then the service creates lower quality/optimised variants.

I guess you have a limit as it is priced on total images stored and not storage/cpu used...
we have 3 of the 4 things you list here. "developer pay" is pretty broad, so its tough to generalize where you're paid more.
I'll repeat my feat in this area: a spelling corrector that had 32kB memory (because it was tied to a keyboard trap, or something like that) and could do four 8kB reads from CD-ROM before telling the user. It contained not only orthographic similarity (the actual letters), but also phonetic similarity. You rarely see that in older English spell checkers, because it's such an irregular language, but for other languages it's quite informative, although in extremely regular languages, such as Spanish, you could also put it in the weighting/probability model (e.g. v<->b is a pretty common confusion).

The CD-ROM spelling corrector was not really great, BTW, but at least it replied in 1s on a typical end-user PC.

Edit: this was late 1980s.
Ask HN: How to transition to academia later in life?
Hello HN,

I am an industry AI practitioner trying to move into academia, asking for advice.

A bit of context: I used to work in mathematics, but then moved away from academia. Nowadays I work in the industry on various AI topics, and I am quite up to date with recent research, but I have little opportunity to do research myself where I work. So I have both an academic background (in maths) and industrial experience (in AI).

I would like to move into an actual research position in AI, but of course every such position requires publications in top conferences and possibly recommendation letters - I have neither. I understand the rationale for such a selection process, but it leaves few opportunities for people like me who have been outside of the game for a while.

Hence the question: what could I do to make the transition possible? Are there some kind of imtermediate positions that I could use to pivot?
Very interesting thank you. Is there an area of study that considers bit strings as one dimensional stochastic processes?
I disagree. I think the problem is that Apple is choosing to support dictators by removing this app.

The ability to side load apps is a smokescreen because only 1% of people would use any alternate means.

So even if they had alternate app stores, Apple removing it from the main App Store is egregious.

Similar to how it’s terrible that Google removed it even though it’s available in alternate stores.

(Of course Apple should allow sideloading and other app stores)
This is good news as long as we can keep up with the variants. This shows that the booster is very effective against the delta variant, but also suggests that I'll likely be getting booster shots for the rest of my life.
I don't think the choice of language/framework matters too much in the grand scheme of things provided you understand the concepts behind the decisions that languages/frameworks make for you. So pick whichever piques your interest.

As far as job prospects, my bet is on Rust/Actix. I'm pitching the idea of creating new micro-services with Actix to my company. (We're a Java shop). I implemented a simple proof-of-concept api server that takes in a single type of request, runs some business logic, makes a db call and returns a response with additional fields. Preliminary testing has shown that the Rust/Actix implementation is 5x faster at processing requests compared to the Java/Spring implementation.
I recently stumbled upon this book, gave it a read and found it surprisingly informative. It's a little bit overwhelming though (as it covers three different architectures).
Are any company charters setup to let employees participate in funding raises or acquisitions at the same terms as the 3rd parties? And what would that do to the marketability of the company to those 3rd parties?

Sort of a poison pill that benefits employees during an exit.
This isn't much different than when Google de-indexed millions of .co.cc domains. They determined that there were so many spammers on those domains that it was better to just remove them all and stop worrying about it. It did get a very few legit sites in the process, but not enough to care.

I get that the people here want more control over their devices, but to be fair, anyone posting here is at the extreme end of the tech spectrum when compared to your average phone user. Those phone users want someone else to help them. It's why I have spam assassin crancked super tight on the mail server that my parents use. They would rather miss a few legit emails and texts than get flooded with spam.

The .co.cc discussion was here on HN https://news.ycombinator.com/item?id=2733352
My favourite benefit of Bitcoin is bypassing the hideously inefficient and corrupt Wall Street financial vampiric system that provided the world with the Global Financial Crisis for which it suffered the punishment of being given billions of dollars by the US Government.

Each to their own I guess.
The iPod’s key moment was “1,000 songs in your pocket”.

That was an inflection point where a portable music player went from a host for swappable units of media, to being the whole library, for most users.
I do not know what technique this app used, but in practice apps are more resilient. It has been shown by Telegram which more or less successfully evaded blocking in Russia. I think it's a combination of lower-level network API, traffic obfuscation libraries, push notifications, and hosting some info on public services which cannot be blocked without affecting too many people. But it is just a guess.
Here's a interesting paper I found that attempts to categorize the mechanisms by which Goodhart's Law operates in the real world. The variants are separated into Causal and Non-causal mechanisms.

https://arxiv.org/abs/1803.04585
Here's another interesting one that's somewhat related:

https://en.wikipedia.org/wiki/Decline_effect
One of the most important lessons to promote.
A lot of basic groceries are sales tax exempt.
Facebook terminates ca. 150 accounts of Germany's largest Covid sceptic movement
Law of attracions and the way it affects you
And yet in Go you don't have NPE that plagues Java code.
I think that it's both -- immunity is not permanent and, while still effective, the vaccine is not as effective against delta.
Habit and Consistency. You’ll be amazed at what that can do.

The common troupe: Someone decides they want to get fit, so they go out and join a gym and start pushing themselves extra hard. One month later they’ve burned-out, got discouraged, and they give up thinking “I guess I’m not ‘one of those people’”. Nonsense: our bodies are built to move.

Here’s what to do instead. Find one day/time every week and show up. Do the smallest amount of “work” possible and leave. Make “showing up” a “religion” but don’t work yourself to burn out.

If you do this, the following things will happen: (1) something will feel out-of-place if you happen to miss a day, (2) you’ll start to appreciate this “special time for yourself”, (3) you’ll start to crave it and want to do more.. let yourself fo more then.. but.. don’t make yourself hate it.

Also, read books on habit formation: Power of Habit, Atomic Habits, How to Fail at Almost Everything and Still Win Big

You can apply these tools to all kinds of other things too. They are extremely powerful.

(I’m also a software developer who never exercised ever and was in terrible shape with back pain due to my sedimentary lifestyle. A year ago I made the change. Since I’ve dropped 70 lbs, run a 50k, and completed a triathlon)
just wait for old hn to show up and tell new hn that the famous Norvig's spelling corrector is not efficient and is not teaching people how to do it right.
Looks like boosters help. Something I am still not clear on though is that I got COVID then got the Fauci Ouchie. Do I need a booster?
iOS 15 is almost here–is your marketing game ready?
I really shouldn't have to teach the concept of an analogy from first principles to what I assume is a grown adult, yet here we are...

They're leaky abstractions.

Here the part that doesn't map perfectly is it's not either/or, it's a sliding scale.

People at other startups make a market rate and get a little equity, some get below market rate and a lot of equity. Even at the same company people can negotiate their position on that scale, trading one for the other.

But you were told essentially "the equity will never have value so don't worry about that scale".

But it turns out the equity could have value.

The analogy works to convey why people are feeling a certain way, it's not a 1:1 mapping to how startup equity is. That disconnect is what the words "might as well be" convey: https://english.stackexchange.com/a/171622

-

Additionally unlike a true lottery there is some form of control and information on outcomes, it might feel random because companies can and do fail for unforeseen reasons, but it's not like someone is throwing darts at a board to choose which tech startup closes its doors today...

-

Really I don't understand your deep lack of understanding if you're in this industry, have you never been given large amounts of equity before?

I personally chose a company that gave me solid cash compensation, but not as much as a competing offer, because they offered a lot of equity. I believed in their fundamentals and their position in the market.

Unsurprisingly the company continued to execute well and the equity ended up being worth more than quadruple my cash compensation.

I understand not relying on equity returns to plan out your financial future, but I really don't get a blanket mentality of only taking money upfront and not diversifying.

Do you not invest in the stock market either? Because that's also pretty similar to this situation... if your holdings crater to near nothing the fact you have liquidity from being on the public market doesn't really help...
I'm not sure that's true. Python mainly uses RC, yet most people think of Python as GC'd. I would argue that most people think that GC == automatic memory management.
I'd have to imagine that's "just" a 2-valued discrete Fourier transform / discrete cosine transform.
I'm waiting for comments downplaying the value of the information while attempting to put the blame on the leakers for whatever reasons.

I'm glad that most the new right is made out of incompetent people with a strong tendency to overestimate their own intellect. Just look at this assessment:

> [...] Epik’s “entire primary database,” which contains hosting account usernames and passwords, SSH keys, and even some credit card numbers—all stored in plaintext.

Storing passwords in plaintext is inexcusable, even if you're a total junior.
StoryCorps: Remembering Jerry Lawson
Find a sport/activity that you can enjoy where fitness is a byproduct.

I get bored at the gym lifting weights/running on the treadmill etc. I've always enjoyed tennis and swimming so I forced myself to signup for lessons. I now swim and play tennis regularly. It is something that I look forward to.

Another tip that worked for me is to start identifying yourself with an activity. I guess you could call it brainwashing yourself. Like: "I'm a swimmer", or in your case, "I'm a runner".
I am leading a transition from TypeScript to Java + Spring Boot and comparing those side-by-side, Java is significantly easier to follow. In TypeScript, we have a (from my point of view) too complex type system and features like destructuring and spreading, that sound smart but actually make it difficult to understand if you are not the author of the piece in question.

What do you find magical in terms of Python in particular?
They are rigged, but not as fully as they were in e.g. Belarus.

Russia is a giant country with 85 "states" and around ~100k polling stations, so the process is very complex and involves different voting and administrative cultures. In some of those states they are fully rigged, with 95% turnout and 98% votes for the ruling party, but in some the elections are surprisingly fair. In a lot of others they can be made fair if any poll watchers are present. Overall the thinking is that they add themselves 10-15% additional votes across the country by straight up voter fraud.

The main way they rig the elections right now is by not allowing anyone who could win to participate and then throwing all of the state resources towards promoting their candidate. That's why consolidated voting for a single opposition candidate can work in this context.
Nothing wrong with it, I was just curious about the claim that the company is legally based in the US but most employees are in Ukraine.
Unfortunately not, this was a famous problem taught by Feynman in his physics lectures. Essentially the Brownian motion of the ratchet and pawl mechanism (used in your watch) will eventually prevent the mechanism from harvesting energy [0].

[0] - https://en.m.wikipedia.org/wiki/Brownian_ratchet
>I'm very much now "I'm more than happy to pay taxes for better social services, but please keep the clumsy, oafish hands of the state out of my personal life before it does any more damage".

This is very much a stance of "oafish hands for thee, but none for me." The same institutional mass of "oafish hands" that interferes in your personal life does the same to everyone engaging with social services. And while , in many cases, you can opt out of those social services at some expense to yourself, the market equivalents/alternatives will, over time, be weakened or killed the same way as you would see with any other deep-pocketed firm selling a product for below-market prices, at a loss, to smoke out smaller competitors.

I can't speak for the UK, but in the US this has brought us such dire consequences as bulldozing of poor neighborhoods for de-humanizing, car-dependent housing projects; the near-dissolution of the institution of marriage for lower classes; and a healthcare system where buyer and seller have become so thoroughly de-coupled as to disarm the pricing mechanism completely and make it impossible to pay real prices for services outside of collective bargaining arrangements.
Vaguely - This client was in the fitness niche and made the mistake if upsetting the vegan bodybuilder niche. The vegan bodybuilder group went hard after anyone that said it was harder to put on muscle with just plants. No shadiness, no spam, just a disagreement about building muscle.
True. But, intentionally or not, we seem to be working hard to "fix" that problem...
The article ventured into Mossad territory, so I pointed out the absurdity of such a scenario.

Distance or not, biometrics are part of a totalitarian future, and as such are to be avoided. The conversation about passwords will be moribund before you know it.
Effective Google search is also history.

I understand they are trying to maximize ad revenue and search does work very well for people who are looking for products or services.

But it no longer works well for finding information that is even slightly obscure.
"eat a vegan"

Hilariously opposite to the intended message. Sorry, I just found it very funny, have an upvote to make up for my shitpost reply.

I believe in leading by example rather than leading by dictate. Others seeing what's actually possible is far more encouraging of change than pointy fingers and harsh words.
The most single life-changing purchase of my life was probably a Linux magazine that included an Ubuntu DVD from the bookstore.
Just because there are shades of grey, doesn’t mean we can’t tell black from white.
yeah im sure accelerating the planet turning into an uninhabitable wasteland is really worth it just to stick it to the man, you fucking troglodyte
One day, I read a foodback (a feedback suggestion) at Google from Jeff Dean. He told the food people they could turn a buffet line into two lines by letting people go down the other side at the same time, doubling throughput.
No App Store, no install, no walled garden, no 30%.
Again, in that quotation he’s really describing what “actually existing proponents of free market capitalism” are doing in reality — practicing a form of heterodoxy that is common within the community. The article barely spends any time discussing philosophy, so I think it’s irrational to elevate his critique to that level. He’s discussing a biography after all.