skysight-inc/HackerNews huggingface dataset:
I've faced this issue as well.

I run a Python script after the build has completed that reads the entire sitemap and chunks it into parts of 50k.

+1 for mentioning incremental builds as well. These two features are often overlooked and people just ask "why do you even have so many pages?" and it ends there because nobody wants to entertain the power user.

A third disadvantage I've seen is search. I use fuse to generate a JSON for client side search but it takes a lot of memory to render and is a cause for concern.
I don't understand the fetish for decentralization.

I have a love-hate relationship with the centralisation-decentralisation debate. Much radical decentralisation advocacy seems to embody little more than wishful thinking. Centralisation affords efficiencies, but at a cost of resilience, as has been widely realised of late, and of power control, if my notions here are accurate.

One possible resolution is to accept necessary, or inevitable, network control points / monopolies, but to ensure that control is shared, distributed, democratic, and/or principled. Public utlities, multiple stakeholders, public input, and the like.

Capture, corruption, apathy, mismanagement, incentives alignment, and the like, remain risks.
The inability of modern states to operationally keep up is deeply distressing. I have no political orientation with respect to the 'size' of government so much, but at very least, it needs to be effective for whatever it is doing.

The massive backlogs in the justice and immigration system, the lack of innovation in so many areas, ultra powerful unions, lack of material investment in anything other that known quantities like 'roads and highways' the seeming inability to have coherent identity solution for elections.

Yesterday, large swaths of Canadian government stats site 'Stats Canada' - a federal agency was just down and completely broken. It's 'COVID', hey, we're not going to fix that. Can you imagine of Amazon.com just 'went down' for a few days?

SF and California in particular lose all credibility when trying to 'lead' the country in any capacity really - Gavin Newsom's words about 'California is the future of America' are toxically arrogant in this regard.

Dysfunction is just another form of corruption.

This is an existential problem for some modern nations.
If you feel old, I once located some posts of mine from the 80's when names started with net.* and everything was bangpaths like foo!bar!bletch

hmm... here's a taste of it:

https://slashdot.org/story/00/08/27/1439247/usenet-archive-f...

EDIT:

Great Renaming: n.

The flag day in 1987 on which all of the non-local groups on the Usenet had their names changed from the net.- format to the current multiple-hierarchies scheme. Used esp. in discussing the history of newsgroup names. “The oldest sources group is comp.sources.misc; before the Great Renaming, it was net.sources.” There is a Great Renaming FAQ on the Web.

https://www.catb.org/jargon/html/G/Great-Renaming.html
This video from Captain Disillusion does a great job of explaining both the biological mechanism and the consequences it has on displays:

https://youtu.be/FTKP0Y9MVus
I would flag github as a more crucial requirement. We've had various im/irq platforms for decades. They weren't really a substitute for video - but video is only a tiny fraction of team communications, and simple chat satisfies most of those requirements.
I had the same issue - it eventually started working after restarting the phone.
Maybe it was taken at night?
I love how there is always an aspiring fiction writer in the comments. Woefully ignorant of the story, has an unrealistic expectation of limitless sevices. It must be cathartic to write victim hood takes like this.
Docker might not seem very impactful if you use Linux on your computer with a handful of apps. If you're shipping software from 20 different teams, half of them extremely drowned in tech debt, and all not being very respectful of each other's resources containerization is a great way to get isolation & system configuration locked down in an extremely low effort way while also giving your engineers an extremely ergonomic development environment that directly mirrors production.

If anyone's migrated software that someone who has left the company installed on a random VM to a new data center you'll know the pain of not being able to do this hermetically.
Facebook contractor downplays Coronavirus risk for content moderators
Apple did too... : https://seekingalpha.com/news/3482463-siri-sends-sensitive-r...
I've worked with good content/SEO teams. Generally, they try to make interesting content, then they hire folks offshore to promote it. It's a low hit rate, but it works over time.

Another "technique" is to crawl sites that link out to 404s, or outdated guides. Especially if it's a high value site. Then email them and suggest their users might prefer <insert better widget/site/etc that you own here>.
Can you describe the breathing exercises? Is it literally just sitting and taking deep breaths?
This truly terrible idea started in a 2 minute thing I put together over here [0].

Terrible ideas are always among the most fun. I ran into a lot of issues trying to put this together, as what JS APIs you can/can't run on a data-uri aren't altogether well documented.

(Modifying location doesn't seem to work, but I didn't see that documented. Modifying the history API doesn't, but that does seem to be documented. These are _very good things_ overall, but aren't really blockers to a bad idea like this one.)

The browser is surprisingly secure about it, which is great. Like opening a data-uri in a new tab doesn't always load/parse it, and often arbitrarily cuts the payload.

[0] https://news.ycombinator.com/item?id=24753685
Which company is this? 30% is a ton. In senior roles, getting 10-15% raises considered a good “promotion”. 30% cut in pay would feel like taking two years backwards...
> why isn't everybody following his method

Eat less processed foods. Go for a walk. Stand up and stretch occasionally. Take the stairs. Lift some weights.

All will improve your life and are trivially achieved by almost everyone. Yet too many people - perhaps most - choose not to do any of these.
To make matters worse, wealth is pretty easily moveable within legal borders. It’s extremely trivial for those in SF to move anywhere else in CA without having to even change their tax status (Edit: for withholding. Crossing state lines is more of a paperwork hassle for some companies), depriving SF of rents and taxes. And that’s not even counting the people willing to leave California for the various PADS (Portland, Austin, Seattle, Denver) cities.

This coming decade is going to be bad for SF. Shame they didn’t spend all that money making the city more desirable for reasons other than FAANG jobs.
Though it should be noted that when you compile such a binary on a system with a newer glibc, it will not work on a system with an older glibc. To be fair this is basically the case with C as well (you can work around it with .symver but it's kind of dodgy), but it is worth keeping in mind.
A one party city in a one party state, endorsed by the local media establishment. You get what you vote for.
Motor vehicle deaths per year in the US are under 40,000. In less than ten months, more than 210,000 people in the US have died of COVID. You're an order of magnitude off.
I think we'll end up with several different markets for a give type of job.

1. One market in each city that has companies in it that require that the job be done in the office.

2. One huge market for doing the job remotely.
At the same time, we're not trying to communicate with any 15th century readers. If it's in fact prevalent that a large number of readers have trouble with a construction, it doesn't really matter how recently that trouble arose, does it?
AirPlay is garbage.

It has a 2-second lag, and still regularly loses sync for me.

Apple didn't even bother to update macOS to support stereo homepods over Airplay.
Was it? https://news.ycombinator.com/item?id=9224
Well, you can't make something simple in a simple way unless you are both really confident and really good :).

In a sign of the crazy times we live in, Chez Panisse has started doing takeout. First time I tried it, I got a BLT sandwich. Exactly what it says on the tin: bacon, lettuce, tomato, no weird spices or creative takes or deconstruction. Just a stock BLT sandwich—except better in every way. I'm not even sure how. I would not have thought there was that much room to improve on a BLT through better ingredients and execution, but apparently there is.

Anyway, if you're in Berkeley, I would highly recommend giving it a try.
Not with gasoline. A gas engine can ignite at temps well below 0F and low compression.

You might be thinking of diesel. Diesel depends on compression to combust and has heater coils to ensure minimum temps as well.

This is more obvious when you read engine specs and they have minimum octane ratings, not specific ratings.
Don’t forget the people literally murdering the word “literally”.
But then you need an official way to report and fix errors.
For those interested in going deeper into the incredible world of breathing techniques I recommend "Breath: The New Science of a Lost Art" [0]. Part personal account, part research summary, the book covers a lot of the world's ancient breathing traditions (including Wim Hof and his antecedents), as well as what modern science has to say about them.

As with many other aspects of holistic health, it's incredible how Western medicine has ignored verifiable scientific evidence about the wide range of health benefits one can derive from these breathing techniques.

A smattering of advice from the book:

* Breathe through your nose, NOT your mouth (except when talking).

* Breathe slowly, softly, not (necessarily) deeply. Optimal breath rate is roughly 5.5s inhale, 5.5s exhale, 5.5 breaths per minute, 5.5 L of air inhaled.

* * Many people tend to over-breathe, which has a number of detriments, including stimulating anxiety.

* As with most aspects of health, the body does best with most-of-the-time low stress (see above "Breath slowly") punctuated by short intense intervals of high stress. Wim Hof breathing is the high stress workout that exercises your breathing system and builds breath flexibility.

* Chew tough stuff, exercise your jaw. This can help build wider mouths (new bone growth!) and open up your airways.

[0] https://www.amazon.com/Breath-New-Science-Lost-Art/dp/073521...
You can note markup in a code block --- 4 space indent.

A code block.

Two asterisks follow: **

This normally would be *italicised*.
I believe that behind the veneer of the official progressivism there's deep monetary corruption in San Francisco government. Here is my data (all within last 24 months):

1. SF Public works director arrested by the FBI:

https://www.sfchronicle.com/bayarea/article/SF-Public-Works-...

2. SF Building Inspector Commissioner arrested by the FBI:

https://www.kqed.org/news/11817788/former-sf-building-inspec...

3. SF health director Garcia forced to resign over conflict-of-interest

https://www.sfchronicle.com/bayarea/matier-ross/article/SF-h...

4. SF DPH official arrested by the FBI:

https://sfdistrictattorney.org/press-release/former-sf-publi...
Why is storing a limited amount of data on a service selling you unlimited storage finding a loophole?
It seems to me that they are basically describing a variational formulation of the "optimization perspective" of reinforcement learning, which is cool, but I am confused... where is the supervised learning? Like what is the input and what is the output?
It definitely feels harder to break ground on a project when you can't easily have a brief chat with someone (need to instead schedule a meeting that defaults to 30m), go look at something your coworker has pulled up on their screen, easily sketch something out on a whiteboard.

On the other hand, there are some benefits to formalizing things. For example, by being more rigorous in defining an approach to a problem you can more easily identify roadblocks. Also I think some people I work with prefer articulating themselves over text as opposed to face to face, so for them serendipity (in terms of creative output) is probably actually improved.

We have tried to "manufacture serendipity" by having unstructured video chats but it usually ends up feeling cliquey (too small groups of friends, people feel excluded) or too awkward (too many people, not enough rapport for conversation to flow easily). I think the problem of building rapport is the biggest issue.
The problem is incentive. No one in the government has any incentive to do anything. In fact not rocking the boat is far safer than doing something new, which is risky.

While I do wish the government would shrink heavily, another idea I have is to pay department heads a percentage of every dollar saved each year. As it stands, agencies want to increase their budget and headcount every year as that leads to prestige. If 10 cents of every dollar saved went straight to the head of the department, you would magically see millions and millions cut each year as they install better software, streamline, etc.
SF isn't an address for close to 800,000 residents just because of tech (or work if you will). There are myriads of other factors of why anyone would choose to live close to nice beaches, a long beautiful Pacific coastline, proximity to wineries/breweries, 4 full seasons w/ unparalleled weather conditions all year round to name just a few :)
or, you know, https://github.com/iamadamdev/bypass-paywalls-chrome :)
Del boys lingo has been documented for posterity here http://www.bbc.co.uk/comedy/onlyfools/lingo/euro.shtml
this post deserves a large, large, helping of down votes. there is easily available evidence based approaches to necessary micronutrients/supplements needed to maintain a variety of different health standards and keep illnesses at bay. denying that in a huff is pure ignorance. Check out Dr. Rhonda on youtube or Dr. Peter Attia's podcast the drive (not nutrition specific, but covered in depth at times).
My learning style is pretty close to a side channel attack. I just start doing the thing accepting that I must be doing very terribly to start with but looking to improve as I go. It sounds a bit like learning by doing, and it kind of is, but often, my focus isn't on doing at all, and I find that I've learned more than I've done, learning by aggressive deduction and induction.

Every element of a system leaks all kinds of related information, when you think of why it must be that way, consider what sort of elements must exist to support it, what similarities they must have, etc. I look at something, just a small piece at a time, then explicitly think through everything I can tell and what I can guess from that small piece I've considered in isolation, look at a bit more, occasionally throw out a bad hypothesis as a clearer picture emerges, look at the deficiencies in what I've done and figure out what should exist to prevent or obviate it, and often find that yes, such a thing exists.

It's hard to explain, kind of a style I've developed on the job, where you really just sometimes need to know things yesterday. When I consult other resources, it clicks better because it takes the haziness out of my sometimes half developed ideas, but the work I put in beforehand makes me remember it close to as well as if I figured it all out myself.
"Literally" is often used when the utterance is figurative, but it is used as an intensifier by way of hyperbole. Saying it should be "figuratively" is incorrect - that would not serve the same role.
I seriously don’t understand the argument that a remote first world would lead to a move from larger US cities to smaller US cities.

If there is any mass movement that is gonna happen, why would it be from big expensive US city with a lot of different entertainment options to a smaller, still fairly expensive US city with almost no entertainment options as opposed to significantly cheaper non US large city with a lot of entertainment options?

Why wouldn’t people move to someplace in Mexico, or Brazil instead? If time zones are not an issue, why not move to somewhere in Asia instead, like Bangkok, Singapore, Kuala Lumpur, etc.
+1 for wrangjangling.
Anecdote: almost every family with kids that I know has the same story: Lived in SF, had kids and gtfo because the city is not great for kids. That can easily be contrasted to Manhattan that was cleaned up by "broken windows policy". In SF the petty crime was rampant. Cars broken into, vandalism, drug use, theft and vagrancy(too bad it's not illegal in SF).

There are no borders and nothing stopping people from moving their tax base down to the Peninsula (where the weather is better, schools are great and no one shits on your doorstep).

Good luck sf, you'll need it.
What is it about the iPhone Mini that is selling you most?

I only now learned that the SE had touch ID and am now contemplating buying that instead of the mini. I was ready to drop $1500 if their had been a mini-sized iPhone with all the pro features and touch ID, but now I find every option frustrating.
My company and the customer I work for moved many apps and services to be accessible outside the VPN with MFAs mandated for login. Pretty much I don’t even connect to VPN nowadays except for accessing some on-prem servers and stuff nowadays.
Dropbox Goes Virtual First
Another great one is "Service Consolidation": When you notice that some of your microservices spends most of their time chattering with each other, it's time to clump them togeather into a regular old service.
Well, agree to disagree. Personally I've found food in the $15-40 range in NYC to be better executed and be a better value, with more options. I think other cities also blow SF out of the water with execution and value for that price range, but few are able to compete on the diversity of options.
This would be a really cool sulotion, kind of the reversal of typical seo bombing techniques that hide spam pages on compromised sites.
Anyone who has the X series and later should just wait for the next generation.
You can't expect everyone to find those tutorials and videos within a full week. It's hit and miss, and the value is nonobvious at start.
So if you want better results, share that will help the most. Not everyone will study asm and kernel calls either.
It is almost always ignored, and it is critical to proper Vitamin D utilization.
How dare you insult the highest form of humanity in San Francisco, the defecators-of-freedom?
Show HN: Canopi – nocode data tool – Like Canva for AI dev
Hey HN.
Coding sucks! serious Im mediocre at best but I love data science and AI. So we built Canopi for coding newbs like me. What makes Canopi awesome is you can share your data with people and they can use it in their projects but cant steal it. We're early days but the roadmap is awesome. Imagine safely sharing realtime data sources, connecting public data. Building your own AI and deploying to production. AI is no longer developer driven, its now democratised and by boosting diversity its now less biased.
Please have a play with the frontend proto, share your feedback and watch this space!
Curious what type is the recent GPT-3 bot u/thegentlemetre :)
Yes, but "critical mass" is much larger than you'd commonly think. It's the low frequency words that contain most information in a sentence.
way better than san jose
The problem is that government is a low-accountability sector, but many people have a quasi-religious belief that due to elections, it isn't.
Except the US already has basically free movement of goods and services.

So people are already reaping the benefits of cheaper and plentiful goods and services.

The last 2 years have begun to show the massive benefits of this. The US tariffs have led to a situation where today the US has the largest net trade deficit since 2006 and is paying subsidies of over $40bn simply to keep farming afloat in the Midwest. And there has been no gain in jobs within the US or any benefit whatsoever to those tariffs. The US consumer is only paying a lot more for products they were paying a lot less for a couple of years earlier making everyone here functionally poorer.
When the Republicans insist on nominating unelectable kooks, a one-party state is indeed what you end up with.

That's what we see happening here in Washington, in any case. There's no one I can vote for who isn't a Democrat, so I guess I'm a Democrat by default, whether I wanted to be one or not. Super frustrating.
Clearly you know more about this than me, so a question, I thought the improvements were significant for edge cases of what would be a good photos. So if you use old/new in a well lit enviroment either is good, but come dusk the more recent generation are much better in getting a decent photo in a less than ideal enviroment... or have I fallen prey to the marketing!
> When I learned Japanese there were more words where it was easier to confuse them and thus require a distinction, probably preserving length.

I did this to unintentional comedic effect the other day by referring to 「星の王子さま」as「星のおじいさま」.
When you wrote 'way better than coffee', I had to think of my favourite morning routine: getting up and going straight to work on my bicycle. In winter this gives me a sort of freshness shock that may be similar to the cold shower. There's nothing quite like it in terms of waking up: indeed it's better than coffee.
> using literally to mean figuratively

I contend that this isn't a thing. It's absolutely the case that "literally" is often used when the sentence is figurative, but for it to mean "figuratively" it would have to be the intent of the speaker that the inclusion of "literally" makes the utterance more likely to be understood as figurative. I think it is instead used as an intensifier.

All of that said, I don't have any principled objection to protest against it on stylistic grounds. I just think we should try and be clear about what's going on. (And I recognize that I'm disagreeing, here, with at least one dictionary - I believe they got it wrong.)
No, but you can send audio message like "hey siri send audio message to foo".
This is the result of monopolies.
The internet is meant for communication by defining protocols to connect all computers with each other. This allows everyone to participate and at the same time creates redundancy, which minimises failures.
Companies like FB are a perversion of this purpose, instead of using free protocols, communication is done by a few programs.
This creates the basis for censorship and forms a bottleneck or a predetermined breaking point.
Rather than efficiency, I suspect you would simply see everything dissolved. Mayor closes up shop on the spot, walks away with $1.5B, and the city no longer has a government.

https://www.al.com/news/birmingham/2018/03/etowah_sheriff_po...
> The city employs 31,830 people, one for every 28 residents and six employees for every city block.

You see, you and I know such a large public workforce is a problem and a burden on private citizens, but the San Francisco government views a large public workforce as an important goal.

The reason San Francisco is in bad shape is because the bureaucrats who run it actually think it’s in good shape.
Shameless plug for a similar post I've made, listing all the variations of Paxos (including Raft), etc:

https://vadosware.io/post/paxosmon-gotta-concensus-them-all/

No implementations/code but if you've ever wondered what the rest of the research landscape looks like for the paxos family tree of coordination (there's also some mention of stuff like SWIM[0], aka batched & randomized gossip at the end as well)

[0]: https://research.cs.cornell.edu/projects/Quicksilver/public_...
Can't we just agree to use one consensus protocol?
why not just have the glass replaced?
They're saying it's okay to convince people with arguments about personal sacrifices, but if it's not hurting you directly and immediately then your argument annoys them and they don't want to hear about it.
True. What about a minimum height? Like 5’3” or so?