skysight-inc/HackerNews huggingface dataset:
I totally hear you about that. I work for FAANG, and I'm working on a service that has to be capable of sending 1.6m text messages in less than 10 minutes.

The amount of complexity the architecture has because of those constraints is insane.

When I worked at my previous job, management kept asking for that scale of designs for less than 1/1000 of the throughput and I was constantly pushing back. There's real costs to building for more scale than you need. It's not as simple as just tweaking a few things.

To me there's a couple of big breakpoints in scale:

* When you can run on a single server

* When you need to run on a single server, but with HA redundancies

* When you have to scale beyond a single server

* When you have to adapt your scale to deal with the limits of a distributed system, i.e. designing for DyanmoDB's partition limits.

Each step in that chain add irrevocable complexity, adds to OE, adds to cost to run and cost to build. Be sure you have to take those steps before you decide too.
The Wirecutter served this purpose for me for a long time. But I also check the Amazon reviews.

With any kind of purchase, I do the same thing as I do with news - I survey all of the sources and look for the outliers and also the common threads. Then I form my own opinion.
Offshoring absolutely did happen for a variety of technical industries. See: the Rust Belt.
Is that actually measurable difference on modern process nodes and cores as big as Cortex-A?
> So which position am I taking when I teach students how to compute the determinant of a matrix?

You mean the wedge product? ;)
Recent discussion: https://news.ycombinator.com/item?id=39413417
>>> but you are not selling that well here

I did not sell it well, that's fair.

>> Why exactly should I want to do it? This isn't the goddamn United Federation of Planets, nor is the company a church - why exactly should I go above and beyond

HN doesn't want to hear this answer: you do it for the PEOPLE around you.

If you build sexy tech, and then get sexy job and I have to clean up your turds... well you can go fuck yourself. Hope that I'm never going to be the one answering the linked in request for a recommendation or sitting on the other side of the table when you come in for an interview.

The tech job market is bad, and getting worse. You're gonna need an advocate on the inside if you want or need work quickly. That means former co-workers and bosses. NO one is gonna hire clock puncher who did selfish resume building project and left. Dont be that guy.
Does Flyscrape execute JavaScript that is on the page (e.g. by running a headless browser) or is it just parsing HTML and using CSS selectors to extract code from a static DOM?
What's a RAG application
How does this compare to fmod?
Interesting, probably "fake news" then on X. Is there a way to publicly share Gemini interactions like with chatGPT?
They did already. It's called VK. The last time I logged in it looked exactly like original Facebook.
The answer is almost certainly no. It means the old APIs that expose phone numbers will stop working in 90 days. And old clients along with them.

I have not investigated this at all, but I have enough faith in Signal/Whisper Systems to be optimistic.
If I'm reading this correctly, this also means that a person that already has my phone number in their contacts will necessarily be able to link my number to my username after they have scanned my QR code.
Potential male contraceptive target discovered
> In my experience the boring "I delivered a project very fast with X,Y and Z and saved the company $100mil" will win over "I rearchitected a massive system to run on microservices

Good luck having the opportunity to work in a project where you have even the faintest idea how much money your contribution will make or save. I don't know about you, but never in my 17 year career have I had enough information to even attempt computing these numbers. And even if I could have, it was never part of my job description.

So how did you know your numbers? Or if you didn't, how did you made them up for your interviews?
I agree. I could have expressed my thoughts better in this case. It wasn’t just OP I was considering. I was thinking of a common AI take that I’ve seen when I wrote my comment. Regardless, will do better to express my thoughts and agree that we shouldn’t profile each other here.
If it's infringing then they're not viable. However, there are plenty of Reddit-like sites that are out there. The issue isn't functionality. As always in these matters it's that they cannot reach a critical mass of users.
They perfectly well have the functionality to make certain tweets and accounts inaccessible in certain regions. There's no reason to shut the account down globally.
I did something similar but used SVG instead - it didn't feel that bad
> in an near-impossible position when it comes to free speech

Also not free speech absolutists.
> So, not fun, not rewarding, no intellectual challenge, no career benefit. Why exactly should I want to do it? … why exactly should I go above and beyond what I agreed to in exchange for my salary?

I think that delivering a solution which works, even if it is not sexy, is exactly what one agreed to in exchange for one’s salary. It may not be fun, it may have no intellectual challenge, and it may have no career benefit, but it is rewarding: the reward is the salary.
The video goes into that, crew are not generally capable of doing that. And hiring mercenaries is very expensive.
Discovering alignment windfalls reduces AI risk
How about switching to Matrix? (I already did and am happy.)
It's worth noting that by eradicating Polio we can also eradicate vaccine-derived polio, as we'd presumably stop vaccinating people once the disease is eradicated, as we did with smallpox.
I rarely use lifetimes and I don't deeply copy everything.
This tool is probably the fastest in its class - does this code look like having a lot of lifetimes, cryptic syntax or deep copying?

- https://github.com/pkolaczk/latte/blob/main/src/main.rs

- https://github.com/pkolaczk/latte/blob/main/src/exec.rs

There was one fundamental "aha" moment for me when it clicked: move semantics.
Once I learned it, suddenly 99% of stuff became simple (including making async quite nice really, contrary to popular HN beliefs).
Scoop Plugin for PowerToys Run
Interesting thanks! On your point #4, I might suggest that hallucination is worse than failing to answer, so maybe it wasn’t a tie.

Also how do you get the code into Gemini? I’ve pasted a C++ file in to the chat window and I get errors. Seems to work on AI studio though, is that how you interface with it?
Ok, that's great that you're using a word for it. I could not possibly care any less.

Why is it bad to assume that a US-centric site is writing a US-centric article when they put "feds" in the title?

Why does there being an implicit bias towards expecting a US-centric site to produce US-centric articles, mean that the journalism is not misleading?

It doesn't. It is misleading. It is clickbait. You are defending the indefensible.
You should be able to choose your own threat model.
agreed, playwright is great. it even has device emulation profiles built in, so you can for instance use an iphone device with the right screen size/browser/metadata automatically
My 2 Samsungs are still running strong from 2008 and 2010. Except instead of looking at a horrible monitor for 10 years I’ve been enjoying a decent picture for over a decade.

However, I bought a cheap Roku TV for my family’s beach house. I don’t care about quality in this situation because it’s not used much and I should be outside at anyway.
> You also have to contend with the fact that movies are essentially immutable - if you watch the same edition as someone else you are seeing an identical product. Consumer products might be damaged, might be counterfeit, or might be incorrectly classified. All of these makes it really hard to build a single source of truth for reviews.

There's also things like the vendor replacing parts but keeping the same product name/SKU, or technically giving it a different ID but hiding it so far down the marketing materials that you're unlikely to be able to find it. This comes up a lot in the aftermarket ROM communities when you have to say things like "this image works on SomePhone 6a+ but only the 2022 model!". Granted, movies also can have sometimes silent edits that are presented as if they're the same thing (looking at you, Star Wars) but I would argue that it's less pervasive and there are fewer versions to keep track of.
Sure you can. I rented a server and after two weeks decided I don't like it, and got refunded all the money, including the setup fee.
Retrieval-Augmented Generation, where you ask an LLM to answer a question by giving it some context information that you have retrieved from your own data rather than just the data it was trained on.
In case anyone is unsure how is "middle class" defined in the UK, here is a short primer: https://www.quora.com/Whats-the-line-between-middle-class-up...
If it doesn't work with sticky notes, it doesn't work.

the rest is just scale.
The UI looks almost identical to https://mimestream.com/
As a freelancer I have been asked if I would go on the payroll. Is that a route?
Since the transition to flat screens I haven't seen a tv with good audio. It could be my bias, but I think that you basically need external speakers with any tv right now.
About a year ago I wrote this: https://steveklabnik.com/writing/too-many-words-about-rusts-...

I do think there's some good criticism of doing this, though, and so even a year later it's not clear to me it's a pure win.

I am sympathetic to the vague calls to action by Aria et al. to improve the syntax for various unsafe features. I understand why we ended up where we ended up but I think overall it was a mistake. I am not sure I agree with her specific proposals but I do agree with the general thrust of "this was the wrong place to provide syntactic salt." (my words, not hers, to be clear)

Ideally `as` wouldn't be a thing. Same deal, this is just one of those things that's the way it is due to history, but if we're ignoring all that, would be better to just not have it.

I am still undecided in the : vs = debate for structs.

I am sad that anonymous lifetimes in structs died six years ago, I think that would be a massive help.

Probably tons of other small things. Given the context and history, I think the Rust Project did a great job. All of this is very minor.
https://github.com/JJJHolscher/tapstrap

https://github.com/TapWithUs/tap-python-sdk

Those might be interesting for you if you haven’t seen them.
The price is a deal-breaker for me. It's borderline insulting, having to pay a subscription fee for an already-paid email service. Were it a value-add, it'd be compelling.

-- edit --

Turns out it's not made by Fastmail, it just uses "Fastmail's standard" of JMAP. I'm still not going to pay a monthly subscription for it; a one-time fee would be much more palatable IMO.
Crushing reminder, I will.
deal with a bunch of this right now, no considerations for future growth of system and also dump everything in json and itll be ok ....tech debt in architectural designs is real... and it takes a lot to trim it back and say ok now we are moving to XYZ tool that works and doesnt need to be shiny. Had a chat with a client once and they needed something and i said this looks like itll be a report and they wanted some super duper dashboard but all you needed was a small db + csv extract for charts etc.
That's good, since similar project from [1] Google as often happens is dead.

[1] https://github.com/resonance-audio/resonance-audio
I'm part of the team that build LlamaParse. It's net improvement compare to other PDF->Structured Text extractors (I build several in the past, includig https://github.com/axa-group/Parsr).

For character extraction, LlamaParse use a mixture of OCR / character extraction from the PDF (it's the only parser I'm aware of that address some of the buggy PDF font issues, check the 'text' mode to see raw document before reconstruction), use a mixture of heuristic and Machine learning models to reconstruct the document.

Once plug with a Recursive retrieval strategy, allow you to get Sota result on question answering over complexe text (see notebook: https://github.com/run-llama/llama_parse/blob/main/examples/...).

AMA
Awesome! Things have gotten so bad this is the only alternative. I tried building a hobby search engine then quickly gave up, but did imagine how I would do the scraping!
The problem is also the states that harbour these pirates, mainly Yemen and Somalia. They have free reign there, well at least they did until the coalition started airstrikes.

When the military gets involved the arms race has to stop because the US is just much better funded than the pirates or any other navy even if they would get involved (which they probably won't).

So generally when this happens it all dies down for a while until the military lose interest and the ships are sailing without protection again.

Ps: I'm not American nor am I a fan of their military but you can't deny they are the best funded in the world.
Reentrancy is a nuisance. seL4 allows for the kernel to be preempted only at specific points of long running operations, which massively reduces concurrent spaghetti but also sacrifices some latency. Would the userspace program have some way of knowing about global resource contention to avoid choosing a thread suboptimally? As I understand it, SA by itself only allows userspace programs to manage their own resources efficiently.
I hope someone corrects me if I am wrong, but around two years ago he backed out of any responsibilities (ceo) after he bundled mobilecoin into the app.
VK is much better but still has a lot of recommendation in the feed going on.
I made something similar for myself. It even has the same name!

https://github.com/alabhyajindal/today
because it exists

mbasic.facebook.com
OpenAI is welcome to train on the questions I’ve been asking about how to do type-level programming in TypeScript. In other circumstances, I might ask such questions in a public forum like StackOverflow, or a discussion forum on GitHub, but ChatGPT is more convenient.

I suppose other people might ask more private questions, but I have trouble coming up with examples of private things that I’d want to ask an AI chatbot about. And there are plenty of things to ask about that aren’t personal.
What Europe's egg-hurling farmers can teach us about climate progress
In the 90s, the cost of choosing the wrong thread to run when another thread blocked was significant in specific kinds of applications.

Since then, the cost has (in absolute terms) gone down, the number of applications for which this is true has not really increased.

In addition, there has been some expansion in the number of applications for which SCHED_RT and SCHED_FIFO are appropriate for at least some threads (financial services high speed trading, real time audio), which has also reduced the pressure for a user-space scheduler that "gets it right". This is also true for designs which require guaranteed scheduling slots.

So, SA might still bring some benefits to large, highly-threaded monolithic apps such as RDBMS, but it doesn't really provide much to the majority of contemporary applications. It certainly doesn't do much for mobile environments, which tend not to run applications where "the application knows best".
CEOs in Cars Getting Coffee - Neal Mohan [video]
I've seen SANs get nuked by operator error or by environmental issues (overheated DC == SAN shuts itself down).

Distributed clusters of things can work just fine on ephemeral local storage (aka local storage). A kafka cluster or an opensearch cluster will be fine using instance local storage, for instance.

As with everything else.... "it depends"
I spent 2 years on a motorbike going all over VN/Cambodia/Laos... you go outside of the cities and it is village after village of people with very little infrastructure. Gia Lai isn't that rural. I drove AH17 and QL14c. I'm thinking more in the North. Ha Giang, Cao Bang, even out to Sapa.

ALL of the borders are porous. I literally drove over the northern border into China at some random point, and there was nobody there. It is super easy to go back and forth. I also drove a lot of the trade routes along the border cut into the forests. ID cards aren't going to stop anything.

You are definitely correct about competency. No argument there.
Because you can't release the same movie under a different title at each theater to avoid comparison shopping. This is exactly what happens with consumer electronics and mattresses.
Is it possible to search for a specific pattern in this (or any other) hex editor?

E.g., if you have some sort of container format or aggregated file where you want to search for a specific instance of a pattern (starting from any offset). I haven't found support for this in ImHex (but I might have missed it).
Is there a name for "article doesn't at any point explain the niche jargon term the whole thing is built around?" Don't make me Google "S.M.A.R.T. attributes" just to understand what the subject of your post is even for
Interesting to watch Lawnmower Man alongside Being There (where an intellectually handicapped gardener is merely perceived to be a genius)
It's obviously incentivized by energy security. But PRC has also stopped funding/constructing new coal plants abroad. So their incentive to limit new emissions is at least genuine. They could have pocketed 100s of billions in BRI coal plant projects.

Like US did massive shale/LNG build out for energy security, except they ended up being the largest producer/exporter of both.
I tried that. Turns out that LLM-generated regex is still better (and a lot faster) than using an LLM directly.
> The problem is that this network is so large and slow that it can't give you anywhere near the performance of a local SSD. This wasn't a problem for hard drives, which was the backing technology when a lot of these network attached storage systems were invented, because they are fundamentally slow compared to networks, but it is a problem for SSD.

Certainly true that SSD bandwidth and latency improvements are hard to match, but I don't understand why intra-datacenter network latency in particular is so bad. This ~2020-I-think version of the "Latency Numbers Everyone Should Know" says 0.5 ms round trip (and mentions "10 Gbps network" on another line). [1] It was the same thing in a 2012 version (that only mentions "1 Gbps network"). [2] Why no improvement? I think that 2020 version might have been a bit conservative on this line, and nice datacenters may even have multiple 100 Gbit/sec NICs per machine in 2024, but still I think the round trip actually is strangely bad.

I've seen experimental networking stuff (e.g. RDMA) that claims significantly better latency, so I don't think it's a physical limitation of the networking gear but rather something at the machine/OS interaction area. I would design large distributed systems significantly differently (be much more excited about extra tiers in my stack) if the standard RPC system offered say 10 µs typical round trip latency.

[1] https://static.googleusercontent.com/media/sre.google/en//st...

[2] https://gist.github.com/jboner/2841832
That would welcome a world of spam. Sybil identities is currently an unsolved problem, the mitigation is the requirement of unique scarce resources (like phone number in this case)
Yes!

My Clojure scraping framework [0] facilitates that kind of workflow, and I’ve been using it to scrape/restructure massive sites (millions of pages). I guess I’m going to write a blog post about scraping with it at scale. Although it doesn’t really scale much above that – it’s meant for single-machine loads at the moment – it could be enhanced to support that kind of workflow rather easily.

[0]: https://github.com/nathell/skyscraper
The version of that quote that I know is about freedom. It's by Tom Robbins. I don't know if he's the original source.

When freedom is outlawed, only outlaws will be free.
How far are we from that right now? If you have an internet connection you basically have access to 95%+ of the information available in the world right now. Is your goal to completely delegate having to think through that information? To what end?
That's not just a feeling, it's a direct consequence of Conway's law. You feel correctly.
That's the late USSR degeneration syndrome.

Decrease in male life expectancy, opioid epidemic and now also metal theft.
No problem with the comparison. I was not comparing power efficiency. We all know that Apple prioritize efficiency.

Since power consumption vs performance is non-linear it's possible that the Intel+Nvidia combo would have roughly similar efficiency as M2 at lower wattage, although it certainly won't beat the M2 at 90 watts.
I've been a Signal beta tester on iOS for as long as I remember, knowing that they were going to introduce usernames, and I wanted to get my (relatively common) name as my username. Now they finally introduced it, but they require it to end in at least 2 digits "a choice intended to help keep usernames egalitarian and minimize spoofing".

Edit: this is not actually a serious problem for me, don't worry! Rather, I think it's funny. And honestly I kind of like having the numbers required, it's a good idea. It does remove a lot of the vanity from usernames.
The reason for having most instances use network storage is that it makes possible migrating instances to other hosts. If the host fails, the network storage can be pointed at the new host with a reboot. AWS sends out notices regularly when they are going to reboot or migrate instances.

Their probably should be more local instance storage types for using with instances that can be recreated without loss. But it is simple for them to have a single way of doing things.

At work, someone used fast NVMe instance storage for Clickhouse which is a database. It was a huge hassle to copy data when instances were going to be restarted because the data would be lost.
Using NER models to detect sensitive data in JSON
tl;dr NER models work best when they process data similar in structure to their training data. This notebook shows a few examples of how one can use an NER model not trained on JSON to actually identify and redact both structured and unstructured values with in a JSON blog. The NER model used is free available but closed source, but one can expect similar results with open source NER models such as spacy.
Especially expensive physical products that you want to review without bias.
Meet Alist: This Is How I Manage All Cloud Drives in One Place for Free
this isn't a first-party app for Fastmail, at least afaict. I had the same initial reaction before realizing this.

(I still have the same reaction to the pricing... but at least it's not double dipping by Fastmail themselves)
A few different techniques -

1. use mobile phone proxies. Because of how mobile phone networks do NAT, basically it means that thousands of people share IPs and are much less like to get blocked.

2. Reverse engineer APIs if the data you want is returned in an ajax call.

3. Use a captcha solving service to defeat captchas. There's many and they are cheap.

4. Use an actual phone or get really good at convincing the server you are a mobile phone.

5. Buy 1000s of fake emails to simulate multiple accounts.

6. Experiment. Experiment. Experiment. Get some burner accounts. Figure out if they have request per min/hour/day throttling. See what behavior triggers a cloudflare captchas. Check if different variables such as email domain, useragent, voip vs non-voip sms based 2fa. your goal is to simulate a human. So if you sequentially enumerate through every document - that might be what get's you flagged.

Best of luck and happy scraping!
> Where "I don't have facebook" was feeling like an insult on the community

Now LinkedIn is like that.
"Network effects" is pretty much the default answer to the question in the headline.