skysight-inc/HackerNews huggingface dataset:
Yes, rhymer has hit on the primary tradeoff behind Algorithm A. While Algorithm A is fast, easy, and makes it possible to sample any dataset you can access with SQL, including massive distributed datasets, its draws from the population are not independent and identically distributed (because with each draw you make the population one item smaller), nor does it let you compute the inclusion probabilties that would let you use the most common reweighting methods, such as a Horvitz–Thompson estimator, to produce unbiased estimates from potentially biased samples.

In practice, however, when your samples are small, your populations are large, and your populations' weights are not concentrated in a small number of members, you can use Algorithm A and just pretend that you have a sample of i.i.d. draws. In these circumstances, the potential for bias is generally not worth worrying about.

But when you cannot play so fast and loose, you can produce unbiased estimates from an Algorithm A sample by using an ordered estimator, such as Des Raj's ordered estimator [1].

You could alternatively use a different sampling method, one that does produce inclusion probabilities. But these tend to be implemented only in more sophisticated statistical systems (e.g., R's "survey" package [2]) and thus not useful unless you can fit your dataset into those systems.

For very large datasets, then, I end up using Algorithm A to take samples and (when it matters) Des Raj's ordered estimator to make estimates.

(I was planning a follow up post to my blog on this subject.)

[1] The original papers are hard to come by online, so I suggest starting with an introduction like https://home.iitk.ac.in/~shalab/sampling/chapter7-sampling-v..., starting at page 11.

[2] https://cran.r-project.org/web/packages/survey/survey.pdf
While not strictly for RDBMS, I think this book is pretty close!

https://www.databass.dev/
Dogs in my street barking at night are totally saying similar things for half an hour.
You think it needs a lot of coordination to fly in sync? I only have a slow clap for you, actually everybody else join in for the clapping and without any coordination whatsoever you'll notice that we clap in sync after a just 50 seconds https://www.youtube.com/watch?v=Au5tGPPcPus
Who was second team on everest? Who was second to land on the moon?
Ansible + Docker. The only "catch" is you still have to manage the host. It's trivial with Debian stable, and really the goal is to have a little on the host as possible and as much containerized as possible, so you can automate.
> Gorhill reports on GitHub that an automated code review by Mozilla flagged problems with uBlock Origin Lite. As a result, he has pulled the add-on from Mozilla's extensions site. The extension's former page now just says "Oops! We can't find that page". You can still install it direct from GitHub, though.

I genuinely think one of the biggest problems in digital society is people being addicted to reading headlines without doing the boring work of reading the article.
My best advice is to not listen to anyone, you know damn well what you should do.

But since you've gone there... Marathoning... okay... stop looking at the ground in front of you and look at the horizon. This marathon is unimportant, the goal is much further away, think of the next race and the one after that. Where do you plan to go with this?
In my experience, we're really bad at holding humans accountable for their predictions too. That may even be a good thing, but I'm less confident that we would be holding LLMs less accountable for their predictions than humans.
Been working with sqlite and Typescript, needing random rows sampled reproducibly with a seed. Found this handy little trick [0]. Not the cleanest, but it works!

`SELECT * FROM sales ORDER BY substr(${seedValue} * sales.id, length(sales.id) + 2) LIMIT 10;`

[0] https://stackoverflow.com/questions/24256258/order-by-random...
I don't think that dev titles have ever had much meaning. I started in this career long enough ago that I don't actually remember the last time I paid any attention to them.
> the signaling value of college degrees as indicating knowledge

I'm not sure knowledge is what a college degree signals to prospective employers. The alternative hypothesis, which AFAIK has a fair bit of support, is that it signals a willingness to do whatever it takes to fulfill a set of on paper requirements imposed by an institution, by hook or by crook.
The solution, clearly, is a world where those who actually learned the math can use it to cheat the people who didn't.

...which is what we have today, where the most lucrative industries for people with good math skills are finance (= cheating dumb people out of their retirement), advertising (= cheating dumb people out of their consumer dollars), and data-driven propaganda (= cheating dumb people out of their votes).

/dystopia
The student is the one paying your salary so that would be expected though, right? Where the students get the money from in the first place is the issue imo. Perverted markets do perverse things.
Haha same, and this Mitchell and Webb skit as well which parodies the same thing https://www.youtube.com/watch?v=I9A5y6mXMh8
I have done so, and one has to be out of their mind to attempt in java instead of c++ in those contests.
I assume you're talking React's hooks. That is not functional programming.
Does anyone have a clue how far we are from having "LLMs for animals"? Even if we don't understand what the LLM is saying to a dolphin or a monkey, does it change much from feeding millions of texts to a model without ever explaining language to it as a prerequisite?
>If you're doing something in a way it's not in the training data set

in my industry, the "training data set" won't get much farther from public code than the barebones, generated doxygen comments we call "documentation".

But in a way you're also right. The industry's approach is fundamentally wrong, making 20 solutions to a problem with plenty of room to standardize a proper approach (plenty of room where you need proprietary techniques, but that's getting less true by the month). But an LLM isn't going to fix that cultural issue and will suffer from it.
> For another thing: it’s straightforward to modify JavaScript dependencies locally. I’ve often tweaked something in my local node_modules folder when I’m trying to track down a bug or work on a feature in a library I depend on. Whereas if it’s written in a native language, I’d need to check out the source code and compile it myself – a big barrier to entry.

Anecdotally I have had to do this in js a few times. I have never had to do this in Rust. Probably because Rust projects are likely to ship with fewer bugs.

Also Rust is harder to pick up but what are you going to do, use the most accessible tool to solve every problem, regardless of its' efficacy? I am not a Rust expert by any means, but just reading the Rust book and doing a couple projects made me a better programmer in my daily driver languages (js and Python).

I think speed is less important here than correctness. Every time you ship a buggy library you are wasting the time of every single end user. The correctness alone probably saves more time in total than any performance gains.
this is a really fascinating and interesting to me. i’ve been using sql to analyze large data sets recently since sql is my primary skillset and having new methods and algorithms is quite handy and interesting.

i do have a question of clarification. this is built on weighted sampling with weights in the dataset. does this indicate some sort of preprocessing to arrive at the weights?
Not sure to understand what you meant
A major reason was that there was a dogma that language is uniquely human phenomenon. It was already part of the hugely Decartes' philosophy of mind and got a strong revival with Chomskian linguistics and the "cognitive revolution" in the late 1950's.

There was sporadaric research into animal linguistics, e.g. the Koko study, but those were dismissed on the grounds that animals can't have language by definition.

The ethics of enslaving and torturing animals is definitely part of the motivation for the dogma.
Do other states in the area have malaria? How and when were they resolved?
They're not scared of computers.

They're scared of building their house on someone else's land.
I claim "processed food" isn't even a cogent concept.
What I will never understand is how can you look at that and bet on something so fishy.

Isn't it better to bet on 5-a-side that you have with your mates?
Plagiarism checkers are much more interpretable.
AI Does Not Make It Easy
Sweet Lullaby from the Solomon Island sold as Pygmy music (2012)
I have seen many companies getting hacked through vulnerabilities that had recently released exploits, while I was working with an incident response team. I believe in most case the CVE was available for some time before the exploit code was made public but no one was aware of the CVE and its implications so they didn't apply the patches. I don't think the researcher is inviting trouble but once the exploit becomes public there is a greater chance of the vulnerability being actively exploited.

Shameless plug: I've been working on a project called https://hacktrack.info, that lets the user track the software they use and get an email alert when new CVEs are released for their stack.
The complete collapse of Boeing needs to be studied.
This is brilliant, it's like you read my mind when it comes to AI in education, thank you.
That sounds like you might potentially break some copyright of your tools. Not all our tools are FOSS (and even some FOSS licenses may not allow that).
To borrow from the freelancer's creed:

Fuck you, fire me.

No, I don't work there, but I'd rather be fired than quit myself. At a minimum, I can get unemployment, and the job market is so saturated that the extra time to find a replacement job will be welcome.
Reminds me of this classic bit (Archive, because they have a paywall, now): https://web.archive.org/web/20160718151008/http://www.thedai...
I use Bitwarden with Vaultwarden running in a Docker container on my Synology NAS. I have about 8 of my family and friends using it via a Wireguard VPN. It works well, but being the admin of it is a real responsibility. I regularly back it up and transport backups offsite. And since my NAS isn't addressable via a public IP address, I can't use Let'sEncrypt. All of the admin duties as well as the maintenance of renewing the cert every year is something that would be a problem for my family members if something happened to me.

I'm having a little trouble finding details on Buttercup's self-hosting requirements. Can anyone comment on whether it's more straightforward for a less tech-inclined person to steward?
> The main courses are mandatory in order to obtain the degree. You can't "not sign up" for linear algebra if it's in your curriculum.

The course might be mandatory but which professor you choose isn't. What if multiple professors teach it? Word gets around and everyone chooses the easy profs.
> we could never rely on having a calculator when we need it most—obviously there's irony associated with having 'calculators' in our pockets 24/7 now

That was just a simple quip to shut down student bellyaching. Even before we had pocket calculators, it was never a strong answer. It just had to hold over long enough so when you realized it was bad answer you weren't that teacher's problem anymore.

The actual answer was that they're complaining about a minor inconvenience designed for reinforcement, and if they really did need a calculator for the arithmetic on a test designed deliberately designed to be taken without a calculator, then they don't belong in that class.
A 12-Ounce Layer of Foam Changed the NFL
Fully agree. I recently replaced my doomscrolling with a retro handheld and it really makes me happy. It also pushed me to pick up my ereader again.

I spend enough time at a computer than I shouldn't really need a smartphone outside of 'I need to message ___' or 'I need to go ___'
How should open source projects handle copyright notices? (2020)
Well, Standard ML was initially designed for a theorem prover, so you're definitely onto something here :)
I literally don't know what people mean when they say processed food, and neither do they. It's a weasel word based on circular, no-true-scottsman, logic.
Kubernetes networking: service, kube-proxy, load balancing
Math Is Still Catching Up to the Mysterious Genius of Srinivasa Ramanujan
May I use this opportunity to alert you to the excellent bird identification app by Cornell University, Merlin.

https://merlin.allaboutbirds.org/
I am expected to produce business value at the end of the day and I wear multiple hats. Paying someone to be the expert in the room is the best value sometimes.

I’d rather focus on my expertise and mental energy in other tools that are much more significant to the stack I support.
It looks cool, but I'm not sure I want nodejs anything on my desktop considering KeepassXC exists. I just use meganz client across all my computers and mobile phones to syncronize kdbx it is doing it for me.
It is particularly bad for a satellite in geostationary orbit to break up or fail. Satellites are packed as tightly as possible into that orbit due to its economic importance (it's very useful for a satellite, particularly communications satellites, to always be over the same part of the Earth), so there is a higher than normal likelihood that this could be seriously disruptive.
> Overeating is caused by lack of movement and bad diet

Is this some kind of joke? A bad diet doesn't cause overeating - overeating IS the bad diet. Also not moving doesn't cause overeating, because how could it? What, I sit down and suddenly a burrito appears in my hands?

The cause of overeating is a propensity to overconsume, i.e. you have an addiction. Diet and exercise address the SYMPTOMS, but not the ROOT CAUSE. You STILL have an addiction. In the exact same way someone who is sober is STILL an alcoholic.

Because drinking alcohol is not actually the root cause of alcoholism. The root cause is an addiction to alcohol. You can't get rid of the addiction, but you can treat the symptoms - by never drinking, by being sober. But you did not address the root cause.

By my logical analysis, I conclude GLP-1 inhibitors better address the root cause than diet and exercise. To further strengthen my point, you've more or less admitted this by pointed out you've been obese "multiple times". If you had addressed the root cause this would be impossible! But you did not address the root cause but merely the symptoms via diet and exercise. You still had the addiction, so when you slipped you became obese again. This cannot happen while taking a GLP-1 inhibitor because you no longer have the extreme desire to eat. Even when you lost weight, you still had the extreme desire to eat.
Now that's one way to counteract the Peter Principle!
I like to rewatch Good Will Hunting from time to time, where he gets a mention
Nope. But AI's sales pitch is that it's an oracle to lean on. Which is part of the problem.

As a start, let me know when an AI can fail test cases, re-iterate on its code to correct the test case, and re-submit. But I suppose that starts to approach AGI territory.
if we can fit that power into a box that can fly with me to alpha centauri, i think we'll be ok

once we figure out feeding and waste management, entertainment over a low-bandwidth link will be tricky
its actually been done, but in slightly different manner

https://t.me/hninsights/836?comment=441
Sure, anecdotal evidence. Here's another anecdote:

Original article: https://osa1.net/posts/2024-10-09-oop-good.html

LLM (ChatGPT o1-preview) results: https://chatgpt.com/share/67166301-00d8-8013-9cf5-e8a980aca7...

LGTM!

I'd like to know which model is used in the article you've referenced as well as the prompt. I also suspect that 50 pages is pushing up to the limits of the context window and has an impact on the results.

---

As for the article itself... Use a language like F# or OCaml and you get a functional-first language that also supports OOP!
A crane collapsed in Hurricane Milton. Authorities aren't investigating
The amount of power needed for data centers over the next decade is estimated at like 80+ GW of growth by 2030 which is insane.

It'll either prompt serious investment in small modular reactors and rescuing older nuke plants about to retire, or we'll see a massive build out in gas. These companies want the power to be carbon free, so they're trying to do the former, but we'll see how practical that is. Small modular reactors are still pretty new and nobody knows how successful that will be.

At the end of the day, I feel like this will all crash and burn, but we may end up with some kind of nuclear renaissance. We're also expanding the transmission grid and building more wind, solar, and storage. However, I don't think that alone is going to satisfy the needs of these data centers that want to run nearly 24/7.
Crowdstrike, for instance :^)
Bob Pease has a pretty scathing opinion: https://www.electronicdesign.com/technologies/analog/article...

“Hi, Jeff H., I have almost never used a 555. Maybe never? I use op-amps, LM324's, LM311's, LF356's. I use 74HC04's and 74C14's but not 555's. I've used ECL fast logic, and discrete transistors. But the 555 just does not do anything precise, or even semi-precise, that I need done. So that's one thing I can "share" - my favorite circuit to use a 555, is: a blank piece of paper. Never touch the things. Go ahead and print that. / rap”
"Skeptical" doesn't mean completely against their usage. From the author in the comment section:

> “Embarrassingly parallel” tasks definitely make a lot of sense to do in Rust.
Java is very fast: https://github.com/gunnarmorling/1brc
They acknowledge it in the comments:

> “Embarrassingly parallel” tasks definitely make a lot of sense to do in Rust.
I have come to expect it in politics, but I was surprised to see it in engineering.
i don’t think the workspace memory is op point. if the initial set (not the intermediate or final projection) is too large, reads will come from disk which also creates cpu churn. at least in mssql, if the data page is not in memory it is read into the buffer pool and then read from the buffer bool into the workspace for processing. if there isn’t enough buffer space to fit all of the data set pages in the pool, you’re going to be reading and flushing pages. i think pg operates similarly.
It was from 2014.

In the past decade, we've seen "the middle way" has won.

- Every mainstream OOP languages now support passing functions as parameters.

- Optional type annotation became mainstream, e.g. Typescript and modern Python.
Write in cursive or in print, or even cut letter from a newspaper if you want. If you do it in a classroom in front of a teacher cheating is dramatically reduced
How big of an issue is this really for db users who work daily with large tables that are frequently updated but still have to be fast for queries?

The article mentioned that there are nearly 900 different databases on the market. I am trying to build yet another one using a unique architecture I developed. It is very fast, but although it is designed for transactions; I haven't implemented them yet.

I think if I spend the time and effort to do it right, this could be a real game changer (I think the architecture lends itself very well to a superior implementation); but I don't want to waste too much time on it if people don't really care one way or the other.
The first Mersenne prime since 1996 not to be discovered on x86 hardware, but on an NVidia A100 [1].

[1] https://www.mersenne.org/primes/
Can it remove popups for newsletters, or subscription, or logins, or cookies' notifications? Can it read pages that requires signing in?
> exponentially more

No.

The word means something.

It's bad enough when it gets misused colloquially e.g. by folks on Twitter and clueless podcasters trying to spice up their talking points, but in a thread like this one, it has no place getting dropped into the discussion except if talking about something that actually fits an exponential curve.
Richard Stallman is the giant whose shoulders we all stand on. Without him, would Linux have been such a success?

Your hit piece is dishonest, disingenuous and is a clear attempt at a hostile takeover of the FSF. You should feel shame for what you are doing here.

If it were an honest report you would all attach your names to it but instead you operate in the dark.
Cooked carrot = not processed
Oreo = processed
Soda = processed
Steak = not processed
Sugar = processed

We can keep on going with all possible ingredients and all possible combinations and most sane people will agree on what is called "processed" or not.

This is disingenuous discussion dressed up in smarty pants talk.

Shall we continue or actually discuss something substantive? Like the fact that Americans are morbidly obese and eat 60 pounds of sugar a year. We look like crap.
Thank you, I'm not sure why I always seem to forget that feature. Although I don't like the Google lock-in, on certain sites I can also visit the AMP version of the page, and have fewer ads while also getting the images.
The Great Seal of the United States
That is super cool. Thanks for the factoid!
Indeed, Intelsat 33e has a couple nearby neighbors in similar orbits and inclinations.

ID Name Orbit Incl.
98050A ASTRA 2A 57.2 4.93
09017A WGS F2 (USA 204) 57.5 0.01
14023B KAZSAT-3 58.5 0.02
12008A BEIDOU-2 G5 58.7 2.10
16053B INTELSAT 33E (IS-33E) 60.0 0.04 <-- 20+ debris components
19014A WGS 10 (USA 291) 60.3 0.01
04007A ABS-4 (MOBISAT-1) 61.0 3.86
10008A EWS-G2 (GOES 15) 61.5 0.04
19049B INTELSAT 39 (IS-39) 62.0 0.02

https://www.satsig.net/sslist.htm
Most of the pythons they are bagging are much smaller than that, and YouTubers have an incentive to make bagging a snake look more thrilling than it usually is.
A predictive/generative model of animal "vocalizations" would be almost trivial to do with current speech or music generation models. And those could be conditioned with contextual information easily.
Unless your array is only a relatively small part of the file this defeats the purpose of patching. And yes, concurrency is also an issue in simple cases (e.g. append/prepend) that json patch handles fine on its own.
They should teach it in every MBA program in the country /s.
>if the IRS knows I owe the money better than I do, then why am I involved with this at all?

Well they made an extra $1k by doing it this way. Maybe if you'd have lawyered up you could have got them down to $500 but the point still stands.

Sure, the database and the developers and mailing the letters isn't free but you need to have basically all that overhead regardless of whether they're sending you a bill or a fine. The incentive is there.

On top of that, it costs them nothing to make you file your taxes. In fact they probably rake in a whole boat load of money from all the people who report things the IRS didn't know about or didn't have enough sophistication to attribute to them.
Well we can always go back to gopher:

https://geminiprotocol.net/docs/specification.gmi

And/or start using Gemini:

https://en.wikipedia.org/wiki/Gemini_(protocol)

https://geminiprotocol.net/docs/specification.gmi

I have moved my site to gopher/gemini. It is far easier to maintain and there are a lot of interesting sites sitting there. Just a few:

* gemini://sdf.org

* gemini://gem.sdf.org/

* gopher://sdf.org

* gopher://magical.fish

* gopher://gopher.floodgap.com
This has always been true? The vast majority of scurvy research was unreplicatable bullshit, and for hundreds of years if you “Trusted the Science(TM)” on scurvy, you were liable to die horribly on long ocean voyages. Mind you, if you didn’t Trust the Science you’d die just the same.

Then, someone worked out a theory and replicable experiment (humans and guinea pigs are the only mammals that die horribly when not fed vitamin C) and with a replicable experiment in hand, you could use little s science and now no one gets scurvy, trust not required.