skysight-inc/HackerNews huggingface dataset:
It's a little surprising that this works at all, since the partitioning step in the radix sort is itself the same kind of sharding operation. But I guess that's because it allows for working on smaller pieces at a time that fit in whatever cache they need to.

> Python can't really reserve space for lists, but pretend `reserve` did that anyway.

FWIW, you can pre-fill a list with e.g. `None` values, and then replacing those values won't cause resizes or relocations (of the list's memory - the elements are still indirected). But of course you'd then need to keep track of the count of "real" elements yourself.

But of course, tricks like this are going to be counterproductive in Python anyway, because of all the indirection inherent in the system. They'll also get worse if you actually do have objects (unless perhaps they're statically, constantly sized, and in a language that can avoid indirection in that case) with a "group ID" attribute, rather than integers to which you can apply some hash function. Some test results, trying to approximate the Rust code in Python but with such objects:

https://gist.github.com/zahlman/c1d2e98eac57cbb853ce2af515fe...

And as I expected, the results on my (admittedly underpowered) machine are terrible (output is time in seconds):

$ ./shard.py
Naive: 1.1765959519980242
Presized: 2.254509582002356
Library sort / groupby: 6.990680840001005
Simple radixing first: 3.571575194997422

It's important to understand the domain. For Pythonistas, simple really is better than complex. And identifying the bottlenecks and moving them to a faster language is also important (Numpy isn't successful by accident). The naive result here is still, if I'm understanding the graphs right, dozens of times worse than what any of the Rust code achieves.

(Edit: merely "several" times worse. I forgot that I told `timeit` to run 10 iterations over the same input, so each test processes ~10M elements.)
First, let's talk about surviving death by metrics.

You need to be thinking internally about why things aren't getting done faster. What are your bottlenecks? What is slowing you down? In your mind you should be done with an assignment in roughly 2 hours and frustrated when the assignment takes longer. If an assignment does take longer than 2 hours write down why. You can keep this to yourself if you have to, but it is better to expose this as a series of comments on your work item.

If you are slow because internal processes are slow and you have to wait 10 seconds between each mouse click you have a serious problem that is beyond your control. You need to be screaming about this with anger, because apparently your job is at stake. If you are in framework hell that requires 10 steps of unnecessary stupidity to accomplish what can be done in a line of code otherwise you have a serious problem to be angry about. If you are slow because solutions to the programming logic do not instantly come to you then you have a cognitive problem that may or may not be solved with extended practice outside the office. Whatever the issue is you need to write it down for your own personal metrics so you can keep ahead of the office metrics.

At my last job everything was slow and everything was full of regression. I was slow because the product was incompetent with logic stuck between SQL insanity and framework hell. Furthermore, I was constantly fixing regression from other developers. I lost that job and didn't really feel bad about it. At my current job I am absolutely crushing it. Even with a low work ethic my productivity is extremely high and they promoted me before everybody else. It is not about how hard you work but what you accomplish.

---

Second, let's talk about the job market.

If you want to be employable then have what employers care about. You really need to ignore what is popular for developers. Things that helped me find employment (I don't have all of these, btw):

* security clearance: secret, top secret, common public clearance from the FBI, and so on

* security certifications: security+, CASP, CISSP, and so on

* business certifications: PMP, Lean 6 Sigma, business titles, and so on

* education: bachelors, masters

* diverse years of programming experience: product design, architecture, test automation, A/B testing, and so on

* writing skills: blogs, published articles, published technical documents, and so on

The ones that landed my current job were the diverse years of programming experience, security clearance, and security certifications. What earned me the latest promotion was leadership, writing ability, and productivity. For me the goal before the promotion was to do as little work as possible and be otherwise invisible, which meant getting work done quickly in the best possible quality so that I didn't have to revisit it.
First Geared CVT Could Be a Holy Grail Transmission
> LLM tries to open a URL? Prompt the user.

That only works in contexts where any URL is an easy warning sign. Otherwise you get this:

"Assistant, create a funny picture of a cat riding a bicycle."

[Bzzzt! Warning: Do you want to load llm-images.com/cat_bicycle/85a393ca1c36d9c6... ?]

"Well, that looks a lot like what I asked for, and opaque links are normalized these days, so even if I knew what 'exfiltrating' was it can't possibly be doing it. Go ahead!"
I don't get the use case for this, all Logitech keyboard and mice are supported with the default USB/Bluetooth HID drivers shipped by any OS in the last 20 years
EU Escalates Pressure on Apple to Open Up iOS Features to Rivals
I should have looked at the comments before I started writing the code. I'd have replied to you otherwise :) (see https://news.ycombinator.com/item?id=42459055 .)
It’s also running on a microcontroller with a few hundred kb of memory so even win16 or macOS classic would be a bit heavy.
We don't have a reliable age for the Great Pyramid. Since we can't do radiocarbon dating on rocks, all of the estimates are based on somewhat circumstantial evidence. It could be much older, possibly with some more recent maintenance. I'm not claiming any particular age, just that we don't really know.
https://archive.is/mMre4

EU-proposed changes for iOS 19: https://digital-markets-act.ec.europa.eu/document/download/8...
But why do you think your problems would be solved by an SUV or a pick up? There are plenty of family cars that are way more practical for the purpose than any of those.
Home schooling is a signal of at least somewhat off the rails parents where I’m from (not U.S.), if these folks have similar experiences what they’re really expressing is surprise that your parents were… normal… but still decided to homeschool their kids? Or that you turned out ‘normal’ despite your parents. You are a significant update to people’s posteriors.
What Is the Oxford-Style Debate Format?
If you've disabled completions and didn't know about chats, what were you using Copilot for?
I have also met teams at FAANG where a foreign born boss’s team is 90% or more H1-Bs from their origin country. Kind of suspicious.
> reduction of the worker to a fungible interchangeable cog

I see this trope a lot on HN, and I don't understand it. All of the highest skilled developers that I have met are the quickest to adapt to new projects or technologies. To me, they look like a "fungible interchangeable cog".

And every solo dev that I ever met thinks they are God's gift to the world -- "tech geniuses". Most of them are just working on their own Big Ball o' Mud, just like the rest of us working on a team.
Apple in talks with Tencent, ByteDance to roll out AI features in China
> ASN.1 DER, BER, or OER? Or XER or JER!

My opinion is that DER is better. (However, DER is a restricted form of BER; any DER file is also a valid BER file, but has certain requirements of the encoding, so that it is a canonical form (the other canonical form is CER, but my opinion is DER is better).)

> Every programming environment has a way to talk about ASN.1.

Not all implementations are well-designed, though; I can see many implementations of ASN.1 that are not well-designed. I made up my own, to hope to be better, but we will see what is (hopefully) better.

> But what we don't need, IMHO, is more investment in "simple" technologies like varlink that end up being too simple

I agree with this, and it is important. This is my intention when I was designing stuff, to not be too simple nor too complicated; most stuff I see tends to be either too complicated or too simple, so I try to make stuff better than that.
>Nobody worth their salt believes just this and nothing else.... and that this depends on the pattern of access (mainly, does it exhibit "locality").... If you don't know this, you don't know one of the first facts about caching.

Not necessarily specific to this issue, but I've found that surprisingly many people out there are not "worth their salt" in areas where you'd really expect them to be.
The AGL distribution is more like an SDK, as it's a fork of Yocto embedded Linux which focusses on building/cross-compiling to a specified target architecture and creating the firmware images.

I guess the difference of AGL is that they implemented kernel mods so that they can guarantee ASIL-A/B/C/D spec compliant behavior which was the deal breaker when vendors were considering an RT Linux kernel over e.g. QNX (which focusses heavily on ISO 26262 compliance).
Thanks! This is timely. I just spent an hour of my working morning fiddling with my Ergo K860 keyboard after changing it from Bluetooth to Unifying receiver. Having to find the secret reset key sequence, swapping ports, restarting everything, argh!
That only lasts a year I think? Mine was cut after a while. Although I had stopped using it before that point.
Ask HN: what great blog posts have you read that never got much attention?
I am mostly concerned by the ongoing maintenance cost of software. Cars live 20,30 years - how to keep the software running and in good condition?
Foss is no solution, especially due to regulations (totally warranted, I want your car to have working braking systems...) and that this also involves systems at the producers.
> but rather the fact that the bible makes errors in his history likely to cover up well known facts about him at the time.

Out of curiosity what errors are you referring to?
That’s a weird comment. Node.js is a stack that works on top of an OS. If you could just plop it on a SD card and boot a computer with it, it would be a OS. Things like DOS or MacOS 9 were definitely operating systems. There is no reason to restrict the term to those with preemptive multitasking.
Thank you for your reply.

Yes, I was asking about new data sources, so for example if I wanted to add Github to query my GH issues with Musoq, how I would do that.

Great, I'll check out the links!
Easiest way to skip the back and forth is give some variation of "Why are you browbeating me over this?"
Has the sparks of AGI paper been retracted yet?
Nice! I wrote about something similar for rectangular layouts: https://maxhalford.github.io/blog/dynamic-on-screen-keyboard...
> Very similar structures, with very different memory requirements and access speeds. I can count on one hand with no fingers the number of times I've seen an array used.

That is obvious when you actually check the access speed of arrays and find out it is about half that of lists on small integers (under 256), and worse on non-small integers. That is literally the opposite trade off of what you want in 99.99% of cases.

Deques are even less of a consideration, they’re unrolled linked lists so random access is impossible and iteration is slower, you use a deque when you need a deque (or at least a fifo), aka when you need to routinely manipulate the head of the collection.
> One would assume that such a powerful entity operates transparently and adheres to strict monitoring practices, as outlined in their own Code of Conduct (Section 8)3. Unfortunately, that's far from the case.

That sounds an aweful lot like how DMCA takedowns works in the states.
The dead are dead - they cannot hear those prayers. God may be able to but if he hears our laments to our lost loved ones, even if we ask them to help us, I cannot conceive how he could anything but pity us, he loves us after all.

People punish - Jesus loves. That's a super easy way to see the lies from the truth
"Stojkovic and his colleague, De-Chang Dai of National Dong Hwa University and Case Western Reserve University, also suggest looking for PBH evidence in celestial bodies with surprisingly low masses. They posit that if a PBH shot through a body such as a planet, moon, or asteroid with a liquid core, it might get trapped inside and vacuum up its center, hollowing it out until an external impact dislodged it."

Please explain how this phenomenon would lessen a celestial body's mass?
Haha thanks
Perl was 1 line vs. 100 lines in everything else, in text processing. Now it is 1 line vs. 2-3 lines that are clearer and have stricter semantics. It also has support for running oneliners straight from cli. You probably don’t want to learn it today, as it won’t make that big of a difference.
Wow, today I learned.

I'm gratified to see that the lizardman coefficient is consistent. In the chart, 2% of "None/Atheist/Agnostic" apparently attends religious services every week.
That's also the argument that Bryan Caplan has been making for years in favor of open borders. I genuinely don't know what to make of it, I get the moral argument within it.
Does this use pgVector?
Long-term maintenance is a confounding factor of course. People sometimes write software faster with the downside that it wil be harder to maintain.

So remove the confounding factor (at the same time removing most projects we would like to apply this to) and it becomes an easy problem?

But there are many confounding factors. Your data science project results will be different (different metric values outputed) and you don't know which one is correct, or closer to correct. Now how does the "projects/month" number look?

Or maybe one of the engineers uses way more compute-hours for getting the job done. Their projects/month number is better, but is that really a better outcome? Compute is not free.

By the time you remove most confounding factors, the productivity measure will only apply to an insignificant number of projects.
Really? You're surprised? You're surprised that a country and industry continuing to suffer from ongoing layoffs after layoffs, both stealth and honest, could possibly be negative about their government saying "yeah, let's bring in _more_ foreign workers while our own citizens can't find or keep their jobs"? The audacity!
There could be a million reasons for the behaviour in the article, so I’m not too convinced of their argument. Maybe the paper does a better job.

I think a more convincing example was where they used fine tuning to make a llm lie. They then look at some of the inner nodes. They could tell the llm knew the truth internally but switched outputs right at the end to lie.
I don't believe this at all. I followed the Maverick for a while when it came out, not for me, but interesting strategy.

The vast majority wanted the baseline, barebones. However, Ford produced the least of these, and gave people 1 year lag times.

Most people who bought higher models did so begrudgingly. Yet Ford will claim higher sales on these upper models, so obviously "what the consumer wanted."
Just switched from logi options to Steer Mouse myself.

You can map the buttons and add chords. The only thing it might lack is being able to use mouse movement as a trigger (eg hold the back button and move left to change spaces). Still looking for it

https://plentycom.jp/en/steermouse/
Deploy a Dynamic Blog Using Cloudflare Pages, D1, R2, and AI
What ever happened to this? Is it still an active project?
I’ve come to few conclusions about this recently.

1. Most people will never believe in UFOs until they see one for themselves in an unambiguous way or hear a report from someone in person that they believe is credible. There is too much stigma around this topic.

2. There is a very large amount, probably 1000s records, of credible and consistent evidence out there. However 99% of it is circumstantial and will never be viewed by the public at large.

3. The military, after years of reporting and chasing, can’t be bothered investigating anymore. This seems to be cyclical.

4. A culture/civilization/whatever that has these kind of technologies would have immense power if they wanted it. It’s just too terrifying to believe in, especially if we don’t know what they want.
Whatever reason to skip text formatting does not make it more readable.
Where I work, we have a directive to use AI as much as we can wherever possible. I was handed a codebase that's been working on by many, many, many different people over the past ~2 years and was written almost entirely with AI (starting with GPT 3)

The only way you can deal with the codebase is to fully embrace the AI. Whenever I want to make anything beyond a simple API change, I have to boot up Cursor and give it 5+ files for context and then write a short novel about what I want it to do. I sip some coffee while it chugs away and spits out some changes, which I then have to go and figure out how to test. I'm not fully convinced that the iteration time is any faster, and the codebase is a hot mess.

It also just feels very stifling and frustrating to me to have to write a ton of prose for something when I'm used to being able to write code to do it! I have to go home and work on other projects without AI just to scratch the itch of actually programming which is what I fell in love with all those years ago.
It resembles a hierarchy wherein a small fraction of memory - a "cache" region - can be accessed much faster than the rest. With careful planning, the programmer can increase the odds that the necessary information for the next step of an algorithm, at any given point, is within that small region. (This is a simplification; there are actually several layers of cache between a CPU and the most general part of the RAM.)
> But probably the best magic trick for Java programmers is debugger hot reload. You write some empty methods, start the debugger, and then code iteratively, reloading as needed. (Set up the data and interfaces right, and change method bodies as you wish.)

Do you have any example you can point to for this ?
if it was dislodged, all the mass it had vacuumed up would go with it?
Very valid criticism.

So far the health data is stored within watch and the iPhone. I'm currently fine with it, but planning to export the data and analyze it in future.

There are various existing tools to export and analyze Apple-Health data already[1].

[1] https://github.com/topics/apple-health
What’d you switch to from JVM?
Artem Kirsanov has many great videos on this subject most of which I fail to absorb on first pass.

https://www.youtube.com/@ArtemKirsanov/videos
> We won't re-teach linear algebra to a developer applicant but we will pay a tech writer to go to school nights/weekends to get a degree in engineering (me, I did that).

Why? Linear Algebra is certainly something that can be learned faster than a degree in engineering. I expect the average software developer (someone that can understand algorithms) can achieve competency in less than a semester's worth of time. If someone is a good developer, learning specific skills sets for the domain is pretty normal.
Yes, its a continent-spanning grassland. But humans don't eat grass. Sourcing water is also a problem. It's inhospitable to humans without some reliable means of turning grass into nutrition. If we're talking about early humans it would be a significant barrier.
To be honest I would be more inclined to install their driver if it did not include ugly Logitech branding and respected a bit more the OS it runs on. I don’t care about cross platform UI in an application for mouse settings, it’s simply not my problem. It has 1 window, FFS. How hard is it to use native toolkits?
Yes! what's the part you have trouble with?
God is in 3 parts that comprise a whole in their sum.

Legislative, Executive, Judicial = Govt of US
Strike 1, 2 and 3 = an out
Mind, Body, soul = A person

I could list hundreds of these examples.

3=1 is a rule found all over reality. The easiest way to create something that will exist for awhile, as it has a sound foundation, is build the foundation in 3 parts that make the whole.

Almost all dichotomies have a hidden third aspect. The fight is over how obvious it was at the time - the church was scared people may discover the secret way to create like the divine, so they convoluted it until they couldn't understand it uniformly anymore.
Learn AWK. It's tremendously simpler than Perl, and even more omnipresent. In a week or two of study and tinkering you'll be an expert.
It's bluetooth 5 with more tx power as far as I understand
Because why wouldn’t we embed the whole Chromium runtime to show the user a couple of checkboxes?
Other comments are on the mark, but still, very cool to see such a young language leaning so hard into wasm components / component model. Other languages have a lot of work to do to support the poly-language polytopia we hope to be heading for; starting with wasm components as an early objective can hopefully set yourself up for a long beautiful future of being really good at the new standard virtual machine.

> MoonBit has supported the Wasm component model and reduced the code size to 27kB in the http-hello-world example—much smaller than other languages, making MoonBit-wasm ready for production usage.
One liners. I dropped ruby when it could not express various one liners as well as perl can.
IF Meta is the benchmark for “good” pay, then this is nuts.

There are far more people who need code, than just the people at FAANG companies.

Are you saying that these firms are economically uncompetitive, with META, and should shut shop?
Dupe (146 points, 3 days ago, 79 comments) https://news.ycombinator.com/item?id=42432374
I see it a bit that way: while osquery focuses on OS-level queries and steampipe on cloud services, Musoq is more developer-centric, I'm using it like swiss army knife for various thing, something like sed or grep. You can ofcourse create plugins that covers what mentioned tools do or even, use that tools as a plugin for musoq but in general - I'm not going to compete with any of them, I'm filling my own niche - flexible developer tool.
I think that this is an attempt to stop the “clean key” problem. Security system keypads (especially outdoor ones) tend not to be cleaned, so as time passes, it is easy to spot the dirty keys. Dirty keys are not being pressed and are therefore not in the passcode.

So look for the clean keys and try combinations from there. In a 4 digit (0-9) keypad, knowing the clean numbers drops the possible codes from 9999 to 24 (if my early morning math holds up).

Also helps the issue of someone looking over the shoulder of a valid person. Chances are they are just seeing the position and not the character pressed. So the keyboard changes and you actually need to know the character not just the old position.
The only single-character sigils I can think of are '&', '*', '\'', and maybe '?'. Am I missing any?
Spring Data can be ridiculously productive. It is definitely in the magic category, but you can just have an interface with methods named in a specific way, and then just call that from a controller class, and you have a REST API that calls into your DB for any of the usual CRUD queries immediately. And it's not even just a hack that works on the easy case, you can annotate it with complex hand-written SQL (both db-independent, but feel free to use native queries), and easily extend them with real implementations if you need more control.
Try avoiding Amazon this holiday season, to not cross the picket line.
Not, on my iPhone 14...gotta have the 15 or 16
Yeah, OK, it did say that. But the reasoning behind this rather complex scenario (i.e., the process) is left up to us to figure out.
"The thing came in here, sucked out all the juice, and then left a while later leaving just the crust behind, like an old chewed out tennis ball."