skysight-inc/HackerNews huggingface dataset:
Show HN: esdump-rs, a fast and native version of elasticdump
Hey HN,
The standard Elasticdump[1] tool is really slow and inefficient. We needed to export >50 terrabytes of documents and ended up building this.

The runtime for a single index was reduced from ~2 days to 15 minutes.

1. https://github.com/elasticsearch-dump/elasticsearch-dump
> I totally get banning phones with young kids, but high schoolers should be treated more like adults as they progress through the grades. Some of the kids were entering the workforce or joining the military after their senior year. They should be ready for that.

High school is from the age of 13 to 18; big difference between those two.
> I felt like I was committing heresy when I told my friends that the vision pro was unlikely to succeed or at least succeed culturally.

I'm an Apple-hater but I'd like VR to become a thing. I work remotely and could imagine being sent a keyboard, mouse, and company VR headset that transports me to the office.
Even without laziness, you can get similar problems if f creates a closure or returns something that includes the parameter object.
This is a non-falsifiable nothing-burger. You could've made the same claim ten, twenty and thirty years ago, yet here we are.
One major problem with the Vision Pro as a devkit is it's extremely locked down. The only significant AR experiences you can create are those already anticipated by Apple and compatible with their privacy expectations.

IMO this was a huge mistake. This is a completely new form factor, not an established market. You need people doing significant experimentation, and to be able to create compelling new experiences that your in-house staff haven't even dreamed of. It's fine if you have a user-friendly default, but there should be some way to opt into a professional mode that opens up more possibilities for novel experiences.
There are dozens of us! As far as I'm concerned, CPUs were Fast Enough as of 20 years ago, it's time to start shifting our priorities.
The Black Hole Explorer: Using Photon Ring to Visualize Spacetime of Black Hole
What are the "objectively harmful externalities" you're referring to?
It's really striking to see two things in this thread: (1) complaints about price, and (2) repeated (cjk, lightroom library management, a half dozen other things) that Adobe offers features that have no competition. Feels like Adobe is charging for being the sole provider for various features that people need.
https://news.ycombinator.com/favorites?id=h2odragon&comments...
I mean my Messages app. I installed it years ago and never updated, because why would I ever updated an SMS app, the only thing that can ever happen is for things to break that used to be working, lol. I don't even know if I run A12.

I do know, though, that the OP7Pro is one of the last Android devices that are whitelisted by Google to pass SafetyNet without hardware-backed attestation. Shame that TWRP wiped my working setup. I've been trying to get them to add any basic protection against that for over three years: https://github.com/TeamWin/Team-Win-Recovery-Project/issues/...

It is an amazing phone. Notchless, relockable bootloader (not just unlockable, but custom AVB key support!!), in-screen fingerprint sensor, 90Hz AMOLED, and great build quality.
There are many jobs unfilled. The biggest problem right now is that unemployed people have the wrong skills for the jobs that need to be filled. This trend will accelerate along with technological advances, no matter which kind of economic system is involved.
I've been thinking of doing something with Octavo parts, because my electronic design skills are totally obsolete now and they are simple to integrate. My idea is a board with 16 parts (for 32 cores) with red LEDs lining up one side mimicking a Thinking Machines CM-1 cube. Not a CM-1, but a lot of nodes if you join 16 boards per cube.
It's fine to stream 20mb in a browser as long as it's not part of the core JS.

Browsers can handle many GBs of storage. You can even store them via OPFS directly on the native filesystem if supported. There's also Chrome File Storage API and if all else fails IndexedDB (which is more limited, but works decent for synced databases).
> tiktoken.encoding_for_model(model)

Calling this where model == 'gpt-4o' will encode with CL200k no?

But yes, I do agree with you. I had time implementing non-tiktoken tokenizers for my project. I ended up manually adding tokenizer.json files into my repo.[1] The other options is downloading from HF, but the official repos where the model's tokenizer.json lives require agreeing to their terms to access. So it requires an HF key, and agreeing to the terms. So not a good experience for a consumer of the package.

> Message frame tokens?

Do you mean the chat template tokens? Oh, that's another good point. Yeah, it counts OpenAI prompt tokens, but you're right it doesn't count chat template tokens. So that's another source of inaccuracy. I solved this by implementing a Jinja templating engine to create the full prompt. [2] Granted, both llama.cpp and mistral-rs do this on the backend, so it's purely for counting tokens. I guess it would make sense to add a function to convert tokens to Dollars.

[1] https://github.com/ShelbyJenkins/llm_utils/tree/main/src/mod...
[2] https://github.com/ShelbyJenkins/llm_utils/blob/main/src/pro...
Nobody will click on or continue reading to see ad impressions if it said “biologists still think animals are conscious”. Or “biologists differ over the meaning of consciousness and which exact animals qualify.” Whenever you want to know why news sites do what they do, it’s so they can serve more ads. That’s the business model now.

Also most science reporting is not good. They’re quoting an econ professor. These articles are really written by someone with a deep understanding of a subject matter.

Notice they’re not giving you examples of noted biologists who think all animals are not conscious. There are few to none.

The only statement in here that’s interesting is that bees may be conscious. I think you’d get push back on that, depending on your definition, and the article does mention the difficulty of definition of consciousness.
Why is this counterintuitive? You're describing scheduling -- your high priority service has the ability to preempt the low priority service and use more of your CPU (or whatever your bottleneck is) if there are pending requests.

If you have a high-availability, latency-sensitive service that's processing incoming requests in realtime, you want it to be overprovisioned (for limiting queue lengths, the ability to soak up DoS before other systems kick in, etc). But that's wasteful if you're idle half the time. (Or generally, off-peak -- you might explore spinning up / down nodes dynamically, but you probably still want some baseline amount of capacity in each of your availability zones.)

Another dimension you could explore (if your problem space allows it) is varying the amount of work you perform depending on your current load -- for instance, you could imagine a video server that serves 4k at light load, then degrades to 1080p at moderate load, and then degrades even further to 720p at heavy load.

That said, it depends on your cost model. If you're dealing with bare metal (or you are the cloud) where your principal operating expenses are space and power, then you might be fine with servers idling if power is expensive. If depreciation of your servers drives your costs (or if you get charged the same amount regardless of your actual utilization), then you might want to run your servers hotter.
>Batteries likely last 20 years and afterwards another 30 years as energy storage devices.

Out of curiosity, do you have a citation for 20 year old EV batteries being able to be repurposed for another 30 years? Assuming they are used for gridscale storage, 30 years could very easily be 10,000 charge-discharge cycles (thats slightly less than one per day).

LFP batteries have a much longer lifespan that lithium ion, but in a brief search I cant find any claim that they will last a half century. For example, this article [1] says LFP batteries have a "calendar aging" rate (capacity loss independent of active charge cycling loss) of "ca. 0.2 percentage points of capacity fade per month at 25°C and to ca. 0.5 percentage points per month at 50°C". So, in ideal conditions a battery that is kept in storage would take 20 years to reach half capacity and 40 years to reach zero capacity. Presumably daily charge-discharge cycles would reduce that lifespan significantly.

[1] https://iopscience.iop.org/article/10.1149/2.0411609jes
But in general I believe this is true. I don't think it's as vague as you think it is. I'm not sure I would agree with "dangerous", but definitely "unhealthy".
This has already been accounted for. The article compares the total derailment risk between two 50-car trains and one 100-car train, which normalizes it per car-trip.
So what? Killing a scapegoat does not a problem solve. You shut down facebook and then what happens? Everyone shuts the phone and enjoy the sunset or would they all just move to the next addictive app? Marlboros are not harmful, tobacco is. If we managed to largely curb smoking, it was by restricting access to tobacco.
How far? I.e. do we know what is the improvement (if any) vs competing products?
but will this access point require wifi?
Discussions:

(33 points, yesterday, 50 comments) https://news.ycombinator.com/item?id=40701868

(41 points, yesterday, 112 comments) https://news.ycombinator.com/item?id=40704435
Why would you allow .equals and .compareTo to have inconsistent meanings?
That is a guaranteed source of bugs. I cannot think of a single good reason to allow this. If you need a different order for some reason, that is what the Comparator interface is for.
Do you have any experience in this? I've been wanting to work on an open board with someone that would use a pi or Nvidia Jetson compute module
Does seem biased to not mention the prior US testing, which destroyed satellite Solwind P78-1 in 1985, leaving debris in orbit for 2 decades. (also suggestive of secret testing which may have left more)

There's also an earlier Soviet program described in the article, with many space impacts, tho debris extent isn't noted.

https://en.wikipedia.org/wiki/Anti-satellite_weapon#United_S...
Google Glass was pretty locked down too iirc. Still was a neat device.
The iPhone did it by being essentially an iPod Touch that could make calls. Lots of people were already familiar with iPod and iPod Touch, so when it turned into the first programmable phone, it was novel and exciting, and then the gold rush took off when people started making money and it grew from there.
Arguably they are different things.

Shirky principle states that stakeholders will prefer solutions that keep them relevant, over solutions that would solve the problem conclusively, but in a manner that makes their existence no longer relevant.

This seems to suggest instead a tendency to solve the problem in a way that is conclusive, and thus indeed making them less relevant, but then trying to impose continued relevance by trying to overstate the importance of any remaining and ultimately trivial aspects of the problem. Which is an equally intetesting angle to consider.

I have to say though, even in the latter case, the name chosen is unfortunate, since the organisation it refers to seems to have actually done the right thing after polio was eradicated: they went after other problems (as opposed to keep campaigning about polio).
Dropbox comment. https://news.ycombinator.com/item?id=9224
Same here, or pretty close.

My late wife and I each had our own accounts, plus a third account for mortgage, utilities, groceries, etc. We'd each deposit into the third account, and kept the rest of our finances separate. I made more money, so I'd usually pay when we went out to eat or whatever, but it wasn't an obligation.

It worked pretty well -- unlike most of my married friends, I don't recall us ever having an argument about money.
The Surgeon General Is Wrong. Social Media Doesn't Need Warning Labels
Because you need to be authoritarian to handle large groups of kids. That's the obvious reason. Otherwise you would have anarchy within the school grounds.
I'm curious how battery life is. Please report back once you have done some field testing!
I've never once looked at a study, nor could I possibly care less what some numbers on a paper say when I've got evidence in front of my own eyes. I'm speaking from experience, kids today are smooth-brained idiots that don't understand how to do some of the most basic things in life, nor do they have any desire to learn. I'm not some screeching, out of touch boomer, I'm someone who is in my mid-20s who has grown up floating in this shit-tank, and I'm so tied of watching people around me being preyed on by predatory algorithms.

This is not some "Oh, curse these wretched novels, polluting the minds of our children with fiction!" This is the recognition that we have released a technology with an addiction cycle that has been intentionally built and tweaked to engage users and keep them on their platform as long as possible, and the human brain is not evolutionarily equipped to deal with that, least of all the developing mind of a child. They have neither the self-control nor the awareness of what's going on to determine that they're feeding an addiction that their parents enabled. Getting Entertainment Boxes™ out of places of education is a great first step in that direction.
> An obvious ARM SoC to use in a laptop is the RK3588.

Yup, I've got the RK3588 module preordered for my Reform and I'm looking forward to it. Would be neat to see an RK3588 board for the Framework too.
Fun concept, but this is security by obscurity. Other heuristics:

- providing fake manifests to hardware drivers commonly associated with virtual machines
- active process inspector handles
- presence of any software signed by hexrays (the ini file is usually enough)
https://arstechnica.com/gadgets/2024/06/tdk-claims-insane-en...

Was posted here just yesterday and is a far better article.
Please add 2023 tag to the title.
When I personally don’t hate the topic Yes.
Otherwise, No.
Why do kids even need a phone in school? There is no reason they'd need one since they should be learning a subject. At best they'd need a calculator but there are cheap stand alone ones.

Here in Canada a few schools have said no phones during school even lunch hour. The kids themselves have said they find they feel better and their studies are better.

A phone now would be like allowing comic books to be read in class say in the 1980s.
Just FYI, Adobe's website will port scan you on 16494, 35693, and 57923 after you login.
I only got a chance to scan the article, but it tracks.

I lost my wife 3.5 years ago. She was in her late 40's. We knew she was going to die, and it was an awful process. We thought we were prepared. But there's no preparing. When it happens, everything inside just shatters. Even 3.5 years later, I find myself just bawling at times, and I consider myself ahead of the grief 'curve' if there is such a thing.

I've come to the conclusion that I'll never be over my wife. Even if I remarry, there will always be that part of me that's hanging on.

You don't really heal. You just find a new balance without that person in your life. You go through the motions until a sense of normal returns. But there will always be part of you that is shattered, never to be whole again. Thankfully, it's not fatal to the sufferer.
I would be perfectly content to put PV on rooftops in a place like that, or let others do so, if I lived there.

I own an apartment in the UK, and inquired about putting PV on the roof. There were two reasons why the answer was "no": (1) leasehold, (2) conservation area.

Theoretically, the neighbours who installed satellite dishes (tiny ones!) were in violation of the latter, though in practice nobody seemed to care.
Rotation of Earth's inner core has slowed
Did you win the Putnam? https://news.ycombinator.com/item?id=35079
Show HN: I made website animations easy
Hey there! I'm Sami.

Over the past year, I've been busy building apps for clients, and I always found it challenging to discover a great animated component library.

So, I took it upon myself to learn how to create beautiful animations. It was tough at first, but with persistence and a lot of practice, I eventually started crafting some really impressive animations for my clients!

Now, I'm excited to share some of my favorite creations with you on my platform, DynaUI.

I'd love to hear what you think!
In all seriousness, the main advantage of the P cores is the wider vector datapath. They are much more set up for loopy "grunt work" like matrix math. Web serving probably doesn't need a P core, for example.
That only makes sense if the projects are unrelated... separate budget, different engineers, managers, executives, separate marketing teams, even separate suppliers and supply chains. Obviously, they are related.
Isn't that more a comment on 8-bit graphics resolution? If you want to question society's relationship with gender I'd examine Lara Croft.
Hi Everyone! I would love to get your feedback on my platform!
That's the main difference with France indeed! We have strong regulations over landuse that allows you to build infrastructure over constructible areas (often located around city center). For this type of large-scale projects you will need to go deeper the countryside but we don't have much desert areas here. You'll always end-up close to housing area or historical monuments.
Yeah, this is a common source of confusion with closures in Python. Example on Stack Overflow:

https://stackoverflow.com/questions/233673/how-do-lexical-cl...
And nobody seems to have paid much attention to the Al Jazeera exposé on the 737 NG where Boeing did this and much worse installing substandard "conforming" structural parts on the 737 post-classic NG series pre-MAX. These weakened planes are still flying around. Some will say "There's no problem. It's worked so far." Bzzzt, wrong. Around 90 people have already died due fuselage breakups where 737 classic fuselages survived similar stress in a number of incidents, including one where the Obama White House directed the DOJ to lie about the conclusions in Boeing's favor before the NTSB completed its investigation.
Afaict, you are describing intelligence, not consciousness.
> So while yes, it is disproportionate, I don't think it's hugely so, especially without taking into account other factors - for example, typical solar capacity in winter.

I would say that it is an important point, don't know if I'd go so far as to say huge. The argument that gas plants are a stable baseload which cannot be supplanted by renewables is undermined if they're disproportionately affected by such events.

I agree that they're in a different class, but I don't think that reliability is the right word. I think dispatchable is much closer to the way I understand you using it. Solar and wind don't have a capacity factor of 100% since they harvest energy rather than produce it from fuel, so as the trite meme goes "the sun doesn't shine at night" so you'll need some sort of plan for how to handle the lower output during the winter and at night (i.e. storage, overbuilding, larger grids).

Fossil fuel plants for the most part (they can become bottelnecked by gas pipeline capacity if all your heating is all off natural gas) has a lower capacity factor due to malfunctions or maintenance.

All that to say, I agree with you that wind and solar are not a 1-1 replacement for fossil fuels. I believe that the future is going to leverage their cheap costs when their available[0] rather than try to re-create the current system which evolved due to different constraints.

[0]: Different time of using pricing, larger and more responsive grids, and energy/heat storage (Rondo Energy).
Concerning code signing: Azure has a somewhat new offering that allows you to sign code for Windows (SmartScreen compatible) without having an EV cert. It is called "Trusted Signing" [1], non-marketing docs [2]. The major gotcha is that currently you need to have a company or similar entity 3 years or older to get public trust. I tried it with a company younger than 3 years and was denied. You might have a company that fits that criteria or you might get lucky.

The major upside is the pricing: currently "free" [3] during testing, later about 10 USD/month. As there doesn't seem to be a revocation mechanism based on some docs I read, signed binaries might be valid even after a canceled subscription.

[1] https://azure.microsoft.com/en-us/products/trusted-signing

[2] https://learn.microsoft.com/en-us/azure/trusted-signing/quic...

[3] You need a CC and they will likely charge you at some point. Also I had to use some kind of business Azure/MS 365 account which costs about 5 USD/month. Not sure about the exact lingo, not an Azure/MS expert. The docs in [2] was enough for me to get through the process.
> The human brain isn't randomly initialized. It's undergone 500m years of pretraining.

All of the information accumulated by evolution gets passed through DNA. For humans, that's well under 1GB. Probably a very tiny fraction of that determines how the brain works at the algorithmic level. You should think of this information as the "software" of the brain, not pretrained LLM weights (350GB for GPT-3).
HumanEval is saturated: new coding LLM benchmark released
Google Glasses were significantly lighter and cheaper since they had the same form factor as regular glasses people wear, not some heavy Robocop headset tethered to a brick in your pocket.

How Apple imagined that clunky form factor would be appealing to general consumers outside the most avid afluent fans is beyond me. If they wanted it to be a devkit they should have just market it and sold it at a masive discount directly to app developers unlocked with no strictions so they can experiment in finding that "killer app". Unfortunately Apple's way too corporate, proud and stuck up to think liberally like that.

Google didn't hide the fat that Glasses was mostly a devkit for tinkerers and pretend it was a ready-to-market product, and it served that purpose for that niche.
The better the models get, the harder it is for me to form a mental model of what goes on inside of them.

An example of a prompt for which I don't have a good mental model why it works:

What do you think about the following text?

Joe drove Sue to university. Afterwards he drove home again
and drank a tea with her in the kitchen.

Older models behaved similar to Markov chains and completely missed that something is logically strange here. Newer models still sometimes do, but more often than not catch it.

GPT-4o for example:

There is a slight inconsistency in the narrative.
The text states that Joe drank tea with Sue in the
kitchen after driving her to university, which
implies that Sue is at home, contradicting the
earlier statement that she was driven to university.

Surely nothing in the prompt directly triggered the word "inconsistency". Did the model form some kind of "world model" in its inner layers in which it knows about a person "Sue" who is at a location called "university" after the first sentence?
> Congress (8%), television news (14%), and the criminal justice system (17%)

This is brutal. How does a democratic society survive with these numbers?
Documents Show How Musk's X Plans to Try to Become the Next Venmo
The page was updated to include that.
I find it really surprising that SiFive doesn't come out with their own edition of this but with the latest cores, rather than a 3rd party with an old u74
the guy who pulled 1.3m from multiple remote jobs and lived to tell the story: https://news.ycombinator.com/item?id=31156417