skysight-inc/HackerNews huggingface dataset:
Hi Simon! Big fan of your blog.

I actually generate two summaries: one is part of the ingestion pipeline and used for indexing and embedding, and another is generated on-the-fly based on user queries (the goal there is to "reconcile" the user query with each individual item being suggested).

I use GPT-3.5 Turbo, which works well enough for that purpose. Cost of generating the original summaries from raw page contents came down to about $0.01 per item. That could add up quickly, but I was lucky enough to have some OpenAI credits laying around so I didn't have to think much about this or explore alternative options.

GPT-4 would produce nicer summaries for the user-facing portion, but the latency and costs are too high for production. With GPT-3.5 however those are super cheap since they require very few tokens (they operate off of the original summaries mentioned above).

Worth noting that I've processed stories by score descending, and didn't process anything under 50 points which substantially reduced the number of tokens to process.
I've tried Hyde and seems to work better. had to do it client side tho. asked chatgpt: "write one sentence explanation about this topic: solutions for postgres clustering" which returned "Solutions for PostgreSQL clustering involve implementing methods such as streaming replication or third-party tools like Patroni to manage and distribute database workloads across multiple servers for enhanced performance and fault tolerance." then I searched that:

https://hackersearch.net/search?q=Solutions+for+PostgreSQL+c...

and results are much better:

1.
An overview of distributed Postgres architectures
2.
A Technical Dive into PostgreSQL's replication mechanisms
3.
Ways to capture changes in Postgres

hyde paper is here https://arxiv.org/abs/2212.10496

it's possible that openai embedding are simmetrical, if that the case you need to hallucinate some content and use that as base for the embedding distance calculation. or you can move to asymmetric embedding, or you can try prompting their embedding

edit: prompting embedding seems to work, tried searching for “write an article about: solutions for postgres clustering” and results are much better https://hackersearch.net/search?q=write+an+article+about%3A+...

you can try prepending "write an article about: " to all user searches :D
With tumors the mass matters. Each remaining cancer cell gives it another chance to stumble on a mutation that can allow it to escape your treatment.

BTW, that's also why so many tumor drugs work well in mice.
I used to ride the train with someone at Two Sigma. His hobby was working on better NTP boxes.
If you buy drives based on there reports, make sure your drives are operating within the same environmental parameters or these stats may not apply
Except it is. High shrinkage can be baked into the business model and digital media is a high margin business that can tolerate it. Other industries with high fraud rates don't get cut out wholesale.
This is a physical attack, the attacker edits the URL (as can be seen in the demo video).
He talks about a historical factoid. He also talks about something that can induce pneumonia that's deadly, not just waiting for some common cold to turn to pneumonia in an off chance. WTF about what he is talking about was difficult to parse?
You're right. I screwed up the math.
Depending on your definition of "huge", you might find Piper TTS fits your requirements: https://github.com/rhasspy/piper

The size of the associated voice files varies but there are options that are under 100MB: https://huggingface.co/rhasspy/piper-voices/tree/main/en
All About DePIN
One can blame the private equity investors buying it, but every sale requires not just a buyer, but also a seller. The owner of RL sold it to this private equity firm for an amount they felt was proper. The PE firm got more money out than they put in, so they increased the value of the assets. If this meant (in effect) shutting down RL in slow motion, then so be it. Sometimes it's best to just put a pillow over a company's face and say that's it.
A React Developer's Guide to Learning SolidJS
This makes me wonder how the recordings on the Voyager 1 & 2 spacecraft [https://voyager.jpl.nasa.gov/golden-record/whats-on-the-reco...] will sound if they're ever heard.
According to cdc.gov, the MRSA bacteria which killed him can spread by simple contact with infected people or objects. I can't but recall the anthrax attacks happened shortly after 9/11. It's completely unrelated and 100% speculation, but an infection caught by something received by a intercepted and compromised package couldn't be completely ruled out.
Most hosted options like GKE also fall into this category - networking, load balancers, and to a certain extent monitoring is all set up for you.
Using it unofficially through unauthorized workarounds brings doubt into the chain of custody and investigation integrity.
> Often I hear people say "well pointer size is constant, so log(64) = O(1)", but that is misleading: if you assume constant pointer size, any function of that is O(1) as well, so any bounded algorithm is O(1). The notation just becomes meaningless.

It's not meaningless. We're designing for a real machine here, and the actual goal is to bound the runtime to a small known constant.

You're right that big O is not great notation for this. Hell, even O(1) isn't good enough because the constant factor is unspecified.

But the misuse of notation does not invalidate the problem. Taking the worst case for a log leaves you with a feasible runtime. Taking the worst case for n or n^2 or "any bounded algorithm" overwhelmingly does not.

> Asymptotic bounds must be presented and understood in context.

Yes, context is exactly what keeps it meaningful!
Thank you! Getting to read comments like this really makes all the extra effort worth it :)
"In January, reporting by Bloomberg revealed that OpenAI is working with the Pentagon on a number of projects including cybersecurity capabilities — a departure from the startup’s earlier ban on providing its AI to militaries. Elsewhere, Microsoft has pitched using OpenAI’s image generation tool, DALL-E, to help the Department of Defense (DoD) build software to execute military operations, per The Intercept."

Hm... to my eye, this just seems to be a great spin on essentially pushing cops or their vendors to sign (more expensive, I imagine) independent service contracts under the guise of oversight. Their principles seem to be as genuine as they were in their plea to the US government to cede control of LLMs, generally, to the big corporate players "for safety."
Simple Postgres to ClickHouse replication featuring MinIO
Utilities and carriers can’t just pick and choose customers totally. For example, your electrical utility cannot deny your service based on your political speech or profession or whatever. Even if they are privately owned.

Personally, I think companies above a certain size should not be able to deny customers because they are effectively like public agencies or utility services due to their size. Banks, big tech, large social media platforms should be regulated like utilities in my opinion.
The daddy that expects infinite growth can never be satiated.
This is an interesting analysis but it ignores the fact that although a cheap drone can destroy an $11MM tank, 2, 000 cheap drones do not give the possessor of the drones the same power as having a tank.

Even if Iran or whoever can produce $800 rockets that cost $50k to destroy, we are able to outspend them by such a gigantic margin that it still won’t matter. They could never bankrupt us this way. They will go bankrupt first.

We spend double Irans entire GDP just on defense. Even if they switched to 100% wartime production, we could outspend them forever. Who cares if a tank costs $11MM? We spend nearly $1T per year on defense. Good luck beating that with cheap rockets.

War doesn’t really work this way - we spend $1T on defense but the economic advantage to the US by being the de facto world power is so far in excess of that the cost would be worth it at 10x the price. We could “lose” a million dollars per missile and it still wouldn’t matter.
Youtube Music’s greatest strength is its greatest weakness: integration with Youtube. That means the videos you like become part of your music profile even if your reasons for liking them unrelated to the music. It messes up your profile quickly.
I can give you an entire studio: https://www.spiderwebsoftware.com/

They make extremely niche RPGs that routinely rate >90% in positive reviews on Steam and they've never had an actual hit. Pretty much the definition of cult classics.
It's still less of an issue than Bay Area, and the other parts are more fun.
Sweet! Thanks for sharing. A prior implementation had HyDE running on user searches, but I found the results to be hit-or-miss depending on the query type.

I definitely want to re-explore that though; I think it should be possible to do so a lot more rigorously now that I have a better sense for what people want to search for.
Any particular bit of Kolmogorov biography I should be paying attention to?

Interesting now that, like Bertrand Russell and his Beacon Hill School, ANK was tempted to realise an ideal school, and even involved himself with Potylikhin school. I read somewhere about a playground design, with a climbing structure that was made so that the paths reachable from each other were age-appropriate; I wonder if it'd be possible to create series of questions, such that the distances in between each question would be just far enough that autodidacts could figure out what they needed to learn to reach the next...

Tunnelling documents to the (2084?) future? that sounds like a Явление Чрезвычайное?
I am happy to stand as is:

- you leaving all of my questions unanswered

- you essentially declaring victory, as is the culture of science's style when encountering inconvenient questions, or the unknown.

Congratulations.
Red Lobster did not go bankrupt because of Endless Shrimp. On the revenue side, customers generally have been turning away in favor of competing dining options. On the expenses side, the company has to deal with high labor costs, expensive restaurant leases - and meddlesome PE investors that have led to high leadership turnover.

Going into bankruptcy might actually allow them to address their debt and operational losses
I think we're up to 3 laptops now. [1]

[1] https://www.foxnews.com/us/hunter-biden-laptop-repairman-joh...
The medicaid route is fine as long as you are willing to sign over everything you own once you need any kind of longish term in-patient or nursing home type care. At that point you'll never live on your own again because once you sign everything over you'll never be in a position to own anything again.
Most people, including Tech people, with software just want a list of sensible defaults out of the box. You are installing Calico, Ingress-Nginx, CoreDNS, MetalLB, cert-manager and ArgoCD out of the box? Cool, some deployment/service/ingress YAML later and my workloads are cooking.

As SRE who deals with a ton of Kubernetes clusters, I find a ton of needlessly complex clusters because rookies setting up the clusters didn't understand the implications of their actions and grabbed whatever a blog post said was good idea.
sounds like a fun project for someone. you could go so far as to direct the user to the proper location on a shelf.
Relatedly, the "Follow up queries" in the righthand floating insert are an attempt at finding a decent balance between recovering from failures & giving users enough control on the queries themselves :) See https://hackersearch.net/search?q=postgres+clustering&period...
> The Military Services Don't Care About Suicide

But that is the soldier's job, isn't it ? /s
with no additional context when running on mac/linux/windows, I like boring technologies, doing everything within python running locally while rendering everything in the user's default web browser with basic HTML/js/css
Everything is going to die eventually.

This is some very specific, public, whistleblowers, in the span of months. Not some pool of thousands, or even hundreds people with mere "potential to criticize".
20 friends is very impressive! Do you have any tips for how to do it? If you don't mind me asking, do they also use it to chat amongst themselves / group chats etc - or only with you?

I also recently set up a server, and have convinced my partner and immediate family to join, but I feel I'm going to struggle to get my friends to do the same. Any tips on what works and what doesn't are greatly appreciated :)
Now that would be capturing the full value chain.
I'm baffled by this comment. It's exceedingly rare for two middle-aged and otherwise healthy people to die without warning.

Suicide is the 7th leading cause of death for men 55-62. It's considerably more common than murder.

Both were whistleblowers of which there are allegedly no more than 32 in the last few years.

Barnett hadn't worked for Boeing since 2017, and was being deposed as part of his appeal of his original whistleblower complaint. It makes no sense to think that someone trying to silence him would wait until 7 years and one Netflix documentary have transpired.
I used to really like Red Lobster, for the money they were quite good. Their cheese rolls are still great. That being said, I haven't been in years. Just the other day I went to a Chili's, I remember going to Chili's all the time in high school and college. Hadn't been in a while. The food quality was just so off from what it used to be. I was really disappointed. I honestly am not sure what these restaurants are thinking. Menu restructuring to cut back portions and also quality control is a significant problem. The only "fast casual" restaurant I can think of at the moment that has maintained its relative quality is Outback.
What about Visa and Mastercard blocking Wikileaks donations? Should that be allowed just because they are private?
2 down 30 to go.
Wow, I had no idea it was this bad. I am not really suprised the lengths American spying goes though. Glad not to be living in New York.

>The Domain Awareness System is the largest digital surveillance system in the world

I wonder how it compares to China and if facial recognition tech is as pervasive in America as it is in China.
I mean, honestly, I don't think either my dad nor I did any research on the quality of the DVDs we were buying. I think, for whatever reason, we just assumed that there wasn't a fundamental difference between the cheap and expensive stuff. Obviously we should have researched it more if we were using it for preservation.

I keep a USB blu-ray drive around because I like to have rips of my physical media, and it seems to read CDs just fine. None of my computers have a CD drive built in anymore.
As the old saying goes for backups:

At least 3 copies.

At least 2 different media types.

At least 1 copy off site.

SSDs and flash drives are both NAND flash (albeit of significantly different qualities), so that violates #2.

As for me? I backup onto a local NAS (1 copy) and forget about it (1 media type [HDD], 0 off site). Why? Because impracticality is a fucking hard mistress, that's why. At least I have more than 0 copies, unlike most people.
Anecdata is such a weird thing. In my own NAS, I've had 3 out of 3 WD Red drives, each a different size, die in an identical manner well before their warranty expired over the last several years. SMART says everything is fine, but the drive's utilization creeps up to a constant 100% and its write IOPS decrease until the whole array is slow as frozen molasses. That's in a constantly comfortable operating environment that's never too hot, cold, or otherwise challenging. And yet it looks like I'm the statistical outlier. Other people -- like Backblaze here -- have decent luck with the same drives that have a 100% failure rate here.

Probability is a strange thing, yo. The odds of a specific person winning the lottery are effectively 0, but someone's going to. Looks like I've won the "WD means Waiting Death" sweepstakes.
macros can help with this if you can narrow down the traits you want to support.

https://doc.rust-lang.org/reference/macros.html
Oh no, they will have to use parallel construction, something they TOTALLY don't have experience doing.
One of Peter Lee's arguments in his AI in medicine book[1] is that the GenAIs (GPT4) actually excel at empathy. He gives a pretty compelling example where the GPT is able to empathize very well with a young girl who is having a medical issue. Empathy is part of the training set.

[1] https://www.amazon.com/AI-Revolution-Medicine-GPT-4-Beyond
Doesn't matter. It's same as any tech. Need to understand mathematics and algos and have great fluency in code. Can't speak for the other guy but I suspect he's same: no amount of skill "aligning stakeholders" and "managing cross-functional teams" is of much use in the business if you're at a prop shop. Have to be able to write code. No "blocked on other team", "Kernel Timestamping API is undocumented" etc.
Be an ML Engineer, Not an API Caller
Avolonia [1] is actually cross platform. I really doubt Microsoft will ever support Linux desktop GUIs.

[1] https://www.avaloniaui.net/
HIV doesn’t kill people, secondary infections do after either the virus or drugs administered kill the person. Regardless, in a given year, less than 1% of people with HIV cited as the underlying cause listed die, far less. Currently, it’s 2/100,000 cases. At its peak, it was 16/100,000

https://www.cdc.gov/hiv/pdf/library/slidesets/cdc-hiv-survei...
AI is a giant liability shield. You can blatantly steal shit and profit of it. Of course enforcement agencies are going to have a field day with it. Announcements like this are just a pretense that they aren’t already counting the money.
> Have you seen this more recent data that includes AVIF? https://cloudinary.com/labs/cid22

The graph from Cloudinary uses libaom to do the encoding at speed preset 7 (aom s7), which is far from speed preset 0 and disables many AVIF coding tools. I do not know why this was chosen by the author, but it does not reflect AVIF performance. According to https://github.com/AOMediaCodec/libavif/issues/440#issuecomm... speed preset 8 loses 20-35% compression efficiency.
Surely investors value parent company less if the company has $6.5B less than they would if the same company had $6.5B more.
Location: Starkville, Mississippi
Remote: Preferred
Willing to relocate: Yes
Website: https://sergiopichardo.com
Technologies: Node.js/TypeScript, PostgreSQL, Amazon Web Services
Résumé/CV: https://sergiopichardo.com/resume-sergio-pichardo.pdf
Email: sergiopichardo@proton.me
you can run a tunnel client on any server and as long as the server has outbound internet access, you can publicly access this server via Cloudflare controlled domain. You can also have standard CloudFlare perks in this way such as CDN and rewrite rules. You don't need to have a reverse proxy server, no need to rely on static IPs or inbound firewall rules in the data center. So you can freely create and destroy droplets they can have different IPs each time.
I'm sure that is true. I just know the C# developers I work with now and recently fall into the camp I mention.
I am more concerned about the surgery to unblock the urethra, which is often needed, becauseof the urinary incontinence that might result from it.

Prostate cancer, as others have mentioned, is guaranteed, like death. But it is not something that affects most men's life beyond the worry of getting it.

Going offtopic: Colorectal cancer is a more pressing matter for older adults. Correct Screening saves lives.
AdvPrompter: Fast Adaptive Adversarial Prompting for LLMs
I agree with you in that the population size is the key question here. However, I have two issues:

First, otherwise healthy people don't just die from stress. Stress can sometimes exacerbate underlying health issues and lead to a long, downward spiral in health that can result in death, but it does not happen in a matter of just weeks or a couple months. It also does not happen in people without underlying health issues.

Second, while a mortality rate of 0.001/yr is reasonable for middle-aged men, that assumes we know nothing about them or their deaths—that isn't the case here. John Barnett's death was a suicide. According to the CDC, there were 14,668 suicides in the 45–64 age group in 2021. The 2020 census shows that there are 85 million people in the US in that same age group. The suicide mortality rate comes out to 0.00017, which is about an order of magnitude lower than your estimate. Josh Dean was otherwise healthy from what's being reported. Given his age and state of health, his 1-year mortality rate is also likely substantially lower than your estimate
It's a great era to be a hardware nerd.

TSMC got so far out in front of everyone that their competitors had to get creative and solve other issues.

Why is this on 7mn? Because I dont think you could do this on 3nm. It is my understand that everything down at that scale is double shot/imaged to get the right sized components, and with that a higher defect rate.

Look at what intel is doing, and holding out for single shot processes. Their pushing of double sided chips (power on one side and data on the other) would be impossible with the 3nm double shot (I cant see flipping the die as being a good way to get reliability in alignment for 4 imagings..)

I suspect that were getting to the end of size (shrink) scaling and were going to get into process and design scaling. Going to be interesting to see what happens to cost and capacity if we're at that point. Process flexibility would be the new king!
> 20% of grocery store milk has traces of bird flu

It shall not be given to cats then. /s
I'd add that it's also a function of revaluing the assets, and then determining if the return on asset value is appropriate.

Take a small restaurant. Grandad bought the building 50 years ago. That's long since paid off.

The restaurant makes say 10k a month. Good honest business. But the building/land is worth say a million.

The owners don't care, it's paid off. The business makes a good living.

So I come along and offer 500k for the business. That's basically 4 years profit up front. They want to retire soon, so that's good deal. But I turn around and sell the land for a mil. I've made a big profit, and since rent is now 10k, in only a few months the restaurant goes under.

The root problem is that the business is delivering a really poor return on asset value. Which opens the door to someone buying the assets, not the business.
Agreed. Being a whistleblower is probably very stressful.
AI-native startup ain't the same as a typical SaaS company
Yea, biggest thing I see missing in EKS/GKE/AKS is they don't come with Ingress Controller out of the box which is really frustrating. By default, they really should install Ingress-Nginx unless administrator asks for not to be installed.

It's pretty minor problem overall though.
Latest Vercel AI SDK Update
The question is, how does this do at GeoGuessr, where users are given a picture from Google street view, and are asked where it is on the world by clicking on a map of the world. Users get points based on how close it is, user with the most points after N rounds, wins.

The best player in the world, Rainbolt, played against an AI out of Stanford, so I wonder how this one would do.

https://www.geoguessr.com/

https://www.youtube.com/watch?v=ts5lPDV--cU