skysight-inc/HackerNews huggingface dataset:
The full dataset is quite huge (~9 petabytes and growing) out of which I'm using just ~8 terabytes.

The data is freely available from the Climate Change Service [1] which has a nice API but download speeds can be a bit slow.

NCAR's Research Data Archive [2] provides some of the data (as pre-generated NetCDF files) but at higher download speeds.

It's not super well documented but I hosted the Python scripts I used to download the data on the accompanying GitHub repository [3].

[1]: https://cds.climate.copernicus.eu/cdsapp#!/dataset/reanalysi...

[2]: https://rda.ucar.edu/datasets/ds633-0/

[3]: https://github.com/ali-ramadhan/timescaledb-insert-benchmark...
I’m working on an internal tool. Maybe 30-40 “customers” total. I say it’s production because it has to be reliable.

We just don’t want to rent a GPU for this little thing. It draws up reports once a day, so it’s okay if it takes a couple mins. It’s work that took a single person maybe 2 hours to do before.

I’ll need to look into triton, I haven’t heard of that yet!

If you have any resources for running models in production that you’d be willing to share, I’d appreciate them.
For me, would be that you earned the billions yourself.

Getting the right attitude, connections and perspective on life/business on how to approach things, is something that you need to learn/observe early on from your parents.

That's almost always related to your parents being rich in this case ( multiple millions), but not billions.

Bill Gates, Elon Musk, ... Are all self made billionaires. But their parents were still rich before they were billionaires.

That's my perspective fyi.
The ONS data linked the comment you're replying to is clear that it counts "vaccinated" from the day of vaccination. What ONS data are you referring to which "used to have the obvious flaw that people dropping dead 3 days after their first dose were defined as unvaccinated"?

> By now there is a hell lot of data pointing at issues with the novel pharmaceutical product.

Where?
Thank you VERY much!
> Anyone who's played Outer Wilds should disagree with this.

Not exactly about death, but certainly grieving things like the emotional blunting of psychiatric medications, inability to accept love or forgiveness, and lines like:

> I'll pretend bein' with you doesn't feel like drowning

Sounds decidedly less hopeful to me than that track from Outer Wilds

live: https://www.youtube.com/watch?v=psIRw0d509w

studio version: https://www.youtube.com/watch?v=G-XICfi4j3Q
GraphCast was trained on this exact same data!

From https://deepmind.google/discover/blog/graphcast-ai-model-for...

> Crucially, GraphCast and traditional approaches go hand-in-hand: we trained GraphCast on four decades of weather reanalysis data, from the ECMWF’s ERA5 dataset.
World Chain, a new blockchain designed for humans
It's a shame that the CEO started reddits downward spiral. I used to be a heavy use and definitely contributed a lot of technical comments. However, their choice to cut off people accessing content via the API so that they could both sell access to user data, and kill third party clients to force you to view their ads caused me to delete all my comments and stop using the site.

I actually have no problems with anyone using my public comments for training AI or other purposes, that's why I make them public. But changing the contract on me and denying access to my data and instead crow about selling it, while ALSO forcing me to view ads unless I pay a very steep fee? No freaking way.

By making reddit "closed" in this way I suspect it will very quickly degrade. Already many communities are gone or vastly less useful due to the better and more knowledgable posters leaving for the same reasons.
My fire department still gives out pagers to firefighters who respond from home. 99% of the time we get alerts from a phone app, but a few times it's gone down and we have to rely on pagers and a big horn that sits near the center of our local.
It is a long discussion, but the TL;DR version is
Puritanism.
I got downvoted for saying a true fact? that I ordered a the new M1 Max in 2021 and it took almost a year for me to actually get it? it true.
> market cap

that means it should have competition. The fact we all agree to just dump money in ONE company is dumb and inexcusable. The fact you just use market cap in a phrase as meaning profits for one company is stellar.
you're right, my threat model is vector DB provider gets hacked, like you.

It's not silly because it takes 1 swe week, max, from start to finish, to just do it in memory locally. You don't need the Vector DB(tm)
If you enjoyed Dune II, and also enjoyed later Westwood RTS games, go download openRA and find yourself a "totally legit" copy of the game disk for Dune 2000, which was a remaster of Dune II on the engine used for Red Alert games.

It features way better controls, a really good soundtrack, and full video cutscenes with actors! It's very fun, and feels so much more mature and polished than the original, though if you grew up with the original you might not feel as nostalgic for it.
tons and tons of papers, most of them had some disadvantages. Can't have the cake and eat it too:

https://arxiv.org/html/2404.08801v1 Meta Megalodon

https://arxiv.org/html/2404.07143v1 Google Infini-Attention

https://arxiv.org/html/2402.13753v1 LongRoPE

and a ton more
Yeah but this does not explain

Starting in 2020, the Faculty imposed a freeze on fundraising and hiring

(note the date)

More likely the freeze and the smear have a common cause, rather than one causing the other.
It’s not pure chance that the above calculus shakes out, but it doesn’t have to be that way. If you are embedding on a word by word level then it can happen, if it’s a little smaller or larger than word by word it’s not immediately clear what the calculation is doing.

But the main difference here is you get 1 embedding for the document in question, not an embedding per word like word2vec. So it’s something more like “document about OS/2 warp” - “wiki page for ibm” + “wiki page for Microsoft” = “document on windows 3.1”
I haven't noticed anything bad about it, except for certain critical systems aren't up to snuff.

That's less because they're bad, and more because those applications demand real excellence when the whole world, probably including your own citizens just for the lulz, would like to hack your water system controls.

Most apps seem to have good enough security. People aren't getting constantly hacked like they used to despite the attack surface being so much bigger. Sandboxing and safe languages do a lot, and things seem to be getting more secure (At least relative to the size of attack surface), not less.

The security issues we do have seem to be less because people aren't trying, and more because nobody is perfect and if you make literally everything digital, and use complex abstractions, that's a lot of potential mistakes.

But at the same time, it reduces some older analog security issues, like someone stealing your cash if you carried lots or someone reading your diary if you left it out.

I suppose for some people those issues might be less emotionally distressing since they feel more in control than they do with computers though.

I did notice software before about 2018 seemed to be bad, probably because nobody cared about performance and just threw around that one premature optimization quote, but it seems people rediscovered optimization.

Perhaps current software would be bad on pre-2018ish hardware, but for the most part software doesn't seem to be getting slower, and hardware continues to get faster.
Nowadays the reddit engineers perverted the link system for old reddit users. New reddit users link to posts using a syntax that for old reddit users returns the submit a new post page.

Also, just to twist the knife further, old reddit users can't open full resolution images hosted on reddit anymore. Click a link and you get thrown to this url:

https://old.reddit.com/r/funny/comments/media/nice_hat/?url=...
Hundreds of Small Presses Just Lost Their Distributor. Now What?
I miss doing “random” renormalizations in physics problems. Though probably best we can’t renormalize the universes QM OS itself. ;)
I was introduced to Django's music in the first Mafia game. It's part of why it's one of my all time favourite games.
People are absurd with their downvotes. I got downvoted for saying it took almost a year for my macbook to arrive once i ordered it. Its true. But its also true that supply chains were a wreck at the time. Apple wasn't the only tech gadget that took forever to arrive.
Oops, I meant the TCP/IP stack. Tailscale SSH uses a userspace network stack.
https://archive.ph/0dIa2
Show HN: A no-watermark video downloader for Any social media
Hi HN reader,

I'm a solo-founder navigating product market fit. I've spent 3 years building Double Subtitles which I am very proud of, but I don't know how to do marketing and my growth is somewhat stagnant. Through learning about SEO, I discovered this opportunity that I want to share:

There are a lot of websites that let you download social media videos, which have extremely high traffic. But they are all disjoint, in the sense that some download TikTok videos, while others download Instagram videos, others YouTube, etc...

I quickly prototyped software which downloads any video from any link. Currently the live version of FastDownload only supports TikTok and YouTube videos, since they are the most stable. But I will slowly start rolling out Instagram and other services weekly.

ps. Personally, what I think is really cool is this Apple Shortcut, which lets you download videos directly from within whatever app you're in, using Share Action Extensions.

pps. Another thing I'm very excited about is that while doing analysis with Ahrefs and SEMRush I have been able to identify many high value keywords which I'm deploying pSEO strategies for now.

I hope this product is helpful and any feedback (even negative) would bring me joy.

All the best,
Bojan
What do you mean by the heat distribution of energy? Do you mean like how much heat is received from the sun at a particular location and particular time? If so, then temperature is only the result of this plus other factors. Factors like cloud cover influence how much radiation is received at the surface.
What you're describing is fully a product of the display controller architecture, not the digital signal. You can "chase the beam" with HDMI/DVI just as well (or better) as you can with analog. There's no need to buffer the whole screen and be even one frame latent.

I've done it in Verilog on FPGA, for example.

But we do so on our machines because that's how the GPU/display controller pipeline works easiest from a software POV. That latency would be present on a CRT as well. What would be missing is the internal latency present in some monitors.
Which real estate investors? Because it’s a spectrum. From the mom and pop trying to supplement their income to the investment firms that bought tens of thousands of properties. The latter being a bigger problem here.

What I’ve seen lately is mega apartment complexes being built and funded by private equity. That’s not good either. Things will end up like Europe where no one owns their flat they just rent in perpetuity.
China lobbies Congress behind closed doors on TikTok, staffers say
No one is seriously pursuing hydrogen for large cargo ships. Storing enough compressed or liquified hydrogen to make an ocean crossing is just ridiculous. The current trend is toward ammonia fuel which, although it has some safety and environmental problems, is far more practical and cost effective.

https://gcaptain.com/one-awarded-aip-for-ammonia-fueled-cont...
You kinda forget how low latency feels like until you relive it and thinks 'oh ye this is how it should feel like'. Like the reaponsiveness of a PS/2 keyboard.
The data is publicly available!

The data is freely available from the Climate Change Service [1] which has a nice API but download speeds can be a bit slow. You'll have to sign up for this.

NCAR's Research Data Archive [2] provides some of the data (as pre-generated NetCDF files) but at higher download speeds. No signup necessary.

It's not super well documented but I hosted the Python scripts I used to download the data on the accompanying GitHub repository [3].

[1]: https://cds.climate.copernicus.eu/cdsapp#!/dataset/reanalysi...

[2]: https://rda.ucar.edu/datasets/ds633-0/

[3]: https://github.com/ali-ramadhan/timescaledb-insert-benchmark...
> No one is moving anything.

Incorrect! I don't know either of you, but let's play fairly.

The other person was asked if they ever had complete information, then they provided an example. Then the goalposts were moved to not only "real world situation," but "non-trivial."

It's possible to deem any real-world situation they offered in return with complete information to be "trivial," thus moving the goalposts again.
The only thing Itanium related I see in this repository is the Itanium C++ ABI name mangling code. This doesn't mean that the Itanium architecture itself is supported.
Huh. I'm assuming that it's this reply that earned the thread a closure. As far as I know, it wasn't flagged (but I may not know that). It still has positive karma.

Was it because I mentioned a particular HN setting?

I would certainly appreciate knowing what I did to earn the Ire of The Gods.

I doubt it was mentioning ageism. We talk about that, all the time, and some folks get pretty insulting about it, without getting dinged.
Apple Shortcut: https://www.icloud.com/shortcuts/f0e03a0999d44e6da53b0522e98...
The Joe Pass tribute is amazing. It is an ode by someone that is at a similar level of technical virtuosity, but with his own extremely distinct voice. It is a nod, not attempt to copy. Very unique.
That’s funny, I’m more
likely to describe “real”
instrument timbres in synth terms, many of which I bet relate closely to the 10 dimensions. Oscillator waveform, envelopes, filter shape/cutoff, resonance…
They froze the institute "starting in 2020", three years before anybody suspected SBF was anything other than the Great Tech Messiah.

FTX didn't even get its initial funding until the last months of 2019.

I mean sure, FTX might be a stain on FHI's reputation now, but it certainly can't have been the initial cause of these actions by Oxford. The dates just don't work.
Your argument supports that tax burden has increased for the majority - if the high income folks are proportionally paying less while the total burden has increased, this a disproportionate increase has hit everyone else harder
It is absolutely possible to write a large stateful system from the ground up so that autonomous testing techniques can be applied to it. FoundationDB and Tiger Beetle are both examples of this, I think Resonate might be another one, and Toby Bell's talk at Strange Loop last year is a great guide on how to do so.

What's much harder is to take an arbitrary system, written in an arbitrary way, without these techniques in mind, and make it amenable to this sort of testing. From the start of our company, we believed that unless this was possible, the market would be too hard to crack, because most human beings are not very foresightful and not able to justify a bunch of extra work.

Hypervisor-based snapshot fuzzing like Nyx-Net and deterministic userspaces like Facebook's now-discontinued Hermit project are the other ways I know of accomplishing that goal. We believe that both of them have some pretty serious practical limitations which our approach does not share.

EDIT: Maybe the way to get to the crux of the disagreement is for me to turn the question around. Why do you believe that the vast majority of stateful and concurrent systems are not tested with fuzzing?
Out of curiosity how did you measure this?
Having used CSR it's not surprising, and some newer formats might have more mechanical sympathy like block ELL, since they avoid uncoalesced reads / gathers, tho the code is trickier.
Although, I'm sure US commercial TV stations frame drop movies to speed them up so they can insert more commercials these days anyway.

I can't say how it's done today, but at the TV station where I worked in the 1990's, we did. But we never dropped frames of content. That would cause all kinds of copyright and contract problems.

We did, however, drop frames of black and superblack. In an average hour, we were able to get back enough frames to insert an extra 15-second commercial at the top of the hour.
What an absolute non-issue. Take a peek at 555 King Rd., 445 King Rd or the other nearby mansions. Good luck Mr. Prince, enjoy your new house (and that what looks to be a kickass ski mountain behind it).
I guess they wanted to be crawled because the Google crawler is easy to identify/block/rate limit.
When I'm messing around, I normally have everything in a Pandas DataFrame already so I just add embeddings as a column and calculate cosine similarity on the fly. Even with a hundred thousand rows, it's fast enough to calculate before I can even move my eyes down on the screen to read the output.

I regret ever messing around with Pinecone for my tiny and infrequently used set ups.
Are there specific laws that deal with rate limits? Honest question - I get that something too fast could be considered DDoS, but so long as it’s below a certain threshold wouldn’t it be okay (not sure how said threshold would be determined)?
You'd have to update the embedding every time the data used to generate it changes. For example, if you had an embedding for user profiles and they updated their bio, you would want to make a new embedding.

I don't expect to have to change the embeddings for each icon all that often, so storing them seemed like a good choice. However, you probably don't need to cache the embedding for each search query since there will be long-tail ones that don't change that much.

The reason to use pgvector over blobs is if you want to use the distance functions in your queries.
Well, you may be right. But there are musicians able to touch me deeply with synthesizers:

https://www.youtube.com/watch?v=4R8RaCLzGgE

https://www.youtube.com/watch?v=iWgXVbI5ZRw

https://www.youtube.com/watch?v=pjIzyeQrG7U

https://www.youtube.com/watch?v=PEDhoRruflk

https://www.youtube.com/watch?v=ZJe1JKzcM8s

https://www.youtube.com/watch?v=O0zRm5SjfQU
Funny, because Data (from Star Trek) mentions that his joints can move like that but he refrains because it disturbs humans.
I'm still goofing around with stable diffusion 1.5 based models. It has such a vibrant open source scene and it's free for commercial usage forever so.. I'm not really interested in V3. I guess corporations might be or whatever?
Making war feel less risky to politicians who want to wage it for domestic jingoistic bullshit reasons[0] makes war more likely to happen in the first place, which costs lives.

Also, bold of you to assume you're going to be winning. Does the excitement about this new tech hold up if you consider it from the perspective that it's going to be used against you and your troops?

[0] as opposed to actual defence against invasion - despite the euphemism commonly used by western governments for their military political departments. And what %age of military actions in the last 50 years that your country was involved in count as one, or the other?
I did misread and misquote that. But when a remark is parenthetical I guess I consider them equivalent. macOS and kqueue is not equivalent. Maybe macOS (using kqueue and Mach ports) would make it clearer?
Buying a newspaper to alter coverage of one's own story not only crosses ethical lines but also mirrors an oligarch’s tactic to manipulate public perception.

Your dismissal of these actions exposes a lack of objectivity and betrays your partisan stance.
> if the modern SpaceX were asked to build a reusable spacecraft with (broadly) the same design choices as STS, [...]

That depends on which design choices should stay the same. The boosters and the main tank were bad design choices that made reuse unattainable. With Falcon 9's and Starships reusability lessons in mind perhaps one could make the boosters just part of the main tank, all methalox burning, and have the main tank land itself.

With the booster and main tank design choices disposed of, the remaining major design choice would be that the shuttle had to be a space plane that could land like a plane. That seems like a tremendous waste of weight which would keep the new program from being broadly successful at being cheap, though it might not be fatal I suppose. But at this point Falcon 9 has a better reliability record including landings since they figured out landings than the shuttle did altogether since the STS became "mature".
>there are limitless hordes of complete asshole users that are only there to cause problems and not engage in legitimate debate

Isn't that what downvotes are for?
> For what it's worth, there's also more nuance to the word "democracy" than you seem to be presenting here. At the time of the founding, it basically meant "rule by popular vote", and was pretty much a synonym for "mob rule". A large part of the US system was explicitly designed to work around the shortcomings of direct democracy.

But even this is a misunderstanding of the terms as even (mis)understood in 18th century. Representative (i.e. indirect) democracy doesn't inherently provide any defense of the minority. It's literally just a scaling solution. Nor does the constitution as drafted provide any protections to a minority. In fact, this lack of protections was one of the biggest arguments against ratification, and directly resulted in the Bill of Rights to address some of these issues. Even judicial review of unconstitutional laws didn't exist until 1803, and arguably is extra textual.

What's left is split a legislative and executive, a legislature that is a poor copy of the House of Lords and the House of Commons, and an idiosyncratic points system that 248 years later has not only yielded three unpopular presidents, but elevates whims of a few voters in depopulated states. None of that protects a minority from an abusive majority, nor does it make an affirmative case about why the majority rule should not apply. Far from protecting the minority, electoral college actually enables minority rule. The same can be demonstrated with gerrymandering and legislative seats. A real concern for minority representation balanced with majority rule would address these obvious failures, but it doesn't.

Even the Wish.com House of Lords is joke as originally conceived, since it empowered state legislatures rather than the people of the state. It's a very concept that is an opposition to the very idea of a common nation, but not alien to the idea of a confederation. Now this may have made sense in a 18th century drawing room, but hasn't made sense over 160 years. They thought they were making a European Union, but that's not what developed.

The American constitution may have been great 250 years ago, but it's not by any modern standard today.
There were several years where having BOTH was desirable. Cell service was expensive, and battery life was short, so many folks carried a beeper that was always on, and a phone they turned on if they needed to make a call and had no land line option.

I've never understood the "it's a leash" thing. Pagers and phones are MY devices, and I get to decide how I will respond to them.
Not the best link, but this largely sums up an effort by reddit to hire "International Ambassadors" that would create a low-effort alternate language version of subreddits about 2 years ago. A dead comment below yours has somebody's personal-ish experience with the program.

https://old.reddit.com/r/SubredditDrama/comments/n8g2om/redd...

Personally, it's pretty easy to find posts on reddit that pair a vague question with an image. I imagine that there are normal people that could be posting these, but it's such easy engagement bait that's both trivial to create as well as use as cover to recycle old comment threads for karma.