skysight-inc/HackerNews huggingface dataset:
We did. As in we, the Internet, existed for a long time without anyone making money and we paid for the privilege. Websites were built and hosted at owner's expense, for years, with no expectation that they be financially rewarded. Sure some would run donation drives, or work with sponsors relevant to the community in question, but a whole ton, mine included, just cost me a lot of money over many years.

Those websites were definitely technically inferior, as the march of progress is unavoidable, but web hosting is cheaper than it's ever been. A VPS that utterly blows away what mine was capable of in 2007 for nearly a hundred a month can now be had for about $10 per month. Yet everyone wants these monolith platforms, but even that wouldn't be the worst thing ever, except that every one of these platforms has a backend to support that we in the Old Internet never did: a C-suite's worth of executives and millions of shareholders, who for some reason have decided that reddit can't exist unless reddit makes them reams and reams of money.

I'd be very, very interested to see how much of, even what's probably the most massive one of all, Facebook, is non-essential busywork that could easily be shut down tomorrow with no adverse effects to the platform. Firstly the entire executive class, just, they don't do shit to make Facebook the product. In fact I'd argue their decisions almost universally have made it worse as a product very consistently for it's entire lifetime. Then, all the marketing people. There's just no goddamn reason to advertise Facebook (or reddit for that matter) the brand is so ubiquitous, if you actually found someone who'd never heard of it, I'd give you a large chunk of money. Add to that, if Facebook was doing a good job of being what it ostensibly is, then people immediately become the best advertising, because people want to hang with people in these digital spaces. Then get rid of the people working to make Facebook addictive with dark patterns. Then get rid of the entire targeted ad division, because it's gross and inhumane. Pare the company down to engineers who build the product, and if anything, expand the moderation team so they can actually ensure the safety of the platform, and of course the IT staff to back them. Now what does Facebook cost to operate?

As far as I'm concerned, this pearl-clutching about "well websites have to make money" is grossly, grossly overstated. Websites don't cost that much to run. A ton of money is being siphoned off by the MBA parasites playing games in Excel all day. A ton more is being wasted developing features that advertisers want and users hate. A ton more is being funneled into making products artificially addictive to vulnerable people, to exploit them, so let's just not do that. And of course, leadership, rewarding themselves with generous compensation packages they aren't even remotely able to justify. Now what does your website cost to maintain? Surely not nothing, and for websites of substantial size, it will still be high, but I'm willing to bet it's a hell, hell, hell of a lot less than it was before.
Especially if they go with thr volcano experiment blend!
An interpreter that handles data downloaded from the internet even.
That's an exploit waiting to happen.
No, it won't.

An interview is like a first date: everyone is expected to be showing their best side. If a company is treating me with that level of disrespect right up front, they're telling me I'm going to be treated even worse if I actually work there. I won't work for a company like that, so wouldn't do the interview in the first place.
> You could also ask why we are conflating machinists with engineers

You could, but it would be rather silly as machinist is clearly a subset of engineer (within what most people deem engineer to mean). It is not a conflation, it is a more precise term. Like using "surgeon" over "physician". It is not like a surgeon has anything to do with your family doctor evaluating your common cold symptoms. Those are entirely different jobs too, yet absolutely get grouped together.

The problem here, it seems, is that we've never come up with generally accepted terms to differentiate the different roles under the software engineering umbrella. I expect that is because the differentiation doesn't matter beyond trying to appeal to some pointless emotions.
This looks very nice. Comment: there's a whole industry that - whether or not they utterly despise the idea - is required to use FIPS-certified encryption. If you were somehow able to make that a component, you might be able to expand your market significantly.
Who needs malware when we have Crowdstrike?
I'm not sure if 20k lines of code and and writing a controller on k8s are really that incompatible. kubebuilder has made it pretty approachable.
Not just that, but a lot of the money in cycling comes from bicycle (+bike component) manufacturers in the form of sponsorship and endorsements. Outside of a NASCAR-like pseudo-standardization, going to a standardized bike from one manufacturer for the highest-visibility events would throw that money out the window (and cause conflicts where the biggest riders are riding bikes from a different manufacturer than the one that funds the rest of their activities).
Why phase out smoking? I thought you just said having your parents tell you not to smoke worked just fine.
Neo4j graph rag is typically not graph rag in the AI sense / MSR Graph RAG paper sense, but KG or lexical extraction & embedding, and some retrieval time hope of the neighborhood being ok

GRAG in the direction of the MSR paper adds some important areas:

- summary indexes that can be lexical (document hierarchy) or not (topic, patient ID, etc), esp via careful entity extraction & linking

- domain-optimized summarization templates, both automated & manual

- + as mentioned, wider context around these at retrieval

- introducing a more generalized framework for handling different kinds of concept relations, summary indexing, and retrieval around these

Ex: The same patient over time & docz, and seperately, similar kinds of patients across documents

Note that I'm not actually a big fan of how the MSR paper indirects the work through KG extraction, as that exits the semantic domain, and we don't do it that way

Fundamentally, that both moves away from paltry retrieval result sets that are small/gaps/etc, and enables cleaner input to the runtime query

I agree it is a quick win if quality can be low and you have low budget/time. Like combine a few out of the box index types and do rank retrieval. But a lot of the power gets lost. We are working on infra (+ OSSing it) because that is an unfortunate and unnecessary state of affairs. Right now llamaindex/langchain and raw vector DBs feel like adhoc and unprincipled ways to build these pipelines in a software engineering and AI perspective, so from an investment side, moving away from hacks and to more semantic, composable, & scalable pipelines is important IMO.
'2001: Creating Kubrick's Space Odyssey' (released July 23, 2024)
FWIW we can do this* with bash in the nix ecosystem (not that this knowledge should deter you from checking out scrapscript).

* you said locking the hash in the script, and in the nix approach these are generally locked in either a lockfile or in the nix expression.

Can elaborate if you're curious.
> adding a contextual title, summary, keywords, and questions

That's interesting; do you then transform the question-as-prompt before embedding it at runtime, so that it "asks for" that metadata to be in the response? Because otherwise, it would seem to me that you're just making it harder for the prompt vector and the document vectors to match.

(I guess, if it's equally harder in all cases, then that might be fine. But if some of your documents have few tags or no title or something, they might be unfairly advantaged in a vector-distance-ranked search, because the formats of the documents more closely resemble the response format the question was expecting...)
that's probably a lot higher than the sort of atomic number we can realistically reach in the lab?
It's a rise about as far as a quantum leap
Show HN: I made an LLM-powered HN digest personalized just for you
Hi HN,
I've built My Hackernews (https://www.i-made-an-llm-powered--hacker-news-digest-just-f...), an AI-powered service that curates and personalizes Hacker News content just for you. With over 1,000 stories and around 10,000 comments posted daily on HN, staying updated can be overwhelming. Here's what My Hackernews does:

- Uses Claude 3.5 Sonnet and GPT-4 to analyze and curate HN posts
- Creates a personalized digest based on your interests
- Delivers content in a customizable email format
- Provides an ad-free experience

You can try sending a sample digest for free, no sign-up required. If you like it, we offer a three-week free trial, followed by a $4.99/month subscription (cancel anytime).
I built this to solve my own problem of staying informed without spending hours browsing. I'm curious to hear your thoughts:

- What features would make this valuable to you?
- How do you currently keep up with HN and tech news?
- Any concerns about AI-curated content?

Looking forward to your feedback and happy to answer any questions!
There’s a bit of irony in the second reference, as the author ended up with some controversial work related to COVID-19. He co-authored a study that was widely cited to downplay severity of the pandemic, but was also heavily criticized for poor methodology (and later I think firmly found to be very wrong). He also published a paper with personal attacks of a grad student that had disagreed with him, which is probably not in the spirit of encouraging constructive science.
This is completely different from one lab running the same experiment 20 times and publishing the one positive result.
So you have mainly straw-manned on the word "schemaless" to make an argument. This is akin to attacking dynamic typing by pointing out that most things can be type inferred by the code.

That is, you are not wrong in that most data stored is structured in some way; but you are ignoring a ton of the benefit of the schemaless world. As I pointed out, there are benefits to specifying schema. In parts, you /have/ to do so. Specifically if you want your DB to do any work on the data. Indexing/filtering and the like.

Now, you do hit largely on the benefits of the "schemaless" world. And that is that it is not undefined how it will store whatever schema you throw at it. You will have restrictions on keys, but otherwise it will store whatever you throw at it.

At large, this means you can skip out on a lot of the formality of specifying all schema shapes during development and can take a much more flexible approach in your code than you are forced to if the data layer can't work with you.
> I’d argue the two are not necessarily at odds, and actually would complement one another.

How would that work in reality though? Aggressively enforcing drug laws push people to the margins (being arrested, having a felony charge, etc.), living on the margins of society is a major factor into pushing people into despair, despair fuels drug addiction.

Aggressive enforcement of drug laws is not compatible with an empathetic approach to drug abuse, it also creates many consequences which could've been unforeseen when introduced but we all live in the world of such consequences. Removing freedoms in name of pushing anti-drug laws, for what ends specifically? What are we trying to achieve by being tough on drugs in the end?
The blocks for MojeekBot, as Cloudflare verified and respectful bot for 20 years, started before the robots.txt file changes. We first noticed in early June.

We thought it was an oversight too at first. It usually is. Large publishers have blocked us when they have not considered the details, but then reinstated us when we got in touch and explained.
I think it exists in Ireland too. I suspect it may be a legislative flaw that can be exploited in all common law countries (with the buy in of legislatures of course).
Hopefully this paves the way for antitrust action, but I won't hold my breath.

Reddit's justification for this is profoundly wrong. Their "public content policy" is absurd doublespeak, and counter to everything the open internet is and hopes to be. You cannot simultaneously call yourself "open" and "public" while refusing access to automated clients. Every client is automated. They even go so far as to say that "crawling" (also known as "downloading") is an "abuse" and violates user privacy.

This is absurd, and not justified. I would love to see legislation that restricted server operators' ability to prohibit automated access in this way, but I suppose it will never happen. Some people in this thread have attempted to justify the policy by saying "they have to protect their income streams". No they don't. You don't have a right to an income stream, and you certainly don't have a right to lie in order to get all the benefits of an open internet with none of the downsides. Noting of course that the "downsides" are in this case actually just "competitors".
European Commission denies responsibility for Microsoft IT outage
"LLMs are fundamentally different to software and using terms from software just muddies the waters."

They're still software, they just don't have source code (yet).
Honestly you clocked the secret: it doesn’t.

It makes sense for the hype, though. As we got LLM’s we also got wayyyy better embedding models, but they’re not dependencies.
This exists with Lemmy already and is fostering nice communities (and due to ActivityPub is interoperable with Mastodon accounts)
It doesn't have to be a vector DB - and in fact I'm seeing increasing skepticism that embedding vector DBs are the best way to implement RAG.

A full-text search index using BM25 or similar may actually work a lot better for many RAG applications.

I wrote up some notes on building FTS-based RAG here: https://simonwillison.net/2024/Jun/21/search-based-rag/
I have to kill several copperhead snakes every summer. (3 so far this year)

we're at the top of a hill and they come up here to lay eggs; i won't tolerate them in the fenced dog yard or chicken coops.

I try to split the head lengthwise, from snout to spine, before i chuck the snake in the swamp. that often expresses any remaining venom, and ruins all the mechanical linkages and leverage used to make the bite action work. even if those muscles contract again the result will not be nearly as dangerous.

"Beware the severed head" was something i heard way back when. I recall being told stories of using rattlesnake heads for mousetraps when i was a child. I've seen the reflex work, poking a dead snake with a stick; but I doubt movement will be possible for more than an hour or so.

The toxicity of the venom can last much longer, as TFA states.
Considerations When Building Embedded Databases
Funny because this tonic is exactly as effective as CrowdStrike itself.
Dumb question here :-

My father has diabetes since he was 30, my grand father had it too in his 30s.

I am beginning my 30s, will I get it too ?

Is it guaranteed that I'll get it ?

Can I avoid getting it ?

Both my father and grandfather had heart attacks...
> do you need a “platform” for feature flags?

It's helpful if you have non-devs on the team who nonetheless want to toggle flags. Sometimes UX people use them for A/B testing, for example. Or a manager might want to see how a certain experiment performs and then turn it off if it's not doing well.

The "platform" is really just an easy web GUI with roles & permissions. In the past I've used Unleash, VWO, some Google thing that was sunsetted (of course), maybe some others. They're simple SaaSes but useful in the right teams.
Didn't the Open Source Definition start as the DFSG? You telling me Debian hates the Free Software movement? Unless you define "hating Free Software" as "not banning the BSD license", then I'll have to disagree.
the body of the snake will thrash around and will void; so it's pretty nasty at both ends too.
I wonder how Aaron Swartz would react to this
It’s all vibes! Type 1 here for 28 years.

You are on the right path here but I think you are missing the “big players” for lack of a better term. The prediction software available now (open source) is quite good and works with different types of CGMS and pumps. You are really going to want to look at Loop.

Loop basically collects the inputs in the app automatically for insulin if you use a pump. I’m on the Omnipod DASH and Loop works with a few, Omnipod being my favorite. You can also input injections. It can also collect CGMS data automatically from that system. It works with Dexcom and others (I think Libre). You manually input carbs, and you are still gonna do that based on VIBES. After that, you get these magic prediction lines that show you where you are headed. And with the pump, it can add or lower insulin amounts (closed loop mode) to keep you in range. Pretty common to be 75-90% in range!

Check it out:

https://github.com/LoopKit/Loop
https://www.loopnlearn.org/
> Not introspecting at all might be more boring.

Because that’s the relevant takeaway.
Understanding the Performance Implications of Storage-Disaggregated Databases
404 is not an error, it's a status code that says "What you asked for does not exist". Why are you worrying about log spam? Why are you monitoring 404s? Now you have an endpoint that lies, how is that better?
PCRI: An Equation about Syntax Potential
In my experience any time a merchant tells me they don't take Amex, they actually do take Amex but the owner / manager doesn't like paying the higher merchant fees so refuses it since most people carry an alternative payment card. I generally insist, and actually if any merchant /does/ accept Amex and claims they don't, it's a violation of their merchant agreement and you can report them for this.

With the exception of international travel, while I'm in the US I generally /only/ carry my Amex, because it's as good as cash for any of the businesses I'd generally want to frequent anyhow.
I'm not enough of a physicist to understand the article, but this Wikipedia page talks about why even numbers of protons and neutrons are more stable:

https://en.wikipedia.org/wiki/Even_and_odd_atomic_nuclei
yep, but with due process so it's legal and separates the USA from corrupt countries that we denigrate!
As someone who has literally no idea of ModelOps / GenAI Deployment, what am I seeing there? Code that just loads in the weights and provides an inference API? Or what does this code actually do?
> SOOT lets you visualize and organize your files in a beautiful and intuitive way.

Can’t really say I agree. It is interesting for sure, maybe even intriguing, but I don’t see myself using this at all. It’s a nice gimmick and demo but doesn’t seem that practical.

Still, thumbs up on the choice of data set. That and the uncommon navigation style still made me share the link with a couple of people. One of them did call it beautiful (unprompted), so there’s that.
Yeah, lots of folks think they have a similar demeanor to cows and don't realize they are in danger while doing so.
AI with std. grafana monitoring / dashboard.?
I mean, the action was happen vertically.
It's the impression given by the medias because cheating is actually taken seriously in cycling.

In other sports its so common that its considered normal.

https://www.youtube.com/watch?v=2op5XG7LGkI
It's ironic, because Reddit is the only search engine that works on Google now thanks to shittening.
“Lacking” implies it’s an unintentional deficiency.

Rust has deliberately taken a “batteries not included” approach due to learned experiences in python, where many std-lib packages are basically abandoned/not recommended anymore.

This gives the ecosystem time to develop better approaches to things, rather than ossifying around the initial implementation.

Yes, it does lead to a larger set of dependencies, but some of the most common packages (including anyhow) were written and are maintained by members of the rust lang organization/team itself.
There is Lemmy for example, very similar to old Reddit. The big problem is the missing content outside of mainstream communities.
right, optional as in you can walk away, but you can't get past TSA to your flight
Its not strange to me. Every single time I've followed a Reddit link from search results, I've got a short and fairly useless conversation that doesn't help me at all. So I have never understood why people like it.

Obviously, people do see value in it, or they wouldn't keep saying so! I would happily exclude Reddit links from search results though.
n++

Dr. Bernstein's book is a must read for every diabetic person. His YouTube channel: https://www.youtube.com/channel/UCuJ11OJynsvHMsN48LG18Ag
> Can I avoid getting it ?

Yeah, by losing weight. Unless the reason they got it is because of some autoimmune timebomb that's genetically programmed to go off in the 30s and destroy the pancreas.
> Not unlike in religion, a competing metaphysical framework (model of reality) to science.

No. Correlation fallacy.
This is basically true wrt the 1-sub lysergamide series (1p-lsd 1cp-lsd 1d-lsd 1v-lsd ald-52 etc) but many other lysergamides are quite distinct: AL-LAD ETH-LAD MiPLA etc. And then of course there are the lysergamides that are used to treat migraine, which are completely different.
Videos and images are software. They are compiled binaries with very domain specific instructions executed in a very non-turing complete context. They are generally not released as open source, and in many cases the source code (the file used to edit the video or image) is lost. They are not seen, colloquially, as software, but that does not mean that they are not software.

If a video lacks a specification file (the source code) which can be used by a human reader to modify specific features in the video, then it is software that is simply incapable of being open sourced.
John Mayall, Pioneer of British Blues, Is Dead at 90
> Date: 24 JUL 1973 1527-PDT

Interesting. I thought Ameria preferred the "M-D-Y" order?
I don't know if 3-mmc ever got a street name but it's got a sister compound 4-mmc that's commonly called mephedrone
Oh, it's immensely massive compared to anything that's likely to possibly exist as an element. But in proving something is finite, it doesn't matter if we overshoot by a million million percent, all we have to do is establish any bound at all. We don't have to engage with the question of what we can do in a lab, because the question only requires any theoretical limit to exist.

It may be difficult to predict just how far we can go in a lab, but the existence of black holes means there must be some limit.
https://archive.ph/ahzMf
Prompts in the background:

const systemPrompt = `
Convert the following PDF page to markdown.
Return only the markdown with no explanation text.
Do not exclude any content from the page.
`;

For each subsequent page:
messages.push({
role: "system",
content: `Markdown must maintain consistent formatting with the following page: \n\n """${priorPage}"""`,
});

Could be handy for general-purpose frontend tools.
"Formerly known as Ununoctium (Uuo)"
Meteor.js 3 is officially here
Show HN: Long query, slow and continuous search –> alerts
Hi HN!

I'm excited to introduce Alertfor, a new tool I've been working on. It's currently in beta, and I'm looking for feedback to help shape its development. for some awesome use cases please refer my tweet [1], Here’s a brief rundown of how Alertfor works and what it aims to offer:

ask a Question: Submit a detailed query about anything you need to know.
track the Answer: Alertfor scours the "open" web to find the most relevant and up-to-date answers.
stay Updated: you'll receive continuous updates whenever there are changes or new information available for the question.

I am offering full access during this beta phase. Feel free to try it out and let me know what you think.

Note: I released in 2017, it didn't go well, relaunching it again with some changes.

1. https://x.com/saran945/status/1815053542610067487