skysight-inc/HackerNews huggingface dataset:
You're right, and it's also possible to still use LLMs and vector search in such a system, but instead you use them to enrich the queries made to traditional, pre-existing knowledge bases and search systems. Arguably you could call this "generative assisted retrieval" or GAR.. sadly I didn't coin the term, there's a paper about it ;-) https://aclanthology.org/2021.acl-long.316/
How to set up USB sharing over a network
Hi! I want to share information on a flash drive connected to my laptop, but I need to block access to another device that's also connected via USB.
How can I do this? Which application is best to use?
Not refuting it at all, just find it hard to see the relevance to the thread.

I would imagine that the funds that Canada froze in a unique situation are a rounding error compared to the funds some random US state seizes in a year.

Whatever their flaws so many other countries including Canada are so much better at this thing than the United States.
Lotteries are for losers, but scratch tickets are interesting crypto problems. Winning tickets are printed algorithmically and (at least around here) serial numbered. Given past winning ticket numbers (available via FOIA request, ask me how I know...) it's possible to determine winning serial numbers in the future. (At least in states that don't rotate their pseudorandom seeds, and some...don't.)

Finding the winning tickets out in the world such that you can get away with buying just them is a harder problem, as they're normally sold 'in order', and going around THAT is the thing that gets your winning ticket DQ'd.

There's always something nice about "free money", and it's achievable here, but an honest job is less work.
you can take private flights, there is no TSA

if you can't afford your rights, that's a you problem, in America
Most pure elements are either useless or harmful to us.

You could say that about the constituent elements of pretty much any chemical necessary for life.
Not to mention the risks to those of us who have no social media presence at all. Will that be considered a big red flag all by itself?
My guess is he'd freak out once he'd hear that lawyers, law enforcement may get involved on this issue.
What use do you get out of a search engine if not searching for reddit and other forums? The rest of the internet has become a cesspool of useless AI generated crap.
Can confidently say, all the previous student protests, along with this one, students have never been the violent one.

But we civilians are more afraid of violence from the ruling party's goon. These people are coming from some remotest parts of the country, have no good education, but empowered by the government to do anything deemed necessary to stop people's movement.
Matthew Carter (ex-team principal of the latter-day Lotus F1 team) has an anecdote that the team had a wing component that held the wing in a legal configuration, but was designed to break under racing forces. When it (inevitably) broke, it allowed the wing to flex into an illegal (but more performant) configuration. Since F1 has a rule that allows exceptions to illegal car configurations if they are due to damage, they were able to pass inspections by saying that the illegal configuration was due to the (intentional) damage.
I think Reddit lost that kind of authenticity a while ago. Advertisers know the "search:reddit.com <product>" trick, and when you look at the number of upvotes, it costs _pennies_ to get your product trending in the comments.
Since you're using Rust, the Cranelift JIT compiler implements something like this[0] to construct an e-graph for its expression rewriting subsystem called ISLE, however if I'm not mistaken it is for disjoint sets (not intervals), and therefore it does not deal with ordering.

Maybe you can adapt it for your use case and add those new constraints in?

Keep in mind though that this was not written to be in the hot-path itself, you could probably do significantly better by pouring your soul into the SIMD rabbit hole (though SIMD in Rust is usually very annoying to write)

Best of luck, hope this helps!

[0] https://github.com/bytecodealliance/wasmtime/blob/7dcb9bd6ea...
No, the stability of elements peaks at iron and nickel and declines again after that. If you look at the curve of binding energy per nucleon [1], the trend is quite obvious. Note in particular that at some point past uranium, the average binding energy declines to below that of helium, making the isotopes extremely susceptible to alpha particle emission. There are some "islands of relative stability", where heavy elements are stabilized by "magic numbers" of protons and neutrons -- which is why thorium and uranium are so long lived. But we can be quite certain that there is no such thing as Element 200.

[1] https://en.wikipedia.org/wiki/File:Binding_energy_curve_-_co...
From the second paragraph of the article:

> Searching for Reddit still works on Kagi, an independent, paid search engine that buys part of its search index from Google.
There is a pinned post on r/LSD of a chart showing advertised doses vs actual doses, it's a pretty crummy state of things in the wild.
Thanks, will put it on the reading list.
The whole point of publishing studies is to be able to brag about how many impressions you have, which is good for your career. Who is going to care that your blog got views?
Ubiquiti. But I imagine making an 802.1X-authorized AP is possible just using linux.
Broadly speaking, it's because elemental sodium and chlorine are very unstable; in other words they have very high potential energy.

A boulder balanced 40m above your head is lethally dangerous; vs. if mostly-embedded in the dirt next to you it's perfectly safe.
You are right.

It might not work out. But I think it's worth trying.

I believe that large part of HN's success has to do with its simplicity and lack of fluff. There is no sharing on social media, no "hearting" comments or posts, no way to see who liked a particular post, etc.. There are only posts and discussions. That's it.

If this is indeed what keeps out people who make such websites crappy, then it can be replicated.
As a model for attempting to understand the world and root causes, the NPC meme is obviously wrong and dumb. But as a coping mechanism for those trying to distance themselves from herd behavior and withstand the social pressure that leads to it, it has some utility. Also note I did not say or imply the OP is an NPC, rather I said that they're choosing to act like one. And I totally get picking which battles you spend your effort on, but when you're intellectually justifying choosing the expedient option as if it's the right one, you've gone too far.

(also fwiw, everything in my original comment is true. it's not LLM drivel or anything)
Given current SOTA, no, they don’t.

But there’s no reason why they couldn’t — just capture the vectors of some of the earlier hidden layers during the RAG encoder’s inference run, and append these intermediate vectors to the final embedding vector of the output layer to become the vectors you throw into your vector DB. (And then do the same at runtime for embedding your query prompts.)

Probably you’d want to bias those internal-layer vectors, giving them an increasingly-high “artificial distance” coefficient for increasingly-early layers — so that a document closely matching in token space or word space or syntax-node space improves its retrieval rank a bit, but not nearly as much as if the document were a close match in concept space. (But maybe do something nonlinear instead of multiplication here — you might want near-identical token-wise or syntax-wise matches to show up despite different meanings, depending on your use-case.)

Come to think, you could probably build a pretty good source-code search RAG off of this approach.

(Also, it should hopefully be obvious here that if you fine-tuned an encoder-decoder LLM to label matches based on criteria where some of those criteria are only available in earlier layers, then you’d be training pass-through vector dimensions into the intermediate layers of the encoder — such that using such an encoder on its own for RAG embedding should produce the same effect as capturing + weighting the intermediate layers of a non-fine-tuned LLM.)
This sort of comment is why I think a lot of philosophy is just communicating poorly to make yourself sound smart.

In your footnote, for example, you translated your philosophy-speak into English (metaphysical framework -> model of reality). Why not just say that? Your entire comment goes into "philosophy mode" and communicates a few very simple ideas in overcomplicated language.

Science and religion are pretty poorly understood as competing models of reality. Religion originates when people make up answers to other people's questions to gain social standing, and religion continues due to (among other things) anchoring bias--the bias people have toward continuing to believe what they already believe. While religion does result in those people having a model of reality, there is no attempt being made at any point to relate the model to reality. When religious people and scientists disagree, it's not because the religious person is trying to model reality differently--the religious person isn't even trying to model reality--it's because the religious person is biased in favor of their existing belief.

You said:

> In its scriptures/philosophy, science describes extremely thorough and sound principles and guidelines...but in on the ground practice (by scientists, which are a part of "science"), they are often not achieved[1].

This is presented as some sort of gotcha, but it's not: few scientists will claim that science is being practiced perfectly or even well. Outside of a few areas such as particle physics, we're quite aware that our ability to practice scientific ideals is hampered by funding, publication incentives, availability of test subjects in human studies, data privacy, etc. And we're aware that this means that our conclusions need to be understood as probabilities rather than 100%-confidence facts.

There are certainly some people who treat scientific conclusions with religious absolute confidence, but doing that is fundamentally against scientific principles. The accusation you are leveling against science would be better targeted toward people: generally science journalists and the science-illiterate public rather than scientists themselves. The entire reproducibility crisis is scientists using science to show that our practice of science is too imperfect to result in high-confidence conclusions.

Religious people jumping on the replication crisis because they think it disproves science is rich. The replication crisis isn't a disproof of science, it's an application of science. The reason we know that there's a replication crisis is because scientists asked "How confident can we be in the conclusions of existing studies?" and applied science to answer that question. If you really think science is invalid, then you can't use science to prove that.

And the fact remains that any confidence in conclusions at all is more than religion has to offer, because again, religion isn't trying to model reality--the fact that religion produces a model of reality is merely an unfortunate side-effect.
Well, it will even out over entire careers.
Nothing Hackernewsworthy here.
Are you receiving your tech for free from NHS?
Licensing Your Movie and TV Content for AI Training: Can You? Should You?
There's no grounds on which to file suit. The 9th circuit court found web scraping is legal.

https://techcrunch.com/2022/04/18/web-scraping-legal-court/
the MM wave scanners were banned by the EU due to radiation or more generally "in order not to risk jeopardizing citizens' health and safety.", they're literally unnecessary X-rays.

In the US they were enabled by a former TSA agent, gone contractor, and selling it back to the TSA
As someone whose early scientific career was destroyed by null results, no. No one will publish your negative results. Unless you win the lottery and stumble across a once-in-a-generation negative result (e.g. the Michelson–Morley experiment), any time you spend working on research that yields negative results is essentially wasted.

This article completely glosses over the fact that to publish a typical negative result, you need to have progressed your scientific career to the point where you are able to do so. To get there, you need piles of publications, and since publishing positive results is vastly easier than publishing negative ones, everyone is incentivized to not waste time on the negative ones. You either publish or you perish, after all.

Simply put, within the current framework of how people actually become scientists and do research, there is no way to solve the 'file drawer' problem. You might see an occasional graduate student find something unusual enough to publish, or an already-tenured professor with enough freedom to spend the time submitting their manuscript to 20 different journals, but the vast majority of scientists are going to drop any research avenue that doesn't immediately yield positive results.
Llama 3.1 finetuning on your own data and infra, without vendor lock-in
Another tip for falling objects (although this applies only on the descent phase, so more for objects falling from cliffs or building above you):

If when looking up, the object has an apparent motion (left/right/back), it won't hit you, and certainly don't move in the direction it appears to be moving. If it appears stationary in the sky, it WILL hit you or very close, so move fast. Best default strategy with limited time & options is to hug the rock face, especially under an overhang.
It was not amazing that the West had monopolies because they are the ones using AI and advancing AI tech to harm people. Im not sure what youre getting at here with that comment

https://www.vox.com/future-perfect/24151437/ai-israel-gaza-w...

https://www.972mag.com/mass-assassination-factory-israel-cal...

https://www.theguardian.com/world/2024/apr/03/israel-gaza-ai...
I am sorry if this comes off to be negative, but with every example provided on the site, when compiled and then fed into ShellCheck¹, generates warnings about non-portable and ambiguous problems with the script. What exactly are we supposed to trust?

¹ https://www.shellcheck.net
>It's not universal enough to be advised to someone as a solution

Sure it is. And if it isn't, why would the suggestion to seek medical treatment be a more universal solution?

>and also exposing both the potential parent and child to the risk of lifelong unhappiness together.

That is a warped perspective.
Gemini's big upgrade: Faster responses with 1.5 Flash, expanded access and more
The only thing close are the "logprobs": https://cookbook.openai.com/examples/using_logprobs

However, commenters around here noted that these have likely not been fine-tuned to correlate with accuracy - for plaintext LLM uses. Would be interested in hearing finding for MLLM use-cases!
I hadn't had my morning coffee yet when I wrote this and I have no idea what I meant instead of "revered", but you get the idea :D
Studying 0days: How we hacked Anki, the most popular flashcard app
Since you cite "pretty much everyone" with the same rigor you do your inflation numbers, I think I'm comfortable with my characterization of "perceived inflation" as your own personal perception.

To wit: you're just simply wrong here, and instead of arguing from a rational basis you're hiding behind your philosophical right to be wrong about whatever you want. And that's very distressing to see on a site like HN.
Odd Lots (an excellent Bloomberg podcast) recently did a great episode on this topic: https://www.bloomberg.com/news/audio/2024-06-03/odd-lots-how...

Lina Khan's FTC continues to look where attention is warranted. I'm not sure there's anything necessarily bad going on here, or presumably there's some bad/some good, but it's definitely something that regulators should be paying close attention to. Tech + data enables totally new and very opaque pricing schemes.
You don't need employees to start a company
According to the link, the local service trains will see the biggest improvements from electrification (100 minutes -> 75 minutes). This makes sense because my understanding is the the electrified system is quite a bit faster in accelerating which really helps when station stops are only a couple miles apart [0].

The difference on the express service is much less (65+ mins to "under an hour"), presumably since the trains can spend more time at or close to top speed due to longer distances between stops.

[0] You can see a list of stations and mile markers here: https://en.wikipedia.org/wiki/List_of_Caltrain_stations
Discussion (28 points, 1 day ago, 24 comments) https://news.ycombinator.com/item?id=41044952
Sorry, what is the antitrust concern about Reddit blocking crawlers that aren’t paying them? Surely you don’t think Reddit has a monopoly on anything?

Or are you somehow suggesting that it’s google’s fault that Reddit took this step? I don’t see any indication that’s the case.
Part of the issue is that it isn’t just the web, but the inevitable american corporate shareholder model. Even businesses could be mom and pop ified and made way more popular overnight: quit raising prices and cutting corners and it would actually stand for itself like a massive $7 burrito. However the expectation is that shareholders get returns. Costs must be cut. Prices must be raised. Margins must be improved. It doesn’t matter if this eats the business alive, as shareholders are sufficiently leveraged. The whole system is incentivized to select for inferior quality and taking all the available money on the table.
> (even if they will not admit it publicly)

Saying you don't care about your user safety is actually often more costly than pretending you care, and then having a breach.
Kidston was only four years dead when Neuromancer came out, and the vibe I get from Gibson is he was in those days part of some circles where it would have remained a somewhat active topic.
thanks for the modal shoutout! really great, detailed blog post :)
It is unfortunate, but it means you just to have keep it under deeper wraps. For what must be easily revealed, keep the balance low.
An exchange traded fund is not a sign of legitimacy. Make your point but don’t bullshit - massive claims like this only make crypto seem sketchier.
The question that goes unanswered (and will turn people away) if you want to use this site is: how and what data is being used to inform the overlap algo.

I signed up and it feels like my data was just collected, and I'm unsure if it's just the user responses or ingestion of my linkedin text that will be used.

Overall leaves me with a negative experience ... Maybe an email confirmation saying something might be good reassurance.
FYI, Kagi lets you do this and personalize it as you desire. They even share aggregated stats※ about which domains users choose to block/lower. (Mine generally match these stats.)

※ - https://kagi.com/stats?stat=leaderboard&k=-2
> Neo4j graph rag is typically not graph rag

I would mildly disagree with this; Neo4j just serves as an underlying storage mechanism much like Postgres+pgvector could be the underlying storage mechanism for embedding-only RAG. How one extracts entities and connects them in the graph happens a layer above the storage layer of Neo4j (though Neo4j can also do this internally). Neo4j is not magic; the application layer and data modelling still has to define which entities and how they are connected.

But why Neo4j? Neo4j has some nice amenities for building GRAG on top of. In particular, it has packages to support community partitioning including Leiden[0] (also used by Microsoft's GraphRAG[1]) and Louvain[2] as well as several other community detection algorithms. The built-in support for node embeddings[3] as well as external AI APIs[4] make the DX -- in so far as building the underlying storage for complex retrieval -- quite good, IMO.

The approach that we are taking is that we are importing a corpus of information into Neo4j and performing ETL on the way in to create additional relationships; effectively connecting individual chunks by some related "facet". Then we plan to run community detection over it to identify communities of interest and use a combination of communities, locality, and embedding match to retrieve chunks.

I just started exploring it over the past week and I would say that if your team is going to end up doing some more complex GRAG, then Neo4j feels like it has the right tooling to be the underlying storage layer and you could even feasibly implement other parts of your workflow in there as well, but entity extraction and such feels like it belongs one layer up in the application layer. Most notably, having direct query access to the underlying graph with a graph query language (Cypher) means that you will have more control and different ways to experiment with retrieval. However; as I mentioned, I would encourage most teams to be more clever with embedding RAG before adding more infrastructure like Neo4j.

[0] https://neo4j.com/docs/graph-data-science/current/algorithms...

[1] https://microsoft.github.io/graphrag/

[2] https://neo4j.com/docs/graph-data-science/current/algorithms...

[3] https://neo4j.com/docs/graph-data-science/current/machine-le...

[4] https://neo4j.com/labs/apoc/5/ml/openai/
Leveraging Types for Better APIs
The Iowa caucus is always poorly run. It's a stupid way to elect a nominee
>Basically all 'independent' search engines piggyback off Google or Bing

Incorrect: https://www.mojeek.com/about/why-mojeek
Protecting Your Digital Privacy in Florida
Florida's new Digital Bill of Rights sets a precedent for how data privacy should be managed, affecting both consumers and businesses. This legislation is vital for anyone interested in the evolving landscape of digital rights and data protection. It ensures transparency, gives consumers control over their personal data, and mandates strict compliance for organizations. Reading this article will provide you with essential knowledge about your rights and responsibilities under this new law.

Discover more here.
Oh thanks! :) Oh ye Karpathy's repo is pretty sick! Well still great work on it! If you need any help on it, feel free to ask!
This article is confusing in some parts. It should highlight one very interesting bit : there are no direct TCP connections between the SP and the idp. Everything flows through the user. SAML is perfectly suitable for offline services (network equipement with web frontend, for instance)
Seems like Karma farming
There's one thing I learned from asking questions like this. You never get a satisfying answer, and you ultimately have to just pick something. This is not about the quality of answers, this is just how the world works. No definitive solutions, just compromises
> To put it simply, it’s the enterprise equivalent of the “Login with Google” or “Login with Facebook” buttons we see in apps around the internet.

This is a little pedantic since the original article is from 2020 when using SAML might have still been worthwhile to invest time into... But today OpenID Connect (OIDC) is the Enterprise equivalent of these features, or rather these products from major vendors are each just their implementations of OpenID Connect. If you have the choice, you should probably be looking at OIDC instead of SAML for federated identity today.
Man, I just want to be able to search the entire internet for when I’m doing niche research.

Does this mean there will be a future where everyone is running their own crawler? I suppose.
Fast Python: High performance techniques for large datasets
> Public services are (in too many cases literally) criminally underfunded.

Finish the job and end 'em. The US isn't a compatible platform for that kind of thing. It's a decentralized libertarian wild west with low social development, as intended from the start. Meanwhile, our taxes are going to waste in ignorance of that or in pretending we can (or even should) change it.
The island of stability should occur (indeed, does appear to occur, although we're still neutron-poor) in the elements of the low 110s.