skysight-inc/HackerNews huggingface dataset:
Design considerations for RAG application in production mode
Been working on a robust Q&A app for enterprise. I used llamaindex (+langchain) as a pipeline. Started using Chroma for my vector db, which worked pretty well, but I realized that my app runs faster when I store the indices in an S3 bucket rather than use Chroma to store my embeddings and generate the index from these embeddings at query time. Are there tradeoffs I'm making in using a pre-built index in S3 rather than a vector db to stash embeddings? Has anyone come across this kind of consideration? I've looked at Weaviate (offers hybrid search) but haven't decided to retool code based around it. Basically, I'm just looking for whichever implementation will result in the fastest response times (knowledge base size is 'large' ~40GB).

RE Weaviate, this looks interesting: https://github.com/openai/openai-cookbook/blob/main/examples/vector_databases/weaviate/hybrid-search-with-weaviate-and-openai.ipynb

Further and related, has anyone tried to embed a larger amount of data before? I estimated total time using CPU ~29 hours. With GPU I've seen demos reducing this to minutes. https://www.anyscale.com/blog/build-and-scale-a-powerful-query-engine-with-llamaindex-ray

TY
SaaS cancer being exported to virtually every industry where the companies will get away with it. The particularly nasty part about this being the new direction for the auto industry(because it isn't just a Ford thing) is that the heavy fixed costs of auto make the possibility of a "dumb car" startup that one could imagine as a response practically 0.
Writing is nature's way of letting you know how sloppy your thinking is (Guindon).
How can they do training in the first place if everything is E2E...?
*Insert I don't believe you meme*
I believe that these connections should also appear in the browser console[1], otherwise you could always log the traffic[2] or inspect/debug any individual extension[3].

You will be amazed at the obvious extension policy violations Mozilla is letting many of their "recommended" extensions get away with.

[1]: https://firefox-source-docs.mozilla.org/devtools-user/browse...

[2]: https://firefox-source-docs.mozilla.org/networking/http/logg...

[3]: https://firefox-source-docs.mozilla.org/devtools-user/about_...
It's in the original:

> […] Similarly, function pointers should be used only if there is a very strong justification for doing so because they can seriously restrict the types of automated checks that code checkers can perform. For example, if function pointers are used, it can become impossible for a tool to prove the absence of recursion, requiring alternate guarantees to make up for this loss in checking power.

In other words, static analysis beats code cleanliness, in this perspective.
Calls for the superintendent's head; a lot of angry parents with sad or scared kids; district says they "will be reviewing bus routes and bus stops for efficiency. Drivers will also be practicing their routes, and get paid for those extra days of work. "

Yeah, no.

When the generated routes sometimes included roads which don't exist in KY and drivers can't complete the routes on time WITHOUT kids on the bus, there's no way they're getting this fixed in 4 days.

My kid isn't school aged yet and I know I will be voting out every single school board member during elections, with maybe the exception of the one who voted against. Of course, last election, people were campaigning against raising the portion of property tax dedicated towards the school district... you get what you pay for?
I understand the concept just fine.

I just find it interesting that people allow landlords to exist.
Ruby_memcheck: A sane way to use Valgrind's memcheck on native extension gem
Not neural networks in general, multilayer neural networks as they were called then ("deep" now). This was self-study but I did read widely on the topic and that was the general consensus.
It's a little odd to link a big commit like this with no explanation. Is there a better link providing some context for what is going on?
Thanks for this.

> I think you should just suck it up and use different hostnames for different services, because running all of your services on one IP is really bad for security since it makes it much easier to enumerate every service you're running

I really, really don't want to do this for a ton of reasons. Port scanning isn't high on my security worries, to be honest. I've been dealing with that for decades and am well-protected, so that's not a compelling reason for me.
Incompatibility, lack of stability and other churn inducing changes are the nemesis of software maintenance.

The implied cost is immense and soul sucking.

In many cases it’s pure vanity as well.

It’s fine for early languages, research languages and toy languages. But outside of these categories it’s not worth the cost.
I live in that "long way to anywhere" zone (a day's drive from both Salt Lake and Denver). Lots of suicide here (annual 41 deaths by suicide per 100,000 people).
Completing the Transition to Internet Protocol Version 6 (IPv6) [pdf]
Perhaps this was just a PR stunt for Musk?

I wonder sometimes what goes on in those peoples' heads.
My view of CDC is that it's a long dead hacker clique resurrected by industry grifters, but I'd love for that to be proven incorrect on that. My biggest question is how the shift from techno-libertarianism to techno-anarchism with techno-dictatorship-of-the-prolotariat characteristics in the general space the CDC occupies will affect development. If successful, all kinds of unsavory actors will be using it, from child predators to terrorists to actual nazis, and worst of all, annoying right wingers. Do they have the values and strength of their views to keep serving those people or do they start eroding the security and privacy guarantees to kick them off?
Show HN: Anonymize HN – a Chrome extension to anonymize Hacker News users
I wrote a small Chrome extension that allows the user to replace all usernames on Hacker News with either the string `anonymous` or a deterministic hashed value.
> There is a duty/obligation on the U.S. federal government to protect freedom of the press, especially if the organs of a state government act to violate it.

But you seem to be commenting as if the U.S. federal government has already failed to uphold this duty. But that makes no sense because this just happened. Now that this is widespread national news, there is very little chance that these criminals get to walk away from this. These people are all going down, whether on state or federal charges (or both). But it will take months or years, because that's how long it takes.

There is almost certainly a story here about how it requires widespread news attention to get something like this sorted out, but once there is widespread news attention, the jig is up.
All they had to do was offer users a 10% discount to agree to it explicitly, and enough would have agreed out of millions of users to generate tons of training data. They were both greedy and stupid here and ended up shooting themselves in the foot.
Because the variance (or any other measure of spread) is a useful explanatory variable that is ignored and left on the floor. Switching from mean to median, while more "robust" doesn't actually capture something new, just something old slightly better.
It depends. One tribal ISP blames Roku's lack of IPv6 support for large expenditures. https://news.ycombinator.com/item?id=35047624
And, of course, the name "Ferris" comes from being a homophone of "ferrous".
"https://www.ebooks.com/en-us/book/209970024/software-enginee..." includes PDF and EPUB formats.

(I bought it, intending it as interview prep for an experienced engineer interview, but seems they are doing student-startup-style Leetcode interviews.)
> "were [sic] not google" is usually good for things where people are using cargo cult

It's no different to cargo culting. That should not be the reason for not doing something, any more than the opposite should be a reason for doing it. Just see if the practice makes sense in your context and decide that way.
> from my experience, the bullies are people advocating for the FSF and GPL. They tend to be even worse because of the moral implications of the Free Software movement, which sees anything non-GPL as a personal offense.

Not in these internal "spirit of open source" discussions. All the Free Software advocates I've seen only have one comment to make: if you wanted a restrictive license, you should have chosen one, not open source. The FSF provides many licenses that might protect authors from feeling "taken advantage of," and you can also write your own, non-FOSS license. Open source is meant to be used by anyone for any reason.
It would be trivial for the agent planting the package to then report it to the venue in order to precipitate the authorities being called.

I'm not claiming that this is what happened, but it's too easy to imagine this scenario being part of some three letter agency's playbook.
For me, the single most important thing about Open Source is that it means I can solve a problem once and then /never have to solve that problem ever again/ in the future.

So any code I write I like to open source, because that's the best possible way I know of ensuring I won't have to waste time solving that same problem again.

The other thing that helps is that I think I've found a cure for project guilt.

I used to feel guilty about my projects - each one was Yet Another Thing that I should be spending more time on.

The fix I discovered was to make sure every single one of them has good test coverage and comprehensive documentation.

Effectively I treat each one as something which can stand on its own if I effectively abandon it - the thing works, and is documented, and other people can use it as-is without me feeling guilty that I'm not constantly actively working on improving it.

I wrote more about that here: https://simonwillison.net/2022/Nov/26/productivity/
New keywords are like the textbook example of a backwards compatibility problem. It's probably why C overloads "static" so many different ways.
> Based on the discussions I've seen, Go2 is considered to be the name for the process of extending the language, not an exact release version.

I know, but many people obviously don't know that, so it might be a bad name. Just label it LanguageChange or Incompatible.
Having been there personally, there’s a lot of unknown. But here’s the core of what happened as I saw it and as I gained information from friends with internal con communications access. A package was identified as suspicious, likely by defcon staff and Caesar’s security was called to investigate. Caesar’s security decided it may have represented a threat and asked Defcon staff to evacuate the building. Goons began calmly notifying and clearing rooms pushing people to the west exits toward Linq and Harrahs. People grabbed their stuff and calmly walked out. Most people appeared to recognize that it was likely a false alarm. Nobody panicked. Several thousand people exited promptly and without incident. Bags were not searched on exit. This was not a ploy to search personal property without a warrant because almost everything got taken with the attendees who brought it. It is possible the bag/box/package had gunpowder/tannerite/rdx/etc residue on it from shooting activities either part of the Defcon shoot or other shooting activities unrelated to Defcon. It is unlikely that Defcon will release any additional detail past this: https://x.com/defcon/status/1690740778124115969?s=46&t=WtjuZ...
A lot of people are teasing their friends about leaving their bags unattended and causing it. These are jokes and should not be taken seriously.
I was startled at the professionalism shown by Caesar’s, Defcon staff, and attendees. Vetcon was cancelled midstream and the main stage party was cancelled as well. DJ gear was left behind for the evening. Much of the con moved to the Linq bar. Don’t make stupid assumptions about any of this.
> if a salesman starts trying to sell me a 'concept' or a 'lifestyle' instead of a car, I'm walking away.

In these places, you're also getting berated for coming in with a XY problem on your way out.
I see. :D I am lucky my time in college was just before the internet "became permanent". Double lucky that all pictures and recordings from my cover band disappeared with it!

Anyway, regarding the dot, we could make `fun.(...)` dispatch to the correct arity, but that would make every function dispatch slower. However, even if we assume that's an ok price to pay, it wouldn't take long for people to request function capture without an arity, such as `&Foo.bar` (otherwise it would feel incomplete). And this feature would add further penalties as we further postpone the call.

Both would also reduce the amount of compile-time checks we can emit and hurt integration with the overall Erlang ecosystem. On the large scale of trade-offs, I don't think it is worth it. :)
E2E means everything between two ends is encrypted. Once it gets on their end, they can do what they please.
I like to think the stock market thing is actually the reverse, and they shut it down every night because all the programs that keep it running were written in a memory-leaking tech stack that needs restarting
Its type system is apparently Turing complete. That’s a pretty major flaw, imo. Meaning that static analysis isn’t always possible.
I’ve noticed Rivian trucks in NC often have a “Weighted” license tag as the truck is near the weight limits for a standard license tag. I suspect it only matters when towing, but plenty of people seem to pay extra for it with their Rivian truck.
For those interested about CA & fed taxes not being paid, from another thread about EVs I posted this breakdown of CA gas taxes:

1. 54 cents in state excise tax

2. 18.4 cents in federal excise tax

3. An average of 3.7% in state and local sales taxes

4. 23 cents for California's cap-and-trade program to lower greenhouse gas emissions

5. 18 cents for the state's low-carbon fuel programs

6. 2 cents for underground gas storage fees

4, 5, and 6 are not applicable to EVs. In California EVs are avoiding ~$15 per full charge in taxes (according to comparison of my 18 gallon ICE car @ $3/gal (pre-tax gas)). Not intending this to be anti-ev, just noting the tax avoidance benefits of EVs.

source: https://www.cbs8.com/article/traffic/gas-prices/gap-between-...
not every product has good documentation nor the code is self explanatory. SO fills in the gap between a requirement and its translation in code. Only OpenAI can say for sure how important is SO for them, but I doubt that it is insignificant.
I disagree about smaller PRs being always better. I often find them more difficult to review if they contain only small part of the feature - I see something and ask - why is this like this? Oh, it's used like that in a subsequent PR... which then forces me to look up that second PR and review them together anyway.

It also brings significant additional overhead - generally every merge to master has to be tested individually, since there's no guarantee all PRs will be merged before release goes out.
Once (in college I think) I was reading the Tractatus on a plane and the person sitting next to me asked “hey, whatcha reading?” I showed them the cover and the face they made was hard to describe but very memorable.
as a counterpoint, this is sorta similar to how Apple creates products:

there's quote about magic:

> Sometimes magic is just someone spending more time on something than anyone else might reasonably expect. - Teller

The 3x code is all the magical "stuff" and that goes on in the background to create the illusion of something magical just working as well as non-essential "flourishes" like animation of different font support

However the key difference is that one magical feature is worth more than 1.5x a list of features to sell to various customers who only care about a different subset of those features.

In both cases though, it's understood that there is an additional burden of complexity and upkeep in order to achieve an end goal. Every line of code adds additional entropy to the system until it caps out based on whatever rate of entropy expulsion the culture can maintain.

The diminishing return on additional lines of code may be an unavoidable part of large systems. So it always feels like returning to the "Beginning" via a new project or new startup increase agency and leverage. Which is then perceived by marketing/sales/etc... as a constant refusal to move into the "future" b/c of "bad code danger".
I have named a function 'foo', in current version of language. A future change makes 'foo' a keyword. My code was broken by adding a keyword.
Isn't it amazing how many celebrities have parents who were in military intelligence or NASA or other government jobs? What are the odds?
The point is that they earned this authority, because their planes fly, whereas, for example, experts on childhood education cannot point to such obvious undeniable achievement that laypeople cannot reach.
Hey good question. I was maybe conflating DRM with Tivoization here:

https://en.wikipedia.org/wiki/Tivoization

I feel that the original vision of most open source licenses was to allow anyone to sell open source software, with the condition that any changes be fed back to contributors. That self-limits how much profit anyone can make on the backs of others, because any value added eventually goes back into the system. This is how it worked back in the Red Hat Linux days.

But today it's impractical to modify the software on locked devices running open source software, like cell phones. And we have video game consoles whose software is notoriously difficult to modify because they run DRM, and their games built on open source software are also copy protected. And most open source software runs on web servers now, walled away from us and unsold, so that changes don't always get fed back into the system.

Put all of this together, and I can't help but feel that the GPL protects the DRM status quo. That may not have been intentional, but here we are. I view any restriction or even inconvenience on the user (where jailbreaked devices work better), or dictating what users can do with their software or devices, as DRM. That stuff should never be allowed to use open source software.

And even linking to GPL code can infect non-GPL software with the GPL license, forcing users to decide if they want to use the LGPL instead. I find this distinction so exhausting to reason about and unnecessarily open to legal challenge that I usually avoid the (L)GPL altogether.

I would have preferred to see a license derived from MIT with a new clause that says if you sell or distribute the software in a locked device, then any changes must be fed back to developers. But maybe GPLv3 is as close as we can get. And it still doesn't solve the problem of open source software locked behind web servers. But maybe it's important to preserve the freedom to do that, as Linus Torvalds said in that video: that it's none of our business what people do with our software (<- as long as they don't sell a modified version without feeding changes back).

And admittedly, IANAL so I might be reading this all wrong. Here are the best links I could find:

https://www.gnu.org/licenses/gpl-faq.html#DRMProhibited

https://www.gnu.org/licenses/quick-guide-gplv3.en.html

https://www.ifross.org/?q=en/what-difference-between-gplv2-a...

https://lwn.net/Articles/200651/

https://www.gnu.org/licenses/gpl-faq.html#GPLStaticVsDynamic

https://www.gnu.org/licenses/gpl-faq.html#LGPLStaticVsDynami...
Fan-made port of Wipeout (PSX) for modern browsers
Mountains == isolation.

I grew up in a mountainous region where the ridges separate the valleys. If your friend lived a mile away, it might take 20 miles of driving to get there because of the separation.

I wonder if they've measured that people who are very isolated have more suicide?
Is it just me or are others also stuck in a I'm-not-a-robot-loop?
My older car requires a hardwire connection for Android Auto, but my newer car will automatically connect over wifi so I no longer need to take my phone out of my pocket unless I want to charge.
Legal battle challenges constitutionality of FINRA, Wall Street’s self-regulator
ahh, your right, I do think with the rest of my comment it basically allows automating `extern template` though.
Fediverse is slightly better than email because there is a cost in the domain from which you send spam. Vanilla SMTP provides zero authentication so anyone can impersonate any domain. Technologies like DKIM and SPF are relatively new and not everyone uses them.

ActivityPub, however, requires all POST requests to be signed by the server that sends them. The signature is made with an RSA key of the actor that performed the activity. The public key of that pair is inside the JSON object of the actor. So, to verify the signature for an incoming activity, you'd make a request back to the originating server to fetch the actor object. This makes spoofing impossible and domain bans practical.
Readability is usually applied in an incremental way. You don't have to fix all the code to make it conformant. If there are concerns about consistency, the style guide actually encourages people to prefer consistency over its own rule.
I'm building a publicly-accessible matrix app [0] that might be of interest to you, and anyone else looking to self-host a discord + discussions alternative.

It's still early days, but I'll probably do a Show HN at some point.

[0] https://shpong.com
And I am sure they are using a 3rd party vendor that has in their TOS the ability to sell that information.

This is going to be abused to hell and back.

A much simpler and privacy minded solution is to tax the chargers, just like taxing the gas pumps.
Is this also for Firefox?
D was doomed from the start. It was designed as an incremental improvement over C++. Initially it provided refuge to burnt out C++ programmers like myself. But once I discovered Rust there was no coming back.

Rust takes its fundamentals from more advanced and well thought out functional languages. As a result it outclasses D and its ilk.
He's a "futurist", who's explicit job is to make hand wavey, big, shocking claims. Historically, futurists have a less than random chance at being right about the future.

Also I would not consider him an expert in anything ML, though he probably has enough of the underlying math to get some things.
Can be. A bootloader is just a baremetal application, so called not by architecture but its primary purpose of loading much larger images, jumping to it and not coming back. If the CPU is coming back, it's called a monitor program, if it's going back and forth, it's a supervisor, or a kernel. Old/mainframe folks sometimes call operating system kernel a supervisor program.

Theoretically it should be possible to flash Linux Kernel onto BIOS Flash ROM to directly load and run it from there. But x86 being x86, you also have to have bunch of circus tricks to initialize motherboard and to get out of 16-bit 8086 compatible mode and to load Kernel from disk, in such hypothetical Kernel image. BIOS/UEFI and bootloader each do parts of those.
I guess I have a hard time seeing how PPXs are worse than `go generate`.
In The UK, It’s Still Legal To Place People In The Stocks (2016)
> ESM/commonjs mess that is modern javascript

No - only a mess in the node/npm scope.

JavaScript modules are just fine if you stay away from npm and node. Node and npm are a total dumpster fire, but that is not all of JavaScript.
Understanding When to Use Padding vs. Margin in CSS
Hello, fellow On-X owner!

I understand the bummer that warfarin can be. I have two pieces of advice.

1. Don’t diet the dose, dose the diet. In other words, don’t try to adjust what and how you eat to fit the mg of warfarin you are taking every week.

2. I believe a large percentage of what you hear regarding warfarin is ridiculously overblown and I almost never place limits on what I do because of some fear of a bleeding event (within reason, of course.)