skysight-inc/HackerNews huggingface dataset:
For embeddings specifically, there are multiple open source models that outperform OpenAI’s best model (text-embedding-ada-002) that you can see on the MTEB Leaderboard [1]

> embedding-based approach will be cheaper and faster, but worse result than full text

I’m not sure results would be worse, I think it depends on the extent to which the models are able to ignore irrelevant context, which is a problem [2]. Using retrieval can come closer to providing only relevant context.

1. https://huggingface.co/spaces/mteb/leaderboard

2. https://arxiv.org/abs/2302.00093
Only if the source is extremely strong. E.g. the sun
> Who golfs? Who has downhill skis?

I imagine you could answer that question by going to a golf course or ski slope to see who's there.
That's because you need the lazers to see how amazing it was
"Richard, these are real people with real crotches, and they're burning."
>How long have you been so passionate about Wikipedia and..

I expressed clear and open distain but was specific. You are using, I think a sneakier version, a snideness... but if "how long have I" is a serious question, I was editing wikipedia when it barely had any articles. I watched it go from feeble to great to a steady degradation over the last decade; is how long.

It suffers other degradations which are not poitical. Categories of narrow interest get taken over by advocates, such that people of casual interest don't get to see the whole truth or even see what they're looking for; or specialist articles no longer have general salience (for example with regard to specific isotopes or something). Articles about celebrities get scrubbed free of stain. People with weird little fetishes take it upon themselves to insert something like the word "metonymy" everywhere they possibly can. And more, but I've been around, son, I've been around, as a contributor.

and it's a standard technique to give people like me a worklist to go do, but I won't do it. If you think I'm wrong about their funding, and some numbers are in order, you research, publish, and I'll evaluate.
Their primary target is B2B and they want to get that market ASAP. Pretty sure any idea or anything that seems feasible will be copied and even improved upon.

The pattern will continue until no one needs anything. I am sure this company will eat everything. There will be no pie.
Settings > Digital Wellbeing> Bedtime mode > Screen options at bedtime > Keep the screen dark
This could work with "meta-commit" messages added to groups of commits after the fact. Such messages could be parsed by the log display program. Git notes is the obvious tool for adding such metadata.
That's a really good way to handle it. I don't know where the brain worms are from exactly, but I've seen people who don't otherwise have rocks for brains going full-on "All the scientists are wrong, I'm just asking questions, leaked from a Chinese lab!" about this specific conspiracy theory. I get there's a nationalism aspect, but that's no excuse to throw your brain out the window.

Edit: It is weird that on a pretty technical forum there are a bunch of people here who don't know anything about virology disagreeing with the overwhelming scientific consensus in the field, based on overtly conspiratorial thinking (e.g. "Look at the connections, this can't be a coincidence, this man leaked the truth and they silenced him" etc etc). You don't get to scientific consensus on something through a conspiracy. I wonder what the people replying with conspiracy theories think about climate change.
Grade A sarcasm.
I predict that this disaster will end up driving up the price of the Bored Ape NFTs.
Arbitration is an abbreviated legal proceeding designed to be much faster and cheaper than litigation. It is not designed to be a substitute for legal representation.

The idea of going into arbitration against a company without a lawyer seems absolutely insane to me and I would bet that the number of plaintiffs with representation is close to 100%. I also do not have actual data on this, though.
> I distinctly remember my Dad telling me to slam on the brakes while teaching me to drive.

Same when my mother taught me to drive. She even took advantage of rainy days to take me out to a large empty parking lot and we practiced how to deal with hydroplaning.
I'm in Fort Collins, I'll be right over! :-)
China is not only trying to be #1 by military force but also trying to string poorer nations into loans they can't really afford, buying mines and harbours etc.

It worries me because their entire direction depends on the whims of essentially one man who is there for life.

I also found it really worrying how the CCP made their own population suffer during the pandemic. Can you imagine what they'd do with the rest of us if they were the leading world power?
> For applications, use Java or Python.

What’s the deployment story like ? Here’s a hot take of mine: we should treat our users as master and make their lives easier, not ours.
The first time I used an induction stove I set it to maximum, because I set my gas to maximum. I waited a while for the pan to warm, then I poured in some cold water for boiling.

I was amazed at how much heat induction could put out. It instantly boiled the water touching the surface of the pan and it was at a rolling boil shortly after.

If there weren't such health and safety risks, it would be great to let customers just have a go with an induction cooktop in a showroom.

Along with most people, I'd thought of induction as a substitute for gas, when really it's an upgrade.
I'm not sure if it's mentioned, but to get these illustrations, they killed the birds first. Birders of history did a lot of bird killing, some which lead to species extinction. Which is somewhat ironic.
The scale is extreme, but that is what a lot of companies do.

For example, with large accounting firms, having a CPA license boosts salary by 10-25% over a candidate without a CPA (assuming both are otherwise equally qualified and get offers). With law firms, having a federal court clerkship on the resume boosts salary by 25-50% over candidates without a clerkship (at the early stages of one's career), not including a six-figure signing bonus that generally is not offered to other candidates.
> My point is if you hide the fringe then you either get left behind or prevent others from moving forward.

Ultimately they’re OK with both because the politics justify it.

It’s so obvious that as formal religion has weakened that informal religion has taken over. It’s not a bible, it’s a screen, you have faith, you think what it tells you, there are priests, you can wear the wrong thing, you do what makes you accepted in your tribe. If you didn’t see it during covid, then you extra double have a religion.

All these people that mock religion - and have no idea they have their own is almost entertaining if it wasn’t so destructive. It’s wired into humans, we know it is, and then pretend it isn’t to our detriment.
Any idea what the deal is with what looks like the Singapore coats of arms here? https://www.youtube.com/live/U9mJuUkhUzk?si=H8yYWiuJvaxVhIsV...
I made the mistake of stopping there to comment before finishing the article, so I've gotten several replies to this effect; You were the first, so I'll respond to yours.

"Endorsing" might be too strong a word, but they're certainly highlighting it.

None of the issues the article author (User:HaeB) has with the study's classification really manage to rebut it. They bring up a 2012 study (pointing out its methods were dubious) - but that was over a decade ago, and before the reforms to NPOV enforcement as the article and paper define them.

The author says it may not "generalize to other countries", but that just means we're talking specifically about American "conservatism" (and "liberalism"). Likewise, there's the anecdote about applying the general principles to the Republican Houses of Congress, where anti-Trump is the fringe, but the comparison there only really holds with the implicit admission that in Wikipedian politics, non-liberals are the fringe among the people making the decisions.
GitHub has been giving me 404s for the past few days, on my own repositories. Appears to be totally random. Comes and goes on its own.
Title misses that it's "weights and activations" as in they (from my skim) are doing all the math with mostly 4-bit values. Normally quantized weights are converted to 32-bits (edit: or more generally a type for which there are native machine instructions to multiply/add, as mentioned below) as they are applied during a forward pass which saves memory but incurs extra processing. They are keeping everything in (mostly) 4-bits to make it faster.
I suspect the reason most people don't have a few stacks somewhere is that the vast majority of people have no savings. 45% according to one survey I saw don't have $1,000 in savings.
I would expect if Krebs had information on a US operation he'd turn it over to the FBI first and report when the operation was busted.

I'm sure the Russians DGAF as long as the locals are getting their bribes, now if this guy ever leaves Russia he might get nabbed by an Interpol warrant.
Hey! i mean you own that commit hash! and you can show it to others through an ipfs link!

So basically ipfs won?! or lost?!
That'd have the problem of tools like grep returning nothing, having an exit code of 1, but being a perfectly valid thing to suggest in the future.
Here's the Linkedin of the channel's CEO for you: https://www.linkedin.com/in/frank-melloul-158470/

Source of the fact that he's indeed the CEO: https://www.i24news.tv/en/executive-committee.

I mixed-up the news Channel owned by Altice (M6 doesn't belong to it), but it's still clearly an important player in French media: https://www.alticemedia-adsconnect.fr/nos-marques/

You're the one trying to muddy the water, first by implying that French media weren't reliable, and then trying again against my refutation.
piece of feedback: it's weird to have a drop-down on "OpenAPI Links" when there are no other options.
It’s a scam, so calling it simply pseudoscientific is quite light-handed.
It’s not as impressive as it sounds. Weather balloons go up pretty high too. Making a rocket go straight up into space and comes down again in a ballistic trajectory is relatively easy compared
to making one that goes to orbit. This is the same kind of headline that Bezos was generating when he landed a rocket from “space” - up but not around.
The PDP-11 has virtual memory with 8k pages. There are four address spaces of 64k each, one each for supervisor/kernel/user and for each of these text/data. This was extensively used with e.g. 2.11BSD to cram programs into the address space that are way too large for what the PDP-11 can do. And yes, that includes the ability to resume on memory trap.

You can read more on the Gunkies site: http://gunkies.org/wiki/PDP-11_Memory_Management
I bet I can think of a less erotic environment than a public restroom, such as...

...I'm going to have to get back to you.
Define "holding" them accountable.

In my experience, this just means asking them to move faster, faster, faster but hold them "accountable" for the inevitable outage.

Unless engineers have the overriding power to define and redefine timelines, without management retaliation, "holding" them accountable== make
Interesting - glad it worked out for you! I agree though -
many doctors just jump to a solution without fully understanding the root issues first.
Well, paying the bills when you're a company whose primary project is open-source remains an open problem.
Was the L40S intended to be a workaround for the export restrictions on the H100, or did Nvidia always plan to create the L40S?

https://fortune.com/2023/11/01/nvidia-shares-fall-report-us-...

>The restrictions were supposed were supposed to only come into play on Nov. 17, 30-days after the US first announced it. But in a filing on Oct. 24, Nvidia said it was informed that the rules were effective immediately and that it would affect shipments of Nvidia’s A100, A800, H100, H800, and L40S products. The 800 series chips were designed specifically for the Chinese market to circumvent the earlier iterations of the export control rules.
That 3M would be in today's dollars already, so need to adjust up for future (predicted) inflation.

Note the catch "for a 20-year retirement". So if you think you might live to be 85, you get to retire at 65.

If you want to retire early, you need more decades of runway thus a lot more cash saved.
Note this is RTX 4090 silicon.

In inherits the... quirks of the 4090, namely the loss of NVLink (which the 3090 had) and basically the same memory bandwidth as the 3090. Also, apparently the crippled tensor core performance for the L40. And the price hikes.

I'm not really trying to sound bitter, but its hard to talk about Nvidia's lineup now while ignoring the artificial segmentation or price inflation and some small corner cutting. They would make Intel at their anti-competitive peak blush.
very likely: we have a "channel" in our DNA to worship, from our ancestry (N-thousand/million years ago) where we were starving to death, chasing woolly mammoths. Those who prayed and concentrated/unified their collective energy to make it 1 more kilometer and finally killed their prey survived. Those who gave it "the ole college try" didn't pass on their DNA because they starved.
Houthis are Iranian proxy, so they likely got Iranian missiles (among other weapons).
> Trees just piled up instead of rotting. That resulted in oil deposits.

That resulted in coal deposits of the Carboniferous. Not oil.
Inkscape is extremely useful for me in combination with a laser cutter.
Grok? Just kidding
Agreed. We should make life easier for our users. That's why a language like Python or Java, with a faster development time, where we can fix bugs faster and ship features faster, is vastly preferable.
Open researchers are trying to shrink and speed up 138K models e.g. YaRN https://github.com/jquesnelle/yarn

It's very compelling and opens up a lot of use cases, so I've been keeping an eye out for advancements. However, inferencing on 4xA100s would be the target today for YaRN and 128K to get a reasonable token rate on their version of Mistral.
How do you square this with OpenAI's assertion that they never use data from enterprise customers for their own training? Are you suggesting they're lying?
Yeah, clearly the camera had a UV filter. We are missing out on the brilliance :)
I'm refusing to update to Windows 11, and won't do until I buy a new machine or something like that, and I wish I could go back to Windows 7, where the task manager doesn't get frozen when things go bad or where there are programs like "Settings" made with that Metro/UWP apps that go slower than most Electron apps written in JS.
I disagree. Using the same algorithms, a language like Typescript or Javascript will inevitably be slower than ones that are “closer” to the CPU.
There are two approaches in my opinion.

You could go with the "beginner = easy" approach, in which case I'd recommend you go with VS Code and learn as much as you can about it. It's more-or-less the "standard" tool these days for general purpose programming.

If you're like me and want to jump into the deep end, I'd recommend trying GNU Emacs[1] and following the Emacs From Scratch series[2]. That's how I started actually "programming" instead of just messing with Linux all the time. I won't go into too many details, but Emacs is a divine gift for programmers. Lisps are also a divine gift. They're crazy powerful and you can pretty much make whatever you want out of them. You'll learn some programming AND get (subjectively) the most powerful and efficient IDE in existence out of it, and Emacs can do a lot more than just that (email, finance, note-taking, anything you want). Some people might try to convince you that Emacs isn't for beginners but that's just plain wrong. It's not for everyone, but beginners can handle it just fine.

I have a playlist[3] on YouTube which includes all of the Emacs From Scratch videos plus more from the same creator. It include his tutorials on the Emacs Lisp language and some of his other streams. Lots of good stuff.

- [1]: https://www.gnu.org/software/emacs/

- [2]: https://youtube.com/playlist?list=PLEoMzSkcN8oPH1au7H6B7bBJ4...

- [3]: https://youtube.com/playlist?list=PLmjXtAFVOGx6Gca81mX_XQSG1...
What a time capsule of how early free-ish software tried to monetize itself and the odd politics of University computer systems.

I was curious about Yen and saw a small bio about him:

https://chinacenter.umn.edu/umn-china/history/alumni/disting...

Its a bit interesting, and shocking, some of the members of the teams behind proto-HTTP software in the 90s were college graduates in the early 60s. If I'm doing my math correctly Yen would be in his 80's today.
Trying to figure out which of the five fringe science groups you mentioned are downvoting this comment
A sounding rocket basically the dimensions of a telephone pole can exit the Earth's atmosphere, going straight up(and coming straight down). It's getting enough sideways speed for orbit that requires all the extra fuel.
Their zappier demo was uninspiring. They are trying to appeal to the mainstream (non devs) users when their actual value is the API. Everyday users don´t have access to propriatery data that makes the LLM Bots valuable.

This makes me think that open source models are the future, for other reasons as well. No company is going to give them OpenAI their data to make bots, regardless if they won't train on the data. So what OpenAI can do at the moment is to focus on everyday user, and see where the biggest use cases are.

Furthermore, as Sam alluded to, this confirms to me that multi-LLM architectures (AutoGen, AutoGPT, BabyAGI etc) is the future. It´s about pushing the ways in which we can use these models, i.e. using different architectures because it will be a while before we get into more powerful models. These is simply no compute for it at the moment. The dust has yet to settle.
SIMD is possible in Go, see: https://github.com/bytedance/sonic

Between Go and Rust for infra, let's say that Go is the #1, Rust if far far behind. Most recent infra tools are built in Go, Kubernetes, Docker, Prometheus, Grafana, Terraform etc ...
This is just Japanese culture. A lot of time, people know it's less efficient, but the Japanese idea of efficiency in itself is different than in the US.

In Japan, it's not about doing things in the most efficient way. It's about being on the same page as everyone else. The mindset is that even if this way is less efficient, if everyone does it the exact same way every time, you can guarantee quality and consistency. Hard work is also held in high regard even if it's dumb work, because you're signaling to everyone that you're a team player-- as opposed to a rockstar who wants all the credit and recognition.

The upsides to this are what Japan is famous for-- quality and consistency. It's why the train is always on time and the convenience store is always around the corner. The downside is that you're often punished for innovating or thinking on your feet. I personally think this is why Japan is famous for quality products rather than innovative ones.
What is low quality about it?
When range is your overriding concern, what's so surprising?

An offshoot to the range problem is the question: "Can I be sure I can recharge this thing?"
Lifelong nose struggler here... one unexpected benefit for me with a CPAP was the constant filtered air. Really helps with dust and allergens. Plus, one of my masks has filters that also add moisture, so my nose, mouth, etc aren't drying out.

Like one of the other posters, years ago I talked to a doctor about fixing my septum and turbinoids, but he offered that there was absolutely no guarantees of any kind that it would make any difference.
Doesn't seem like a problem to me. Many brands are acronyms that are meaningless, too technical or arbitrary. Very common for cars for instance, how about a BMW X5 V8 SUV?

Plus, "generative pre-trained transformer" sounds futuristic, which seems like a fitting brand image for OpenAI.
"What looks like squeezing value out of OpenAI today might look a lot like technical debt and frustrating lock-in a year from now."

Just wanted to highlight this as such a great, concise way to look at the Buy vs Build with pretty much any cloud service, thanks!
> They became used for computing in the late 1800s, notably for the 1890 census

Those census records would have been awesome. I was lamenting it's absence just yesterday.
First of all, the odds of "white cis men" as you put it being put to shame for free is... quite, quite smaller than people who don't share the social structure privilege.

It's... not that people have a _need_ to do that. And let's be honest, you know it.

And second, there's a reason reverse racism and cisphobia aren't things, and that "they" (kinda we; I'm in the group too) are deemed privileged: by default they do happen to have it quite easier over the course of their lives. Both in opportunities and general quality of life. And things got so bad there was finally some critical mass to try and get people less scared of contributing to Free Software because they are in a group that is _quite_ disproportionally bashed by groups disproportionally more in power. One shouldn't compare the reaction of the oppressed with the violence of the oppressor, after all.

Bullies are trash, bullies in power doubly so.

If you think there's a _need_ to be able to hurt others, be it the group you are somehow against or think about them hurting you, I don't think the issue is in the CoC.

Maybe if a good number of people hadn't done bad things for decades, no one would need a CoC. But this is the world we are living, where people define themselves by their ability to mock and shame others. One group happened to do it a lot more.

Do you think it weird that it doesn't seem an issue at all? I just never thought of shaming others. Or feeling like the right to "need" it matters. I don't think this is the right mountain of freedom to die defending at all. What matters is code, helping a community grow, helping people get a modicum of privacy and freedom at least on their software. Not being free to harass.
See, this is a problem I see many junior engineers struggle with: Excessive desire to make one's own life easier at the cost of customers.

Yes, your codebase is nice and elegant and maintainable. But you haven't shipped as many features as the Python or Java developer, haven't delivered as much value to customers. Ultimately, the users suffer. It's a form of selfishness.
Medical expenses like OP said. If you retire at over 65 then possibly Medicare/etc can cover some of this.

But if you're wanting to retire early, it's a huge gamble on medical expenses in the US.
> did Nvidia always plan to create the L40S

Nvidia repurposes their gaming silicon every generation, and this one is no different.

If you are talking about the L40 vs L40S, I'm not sure. Does the L40 just barely sneak by the export restrictions?
Huh, I thought this is what was usually meant by quantising
Creator of Cicada here. Thank you for the feedback! I've mentioned this in a few threads already, but the reason for making a new DSL for writing the workflows is that YAML makes it hard/cumbersome to express more complex workflows. Using a programming language though gives you more control over how your workflows execute. While there are already plenty of tools that use existing programming languages (ie, Python/TypeScript) to configure workflows, having a custom DSL allows you to make some of the more abstract terms like caching, conditional execution, permissions, etc. more explicit.

To your last point, I have experience with using CD in production, but not to the scale where I have builds stepping over each other and causing issues. I agree that serial builds are important in this case, and is something that I will need to look into (conceptually it sounds pretty simple).
What would those "crappy, outdated" laws be? We have one of the more functional commercial law systems in the world.