skysight-inc/HackerNews huggingface dataset:
It's important to note that despite the recent excitement about LLMs, which is still an emerging technology, "AI" is not a new market by any means, nor are major companies only now investing in it. For the better part of a decade, ML has been widely adopted across industries, and the average person uses an "AI" system many times in a given day.

For example, if you open the home screen on the average smartphone right now, you'll see apps like:

- Delivery apps like Uber, Lyft, etc., whose recommendations, ETA predictions, driver matching, and more are built on ML.

- Media apps like YouTube, Netflix, etc., all of whom rely on models for recommendations.

- Email apps like Gmail, whose filtering (both spam and categorization) and text completion are based on ML.

- Photo apps like Instagram, Snapchat, and even your phone's basic Camera app, all of which use computer vision.

If you Google anything, you're perusing the output of a model. If you're being recommended something on basically any platform, you're interacting with ML. If you ever use speech-to-text, you're using a neural network. Your bank uses ML for fraud detection, your posts on social media are moderated by ML-based content moderation, and if you have a car with any recent-ish sort of lane departure assistance, you're driving with help from a neural network.

Most of these companies have large, mature ML teams, whose outputs represent massive amounts of revenue. Hence, they represent a legitimate market for selling picks and shovels.
What Is SolidStart?
Not to discount the other issues, but apple wallet being offline is one of my favorite features and side-steps many of the issues related to connectivity of bandwidth issues when you're at a large event/venue.

It would be much better to have varied and robust options though.
I don't have any issues with Python's packaging ecosystem anymore, having settled comfortably into a pyenv+virtualenv+pip-tools as my "stack" after going around the block a few times.

But even so, I must recognise how awful the experience is for new users. It's taken me years to settle into this system, and it can take half a day to get someone up to speed with these tools if they haven't used them.

I also work a lot with non-developers who need to use or contribute to Python models, so that doesn't help — but I bet it would take an order of magnitude less time to get them up to speed with something like cargo. Coaching them has helped me see how user-hostile the process is to beginners.

It also doesn't help how infectious "all-in-one" Python distributions like Anaconda can be, to the point that whenever anyone has an unexpected issue one of my first reflexes is to check their PATH. The fact that Rust has a widespread default toolchain multiplexer completely solves this issue.

I appreciate that maintaining such a toolchain is work, and there is value as well in the diversity and choice of an open ecosystem. But perhaps building is one place where first-class support by the reference implementation creates a worthwhile tradeoff.
The good thing is that if it's only finetuned on 15k instructions, we should see a community made model like that very soon.
Thanks for spotting!

Updated now.
It’s good practice to have a copy of the recovery key somewhere.
It is a bit more flexible would be my guess.

On the flip side, separate arrays and pointers should be slower on modern CPUs because the multiplication will be faster than the cache misses from jumping around in memory.
Right, but they’re not competing directly on offering the LLM - they benefit from having a better LLM as a feature, but their value add is elsewhere in the product.
https://aidev.codes shows connected to VM.
My mistake in the wording. The California law creates a private right of legal action for intentional distribution, not creation.
You are acting like an ignorant first rate asshole.

As example of your ignorance is your lecture about the dangers of an umbilical cord wrapped around the neck. That is, in fact, very common and it is incredibly rare for it to lead to complications. https://unmhealth.org/stories/2022/12/nuchal-cord-managing-d...

Which leads to your willful ignorance of the fact that the guy was exposed to a lot of research about problems in medicalized interventions. "This guy"'s critical experience was almost certainly running across that research. And not on his personal anecdote. I've seen enough of that research myself to know that the interventions that he's questioning really aren't equivalent to any of the software best practices in your straw man comparison.

As for an example of your being an asshole, take your question about what he's upset about with due dates. You are right that it is a medical fact that the date chosen is imprecise. He knew that as well. But you are wrong to have not noticed his story about having his wife be asked about abuse because she wasn't getting induced 2 days after her due date. That behavior on the part of the doctor is an excellent reason to get unhappy.

Now why do doctors behave that way? According to research I saw close to 20 years ago, because they really want to control when the baby comes. It is more convenient for them to have a baby come during the work week rather than interrupting their Sunday golf game, and so they pressure mothers to make that happen. They do this both by recommending medically unnecessary Caesarians, and by inducing when there is no medical need.

Which is an example of the arrogance of the medical industry that illustrates why people get upset about this.
If you're willing to sacrifice token/s you can even run these on your phone.
If they log off, how will they know how is this a problem? Assuming someone’s going to answer this question.
I suppose a “long time” is relative. I don’t have a Twitter account and haven’t cared much about what he does for about…3 months or so? with a 24 hour news cycle that fees like an eternity.

I thought gp was alluding to something within the last few days.
Any suggestions? I found my current job on climatebase.org but am interested in other ways to help. I would love to be able to directly quantify my work's impact on the planet.
Build a chatbot with custom data sources, powered by LlamaIndex
Is this even true? That refugees and asylees largely vote democrat?

I ask because a lot of these people come from countries that are highly conservative in nature and culture.
You remove one of the sensors and pretend the disagreement didn't happen?
Exactly. He's mercurial, he doesn't think things through properly but how many founders have created a $1 trillion company? Let alone SpaceX, Boring Co, Neuralink, and X.ai
Bisqwit on youtube
Author here: Right now we're entirely focused on getting parity of functionality so that anything that runs on the Hotspot JVM runs similarly on Jacobin. There's still a lot of work to do to get there. However, once we do get there, we'll start working on performance.
By the way, SpaceX's updated job descriptions are consistent with this interpretation. They now say:

"To conform to U.S. Government export regulations, applicant must be a (i) U.S. citizen or national, (ii) U.S. lawful, permanent resident (aka green card holder), (iii) Refugee under 8 U.S.C. § 1157, or (iv) Asylee under 8 U.S.C. § 1158, or be eligible to obtain the required authorizations from the U.S. Department of State. Learn more about the ITAR"

They have explicitly added refugee and asylee.
What threat model assumes it is easier to attack fTPM than the OS that is running?

Once you are online Bitlocker does nothing and you can just attack the OS and bypass all of its protections trivially...

Your threat model here assumes arbitrary code execution as a starting point of an exploit, the security game is up for the PC once that occurs.
You can say this about every major invention. The loom destroyed jobs! The engine destroyed jobs! So on and so forth.

This view is critically flawed in two major ways:

1) AI is not anywhere near being able to replace the majority of what developers do on a product team. We are decades away from a PM at Facebook being able to type "make a twitter clone that uses instagram login and can scale to 1 billion" and have an AI just do it.

2) Programming and product work is not zero sum. The more we can do means the more product we can make. It means more products can be made overall. After the loom came out, we simply made more clothes than ever before and in the process created a ton of jobs. We are not at some peak software point where we've completely saturated all humanity's need for software or profitable software and thus tools that increase efficiency don't put us out of work.

And frankly, if we develop the kind of general AI that accept a query like "make a facebook competitor capable of scaling to 10 billion" and simply do it, inventing whatever languages, frameworks, hardware, processors, patterns, methodologies, global datacenters handling global politics and law, etc, etc necessary to accomplish such a task, then so be it. I welcome the overlords!
The Boniface Option
He might be sane now, but will he always be? How about each of the next 100 leaders? The terrifying thing is that it only takes one crazy/confused/suicidal leader to obliterate humanity. The risk in any given year is usually low, but everyone knows how small chances compound over time.
I never stopped!
The uncarrier stopped being a thing as soon as the old CEO, John Legere, left. That was the only time it felt cool. Mike is ruining that legacy, and now has plans that are more expensive than AT&T or Verizon. Only good thing is that their prices are inclusive of taxes and fees.
You're right the scummy marketing is such a turnoff it's not worth even looking into
> The Immigration Reform and Control Act of 1986 (IRCA) makes it illegal for an employer to discriminate with respect to hiring, firing, or recruitment or referral for a fee, based upon an individual's citizenship or immigration status.

https://www.eeoc.gov/national-origin-discrimination

The Civil Rights Act also prohibits discrimination on national origin.

Obviously the CRA does not mean you have to hire blind people to be truck drivers. You do have to provide reasonable accommodation for jobs they can do. If you circumvent the reasonable accommodation requirement by eg barring people by immigration status for jobs where it is irrelevant, you're breaking the law.
The Programming Priesthood
34B should be able to run on 24GiB consumer graphics card, or 32GiB Mac (M1 / M2 chips) with quantization (5~6bit) (and 7B should be able to run on your smart toaster).
I've used Ollama to run Llama 2 (all variants) on my 2020 Intel MacBook Pro - it's incredibly easy. You just install the app and run a couple of shell commands. I'm guessing soon-ish this model will be available too and then you'd be able to use it with the Continue VS Code extension.

Edited to add: Though somewhat slow, swap seems to have been a good enough replacement for not having the loads of RAM required. Ollama says "32 GB to run the 13B models", but I'm running the llama2:13b model on a 16 GB MBP.
Among the ML descendants, I suggest Scala 3, because it has essentially all the power that we like in Haskell, (HTKs, good support for ad-hoc polymorphism), but runs on the JVM, a mainstream platform with a vast library ecosystem.
Already being discussed here: https://news.ycombinator.com/item?id=37249002
It's not "obvious" that he is not opposed to bad and harmful technologies.
confusing, did they just invite or actually accept new members? My understanding is the later and that the headline is misleading.
The Go scheduler is now (well, for years) preemptive.
Llama2 is not licensed non-commercially. There was some weird provisions about not having more than 1 billion users at llama launch though
A) so you’re competing against aws, azure, etc. That sounds brutally tough.

B) re: value adds, like what exactly?

C) this seems like such core functionality that a company wouldn’t outsource this to a 3rd party vendor. If that’s the case, there isn’t an opportunity to sell anything if you’re that AL/ML vendor then.
> If a sensor-fusion car cuts accidents per mile

There is no robust proof that any self-driving system outperformes a well-trained driver.

We could take that money and invest it into advanced driving lessons
(Current) AI is a glorified stochastic parrot[0]. Randomness != Reason.

[0] https://en.wikipedia.org/wiki/Stochastic_parrot
Maybe they used GPT-4 to train it. OpenAI terms of use don't allow that to be released commercially.
Author here. No threading currently. Once we have all the bytecodes executing, we will perforce be obliged to add threading. Starting with the heavier threading that Java pre-Loom uses.
https://www.forbes.com/sites/alexkonrad/2023/07/13/ai-startu...

> Its revenue run rate has spiked this year and now sits at around $30 million to $50 million, three sources said — with one noting that it had more that tripled compared to the start of the year.
Yes, it's fine to have a large product line with different price points for different consumers, but I don't think it's quite fair to add the last generation's cards in there too (because they won't be around forever). Typically they only keep 2-3 generations alive in the marketplace at any given time, and if the prices keep going up, once the 30xxs disappear, so too will the affordability. Even an entry-level 4060 is $299 these days and doesn't have much RAM.

My fear is that Nvidia, seeing record-high profits for their datacenter cards, will gradually phase out budget/midrange gaming cards in favor of the higher end stuff. Maybe AMD and Intel will step up their game to tackle that segment, who knows. Or maybe Apple Silicon gaming will gradually take off. But if neither of those happen, there might just be a huge void left in the "affordable PC gaming" segment (which used to be most of it, not so long ago).

On the other hand... I do have to give them credit and say that GeForce Now is AMAZING -- limited library aside. If they can keep growing that segment, hell, maybe the future of PC gaming is just in the cloud, like everything else, and nobody would want to buy expensive GPUs for home use that just become obsolete in a couple years anyway.
Llama is a very cool language model, it being used for coding was all but inevitable. I especially love it being released open for everyone.

I do wonder about how much use it'll get, seeing as running a heavy language model on local hardware is kinda unlikely for most developers. Not everyone is runnning a system powerful enough to equip big AIs like this. I also doubt that companies are going to set up large AIs for their devs. It's just a weird positioning.
Space work requires clearance in all nations. This DoJ lawsuit doesn't make sense given that the primary client for SpaceX is NASA.
> whoever you elect to the office, lobbyists already bought their asses before day one

This is a disingenuous attitude; yes, special interests/lobbyists fund far more than (I think) they should, but there are _very_ clearly differences in opinion and legislation amongst political candidates and elected officials.
> It's about building and maintaining the electrical/cooling/network infrastructure the servers require.

Except at the extreme high end of scale, you never do this yourself. Rent racks in a colocation. It's a very clean separation of duties. You handle all the tech work, they handle all the real estate upkeep.

> Or you rent a rack in a colo (or five)... But that's just a step away from going full cloud

What? Not even close. When you rent a rack in a colo you have 100% of the benefits of owning the hardware (much higher performance, much lower cost). Just because you let someone else do the A/C and generator maintenance (and other non-computer real estate logistics) doesn't make it anything at all like the cloud.
I wish I could open a window for ventilation without also opening it for sound.
Even when the maintenance is short term, there is also optimization for making the expected type of changes quick and/or easy to perform, something that appears particularly hit or miss with language specific problems: having to fit monad square pegs into typeclass round holes when two libraries need to be used together, unexpectedly needing a significant increase of sophistication and/or boilerplate to support a generalization that should be small, finding a compromise between conflicting preludes or incompatible extensions.
It will be interesting in the future to read the "oh, Windows 10 is no longer tier-1 !!" when the bell arrives at their windows.

PS: Good job Microsoft, receive our acknowledgment. Say hello to the busy telemetry guys. /s
Once again it seems like you want me to inconvenience myself because you don't want to make the effort.

> It's like complaining that the sun is too bright after deciding to stay indoors and consequently not bringing a hat, but then being forced to go outside.

You really didn't know that in 2023 you might have to use a QR code to see a menu? That's like going to Seattle and being surprised that it started raining.
I don't understand questions like this. You have the entire internet to search, powerful search tools, libraries, bookstores, etc. You're asking about the most basic building blocks of a subject (akin to asking "How can I learn about arithmetic?"), of which there must be an effectively infinite amount of material aimed at beginners.

The best answer to your question is "Do anything. Anything at all".
I was using the phrase relatively casually, but im interested to learn more there.

I was not exactly trying to argue it ipso facto but rather just the nature of it lends itself to (imo) being a much more commercial experience than not when you take a commercial model off the shelf, bring it home, and ask it to show you content that would be illegal to trade otherwise.

Basically I'm arguing that anything the model can generate is relevant to the transaction of the model itself once generated. As in, everytime a model generates something for you, you should think of that generated item as something you originally obtained in the same manner you obtained the model. Creating illegal content at home with a local model you downloaded off the internet is, to me, the same as just downloading illegal content directly from the internet.

If a painter cannot sell you a portrait they painted of someone without their consent, then it's equally illegal to invite the painter over your house and have them paint it for you in secret.
This is a wind-up, isn't it?
Elon was (sadly) right. His cuts were painful but they produced a much leaner and more productive company at Twitter. They actually ship now.

Nat Friedman once said on Twitter that tech companies are 2-5x overstaffed and everyone knows this.

I hope the same positive outcome comes out of T-Mobile, and not just people losing their jobs. And I hope they find new jobs soon.
This is a really dishonest interpretation of events. US law states that asylees have been vetted thoroughly and can take these positions the same as any US citizen or green card holder (if you had read the article).
> And that is - always be ready to walk out.

No, it's to crush your competition. And we all know it. Employment is largely out of an individual's ability to negotiate—we're all getting fucked and we know it.
You ought to think about using Oracle Cloud for your next LLM/GPU project, because they sell access to A100/H100s for cheap and they actually have them in stock!
any group that punishes criticism is destined for failure.

Censorship is something groups do, govts and beyond. When the govt requires you to be a member of an organization and that organization does these things, it's hard to argue your case that this is somehow devoid of govt connections

it's childish to call someone an idiot for having different opinions or beliefs, grow up
Note that current GPT-4 pass@1 for HumanEval is closer to 90% than to 67% reported in GPT-4 technical report, as reported, e.g., in [1]

[1] https://arxiv.org/abs/2305.01210
The people the DOJ claims are discriminated against (asylees and refugees) can't vote. The issue is SpaceX claiming they can only hire citizens (who can vote) and permanent residents (who can't vote).
The locking feature built-in locks it at the hub. I feel good that I've made some thief's day worse.
> One aspect of this is that some laptop manufacturers provide a setting to erase the TPM is the laptop is opened.

Do you mean like if you remove the screws and get inside a laptop?

Could they gain access by cutting the plastic instead (maybe Matrix parasite extraction style).
$6/GB/Month or $6/TB/Month?
... "seeing as running a heavy language model on local hardware is kinda unlikely for most developers"

for now it is :) but with quantization advances etc. it is not hard to see the trajectory.
MM-DD is not terrible.

It was a useful format for a very long time, and in contexts even today, it is still appropriate. Say I have a bunch of dates associated with things I want to organize, maybe physical things. First of all, in my organization, the year is either inconsequential or it's just implied - "the current year". Ok. What's next? The month. So the month and the day are most significant. And say I want to file things away in a cabinet for the implied or current year - we go by month first, then day, not day then month - that would be silly. And colloquially we say "month/day", and again, the year is implied. So then we write the way we speak things, and that yields MM-DD. When we do add the year, it just comes at the end. That's not terrible, it's useful for what we need it for.

In American, the format emerged organically, it was useful (still is), and it just stuck.

If you're a software engineer and you need YYYY-MM-DD dates because they're easier to work with and they collate more appropriately, that's great, that's your use-case. Engineers, however, are infamous for not considering others' use-cases, least of all the use-case of the users they're actually building their program for! Perhaps that's why so much modern software is just so user-hostile.

Perhaps the engineer should consider that his goals and use-cases are not necessarily the same as other people's. And perhaps he should stop trying to impose his own goals and use-cases onto others. And before he criticize others' specs, reqs, and use-cases, perhaps he should make an attempt to understand them to begin with.
"I have spent the last eight months researching the JVM--reading the docs and articles and doing exploratory coding in various languages with which to write the Jacobin JVM."[0]

I wish I had the discipline to decide I wanted to do create a long-term pet project, spend months researching what kind of project and which programming language to implement it in, and to still be motivated enough to keep actively updating it 2 years later. Also, the code comments are educational, and the write-ups are inspiring. Great stuff.

[0] from http://binstock.blogspot.com/2021/08/a-whole-new-project-jvm... linked from article
Since his cuts Twitter seems like it would be worth a lot less than he paid for it. And twitter shipped before him.
Still waiting for a sample return mission
I think online ticketing systems are fine, and yeah they mostly require to run on a robust infrastructure. Knowing the trends, that certainly would depend on big-tech cloud infrastructure.

I don't care unless this become a mandatory de-facto standard to access public places.

Hopefully yet it is not, and people would reject that if that would become an obligation. But there's a chance that our children would not even know this is bare dumb cause it would be the norm.
They are talking about cells, but must every form of life be built from cells?

It seems like all life on earth descended from one species, that was a cell. So all our life on earth is made out of cells. But couldn't life be completely different somewhere else?
Ship what exactly?
The deviation in sea ice extent from previous years is terrifying. I've been watching lines be slightly lower than previous years my whole life but it seems like the ice loss has accelerated dramatically.