skysight-inc/HackerNews huggingface dataset:
not only price but also speed and API limits.

I always ask myself the following pseudo-question: "for this geneneration/classification task, do I need to be more intelligent than an average highschool student?" Almost always in business tasks, the answer is a no. Therefore I go with GPT3.5. Its much quicker and good enough to accomplish the task usually.

And then I need to run this task thousands of times, so the API limits are the most limiting factor, which are much higher in GPT3.5 variants, whereas when using GPT4 I have to be more careful with limiting/queueing requests.

I patiently wait for a efficient enough model that only needs to be on a GPT3.5 level I can self-host alongside my applications with reasonably low server requirements. No need for GPT-5 for now, for business automations the lower end of "intelligence" is more than enough, but efficiency/scaling is the real deal.
I wish modern "closed captions" were accurate. It is one thing to have a computer screw up voice recognition on a live broadcast. It is another thing to allow the same on a prerendered video in which somebody has a chance to check the input and the output.
how does this work in their favor as a business? Don't get me wrong I love how all of it's free, but that doesn't seem to be helpful towards a $2b valuation. At least WeWork charged for access
On Mastodon (and similar socials like Twitter and Facebook to a certain extent) you mostly follow people instead of themed groups like Usenet.

You set up your "wall of postings" (the "feed" or "timeline" in the jargon of socials) by following (subscribing to) the people you're interested in. On Mastodon you can also follow topics by following "hashtags", which are the sets of posts by any user tagged with a string preceeded by a hash character. For example, following the hashtag #retrocomputing will bring in your timeline the posts about that topic.

So, on socials, you typically scan your feed and the feeds of any additional hashtags you're interested in. For each post you can reshare it, reply (comment), or like it.

Some additional resources: 1) https://opensource.com/article/23/1/mastodon-beginners-guide 2) https://github.com/joyeusenoelle/GuideToMastodon
You're looking too close to the trees gcc/vi instead of the BSD forest.

BOW's only weakness is its single user mode, more so a limitation of being a Win16. If it'd been pushed harder to a NT service/client/server DLL it'd have been a much bigger player.

It's all moot, Pink/taligent died, Virtual Machines is where everyone runs their stuff these days, OS/2 had the driver/disk/filesystem stuff done right.
> Today, it's worth $175bn in the private market.

Only theoretically.

In practice, just because someone is willing to buy a completely insignificant stake (0.2%) for $500mn doesn’t make the entire company worth $175bn.

If anything, this is probably Elon and his friends pulling off an accounting trick.

I can register a company with a share capital of $1 and issue 1000000000000 shares with a nominal value of $0.000000000001 each. Then I could sell you one of those shares for $1 and then I could tell everyone that I’m a trillionaire. Which would technically be the truth.
I feel like the new kinda-alternative on the rise is to support federation with either ActivityPub, BlueSky/ATProto or both.

That is, instead of going for search engines, go for open social. It’s obviously a new and relatively unpopular ecosystem, but makes much more sense than this SEO stuff IMO.

Wordpress have rolled out their AP support and it seems to be working well so far. I just “replied” to a blog post on mastodon today without even realising it was from a blog.
30 years of DOOM: new code, new bugs
Today marks the 30th anniversary of the first game in the DOOM series! We couldn't miss the event. To honor the occasion, we decided to see what the code of this legendary game looks like after all these years.
Or in other words: people have misused px so bad it now literally does not mean px anymore because then the web would be unusable.
> The DOS version was dreadful.

Not at first, and not later.

Apple sued DR and won, and DR had to cripple PC GEM. No overlapping windows, no icons on the desktop, drop-down menus instead of pull-down, and much more.

When it went GPL, all the removed functionality was put back, plus most of the stuff from the vendor-specific runtime-only versions 4 and 5.

IMHO it looked great:

https://www.seasip.info/Gem/History/freegem2.html

Also, some of the GPL code went into EmuTOS, an all-FOSS TOS+GEM, so it wasn't wasted or lost.
Necessity is mother of all inventions
Are you looking for a job at Google? Don't be evil. They have enough scammers there already, no help needed, including PR at hacker forums
The Shirky Principle: Institutions Preserve Problems to Which They're a Solution
Isn't gzip disabled with https a thing since forever due to a security issue?
Finally a reason to update from 4.2.0
[Submitter here]

The original version, now FOSS: the PC port/rewrite of the C64 original.
This article[1] may be contextually useful.

[1] https://www.tomshardware.com/pc-components/ram/new-incredibl...
Didn't you know that everyone on HN bakes their own bread?
Two factors:

Scrum and its idiotic sprints, especially two weeks sprints. Sometimes things are more complicated than what they seemed, and maybe they just need a couple more days. In the overall scheme of things, no big deal, yeah, from time to time, things take more time than expected, the world is not going to end because of one or two days in 99% of the circumstances. Sometimes you win, sometimes lose and all that jazz. But, then the sprint is over tomorrow, a one day delay becomes a two week delay, demoralization and demotivation ensue, trust is fucked, and it is all downhill from that point.

Second point, closely related to this one, is the strange idea that some managers have that any delay can be solved by the copious administration of more overhead. Let's schedule more meetings! Let's micromanage more! Of course, the developers are slacking! Beatings to rescue. And this is related to the first one, because this kind of manager is usually a True Believer in Scrum.

Over time, developers, like any other animal, is mentally geared towards avoiding pain. Shortcuts will be taken, and one of the most obvious is overtime. And at first it works, overtime actually works a lot of time, until it is chronical.
No, that's not totally reasonable and expected. Change of control can be a valid reason for breaking open a previous arrangement, especially when that change of control negates the exact reason why people would join this to begin with.

After all, if your data can be transferred at will to another entity due to a change of ownership and the agreement you made can then be annulled (because the new owners don't care about your privacy as much as the previous ones) then that's an end-run around the whole principle.
A lot sites are like that (most big ones), that's the whole reason they started GDPR. All you have to do is add a few widgets/plugin/third party ads/traffic monitors/tracking and their dependencies and you'll get hundreds of "partners"

arstechnica, cnet, &c. all have 200+ "partners"
Why not actually?
Grant has singlehandedly taught me more than all of my elite education combined. Man is an absolute treasure
Cedar is a language for writing and enforcing auth policies in your applications
Maybe they will charge for accessing the future Mixtral 8x70B ...
Are you seriously claiming most oss is irrelevant? Maybe in consumer facing products such as libre office. But oss powers most of commercial products. I wouldn't be surprised if most functionality in all of current software is built from a thin layer over open source software.
That's another issue going on: you using your cheating to belittle Google scan which again plays against any ethical ground you might still had
Essentially, L4S shrinks the latency feedback loop. The second half of this video explains it quite nicely: https://youtu.be/tAVwmUG21OY?si=lydbqfNL80Y8Uxvp
* Open source models: give you all the attention (pun intended) you can get, away from OpenAI. At the same time do a great service to the world.

* Maybe in the future, bigger closed models? Make money with the state-of-art of what you can provide.
Show HN: AI driven but curated SAT-Math Tutor
Hi HN,

Last month, I have worked with my team here at Amy.app to make a stand-alone SAT Tutor.
I'm pretty excited about this product, as it's our first attempt to make a stand-alone product targeted directly at students.

So far all our products were targeted at teachers/schools/publishers. But we never found product-market fit ¯\_(ツ)_/¯

Our SAT-Math tutor is designed to find your knowledge gaps and gets you up-to-speed as fast as possible. We believe it offers a fresh approach on how online learning usually works.

Please let me know what you think.
The product has a 3 days trial period.
The link is: https://sat.amy.app/
Just click on "disagree to all", no ?
Embark on a journey to success with Salesforce for Travel & Hospitality! From a 360-degree guest view to sustainability solutions, Sales Cloud to Marketing Cloud – explore the tools shaping the future of the industry. Innovation, efficiency, and personalized experiences await!
Maybe after decades we have to accept that batched, concurrent I/O with asynchronous notifications is the least bad interface that can exploit the potential of modern hardware and let the simpler to use default Unix I/O model (blocking, synchronous) go. If this happens I hope we'll get a better designed API than some hacks around eBPF and io_uring.
Linux is funded by big tech companies. IBM probably put a billion into Linux and that was 20 years ago now.
Snader's Law: "Any sufficiently advanced technology is indistinguishable from a rigged demo."
It'd be balanced by the difficulty in getting the light into the material in the first place. You're right, you can't change the laws of physics. Light will only enter an object with lower refractive index if its angle of incidence is close enough to straight on that the beam coming through into the material has somewhere to go that satisfies Snell's law. When the object's refractive index is near zero, the object will only accept incoming light across an extremely narrow angle. This solves your concerns about having a global decrease in entropy.

You can fudge this by making the incoming surface of the object match the shape of the incoming waves. Then all the light will be allowed in. However, that surface will only match the shape of the incoming waves for light originating from a tiny point in space. If your light source is larger than a tiny point in space, then the light coming from the larger area will bounce off the material and not enter it. In effect, the magic material will magically collimate a light source, but only if the light source is already fairly magic, and in that case a simple lens would suffice.
Of course he'll say that.

Except, everything Ilya didn't like in Sam is amplified 100x in Elon, and also Elon has no money left to fund a serious AI effort so he's reduced to making quick models trained on ChatGPT-3.5 output for RLHF.

So precisely 0% chance.
And is illegal to boot. If that's their attitude they should not allow Europeans to register in the first place because all it will do is set them up for a confrontation with the various Data Privacy Offices. And such wilful language rules out any apologies.
The City with Golden Garbage (1952) [pdf]
This is a pretty fraught area. As the comments show, there's a lot of emotion, and cultural differences at play.

"Cultural differences" can be macro, like, in Japan, a 10-12-hour workday is de rigueur, and it can be "micro," like individuals that have different clocks.

I had an employee, who is, no exaggeration, one of the best engineers I've ever known. But he couldn't come in early, to save his life. He'd roll in, around noon, but would often stay until 2AM.

The Japanese loved him. He was often on their time zone.

American HR hated it, and I got called on the carpet, numerous times, as his manager.

But I stood up for him, and let him do his odd hours, even though it cost me. Fortunately, Japan backed me, and they were the ones in charge (that didn't win me any friends on this side of the pond).

I have been "retired" for the last six years. In that time, I have worked harder -and far more productively- than I ever did, in the workforce.

The key seems to be, as has been alluded in the comments, mastery of my own schedule.
I reckon these books or any other learning material will be sold with access to a trained AI on the subject.

So basically the expert/author will help fine tune the model.
I'd like to think it'd have had some subtantial tracktion back in the day, being able to overlay your work windows 3.1 machine with BSD. It has some DDE exchange I haven't tried to use yet, but it'll talk to Excel, so imagine having snmpwalk scripts to poll networks and do real-time excel graphs!? It'd have been awesome.
Also, I threw that in there because, if the site operators were to see "I don't expect them to actually remove my data", I do not want them to interpret that as releasing them from the obligation. It does not. It's just my prediction of how things will go.
Welcome to Europe
Well done, you're halfway to secure a job at Google, no eh
ethics/morals needed.
That's not really that interesting of a question, if the owner wants to give the finger to the laws of a region with 300+ million people in it then that's their right, how they go about doing that in a way that it doesn't translate into liability (rather than simply respecting the law with regards to EU subjects) is not something that we need to solve for them. The choice is theirs, so are the consequences.
You can say anything you want in european countries. Some things might backfire in various ways, though. IE if you megaphone that some person group X should be killed right away, that usually is a criminal offense and punished according to law.
Exactly this. It's worth pointing out how many comedians* have argued the dangers of today's "getting offended" culture. Not because they are 4chaners or far-right extremists, they certainly aren't, but because they appreciate the negative consequences it has for society.

* Rowan Atkinson, Stephen Fry, Ricky Gervais to mention some of the most outspoken.
What is strange is the part where CC reads the TOC (with usual tracks) then seeks based on time

Yes it would be normal if the sound was just one long track, but that's not what's happening here
I thought people would catch on to the sarcasm because of that. Too late to edit a /s in now.
Not really? Hard to find new though, 598 is older model, 599 is almost the same and more available

https://www.amazon.com/_/dp/B01L1IICR2/ - HD599 new, $149

https://www.amazon.es/_/dp/B01L1IICR2/ - HD599 new, €115

https://www.amazon.es/dp/B07Q7S7247 - HD599 new, €101

https://www.ebay.com/itm/296053418289 - HD598 used, $88
Probably for the better while I don't trust the Supreme Court on any partisan issues with their current make up, on nonpartisan they are more likely to be grown ups and actually research and consider the issue rationally rather than try and defened us from skynet or other fictional ai boogiemen by only allowing fortune 500 companies and the dod to play with ai.
For now LLM can only answer, but they will soon be able to prompt YOU.

True conversation is going to be very interesting.
anyone know the status of the Mill IP?

Edit: looks good to mid 2030's, eg https://millcomputing.com/blog/wp-content/uploads/2016/10/us...
Many VC funded businesses do not have an initial business model involving direct monetization.

The first step is probably gaining mindshare with free, open source models, and then they can extend into model training services, consultation for ML model construction, and paid access to proprietary models, similar to OpenAI.
> Aren't the vast majority of SaaS companies burning VC money to stay afloat?

Only if you're thinking of the HN/SV bubble. Many, many businesses exist that aren't startups and aren't VC funded, including many software SaaS businesses.
As I read it they are doing this with 8 * 7Bn parameter models. So, their model should run pretty well as fast as a 7Bn model and at the cost of a 56bn parameter model.

That a lot quicker and cheaper than GPT-4

Also this is kinda a promissory note, they've been able to do this in a few months and create a service on top of it. Does this intimate that they have the capability to create and run SoA models? Possibly. If I were a VC I could see a few ways for this bet to go well.

The big killer is moat - maybe this just demonstrates that there is no LLM moat.
You could broadly segregate the market into three groups - general purpose, specialized-instructions, and local tasks.

For general purpose, look at the uses of GPT4. Gemini might give them competition lately, and I dont think OSS would in the near future. They are trained on open internet and are going to be excellent at various tasks like answering basic questions, coding, generating content for marketing or website. Where they do badly is when you introduce a totally new concept which is likely outside of their training data. Dont think mistral is even trying to compete with them.

local tasks is a mix of automation and machine level tasks. A small mistral like model would work superbly well because it does not require as much expertise. Usecases like locating a file by semantic search, generating answers to reply to email/text within context, summarize a webpage.

Specialized instructions though is key for OSS. From two angles. One is security and compliance. Open AI uses a huge system prompt to get their model to perform in a particular manner, and for different companies, policies and compliance requirements may result in a specific system prompt for guardrails. This is ever changing and better to have an open source model that can be customized than depending on Open AI. From the blog post.

> Note: Mixtral can be gracefully prompted to ban some outputs from constructing applications that require a strong level of moderation, as exemplified here. A proper preference tuning can also serve this purpose. Bear in mind that without such a prompt, the model will just follow whatever instructions are given.

I think moderation is one such issue. Could be many and it is an evolving space as we go forward. (though this is likely to be an exposed functionality in future Open AI models). There is also the data governance bit - which is easier to do with an oss model than just depending on Open AI apis, just architectural reasons.

The second is training a model on domain knowledge of the company. We at Clio AI[1] (sorry, shameless plug) have had seven requests in the last one month about companies wanting their own private models pretrained on their own domain knowledge. These datasets are not on open internet and so no model is good at answering based them. A catalyst was Open AI dev day[2] which asked for proposals for custom models trained on enterprise domain knowledge. and their price start at $2M. Finetuning works, but on small datasets, not the bigger ones.

Large Companies are likely to approach Open AI and all these OSS models to train a custom instruction following model. Cos there are a handful of people who have done it, and that is the way they can get most out of a LLM deployment.

[1]: https://www.clioapp.ai/custom-llm-model Sorry for the shameless plug. Still working on website so it wont be as clear.
[2]:https://openai.com/form/custom-models
"But you have to admire someone who's willing to run a business into the ground for his ideals"

What ideals? He said just few months ago he'll never unban Alex Jones because: "I have no mercy on anyone who uses the deaths of children for gain, fame or politics."

Those were his stated ideals. As you see they're worth zero.
There is a link in the bottom right or left of that form that allows you to download without registering.
It's not even close to a 45B model. They trained 8 different fine-tunes on the same base model. This means the 8 models differ only by a couple of layers and share the rest of their layers.

Which also means you can fit the 8 models in a much smaller amount of memory than a 45B model. Latency will also be much smaller than a 45B model, since the next token is always only created by 2 of the 8 models (which 2 models are run is chosen by a different, even smaller/faster, model).
"W..what do you mean exponential growth is not the only dynamic?!"
Funny you should mention that - try telling people you're a Pagan and you get a similar reaction.
An aside - “Your privacy your choice” however we have 50+ cookies which are strictly necessary and can’t be disabled.

Wtf
I'd have to ask him if it's finished, but Joe, one of the core contributors to Templ definitely has a jetbrains plugin in the works: https://github.com/joerdav/templ-jetbrains
I haven’t worked on LLMs/transformers specifically, but I’ve “independently invented” MoE and experimented with it on simple feedforward convolutional networks for vision. The basic idea is pretty simple: The “router” outputs a categorical distribution over the “experts”, essentially mixing the experts probabilistically (e.g. 10% of expert A, 60% of expert B and 30% of expert C). Training time you compute the expected value of the loss over this “mixture” (or use the Gumbel-Softmax trick), so you need to backprop through all the “experts”. But inference time you just sample from the categorical distribution (or pick highest probability), so you pick a single “expert” that is executed. A mathematically sound way of making inference cheaper, basically.

Mixtral seems to use a much more elaborate scheme (e.g. picking two “experts” and additively combining them, at every layer), but the basic math behind it is probably the same.
i just wish gomponents/html would define an alias for gomponents.Text so i don't have the impedance mismatch of switching the package qualifier

but otherwise, I'm quite liking it so far
> a framework component is a reusable block of javascript while a webcomponent is a reusable HTML element.

Web components/custom elements are reusable behaviours/functions - which can contain custom js, all bundled as a reusable HTML element.

Think of it a bit like an object in an object orientated programming language - the object has both data/state (DOM) and code/functions to manipulate that state.
Was good maths
I actually don't really use the social stuff all that much. I already have a mastodon account on a country-specific server, and I'm not much of an IRC/Discord user
> A lot of people talk about adult mathematical/statistical illiteracy and how it leads to major problems with cognitive biases, poor decision making, etc.

Yeah, I find that difficult to imagine too. The assumption behind that seems to be that with the proper statistical knowledge, people are able to understand ... scientific articles? Because I don't really know where else you could find a relation between cognitive bias and knowledge of statistics.

But first, articles have the statistics done. Second, knowing statistics isn't going to make you understand the article, nor spot the errors. Third, most articles still rely on poor statistics, because many of the authors and reviewers still think that e.g. null-hypothesis testing is just fine. As a corollary, most articles are wrong, and should not be used for decision making.
I believe Space Station 14 is implemented using an ECS engine. It's open source but quite impressive regarding scale and features. It's also a multiplayer game which brings some extra questions to the usual ECS ambiguities.
> Are you seriously claiming most oss is irrelevant?

No