skysight-inc/HackerNews huggingface dataset:
I wanted to plug a GPT4 chatbot into a group chat, so it could react to what people said. In the end I abandoned the idea because it was too hard for me to figure out when it should talk vs let people talk between them.
> you need to look beyond its direct, first order effects.

Sure, I agree! But too many developers, in order to look beyond the first order effects, have a tragic tendency to forget about looking at the first order effects. And that is a big problem!
Radio and TV evangelists that steal money/time from people have been around for many decades. Leave it to the government(s) to deal with them or lose your Section 230 immunity.

For fun, lookup the history of Zzyzx Road off I-15 in California... ( https://sbcsentinel.com/2019/07/shannon-2/ )
I am guessing you mean you can not complain about edge case quality in Free Software. Because people discuss quality all the time.

Getting video crashless seems hard, I had problems back in 2006. Have not tried again.
Hamas isn't just a political movement. It's an organization with a group of members, with weapons caches, with plans, etc. They have people trained to invade Israel and kill civilians, have proven that they can do this, and have promised to do it again.

They can be stopped by arresting/killing the members. Why wouldn't it be possible? Similar groups have been stopped.
Lines of C aren't the defining factor. You want total instructions executed.
There are plenty of AOT compiled languages, C isn't the only option, thankfully.
Hacker News has had an API since 2014[0]. It can be found via the "API" link at the bottom of the page[1].

[0]https://www.ycombinator.com/blog/hacker-news-api

[1]https://github.com/HackerNews/API
Making SimCity 2000 for Windows 95 Run on Modern Systems [video]
I remember playng Doom at a common PC (no graphic card). Was there something special about running Doom on some expensive machine? (FPS wise?)
Nice rant. Upvoted.
Can anybody explain to me where the meat of the application code is? For example, when I look at GeoDraw under Appl/GeoDraw I see .def files containing definitions, declarative looking .ui files in the UI subdirectory and some .asm files containing only a few very short functions. That surely can't be everything? I remember it being quite a complex application.
> How do people see things going in the future?

A niche thing that thrives in its own niche. Just like most open source apps without big corperations behind them.
Both Web Components and Framework Components utilize JS and HTML.
Considering that their email verification has been in different states of brokenness for the last hour, I’m guessing they were not as ready as they thought for the publicity ;)
Not only that but they can't afford it. They need the price to be near $100/barrel to avoid a budget deficit.
OpenBAO – Fork of HashiCorp's Vault
Normal machine code runs in even more contexts and has been for much longer. I don't know any numbers on how many mainstream projects are WebAssembly but it feels like a stretch to call it the "worlds most robust and well-tested" anything. And the tech itself doesn't sandbox anything so it just feels like a strange choice.

Use KVM if you're on Linux/Android. It's not about the binaries but where and how it's running, there is 0 isolation in WASM alone, and creating a new runtime to run it outside of browsers will not give you what you're looking for.

Android recently announced they're going the KVM route.
> LLM scaling laws tell us that more parameters make models better, in general.

That depends heavily on the amount and complexity of training data you have. This is actually one of the things than OpenAI have advantage, they scraped a lot of data on the internet before now it became too hard for new players to get.
Are there any scores on Dutch support? Is it totally not supported or not benchmarked?
This book recommends font sizes in `px`. Why are people still doing that? Me and my high DPI monitor hate you. Use relative sizing in `em`, or even just actual `cm`.
Show HN: We Built FlyCI – Cost-Effective Mac Runners for GitHub Actions
Hi, I'm Kiril Gantchev, one of the co-founders of FlyCI.

FlyCI offers substantial cost savings for M1 and exclusive access to M2 runners for GitHub Actions, boosting mobile CI/CD workflows. Beta users get exclusive access to our M1 and M2 runners for free until the program ends (January 31, 2024).

The key benefits are:

- Up to 2x Cost Savings: Compared to traditional options, FlyCI's Mac runners offer significant price reductions, optimizing development budgets.

- Exclusive M2 Access: Stay ahead of the curve with FlyCI's exclusive access to M2 runners, ensuring your development environment has the latest hardware technology.

- Easy Configuration: Simple one-line change integrates FlyCI seamlessly into existing GitHub workflows.

Getting Started:

1. Enter your email in the FlyCI website to receive the GitHub App install link.

2. Update your workflow configuration with `runs-on: flyci-macos-latest-xlarge` for M1 or `flyci-macos-large-latest-m2` for M2 runners.

Simple as that and you get to try it for free until January 31, 2024! I hope you all enjoy it and please provide us with as much feedback as possible.
Cdg paris cab is private transfer best cdg airport to Disneyland Paris! Cheapest & Best taxi from disneyland paris minivan transportation
Ah yes, and the few times I actually use a pen to write, 90+% I'm filling in a form that requires me to write in block letters...
Or numbers that add up to over the size limit of what ever byte/int/long type you are using.

There's a surprising amount of depth to adding two numbers.
At this point Elon is even losing some of his biggest fanboys
Same with the UK - the latest string of PMs would probably never have been elected by the people.
Can you please expand on how french citizens don't have free speech ? And how ensuring minimum decency in the output of a computer program would impact free speech ?
You don't necessarily need to know the architecture, given the "only" real metric regarding speed is tokens/sec and that pretty much depends on memory bandwidth, you can infer with some certainty the size of the model.

Also, if we have been eating up posted "benchmarks" with no way to independently validate them and watching heavily edited video presentations, why can't we trust our wonder kid?
Niche market?? You have no idea how big that market is!
That just opens a dialog that saves the draft to the Notes app. You can configure whether it goes to the same note each time or a new note every time.
1. Application developers frequently don't know how the libraries they're using work, and often don't even know what libraries they're using because they're transitive dependencies (even a version update of a library can pull in a new transitive dependency). If a library imposes any kind of risk on the application, the application has to acknowledge that it accepts it.

2. The last word is given to the application, and the point is that libraries must not make decisions that have a global impact on behalf of the application. That's why an executable JAR, i.e. an application, can grant such permission in its manifest but library JARs cannot.

See more here: https://openjdk.org/jeps/8305968, https://openjdk.org/jeps/8307341
They might be willing to do things like crawl libgen which google possibly isn't, giving them an advantage. They might be more skilled at generating useful synthetic data which is a bit of an art and subject to taste, which other competitors might not be as good at.
I don't read blackmail into that. I took it literally: quit the job and if/when they call tell them you're charging $500/hr. That's a high but not crazy high consulting rate.

If someone quitting their job, or just getting sick, means critical systems will fail, that says the management didn't bother planning to mitigate that risk -- they didn't manage, in other words. If business continuity depends on one or a few key employees never leaving that business needs more competent management.

As for Adam Neumann and SBF, I intended to make the point that despite a well-known history of fraud and behavior worse than quitting and charging $500/hr they got multiple chances. I could name many other examples of serial failures and scammers in the tech industry. I don't condone that behavior or propose we emulate it. I gave those examples to counter the argument that quitting and contracting back to an employer would somehow tarnish a reputation, or that our professional reputations even exist anywhere except our own imaginations, or that anyone will bother to check work history.

You specifically mentioned getting blacklisted. Who maintains that blacklist? Can you explain in an intellectually honest way what you mean by that?
I'm not sure what tech weighted diversity means. Number of Asian people? If you're looking at % white people Austin is the whitest city in Texas. SA, Houston, and Dallas all have less white people than New York or San Francisco.

It sounds like your friends aren't interested in diversity but specifically looking for the opposite. People that share a shared cultural heritage and language. Nothing wrong with that, but it's just weird to call that diversity.
If a and b are strings, Python would make "ab".
This actually begs the question:

Does anyone know the kind of actual infrastructure something like gpt4-32k actually run on?

I mean when I actually type something in the prompt, what actually happens behind the scenes?

Is the answer computed on a single NVidia GPU?

Or is it dedicated H/W not known to the general public?

How big is that GPU?

How much RAM does it have?

Is my conversation run by a single GPU instance that is dedicated to me or is that GPU shared by multiple users?

If the latter, how many queries per seconds can a single GPU handle?

Where is that GPU?

Does it run in an Azure data center?

Is the API usage cost actually reflective of the HW cost or is it heavily subsidized?

Is a single GPU RAM size the bottleneck for how large a model can be?

Is any of that info public ?
The kernel, I've been told by people more knowledgeable about this things than myself, is a work of beauty. But the layers and layers of Win32 that sit on top of it do a great job of covering that up.
It would be interesting to check if piracy is back for pc gaming or just tv (haven't read the article yet) to verify what Gabe says (pretty sure it will)
Yeh, that’s the next thing on the list.

Wanted to get something out the door for desktop, then it’s on to mobile.

Any things in particular that you’d want fixing?
> They might be willing to do things like crawl libgen which google possibly isn't

Are you implying big companies don't crawl libgen? Or google specifically? I would be very surprised if OpenAI (MS) didn't crawl libgen.
I don’t think the point was about ABI compatibility across operating systems—that’d be unreasonable. It’s more so about using POSIX API’s as much as possible to enable portability rather than relying on Linux-specific API’s that make compiling the code an unnecessarily frustrating experience. Sometimes, using Linux-specific API’s is inevitable, but in the overwhelming majority of cases, POSIX API’s work just fine and would make the code instantly more portable.
Hangon, if go to another country I most certainly have to follow the laws that apply there.

If I surf over to another (Internet surfing) country because the server is physically located in that country, I again am forced to follow the laws that apply there.

It does seem illogical to have such setup especially since physical I haven't moved.

Now it seems that I can take my laws with me when I visit a server in another country. Making everything even more confusing.

Unfortunately that does not apply to physically traveling to another country: that country doesn't care two bobs for my countries laws.

Edit: INAL.
Does the 8x7B model really perform at a GPT-3.5 level? That means we might see GPT-3.5 models running locally on our phones in a few years.
> Phase kicks don't change the speed of a wave.

"Phase kicks" explain the phase velocity. The speed of a wave is the group velocity. Phase velocity is omega(k)/k, group velocity is omega'(k). So if "phase kicks" explain phase velocity sufficiently so it's valid for a range of frequencies, then it also explains group velocity by taking the derivative of the dispersion relation.
Disagree, at least when stated this generally. This article is explaining it thorougly: http://www.chadskelton.com/2018/06/bar-charts-should-always-...

(The article you linked is not accessible to non-medium users, by the way. Apologies if it covers caveats.)

For bar charts it's a good rule of thumb. For line charts, not necessarily.

Scroll down to the cases where it makes sense to zoom in. Imagine you plot the global average temperature of the last 200 years including the zero. You could barely see the changes, but they've been dramatic. Use Kelvin to make this effect even stronger.

Which brings up another point: The zero is sometimes arbitrary. If instead of a quantity you only plot its difference to some baseline, all that is changing is the numbers of the y-axis, but the actual plot stays the same. Is it now less misleading? I say no, because the reader must look at the axes and the title either way.

So please do zoom in to frame the data neatly if it makes sense to do so.
There was some high-level discussion of this in the chat Guido van Rossum had with Lex Fridman (timestamped): https://youtu.be/-DVyjdw4t9I?t=3964
Resolve is so good I paid for the full version even if all I do is edit GoPro videos.
Who Said So?
I myself wanted a new 4090 (2.000€), but my budget constrained me to a used 3090 from eBay (800€) which has served very well so far.
The Factorio method of problem solving, I like it.
Same for me, too.

I honestly love https://mataroa.blog it ended my paralysis for searching a blog platform, and every page is bog standard HTML. It accepts Markdown, plus it has its own anonymous analytics, so it's nice.

On the other hand, everyone has different needs, and I wish Banner blog the best of luck!
Tiny and small, those two have been released, yes.
1. This is an open source model that can run on people's hardware at a fraction of the cost of GPT. No cloud services in the middle.

2. This model is not censored as GPT.

3. This model has a lot less latency than GPT.

4. In their endpoint this model is called mistral-small. Probably they are training something much larger than can compete with GPT4.

5. This model can be fine tuned.
Yeh, I agree. Especially with the most recent updates.

The sentiment behind this is more about making the posts more readable to bots as opposed to trying to game the system
Well, as long as you don't expect others to perform in similar way all is fine.

Since, you know, we have this tiny little thing called actual life we enjoy living, which definitely absolutely 100% doesn't happen in front of screen, any screen. Or you/we have kids. Or need 7-8h of sleep like a normal person does.

Doesn't matter at the end what are the reasons, I know on my proverbial death bed (and all years from right now leading to it) I would regret massively spending more time at work then necessary, since it eats time I can do everything else. Life is awesome if you do some effort to make it so. Not so much without that effort part, then even that screen may look like a good use of time. Also life is much much shorter than youngish folks feel like it is, and the window for great experiences is much smaller.
> it would really be more complicated in C if a and b were actually strings or lists

You don't event need strings or lists for that. Just imagine bigger numbers for a and b. Arbitrarily long integer addition is not a native language feature in C.

edit: formatting
This is nitpicking, but:

Disney plus doesn't allow casting to my pc to my tv with desktop mirroring. This is DRM crap.
I was using that to watch the same movie my children were watching while I was doing some work and I couldn't.
It stems from a bias, developers are power/expert users and their interface behavior is likely matching, which means they are heavily reliant on keyboard shortcuts (Think Blender 1.x and Blender 2.x who leaned heavily and even exclusively on shortcuts)

This gives them the idea that their software is very powerful (and probably is) but this creates a cliff to the beginner and intermediate level users.

A lot of examples can be found in “About Face: On interaction design” by Alan Cooper.
> Mistral-embed, our embedding endpoint, serves an embedding model with a 1024 embedding dimension. Our embedding model has been designed with retrieval capabilities in mind. It achieves a retrieval score of 55.26 on MTEB.

Is there any information if this embedding model is or will be open source?
We had the 1972 first-run Odyssey and a game where you identified the capitals of the US states was the one I remember and a haunted house. An acetate screen layover of the US and the outlines of the various states in different colors clung to the TV screen via static. You set up the paddles and ball so that the ball would land on a part of the screen, and then you had to identify the state capital. Those controllers with the tapered sides and dials on top were bulky for sure! We
Problems with exposing RSS feeds:

- People do not feel the need to expose it as more and more RSS clients are killed, it is not often used feature

- I think that RSS client are not killed because it is a faulty standard. It is a problem with deliverability. There is no state of the art RSS client. Most of RSS clients are not feature-rich, even thunderbird. People also do not know how to manage RSS feeds, how to obtain them

- I think that people use social media, link aggregators to see 'what's new', not RSS feeds

- People that self host do not focus on details, often even not properly configure their pages. OG:fields are not set, page title is not explanatory, weird redirects are used with invalid HTTP statuses, javascript page loading. If it is a problem with these basics, then other things are treated even worse, RSS included

- RSS feeds are often even not named properly. Naming "Blog", or "Title", or "Home" your RSS feed, or page is erroneous, in the same manner that you would not entitle a Book you wrote "My Book"

RSS readers I am aware of:

- https://newsboat.org/

- https://www.rssbrain.com/

- https://theoldreader.com/

- https://www.freshrss.org/

- https://readwise.io/read

- thunderbird

- https://github.com/rumca-js/Django-link-archive - RSS reader, web scraper, which I wrote
A lot of Last of Us players don't realise you can grab a hunter or infected, and then "feed" them to a clicker.
This is very exciting and I think this is the future of AI until we get another, next-gen architecture beyond transformers. I don't think we will get a lot better until that happens and the effort will go into making the models a lot cheaper to run without sacrificing too much accuracy. MoD is a viable solution.
> You're trying really hard to misunderstand my point.

No, you're missing mine:

1. In no country in the world do the people vote on everything. In many countries, the head of government is not elected directly.

2. Direct democracy is rare and most democracies are representative.

3. The EU's institutions are thus not uniquely undemocratic - they all eventually derive their power from the people.

4. What you're accusing the EU of doing (i.e. bad legislation) is happening elsewhere too (e.g. in the UK).

5. That's because people actually want or are indifferent to such things.
Take1 – An Exploration into LLM Writing
Or Notes.app.. or Reminders.app, both of which are available by default on every Mac, iPad and iPhone. Heck Reminders.app is even on Apple Watch.

I get that not everyone uses a Mac (I'd imagine HN audience is probably more likely to than the average population though), and I haven't used a Windows machine for anything besides browser bug testing since XP was relatively new... is there really not a basic note taking/reminders app built in on Windows.. whatever?
> This suggests that they’re reasonably confident that the mistral-medium model is substantially better than gpt3-5

How did you reach the conclusion? Maybe they are counting on people paying extra just to prevent vendor lockdown.
Interesting to see that the very first thing that came out of seed had some basic structure already and than it looks like it just kept repeating that and growing.
Thanks for those links, those look interesting! Especially interaction-design.org.
> Signal doesn't even send the message via push notifications.

Threema doesn't send the message in the notification either, per the link.
"Anything over around 20 cents a kWh makes it uncompetitive"

Cries in European
As someone who has worked in the field for many years now and closely follows not just the engineering side but also the academic literature and the personell movements on linkedin, I too was able to put together a lot of this. Especially with GPT-3 Turbo it was obvious what they did due to the speed difference. At least in terms of model architectures and orders of magnitude for parameters. From there you could do some back of the envelope calculations and guess how big GPT4 had to be given its speed. I wouldn't have dared to say any specific numbers with authority, but maybe Hotz has talked to someone at OpenAI. On the other hand, the updated article now claims his numbers were off by a factor of 2 (at least for the individual experts - he still got the total number of parameters right). So yeah, maybe he was just guessing like the rest of us after all.
Mistral AI only hiring female AI researchers
I don't think it's unreasonable to demand that products and tools don't spontaneously combust frequently, so long as that demand is based on warranties and other such professional/commercial guarantees.

FOSS's primary problem is that the goal is the tool itself, rather than what is done with the tools: Commercial software exist to let the end user achieve something, which in turn generates profit for the commercial developers. FOSS exist to let the FOSS developers achieve their dreams, end users be damned.

A video editor crashing every hour is a problem for the end user, but if the FOSS developer doesn't care then that's that.

This is why Photoshop will continue to surpass GIMP, and why exceptional FOSS like Blender succeed where other FOSS do not.
While we can't be sure of most of those answers, they have stated it is running in Azure.

Also we can probably assume the pricing is likely to be somewhat in proportion to the cost to run (possibly subsidised to gain market, but they are unlikely to be taking a giant/unsustainable loss per query here, particularly as they seem to announce price decreases when they increase model performance).
Getting an exact number is impossible, that's what I wrote in the linked blog post as well. But every RSS reader that requires user accounts knows the exact numbers, and 4 of the main readers expose those numbers via HTTP requests.
FDA approves first CRISPR therapy–here's how it works against sickle cell
That doesn't explain how we know that GPT-4 is a sparse MoE model with X experts of Y size and using Z of them during inference.
If Micro$oft keeps enshittifying their OS at current rates, I bet a lot of people will get fed up and jump ship to Linux after one or two more windows releases.

https://en.m.wikipedia.org/wiki/Enshittification
They're only paying 80,000€ for a full stack dev and want the candidate to have a "portfolio of successful projects"
EU plan to ban geoblocking will lead to dull content, warn film-makers
> And there was no way users could work around it to maintain their previous workflows.

Yes there was. Staying on version 29 of emacs. Or write everything that is needed in lisp to revert to old behavior.