skysight-inc/HackerNews huggingface dataset:
Ask HN: What is going on regarding quality of service for API access to LLM's?
I saw in the latest ChatGPT plus announcements that you get better speed if you pay them $20/month. This made me wonder how the speed of the plus version of ChatGPT compares to the API that we pay for (to integrate ChatGPT into https://cocalc.com). We have had solid usage over the last 2 months, and I keep track of exactly how long the complete response takes for each api request. I just checked the stats and the average api response time for chatgpt and gpt4 have both gotten MASSIVELY WORSE for us over time:

smc=# select model, sum(total_time_s)/count(*) from openai_chatgpt_log where time >= now() - interval '1 weeks' group by model;
model | ?column?
---------------+--------------------
gpt-4 | 64.17583870967742
gpt-3.5-turbo | 22.513887411945003
(2 rows)

smc=# select model, sum(total_time_s)/count(*) from openai_chatgpt_log where time >= now() - interval '8 weeks' and time <= now() - interval '7 weeks' group by model;
model | ?column?
---------------+--------------------
gpt-4 | 30.74102777777778
gpt-3.5-turbo | 10.309548475729441
(2 rows)

The times have more than doubled on average! (I checked and the average total tokens hasn't changed at all.) Does openai publish any stats about API response times?

I also subscribed to ChatGPT plus, and anecdotally it does seem much faster than the API for us. So maybe OpenAI is increasingly throttling API access for customers who are not marked as special? I wonder if some API users get much faster response times?

Given how valuable LLM's are for products like ours, what does this mean for us? Does it mean that relying on api access as a longterm solution isn't a way to stay competitive? There are other LLM api providers like Anthropic (and potentially Google), but so far they are vaporware for us, since it's just waitlists forever.

This gives me new appreciation for the approach repl.it is taking of building their own open source models.
>It's much more likely that more than 1 or 2 still work and that is more than enough.

Obviously.

Historically, with real tanks seen to be performing in action, then cardboard tanks additionally performed exactly as the deterrent fake ones were intended to do.

Also in tank warfare when the majority of tanks have not been brought into action, the cardboard ones accomplished the same things as the majority of real ones.

Edit: not everyone can be expected to believe it's true, some are just more easily fooled than others

Plus my bad, there were a lot of inflatables historically for even better deception:

https://www.theatlantic.com/technology/archive/2013/05/ghost...
Looking at an idea and saying 'not worth perusing' isn't a failure.

Should every concept vehicle of every car company that didn't get built considered a failure? Every design study ever done by any engineering firm is a failure?

Something is a failure if you invest large amounts of money into something and get nothing out of it.
Can a blog post trigger what an open war in Europe hasn't?

Decision makers get their information from other, probably more accurate, sources.

How many times have you heard the line "nobody expected that Russian army was so useless" in the past year?

I'm sure some people knew.

We don't know, we won't know until much later.
Yes but Russian leadership doesn't necessarily believe that the nukes don't work. If they do a massive launch then we'll probably take at least some damage, and if we massively retaliate then we'll conduct a risky experiment to see who's right about nuclear winter.
Sure, according to the Ukrainian sources, after the Ukrainian state persecutes anyone who publishes factual information which does not align with its propaganda campaign (like the bloggers who posted videos of "interception"). Meanwhile, the US side reluctantly admits [1] "minimal" damages from those "reportedly neutralised" Kinzhals. Also the Saudis would like to have a talk about miracle effectiveness of Patriots.

[1]: https://edition.cnn.com/2023/05/16/politics/patriot-missile-...
Another advantage of autofill is that it's more resistant to phishing attacks.
Yes, and civil engineers have to follow a lot of regulations and have to plan things carefully
>If Russia and the US engage, this is a madman shooting a tank with a 9mm.

I don't know, losing for example New York City would be kind of rough. In reality probably every major US city.

Your analogy doesn't quite check out.
The pirate bay is just about my favorite torrent site. Kickass torrents used to be good as well. For anything anything anime related, there is still the good ol https://nyaa.si/
I dunno. Bezos is pretty good at managing a company. A lot of people chose to bet on Jeff Bezos. He delivered phenomenal results for decades. I’m not seeing the societal failure.
The wrongness I'm pointing out is the Yale article, circa 2023. It makes false claims about the past, so what else are they saying that's false?

Re: droughts and floods. Good example. These aren't getting worse. The media and academics like to claim they are, but they are wrong. Select the "Palmer Drought Severity Index" here from official US data and plot "All months" from 1895 to 2023 i.e. all data. Observe that there's no trend:

https://www.ncei.noaa.gov/access/monitoring/climate-at-a-gla...

Then select "Precipitation". Observe that there's only a very slight trend of 0.18 inches/decade. That's tiny and not enough of different in average rain to change the incidence of flooding.

Remember that the actual climate claim is only about 0.1 degree of change per decade since ~1980, i.e. only about half a degree of warming since the end of the period of global cooling. Half a degree isn't enough to have any visible impact on weather patterns. The climate just isn't that sensitive.
I've read before that the most common amount of time for someone to be homeless is one day. Temporary homelessness is comparatively common. If they are grouping the temporary homeless with the chronically homeless, that would totally invalidate arguments like, "only a third of homeless people have serious mental illness".
The whole concept of "my password" is horribly insecure, as if you use the same password everywhere, there is a big risk that one of the sites leaks your password and then all your accounts are compromised. Whatever risks a cloud-enabled password manager has, reusing a single password is so much worse that those things aren't even comparable.

Having all your passwords on a piece of paper could be safer than a password manager, but it's so inconvenient to store a hundred different random passwords this way that people simply won't do it and will reuse passwords. So if password managers get people out of the password reuse trap, they're a net gain in security, that far outweighs all the password manager risks.
Steele had illegal campaign cash from Hillary Clinton laundered as legal fees to back up his “dossier”. No charges for that of course, just a slap on the wrist fine.

They applied the full force and technology of the United States spying apparatus and all the Mueller report proved was that they found nothing.

Brennan briefed Obama and Biden on the Clinton campaign’s dirty plan right from the start, and they ran with it. They knew it was a Clinton plan and had no evidence to back it up, and lied to Congress, and lied to the American people about it.

Those are the established facts, but there will always be people like the Peter Strzoks who will never admit how wrong they were, or how much harm they did.

Then they followed it up in 2020 with 51 intelligence officer / signatories lying to suppress the Hunter Biden laptop. They’re not done lying and cheating, and the FISA abuses we know about are just the tip of the iceberg.
I’m a paying Neeva user and I was extremely surprised to see that they’re shutting down after less than a year in operation.

I’ve been extremely happy with it as my switch from google so now I’m left wanting.

Thanks free market
Core Memory-Computers Are Sensual
A russian soldier is paid less than an American. A russian factory worker making military equipment is paid less than their American counterpart, leading to lower cost of that equipment. I don't see a problem describing that difference as ppp.
This looks great! Are you thinking of making it open source but still being a for profit company (with an open core business model etc.)? I would be much more likely to use it if this was the case
This is exactly how I look at it as well. Our culture seems obsessed with “takeaways” when a lot of the time I might not discover the takeaway for some time, until I happen to encounter some other experience that made reading that previous book completely worth it.

I guess it comes down to wanting a wide funnel of experiences to sort through or a narrow focus on whatever is going to help you achieve your objective. In reality, we probably need both but I sure wouldn’t trade some of the experiences and insights I’ve gained by having a wide funnel and not worrying about takeaways.
It would be fair to say though that there wouldn't be an order of magnitude more data to train a future version with.
Some people believe they have inherited the stars, that God is behind all things, and that we’re not going to just grow too fast like a cancer and then kill the planet.

I’m one of those people, so this argument doesn’t work for me. There indeed appears to be a slowing of global population growth and an abundance of headroom to grow further.
There were recent (2019-2022) conversations about sanctions against India for buying S-400 missile launchpads [0]

This was dropped after a last minute amendment of CAASTA [1].

Though, if we're actually being honest, there was no real chance of sanctions actually being placed - it was just a negotiating ploy, and Indian Weapons manufacturers are increasingly working with American companies like GE and General Dynamics for IP transfers, though they lag behind Israel, France, and Russia in that market (FCPA's ability to pierce the corporate veil and an imo rightful aversion to IP transfers to generic competitors plays a big role in America's lag in the Indian defense market).

[0] - https://www.thehindu.com/news/international/us-discourages-i...

[1] - https://www.outlookindia.com/national/us-house-votes-for-caa...
Liberals, you may have been surprised by the news that we're escalating a war with a nuclear power by sending F-16s. This is why you should go back to sleep. This guy says everything will be fine.
this kind of infantile analysis is about a step above flat earth conspiracy theories at best.

it has no place whatsoever in intelligent conversation.

a 50 year old bullet may not work. are you going to put a gun in your mouth and test it? (ironically, there is a name for that)

it makes zero difference whether russia's nukes work or not. if they launch, then the US launches also, and the fallout and nuclear winter kills untold numbers.

if russia really thinks their nukes will have a high failure rate, then they will just launch more, and the US will launch more in retaliation before they ever hit.

the hot takes of twitter arm chair warriors have no place in reality. if you are even thinking of taking this bs seriously, please don't.
> Because Putin might see it and nuke us to prove us wrong?

God, what a reckless sentence.
Sam and friends must be giggling all the way to the bank: they have a service that 'probably' gives the correct result and paying customers are happy to retry until it gets it right.
Unreal Tournament also worked well with the ifeel mouse.
Questions may be asked but it’s still pointless to ask them. Practical conclusions will be the same. Even if some part of Russian nukes won’t work, even if Russia has problems with execution of a strike due to communication or command issues, it is still: 1. capable of response, 2. capable of first strike, 3. any such strike will render significant part of the planet uninhabitable.

Besides, we can be sure that it does not share its nuclear technology and nobody had stolen it. If there are 4000 nukes or just 500, it doesn’t really matter. Though I’m sure nuclear arsenal in Russia is maintained much better than anything else.
but you don't have soldiers in your home! at least 3A is fine.
You are getting the timeline wrong. Musk said he didn't have time or interest in perusing Hyperloop before he even released the Blue Paper.

Maybe Hyperloop as a concept is a failure, that is correct. But for Musk, releasing a idea as a short paper and not perusing it beyond that isn't a relevant failure.

If he had invested 100M$ and then walked away, then I would consider it a real failure for him. As it stands, its a couple of wasted weekends doodling on project.

If that is the most people can come up with talking about failures, then its really not worth talking about.
Watch the movie “other people’s money” for the original reference
They replied and said they can't do it.
The code itself is a mere curiosity, but it has two key takeaways.

First, writing code in national languages is mostly a shit idea. Here we can at least recognize and match some words, but what if it was Arabic or Chinese script? Even with source code, you just might've been better off with a disassembly.

Second, don't underestimate Pascal. For all its faults, the language is very readable, and its build and module systems are still more convenient than most of what we have today. I dearly miss the time when you could just download some code, hack on it, press Ctrl+F9 and see the result.
Thanks! That is a consideration. Similar to how n8n does it.
You get two thumbs up from this local!
A video of these conditions and the resulting colors would be nice.

I wonder if the limited amount of variables mean one could just ask ChatGPT to generate a one-time lookup table of colors and store them locally. But it's interesting to see that an LLM can be a "color designer".
Introducing Background Video Recorder - the powerful stealth camera app that allows you to record video discreetly and unobtrusively. With this hidden camera app, you can capture important moments and gather valuable evidence without anyone knowing.

Background Video Recorder operates in the background, even when your phone's screen is off or locked, making it possible to record video without anyone noticing. The app supports both the front and back cameras, different video quality formats, and you can cut your favorite part with video trimmer. Additionally, the app's motion detection feature ensures that you only capture footage when there is activity, saving you from having to sift through hours of unnecessary footage.
Background Video Recorder is ideal for a wide range of situations. You can use it to keep an eye on your home or office when you're away, monitor your kids or pets, or gather evidence of wrongdoing. The app can also be used for journalistic or investigative purposes, allowing you to capture footage of events or people without drawing attention.

Background Video Recorder is user-friendly, with intuitive controls and a simple interface. You can adjust settings such as video resolution and recording duration to suit your needs. The app also lets you choose whether to save your recordings to the cloud or to your phone's memory and share video with friends.

With Background Video Recorder, you can be confident that you'll always be ready to capture video when you need to. Download Background Video Recorder today and start recording like a pro.
I remember there was a ahem review of the Rez Trance Vibrator on a gaming site when that particular peripheral was released.
It also fails to write a sentence with only five character words.
Where do you draw the line? Is type checking in any domain harmful because it acts a crutch for your mental model of how your code works? One could similarly extrapolate this to any static analysis in any language.
That is a very interesting read. The maintainers seem more sane than Antender. Im even sympathetic to many of his points but he cant be sure a maintainer put a cryptominer in the image. Shouldnt be so fast to point fingers.

Are there any aggregators of interesting github issues? Links with a bit of context about them make for some fascinating reads.
I wonder how developers of computers came to idea to use binary numbers? As I remember, early calculating machines used decimal system (e.g. Babbage's machine, IBM's tabulators). For example, did Konrad Zuse invent floating-point binary representation himself when developing his machine or there were previous works which described how numbers can be added in binary system using relays or tubes?

So, were there any works on floating-point binary numbers and implementing operations with them before 1938?

Also, did he invent logic gates or there also were previous works?
> Did they fix the underlying issues or does it just have more data?

IIRC they do have slightly more data, but that's not the primary cause of improvement, the key factor is simply more parameters and more training. No significant actions have been taken "fix the underlying issues" - you should assume that any major differences between GPT-2 (which is horrible in comparison to GPT-3) and GPT-4 are emergent behavior from the model having more horsepower.
> Russia’s nuclear saber-rattling is more maskirovka and politics than it is actual capability.

Probably nothing will go wrong if we invade Russia, then? Not a great threat model.
attention abuse would be a better one, imo.
I thought the Daoists invented binary. I-Ching is a binary system of size 2^6.
The US has a tradition in messing with banking, but it’s not long. While sanctions have existed forever, weaponzing the banking system did not start until the last decade or two, when more power was given to FATF, and other non-elected international bodies led by the US.
There is a real question if splitting the budget into two options increases or reduces the chance for success.

Sure if money was magic you would like to have 10 options. But in reality that money is now not available for lots of other-things that are useful and could improve the moon missions in various way.
Apache Rivet: Webscripting for Tcl'ers
The "high end" PC parts market comprises such a horrendous pit of garbage.

The only way to know if anything even works to begin with is to read all (poorly written) manuals front to back taking notes, then procure the rest of the parts and rigorously test them yourself within all of their 30 day return windows. And even then you're virtually guaranteed to miss some glaring issue.

Just last week, an obscure forum post from someone who already went through the tech support/RMA gamut saved me from wasting a month + $5K on a build with a motherboard that doesn't support sleep mode, which the manufacturer ASRock doesn't mention anywhere.
Yeah the second half is really weird. It seems to suddenly take the proposition "more energy is good" and conclude that "energy inefficiency is good" follows. Both energy abundance and efficiency are good; efficiency is a multiplier of the positive effects of increased abundance. The detachment of energy use per capita from gdp per capita after the 70s is a good thing. That gap is pure upside, where each unit increase of energy is strictly more valuable than it would otherwise have been.

In general, I find this false dichotomy between efficiency and abundance so maddening. Why not both??
It did come up - it's hard to avoid an elephant in a room, despite the saying... I'm not going to go into details, but we did and do talk.

I also don't want to give the impression that my concern is more for the process than my wife - while writing, I didn't want to be seen to be blaming them for enforcing the 3-day hold. Once someone's called it in, and the police making the house-call decide it's plausible, they don't deviate. They were kind, but firm, is all I was trying to say.
It is just Kinzhal missile is not hypersonic till target hit as it was advertised. It slows down to increase accuracy.
Maybe I’m missing the joke, but what is the name for putting a gun in your mouth to test it?
Unsurprising. This is why Neeva failed. [0] Also with Bing disallowing its partners to bootstrap their own LLM search engines with Bing's search data. [1]

After that, they had nothing and burned all their VC money.

[0] https://www.similarweb.com/blog/wp-content/uploads/2023/05/C...

[1] https://news.ycombinator.com/item?id=35306890
> Sam and friends must be giggling all the way to the bank

it's true but for another reason. they yoinked it away from the nerds who were baited to work on openai because those nerds thought how the name of the company was spelled meant something about how it would behave. it reminds me of how some act around software names like 'alpha' like it has objective meaning with consequences in reality
And a big part of the self-love journey was learning how to truly take care of myself. How to eat properly, how to rest, cutting out toxic people from my life, becoming clear with my boundaries, forgiving myself, accepting my pace of progress, and so on.

Once I recognized the pain in my heart, I just kept returning to it, and over time that guided me towards the truth.
The whole point of using Kagi for me is that I've got my search options customised and I'm paying for a service better than the alternatives. The payment privacy aspect of that lives on a completely different layer: you'd need to first solve the KYC -vs- privacy problem, and that's more of a politics problem than tech.
How so? Are we all supposed to pretend that we think that Russia's nukes work for... Reasons?
What you might actually mean is that you are going to try to sell agile snake oil to someone who knows less. Try a middle manager without technical background? They tend to be more receptive.
Becuase money isn't magic and that money going to a very unsuccessful company BlueOrigin is now not available for space suits, habs, surface operations and many other potentially useful things.
I am very interested in what LLMs will be able to do when trained on something other than the content on the Internet, which is primarily generated to sell advertising views.
That's a tricky one. Should we be able to actually write down each and every digit? If so then you'll need to invoke some sort of infinite related concept to allow it to happen. I'm not a mathematician but:

Let the digit for one be a single pixel (the simplest mark I can make), two is two lots of one pixels etc. Now we need an infinite number of these.

I don't think we can change over to say symbols made up from pixels either, nor mess with multi dimensions to add extra "depth". In the end we still need an infinite number of pixels or pixel properties - we could mess with colours but that is simply adding dimensions.

We can conceive of base infinity but I don't think we can actually use it as such except symbolically. We can decree that a particular symbol or construction for a symbol represents a particular digit within base infinity that we can define by other means, and we can do that a lot but can we do it infinitely often? If we relax the physical representation requirement, then I'd say yes, otherwise no.

I've no doubt that this concept is well understood and dealt with already by the pros.
The hard part would be finding a buyer. North Korea already has their own domestic capability, and Iran is using their current situation as a negotiating point. Beyond that, who would even want black market nuclear fuel?

It theoretically could happen at small scales though, eg. The Apollo Affair where Israel's nuclear program was allegedly kick-started by the illicit diversion of nuclear fuel from the US.

https://en.m.wikipedia.org/wiki/The_Apollo_Affair
They were. Coincidentally I was listening to a Hitchens interview this very morning (before this news) in which he mentioned it.
No need to bet, just look into it. I provided some reading on it.
It was claimed to use book data, but IMHO nowadays the available internet data is larger than all the books ever published; so while book data definitely should be used, it's not a pathway to significant increases in data size.