skysight-inc/HackerNews huggingface dataset:
With the recent scaling law papers that have come out you can evidently predict with pretty high accuracy how good your model will be by plotting out the scaling curves. So performance @ X Flops and Y tokens can be reasonably well known ahead of time.
I don't get why people are so optimistic about machine translation. Computers can get explicit meaning across – that's obvious to anyone who understands linear algebra, information theory, and linguistics. But many aspects of translation (puns, tone, cultural context) aren't just about mapping from one vector space to another. A human, no matter how fluently bilingual, would have to think about the problem, and the current systems don't think.

If we keep working on them, these systems will likely get better and better at low-level translation (including translating idioms), but no machine translation system currently in existence could translate the 逆転裁判 games to Ace Attorney games. Perhaps computers can do it – I don't see a theoretical reason they shouldn't be able to – but it would take a fundamentally different approach.
This sounds super cool, I’m very curious how you implemented it.

I’m only vaguely familiar with the API.. if I had to guess I would say you send

- a system instruction that its job is to filter unwanted content

- examples of unwanted content

- an instruction like “filter the following html:”

For every web request you want to filter, you would re-send all of those messages followed by the page HTML as the final message. Is that close?
Car alarms and smoke alarms: tradeoff between sensitivity and specificity (2012)
That 'censorship regime' (your words, not mine) was doing a very good job compared to the clown running it today.
> domain of the site matches what is registered in App Store Connect before it shows the banner, but apparently not.

This might be by design... For example, a podcast website might be interested in showing a banner for the app that you can get their podcast on. (This isn't a defence of the banners themselves, which IMO are naggy and unnecessary)
Well, he is definitely upsetting some (many) people. But, at the same time, he is getting the new set of people as users. In the last few years, I would not touch Twitter with a ten-foot pole. Mostly because, I could no longer assess the provenance of the posts and the authenticity of their rankings. Is this post popular/important or is this post was put into my stream by Twitter/other entities in order to influence me? I don't like being manipulated so brazenly.

Now, with the new management, I find myself going to Twitter more and more often. I disagree with many posts and I do not like many posts, but now, I could have some assurance that I am getting an authentic information.
I moved to Japan recently so have been trying to learn the language. Im atrociously bad and dream of the day when I can read a sentence without getting tripped up on kanji, grammar, etc. I mentioned this to a coworker who has been studying for several years and she said she just uses Google translate for everything. Even with her pretty good japanese, translate is better and faster than she is for doing things like going through forms, letters, etc. We may reach a point where computers are good enough that they beat all but native speakers, maybe.
Can you cite a researcher that says the problem has anything to do with people refusing the vaccine?

They say very clearly it was the vaccine that was the problem.

Those oral vaccines are very quick to deploy, but still, your solution would require that EVERY PERSON ON EARTH takes the vaccine at the same time and then goes into isolation. And the problem does not stop there. Or how would it work your way? You realise that the virus from the vaccine goes into the sewer and god knows where else and stays contagious?

The only solution the researchers are saying is for everyone to get the expensive shot, which is not using a live virus.
It's one of the hardest things any leader will ever have to do. Jobs said as much repeatedly. Older Jobs lavished credit onto his teams because he knew very well how hard it is to put them together and keep them together. And if you can manage to acquire them, and if you can manage to retain them, you have to then manage them as an individual and in function with a lot of other people that will inevitably clash at times (egos, conflicting ideas/visions/paths, whatever it may be).

Assembling top talent is something very few can do. Assembling it and then keeping that talent together and getting it to work in some manner of harmony, almost nobody can do that, it's an extraordinarily rare skill.
Drew DeVault isn't wrong.
> Also, I tend to prefer pencil, and will recommend the Pentel Kerry.

You can pry my Zebra DelGuard from my cold, dead hands.
Are you memeing or are you serious? Because I'm curious how you'd have a language model design a page for you. Just ask it for the HTML and CSS for a nice looking page?
Steve Jobs made products for himself. He just subsidized costs by selling to the rest of us.
UK to be one of worst performing economies this year, predicts IMF
Sig Sauer P320, a popular handgun with police, is firing on its own
Money is a poor measurement tool. Unless you like measurement tools whose value changes every second.

Money is a contract; no more, no less. A unit of money essentially represents some amount of goods, services, or labor, all of which ultimately boil down to some amount of work.

Oh, and the value of work also varies over the long term depending on factors such as supply, demand, and perceived importance. (And in the case of humans, things like experience, education, and location).
Salaries only rarely go down. They might stagnate for a while (and thus go down relative to inflation!), but nobody likes making less money than before so it is very hard to reduce salaries no matter how much someone is overpaid.
This is obviously very cool, but at this point — who knows what I’ll say in a year — my concern with these LLMs is that they’re in the uncanny valley.

Here’s one passing a very difficult test. Amazing! Now, rely on it to build a nuclear doohickey for a power station or a multi-billion dollar device for CERN or anything really and, well, no.

So humans still have to check the output, and now we’re in that situation where humans driving a Tesla on autopilot who are supposed to be 100% aware of the road aren’t, because they get lazy and doze off, and now the car crashes and whoops.

No negativity towards AI here. It’s amazing and it’ll change the future. But we need to be careful on the way.
I definitely hope you are correct.

I’m really hoping there are viable distributed and somewhat decentralized eventually consistent training algorithms we could all run in a P2P system. That would be super cool.

However I can easily see that now the framework has been established if a company builds a proprietary curated dataset for specific skills and then pays to spend resources on specialized reinforcement training.

Then they can commercialize that I would think. As people would pay for an LLM that does XYZ the best. Kinda like your Disney example but I was thinking engineering tasks in my head.
>The only reality in which Anthropic will take on OpenAI (et. al.), would be if someone involved possess some sacred knowledge regarding how to build an AGI system that is radically off the path that the current market is charging down (i.e. ever-larger GPU farms and transformer-style models).

Train on More tokens with More GPUs isn't exactly rocket science. I assume the RLHF loop is complex but training the base model itself is pretty well understood.
Have you actually tried using GPT 4 and 3.5 ? I'd say 3.5 could be called a regurgitation machine with a few tricks, GPT 4 seems to apply concepts and feels like showing signs of human level intelligence. If the rate of progress continues for a few years we are collectively fucked.
I had a friend of mine recommend them a while back. I was extremely dubious -- a gel pen? For lefties?? No way.

Well, he was right. I've been converted to the church of EnerGel.
Google Translate works great for having conversations with spanish speakers right now. Don't know how well it works for other languages.
It's also important to contrast the information density. Both the "bad" and "good" examples are quite readable but the one on the left is going to be more useful for larger lists of things.
I’m a principal software engineer. If it takes me more than a month to get up to speed with an organization (I usually work with small-mid sized companies), I consider that a failure. Six months to first contribution is insane.
Never forget:

https://www.newscientist.com/article/2277145-cias-hunt-for-o...
Nostr is the real deal.

I first heard about nostr last in November when Twitter tried to ban it. There's an incredible dev ecosystem developing — so much so that I decided to rebuild Satellite (https://satellite.earth) the social platform I'd been working on to become a client for the protocol.

There's a bunch of other clients too. Someone started a directory here https://www.nostrapps.com/

I'm happy to answer technical questions about nostr if anyone is curious.
Hooks are copyrightable as part of the composition - it's songwriting.
My thoughts exactly half way through the article.
AI bot, ChaosGPT, tweets out plans to ‘destroy humanity’ after being tasked
The goal was beautiful design, not good usability.

You gotta admit that it looks good, and eye candy is usually extremely effective for user retention, even if the alternative handles better, technically.
Love the app and use it as a thought log all the time! It would be great if I didn't have to select the output type upfront but rather just free-flow dictate. I don't always know if something will turn into a blog post or small tweet at the time I am dictating.

If you could summarize the content into a few words (similar to how ChatGPT names its chat thread), and I could generate a specific output type from that list in the history, that would be a game changer for me!
The file versioning in OpenVMS is really not that powerful. It also led to it's own set of issues, specially in terms of space waste.

Also VMS had their own issues when it came to it's filesystem(s).
> as most security certifications require SSO as a best practice, manually syncing users from different tools won't cut it

Having taken a couple companies through SOC2, I can say that's not true.

Lots of apps being used by enterprises don't even have support for SSO at all, even if you were willing to pay the tax. Audits can't require you to use something that does not exist. Thus, the manual syncing and comparing is a frequent ritual of audit compliance (and to be fair, is something that should be done regularly even if no auditor is asking for it).

> Also, implementing SAML-based SSO from scratch isn't that difficult, I did it for our enterprise product and it's barely 500 lines of code.

That's not the problem though, the issue is third party apps that don't want/care to support SSO. You can't go and modify their code.
This is eventually a subsidy to the sellers (while the program is in effect)
Here are a couple of tips if you want to use postgres queues:

- You probably want FOR NO KEY UPDATE instead of FOR UPDATE so you don't block inserts into tables that have a foreign key relationship with the job table. [1]

- If you need to process messages in order, you don't want SKIP LOCKED. Also, make sure you have an ORDER BY clause.

My main use-case for queues is syncing resources in our database to QuickBooks. The overall structure looks like:

BEGIN; -- start a transaction

SELECT job.job_id, rm.data
FROM qbo.transmit_job job
JOIN resource_mutation rm USING (tenant_id, resource_mutation_id)
WHERE job.state = 'pending'
ORDER BY job.create_time
LIMIT 1 FOR NO KEY UPDATE OF job NOWAIT;

-- External API call to QuickBooks.

-- If successsful:
UPDATE qbo.transmit_job
SET state = 'transmitted'
WHERE job_id = $1;

COMMIT;

This code will serialize access to the transmit_job table. A more clever approach
would be to serialize access by tenant_id. I haven't figured out how to do that
yet (probably lock on a tenant ID first, then lock on the job ID).

Somewhat annoyingly, Postgres will log an error if another worker holds the row lock (since we're not using SKIP LOCKED). It won't block because of NOWAIT.

CrunchyData also has a good overview of Postgres queues: [2]

[1]: https://www.migops.com/blog/2021/10/05/select-for-update-and...

[2]: https://blog.crunchydata.com/blog/message-queuing-using-nati...
Ok, so can you be more specific that's a large reason, but my understanding was it's very expensive there? So what is an average home price like, and is there any significant diversity diversity? Massachusetts as a whole looks to be as much as 80% white.
what happens if the task cannot be completed? or a worker goes down? Is there a retry mechanism? maintaining a retry mechanism might be a huge hassle.
Maybe they already did, and this "bug bounty program" is just for appearances.
> just a matter of actually thinking about how people will use the app

What I learned during my professional career is that this is exactly what 80% of engineers are absolutely incapable of. Do belong to the 20% and hit the jackpot.
Ubuntu held out for quite a bit with upstart, but.
Whats the co2 and environmental impact of building out CNG infrastructure for refueling? That seems vastly more costly in terms of resources than running wires to charge EVs. Especially when the electricity needed to charge an EV is the same as the electricity/energy needed to refine a tank of gasoline.

How much electricity will be needed to compress and refine the natural gas into fuel tanks? How big and heavy are those tanks?
How much does 64GB of RAM cost, anyway? Retail it's like $200, and I'm sure it's cheaper in terms of Apple cost. Yet we treat it as an absurd luxury because Apple makes you buy the top-end 16" Macbook and pay an extra $800 beyond that. Maybe in the future they'll treat RAM as a requirement and not a luxury good.
Even if machines could translate perfectly they wouldn't make you able to speak to people on the street in a foreign country. I mean, in X years maybe we'll have "real time" devices but they'd be extremely clunky unless they were working from brainwaves or something.
> half of that $25 goes to the payment provider (Stripe etc.)

Surely they are not making a transaction for every patron/maintainer combination, but rather batching the payments.

Otherwise yes this is a Stripe charity :)
Are you saying that you would abuse users' data if given the chance?
Honestly, I'd just once like to work with a designer that has heard of words longer than 5 letters.

Every. Single. Darn. Design I get completely ignores the fact that the texts inside them won't be built from nice little short words with EXACTLY the correct letter counts (especially when localized).

Which results in shit UIs like one I've just seen on Android where (in my language) the button literally just says "Tap to..." and every single label on a button is truncated and doesn't finish a word.
You're right. I didn't think of the lookup layer as a bootcamp for moving into the creative/synthesis layer. And "lookup as a learning experience" applies to most professions. We can even say that this is probably "apprenticeship" in common terms.
I think that crowd has gone quiet as they realized the billionaire private owner was not going to be the champion of (their perception of) great Constitutionally-enshrined freedoms they thought he'd be.
How common is photosensitive epilepsy?

This is when seizures are triggered by certain rates of flashing lights or contrasting light and dark patterns.

Around 1 in 100 people has epilepsy and of these people, around 3% have photosensitive epilepsy. Photosensitive epilepsy is more common in children and young people (up to 5%) and is less commonly diagnosed after the age of 20.

Source: https://epilepsysociety.org.uk/about-epilepsy/epileptic-seiz...
WordGrinder: Terminal-based distraction free word processor
It's similar - basically here a vector/tensor is an array of magnitudes across N dimensions. Whereas in (undergrad-level) physics you might have a 3- or 4-D vector for spatial dimensions and time, here the LLMs are embedding sequences of tokens into N-dimensional space where N is much much larger.

There's a pattern called "embedding search" - you precalculate a set of embeddings for a corpus of text. Then to do a search, you calculate embeddings for your search string. Then you can find the closest vector in that N-dimensional space, which finds you the semantically closest neighbor from the original corpus.

For an embedding search - the OpenAI Embeddings API gives you a ~1500 dimension output vector. When a LLM is working with input text as a vector, I am not sure what the tokenizer is actually feeding into the model. Hopefully someone else can chime in!
https://www.secjuice.com/mastodon-child-porn-pedophiles/
What were you thinking off? Surely no corporal punishment?

House arrest won't be on the table either ("what good does that do?"). Being barred from starting a company? I can see people arguing against that ("but it'll allow her to pay back the money sooner") for the same reasons they're arguing against punishment.
In EU it's brutal right now for senior/lead roles. But it's fine for medium ones. Nobody needs a rockstar to do a boring enterprise work.
The first step is for it to be viable for smaller models on desktops. The rest will follow, as hardware catches up. Hybrid analog-hybrid NN hardware is on the horizon, maybe in 3-4 years. This would allow GPT-4 level performance on an iPhone with plausible battery life.

The current hardware of course can't pull anything like this yet. But iPhone supports on-device facial recognition, object recognition, dictation and translation, so small steps...
>lack of perceived competence will lead to faster regulation.

This is complete fantasy. Breaches at both Equifax and Facebook where results of incompetence and absolutely nothing was done.
Of course not. I'm pointing out people upset with a small mandated inconvenience are completely fine with the imprisonment and forced medication of others.
Have you actually used GPT-4 for translation?

Seriously all this talk about only getting explicit meaning across would be easily dispelled in an afternoon if you only bothered to try.
Nice! Interesting that it has to use i2c for it. I guess there are no other interfaces to modify display properties?
Neil Gaiman had 3M+ followers on Twitter, it is a pretty high profile account.

Anyway, I think it's more relevant that many accounts are now also syndicating to Mastodon, which makes it a viable alternative for consuming users.

It's far from being an exodus, but they are averaging 200k new users per week, which seems pretty good.
Has this been working for you?

At times, I've had panic mode set in and _feel_ like I need to apply to every little job that looks remotely decent, but I don't know if that's _actually_ helping.
I think one reason is that image resizing algorithms are nontrivial. An image uploader sounds simple enough until you start supporting many different scaling algorithms [1] across a bunch of formats. Browsers are already big and complex enough IMO. This could be easily / best handled by a library instead.

Another point is that holding onto the unmodified images server-side (and merely serving a cached, resized, optimized version on the fly) can be beneficial for future use cases.

Check out, e.g., Thumbor [2] if you're curious to see more of the complexities involved. I have self-hosted it for a company before, and it worked well.

[1]: https://en.wikipedia.org/wiki/Image_scaling

[2]: https://github.com/thumbor/thumbor
Also today humans need to check the output, code reviews etc.

Maybe in the near future humans can just focus on the reviewing and testing part.
Ok, so can you cite a reasearcher who shares your opinion?

We are talking about large scale campaigns that were thought to be succesful as they were widely deployed. But the virus simply mutated back to dangerous.

solution: expensive and working vaccine

problem: cost
Looming behind antibiotic resistance is another threat – antibiotic tolerance
I was curious about the argument you seem to be making here, so I ran it past a researcher I am acquainted with and he said this (with some minor edits for clarity):

In the case of IQ, we can identify the model through the exogenous quantity "relatedness." We know exactly how related monozygotic twins are (100%) and the expectation for dizygotic twin relatedness (50%), so we can use the fact that these quantities are known to figure out other model parameters.

Since we know that dizygotic twins are exactly half as related as monozygotic ones in the limit, we know the the genetic effect is going to be equal to 2(r_{MZ} - r_{DZ}) and excess resemblance cannot be attributable to genes, since dizygotic twins are not >50% related (on average).

Therefore, we can use it to directly figure out the fraction attributable to genetics, then we can see the excess relatedness as due to shared environments, and the residual as the unshared.
Catastrophising about a future that doesn't exist based on pure speculation. You're already upset about this product on the basis that bad things MIGHT happen in the future. Live in the moment, this type of chronic negativity is unhealthy.
Hardly a danger. Amazon store is filled with counterfeits and scammers due to its comingling policy.

When you buy from a small shop where its reputation is on the line, you're assured you're getting what you ordered. When you buy from Amazon, it could be comingled scammer-goods from that one guy who ruined the collective commons for everyone.

Its clear how Amazon works. They merge SKUs together, and "Fulfilled by Amazon" means those goods are comingled with other marketplace sellers (possibly even "Sold by Amazon"). It only takes one bad actor in the marketplace for counterfeit goods to be mixed up with everyone.
Why do you think going into isolation would be needed? The whole point of the comment you're replying to is that contagious people aren't a problem if there's no one vulnerable for them to spread it to. (Also, that doesn't require everyone vaccinated, just a high percentage).
I mean, that doesn’t change how it’s a confusing and seemingly absurd claim at face value.

It doesn’t read like a joke, it doesn’t in any way imply the link, it just sounds like an absurd statement put out to incite responses. And people clearly all read it this way. If one person read it wrong then sure, you might have a point. If every single person replying read it this way, then it just shows the point was not clearly articulated to begin with.

Even if you had just watched the documentaries about Theranos, I doubt you could have immediately pieced that connection on first read.
OPV is only applied in developing countries, where setting up an infrastructure with syringes and refrigeration is way harder.

IPV is better in all ways, but OPV still is better than nothing at all, even if it can sometimes mutate back to the wild variant and cause polio... this only occurs however if you are not fully vaccinating the population, as only non-vaccinated children can get infected.

https://polioeradication.org/wp-content/uploads/2018/07/GPEI...
It's safe to assume the enrollment of Prof. Aaronson's Quantum Computing course isn't 50k.
CA will make money if home prices increase from current highs due to supply constraints and if owners sell triggering the capture IIRC. CA now has a +$300m financial stake in that outcome. $300m is probably peanuts compared to the upside of addressing the CA housing crisis and enabling more CA GDP growth but it's also not nothing.
What serious mistake will be made?
I used rabbit many many years ago but agree, scale consumers and only pop when ready to actually process