skysight-inc/HackerNews huggingface dataset:
You would have to write the platform code for iOS similarly to how the Android and Windows is written. The initial idea was to release it on iOS as well but at the end I didn't want to invest in buying a Mac, the license and the time to port it.

Edit: As for the release, I think it barely broke a couple of hundred downloads. I didn't do any real marketing and had no real goal of really getting the game out there as it was a learning experience for me first and foremost.
For all the 'I know every number' certainty of this post, there's some weird stuff:

>(Today, the pre-training could be done with ~8,192 H100 in ~55 days for $21.5 million at $2 per H100 hour.)

Why flex both system size and training time to arbitrary numbers?

>For example, MoE is incredibly difficult to deal with on inference because not every part of the model is utilized on every token generation.
This means parts may sit dormant when other parts are being used. When serving users, this really hurts utilization rates.

Utilization of what? Memory? If you're that worried about inference utilization, then why not just fire up a non-MOE model?

Here's what the post said about MQA:

>Because of that only 1 head is needed and memory capacity can be significantly reduced for the KV cache

This is close but wrong. You only need one Key and Value (KV) head, but you still have the same amount of query heads.

My guess is that this is all a relatively knowledgeable person, using formulas laid out by the 2020 scaling paper and making a fantasy system (with the correct math), based on that.

Put differently, I could probably fake my way through a similar post and be an equal level of close but definitely wrong because I'm way out of my league. That vibe makes me very suspicious.
That's interesting because that's more or less on more level above the multi-head attention.
Like for anything else in nutrition, it is meaningless to say that linoleic acid or any specific kind of oil is healthy or unhealthy.

Only when describing the complete daily intake for some category of nutrients it is possible to say whether the quantities that are used are healthy or unhealthy.

In most human studies it is pretty much impossible to feed all the participants with exactly the same food and to vary independently various ingredients over long times in such a way as to obtain a reasonably certain conclusion.

For instance, in most days around 90% of my daily intake of fatty substances comes from a mixture of 4 oils: 50 mL of extra-virgin olive oil + 20 mL of cold-pressed sunflower oil (required to provide enough linoleic acid and enough vitamin E) + 5 mL Schizochytrium oil (provides enough DHA & EPA omega-3, can be substituted by 10 mL of fish oil, e.g. cod liver oil) + 1 drop of oil containing D3 & K2 vitamins.

According to the current knowledge, this mixture of oils is healthy.

Nevertheless, it is not possible to say that any of its components, e.g. olive oil or sunflower oil, are healthy in isolation, unless the total daily consumption and the total daily consumption of any other fatty substances are specified.
It's the tweet equivalent of one of those obnoxious YouTube 'reaction' thumbnails.
Ctrl+F4, Ctrl+W close tab
Alt+F4 close window
Ctrl+(Shift+?)+Q close browser entirely
Ctrl+Shift+T undo close tab
Ctrl+Shift+N undo close window
Ctrl+N new window
Ctrl+Shift+P new private window
Ctrl+B toggle bookmarks bar
Ctrl+Shift+B open library (bookmarks window)
Ctrl+H open history in side pane
Ctrl+Shift+H open library (history window)
Ctrl+G, F3 find again
Ctrl+Shift+G, Shift+F3 find previous
Ctrl+Shift+V paste as plain text
Ctrl+Shift-Z redo
Alt+Entry in address bar opens address in new tab

See also:
https://support.mozilla.org/en-US/kb/keyboard-shortcuts-perf...
https://support.mozilla.org/en-US/kb/mouse-shortcuts-perform...
https://firefox-source-docs.mozilla.org/devtools-user/keyboa...
GPT-4 is the name of a machine learning (language) model that is the basis of chatGPT. This post speculates about its internals.

https://en.wikipedia.org/wiki/GPT-4
I started to have an interest in Japanese kitchen/cooking lately and every cookbook I have lists more than one type of knife as an essential.

Also this article mentions that the chef of the restaurant in the Japan House in London: “Akira has used many different types of knives in the past, but these days he finds that one sturdy knife and one small petit knife are enough to prepare almost any Japanese dish.”

So I’m not sure where you information is coming from but sounds more like myth than fact.

Article:
https://www.japanhouselondon.uk/discover/japanese-knives-par...
I use PhotoSync on my iPhone.
the image lists an attribution. but that’s for the image artist. otherwise all the “article” seems to have is a column name.

is the author byline hiding somewhere? or was it a paid message by the commercial real estate bag holders?
I worked at bloomberg for an extended period. Feature flags are seriously used eg. >10k flags added per month across all code. Now, they came with ample management systems to enable/disable, rollout, and check for complete rollout. Various techniques (shared memory, caching) were used to drive down lookup time.

Removing them came down to team discipline.

Ideally, a Google like clang analysis of code would find flags ready for removal and alter code to remove the old code path. Recall Google used tools like this ro update or migrate deprecated api calls

Bbg however never got there. Instead you'd just get various alerts
I always thought discussions about encryption forget about this topic. Encrypted data today is only hidden today, not in the future. So any darknet criminal should consider that files he/she sends are being intercepted and readable in 30 years.
If this is true, anyone [1] can now build a GPT-4 given training data and budget.

There's no magic here.

[1] That's probably twenty or so orgs right now, which will blow away OpenAI's moat and margins.
> (spicy pillow)

https://www.urbandictionary.com/define.php?term=spicy+pillow

TIL!
Same here, I can blame the liars in Kyiv government for pretending to be interested in implementing Minsk II but really never doing it, because they used it to "buy time" for this war.

You can "blame" them all you want if it makes you feel better. But there's no evidence that this was their intention. The whole "they did it to buy time" meme rests on single quote from Merkel, well after the fact, taken judiciously out of context.

Overall this is highly misleading representation of the events that led to failure of the Minsk protocols. But even if this is what they did - so what? To suggest that this is somehow an important thing in itself, to be weighed against the broader insanity and evil of the full scale invasion -- let alone, as you are implying, that it effectively caused the invasion (even partially) -- is just asinine.

Like a lawyer who offers in defense: "I blame that lying hussy that some are calling a 'rape victim' for feigning cooperation with the my client's perfectly natural and understandable impulses, while she looked for a sufficient heavy object to club him with."
Threads has scaled to 100M users in 5 days
Mechanics, no. Stats...are more complicated.

For example, much of the DnD kerfluffle is over the open rulebook and monster manual. If you make a game that has a Blue Dragon and operates totally differently from the "Adult Blue Dragon" that's in DnD you're probably OK.

But if you make a game that has an "Blue Dragon" with an Amour Points of 19, a Health of 255, a Speed of 40, but 80 while flying, and a Str 25, Dex 10, Con 23, Int 16, Wis 15, Cha 19...then you're a lot more likely to get into trouble.

So you make make a knock-off DnD that has pretty much the same _mechanics_ its true that you're probably fine. But once you start borrowing all the of stats of things from another work that fit into those same mechanics... well, I Am Not A Lawyer, but that's definitely the kind of thing that you'd want to start running past a lawyer.
Well, I guess I see people assert their beliefs as though they are an authority on any given topic on here for sure and any comment that challenges their belief is seen as an insult, or a threat to someone else’s position of authority or their expertise. It’s all relative though I don’t mind if people disagree with me or challenge my assumptions or whatever, sometimes people can be rude about it, that says more about them than the person they are being rude/abusive to.
Why would it matter? They can deploy updates via the existing system instantly.
Oh don't worry, were definitely fighting for better public transit too! Top-down successes like ensuring state bridge funding to prevent a death spiral for now (was a big multi-coalition effort), local support for new bus lanes (e.g. on Geary), to bottom-up direct action work that is secret :)
I wonder what the legal implications of them using SciHub and Libgen would be if that's true. I'd imagine OpenAI is big enough to make deals with publishers.
Thanks, it's not the cleanest code and for example my immediate mode GUI is nowhere near IMGUI but theres still plenty to look at.
Clickbait has its time and place. Despite my hatred towards it, sometimes it's really needed.
> They do if they're going into foundations of physics

People don't do PhDs on this topic because it's not productive. Famous/bored/tenured/rich people pitch in arguments for fun. Anyway, the vast majority of work in foundations of physics has nothing to do with these interpretations https://link.springer.com/journal/10701/volumes-and-issues This is a niche inside a niche in a mostly irrelevant field.

No advance in physics has ever been made based on QM interpretations. No Nobel has ever been won. No phenomena have ever been discovered this way. It's just not what people work on and it's not how physics is done.

You're determined that your view of the world is right, and that of actual working scientists is somehow blind orthodoxy that's missing the point. There's nothing I can say to fix that. It's like arguing with an antivaxer. You think you know more than the people doing the work. Bye stranger! But.. it's worth considering that here and elsewhere in life your probably don't know better.
The money being spent on "fixing homelessness" is a small fraction of the money that was being spent on the (admittedly terrible) mental health medical facilities that California shut down back in the 1970s.

"A failing mental health system leaves this mother pleading: Keep him in jail"

https://www.latimes.com/california/story/2022-12-12/one-moms...

https://www.latimes.com/opinion/letters-to-the-editor/story/...
Would be pretty difficult to find an exploit that avoids the boot chain attestation features. Good reason why a lot of exploits require you to reapply them every reboot.
Categorization and Classification with LLMs
Shouldn't you use a .com tld?

Will your pricing be competitive with Replicate?
Google is jokingly behind in terms of LLMs. They've done a pretty good job at incorporating vision and audio ML models into their ecosystem, but they underestimated language.
While being a good idea, it's still a company and a company does what ever it thinks is good for it. And why the heck is the petitioner doing all the work that should be done by Apple itself?

Just use another system and point. Is what I would do, if something is not like I would like to have it. Chose wisely :)
Depends the interpretation. Bell thought the most straight forward conclusion was that quantum systems are both quantum waves and particles, where the wave guides the particle (Pilot Wave/Bohmian Mechanics). In MWI, particles are superpositions of every possible quantum value. We can understand that as branching worlds thanks to entanglement and decoherence.

Saying we can't understand the mathematical formalism is a kind of Copenhagen interpretation.
Yes! We fully support this, but we really need the EPA to close the monster SUV /truck loophole. Otherwise there is economic incentive for people to keep buying these insane trucks
Show HN: Podpilot.ai – AI-Generated Podcasts
Hi HN, we’re Brian, Scott, and Ash, the team behind PodPilot. PodPilot uses AI to create a podcast series for your organization at a fraction of the time and cost it takes to produce a podcast traditionally.

How it works: We use AI in every part of the podcast creation process. Just type in the website for your company / org. PodPilot uses that as a starting point for an AI agent to discover more about your organization online and then to surf the web for relevant topics and news. Using what it finds, AI comes up with a pitch for each episode and then writes the script for the host and guest voiceovers. We then use AI to compose intro and outro music, and finally use AI to generate the personalities, avatars, and voices for the host and guest. It all comes together in a podcast episode that you can review and make adjustments to before publishing. We’re providing an early preview of personalizing your podcast series, and we will create an AI-generated podcast episode for your new series if you request one through our web app.

We’re targeting organizations who would like to have their own podcast series but don’t have the time and/or resources to produce one. By drastically reducing the time, effort, and resources involved to produce a podcast, we make it accessible for any team to have a quality starter podcast that, with editorial control, the team can develop into something truly special.

More thematically, this is a bet on AI’s role in the future of entertainment. Although it is still in its infancy and we have not witnessed a defining AI-driven entertainment breakthrough yet, we anticipate that individuals will increasingly harness AI in profound ways to create genuinely creative and captivating content, and that over time such content will represent a growing slice of our media consumption. PodPilot is an early exploration of what is possible with today’s AI technology.

We’re really excited about the technology behind this and would love your input. We know that there might be opportunities to use the tech in other ways, and we’re interested in what ideas come out of discussion with the community here. If you’d like to send us a private message or are interested in collaborating with us, please do get in touch at hello@podpilot.ai.
Let me put it this way;

You might get away with installing your RootCA on your in-office PCs that you own.

Good luck though getting me to install it on my (external contractor) laptop or my (employee) phone, or my (hosted) VMS machines. -you- may plan to only use the CA for good, but I don't trust you (and by extension all your IT staff, present, past, and future) to be angels.
Thanks! Finishing such a large project feels great and you learn a lot when you have to implement so much you take for granted when using things other people have built
I noted several things that don't seem consistent with what people have been assuming from before.

For instance - MoE yes, but 16 experts at 111B parameters? Doesn't make sense. GPT 3 had 175B parameters. I doubt they would go less on base models from now on. The number that makes more sense is ~220B parameters per model and 8 expert models. That is the same inference cost in total.

The 13T tokens of training data seems pulled from thin air.
Yeah the privacy policy page had an expired certificate and Google delists the app automatically when that happens.
> If you take an originalist argument that the constitution is static and cannot be reinterpreted/amended you have to first justify why you think amendments like the banning of slavery or women's voting rights amendments are not legitimate in the United States

Holy straw man Batman! What kind of crazy "originalist" believes the constitution can't be amended? There's a literal provision in the constitution for amending the constitution!

Originalism just means you don't use the courts to invent new rights out of thin air, or nullify rights you don't agree with, not that you can't amend the constitution at all. And even by originalist standards I don't think interpreting "papers" to include digital records is a stretch, anymore than interpreting "press" to include blog posts is.
Oh, you were complaining about the parenthetical statement where I suggested my ideal use would be for it to go to the arts?

That's fine, it's a parenthetical because I don't think it would survive the actual proposal because of concerns like yours. I think the US government is able to do a decent job of funding the arts, but I'm aware a lot of people don't agree, so I'd definitely expect that in the end the funds would just pay for the administration of the program itself, and the excess would go into the treasury and general fund.
This is the Boston Consulting Group hired by a mismanaged university in debt telling a library it should stop preserving/digitizing historical works and focus on it’s supposed main business of supplying (recent) literature to researchers. All while that library is a national leader in digitization projects.

(BCG is the consultancy per the linked-in-the-article blog post in german which also has a comment with some information about the (former?) mismanagement)

https://www.jmwiarda.de/2023/07/05/keine-ruhe-in-g%C3%B6ttin...
Irfan – a free, lightweight image viewer for windows
I think you need the layer4 module to get this working.

https://caddyserver.com/docs/modules/layer4
I mean I'd say this is pretty noticeable: https://imgur.com/e6TbXFj

Same screen, same zoom levels. Viewbox properly set, height/width set, confirmed compliant units. Switching between img/object would get it unblurry but then lose the embedded image data. Switching to inline-svg would in turn get the image data working but the drop shadow was completely broken.
Should Mozilla (or any other group) get to decide what I can or cannot do to a process running on my hardware, even if it originated from them? Things like this make me feel uneasy because it seems to be sitting on the edge of a slippery slope.

Another example of these "silently user-hostile" applications is VirtualBox; it spawns multiple processes in a similar way, and even resists attempts to debug it if it's already running. I remember being incensed enough by it complaining about my --- patched to make the OS work for me and no others --- system DLLs not matching its internal whitelist and not starting, but not after I exercised the same skills to patch out those checks in it.
Figma, and I got to the point of running it through SVGO and hand patching any constructs that had known issues with Safari.

Going based off the types of bugs I was seeing alone I wouldn't trust SVGs for anything but the most basic shapes.
A doctor can hold your papers even if they created them and you’re unaware they exist.

Why wouldn’t this apply to metadata about you? It’s just as much your information as the results of a cholesterol test.
I half wonder if something like the Yahoo directory could make a comeback. A human created directory of high quality websites rather than search.
The most optimal situation to pick a mate is during college, undergrad or grad school. This other institution has been eroding because of the lack of men going to college and excessive tuition costs, i.e., debt, for all reducing the net economic incentive that it once was.

The questions they must eventually answer in the affirmative are:

1. Do you trust them implicitly with your life and everything else?

2. Are you better with them than apart?

The irreducible problem is: very few people today can or would meet this standard. There aren't that many good, decent, mature, reliable people who are also available and mutually attracted. There are millions of cowardly narcissists working on their sun tans, personal brands, and increasing numbers of people they've slept with without knowing anything about them because they're too afraid to have emotional courage.
That explains how they merged.
Twitter killed two spaces.
That seems like an unfortunate tool to have discarded. Right now, I can use vertical separation to structure text, but horizontal separation.... Well, that's far more limited.

Within sentences, there's the dash—either em or space-en-space, depending on where you're from—and there are plenty of other structural options. Between sentences, you've got the ellipsis, and that's it. The way they're used in the Declaration, in place of paragraph breaks, is helpful even when you're not just trying to save space—for example, to structure a list of short words or phrases without creating the visual separation from the text that comes with using separate lines.
Somewhat recently, OpenBSD binaries for Chromium and Iridium were changed to identify as Linux instead of OpenBSD in the useragent, I think to pass dumb "security" webapps that refuse to talk to unknown clients. Firefox still identifies as OpenBSD.
Surely they're allowed to collect something in payment?

I would assume they owed whatever ethical duties they owed to Twitter in the sense of the shareholders selling to Musk, and I threw out $20 billion as a wild-ass guess of how much he was paying above fair value at that point in time. They got paid ASAP because they're savvy.

And I assume Musk is having a fit of pique and the legal arguments make no more sense than the stuff about the "bot problem". He didn't own the company before he owned it, and usually you acquire the debts of a company you buy, right?

But I'm an expert in none of it. I just expect more of the same from a person with an established routine.

(By the way, a $100 bill - the largest US currency these days - is said to weigh about 1 gram, meaning that $100 x 454 grams/lb x 2000 lbs/ton = $90,800,000. $90 million, in other words, is literally a ton of money...but $20 billion is more like 220 tons of money - ChatGPT claims that is the weight of a blue whale, a Boeing 747, or an M1 Abrams tank)
I am going to assume that this is not just a troll so I will take the time to answer your question.

> technologically aware people know what Apple are doing

Yes, I do. I have over 30 years designing chips and computing systems (not an Apple employee). The Apple Silicon Macbook Pro I am typing on has great performance and I never think about battery life any more and I never hear a fan. I've owned a lot of laptops and nothing has ever come close in build quality, design, and performance/watt.

Apple has over 2 billion active devices in service. Two possibilities: We are all suffering some massive delusion, or your criteria for evaluating quality and engineering need to be adjusted.

Please name another large company that cares more about privacy, freedom, education, empowering people, the environment, diversity, etc. than Apple. They are from perfect, but they keep investing in the quest to do better. What specific ethics issues are you so concerned about?

Please answer a question for me. How come so few people who are into open source operating systems seem to be unable to understand that the vast majority of the world doesn't want to deal with all of that stuff? I think it is great that some folks enjoy the configuring, tweaking, writing their own services, setting up their shells, arguing about vi vs emacs, etc. That's really cool and I am happy that is available for those users. However, don't condemn me if I have other priorities.

It is super simple. Apple makes products. If people like the products they will buy them. If people can't do what they need to do with the product and don't enjoy using it, they won't buy it again. If you are right, Apple will soon die and your problem will be solved. If you are wrong, their unprecedented growth will continue.