skysight-inc/HackerNews huggingface dataset:
Complicated question, the answer is “it depends”.

Several factors influence performance beyond parameter count, notable ones include: training corpus quality, training flops, and the downstream task.

It depends on how much compute you are spending on training and how big of a model you’re talking about.

There’s a “minimum” tokens/parameter for increasing size to be effective at improving loss/perplexity, so as you go up in parameters you generally will have to broaden your corpus which may lower it’s quality (e.g. tweets/reddit posts vs books/articles).

This effect isn’t as significant at 65B parameters as there is still enough high quality training data but if you’re talking 1T the corpus will (probably, I haven’t tried this/seen this done) by necessity be significantly poorer quality as you will overfit by simply repeating (it’s only beneficial so many times to repeat).

As a general rule, when validation loss/perplexity are the same in two models of different sizes downstream performance seems to be also generally the same (this was briefly explored in the PaLM 2 paper by Google) although it doesn’t correlate perfectly.

Practically speaking, this translates into a bigger model is better for applications we’re generally talking about. It just may not hold infinitely which we’re starting to see evidence of.

It’s definitely not linear though, you can look at some of the OpenLLaMA benchmarks (without getting into the weeds of if current benchmarks are representative) and the accuracy improvements in even 13B is not that significant (noting here all models were trained for the smear number of tokens, so relatively overtraining the smaller models).

There are probably some threshold parameter sizes that make a big difference but it’s still being determined.

https://ai.google/static/documents/palm2techreport.pdf
Thanks! what do you mean with founder details? you can find me at twitter: @borjasolerr
18 rotors, in case anyone else is wondering.
It’s opt in. I never used it and don’t plan to and all my devices have it disabled.
Because no information is lost if you simply change domain, but you may spot more patterns faster or easier. For example (even if a bit dated) https://ieeexplore.ieee.org/abstract/document/1614066

There is a lot of research in this field because of the IoT fad/trend.
If you want to know more i would suggest to simply pic a paper from IEEE and deep dive into the terms and terminology and simply skip the proofs of most algorithms/theorems.
You're right. It's a good lesson to take away when it isn't you because when you're that guy, it's so hard to separate yourself from your work.
All of those are absolutely real. There is a lack of economics and a surplus of optics in the game for all players.
Why do you put quotes around hateful content. Do you think a film blaming Jewish people for WW2 is not that?
Can confirm Google broke hardware tokens on Android last week. Very likely when shipping their new passkey product. I cannot login on Facebook Twitter and AWS anymore.

Classic Google. Shipping shiny new toys is great, but you should care more about maintenance.
Would this be a good model for my work on 𝙇𝙇𝙈 𝙢𝙚𝙘𝙝𝙖𝙣𝙞𝙨𝙩𝙞𝙘 𝙞𝙣𝙩𝙚𝙧𝙥𝙧𝙚𝙩𝙖𝙗𝙞𝙡𝙞𝙩𝙮?

I only have an older MacBook so I’m not sure what I can install.
Uber was a massive example of this. The best engineers kept their head down and just tried to keep things afloat, fixing bugs, etc.

However, a large and insidious cadre of B tier engineers was constantly writing docs proposing meaningless arbitrary system changes and new designs for the sake the changes themselves. These new projects were the only way to get promoted. The entire e4->5->6->7 track was written in such a way that it only ever encouraged “TL”/“architect”types to grow.

This led to constant churn, horrible codebases, and utter bullshit self made problems which could only be solved by digging a deeper hole.

There are companies who handle this well. Ultimately it comes down to engineering culture.
Apple Earthquake Survival Kit 1986
The Foundation Model Transparency Index
I wish more VPN services offered multihop. I know of Mullvad (no more port forwarding), Perfect Privacy (slow), NordVPN (no port forwarding afaik)

Who else offers multihop+port forwarding?
There have been previous discussions regarding this topic, I suggest you to read through them!

TLDR: Flutter is here to stay.
No, there isn't a contradiction here. GAAP Operating Margin is smaller than Gross Margin by definition.
Sounds like you read this in your local newspaper in Nashville or something. The entire city is well-covered by transit services. 450k people ride Muni every day. 65k people use BART stations in SF every day. Only Washington and NY enjoy significantly more transit ridership than SF does.
Today they might have a psychologist on the team to research which buttons may serve as dopamine triggers so you're a lot more likely to upgrade to Premium before thinking it over
How GPU Computing Works
Thanks for the heads up, I was about to try it.
Try to find other real problems to work on that are different from your current boring parts? The new problems might eventually become boring as well, but often the change and fresh perspective is enough to pique your interest in a motivational and productive way.
> No engineer is paid extra for keeping the codebase without growing too much.

I am. I'm paid more than most developers to run a team doing just this. We make minimal change, have an absolutely non-negotiable focus on stability and minimalism and reject any change that isn't absolutely driven by validated majority user need. Even then, the bar is high.

I'm not saying this is a common situation, but it certainly isn't rare in my experience. Software is a vastly wide scope of software types and requirements. I'm paid to be ruthless, and to know what ruthless looks like in terms of delivering consistently without downtime/data loss/critical issues.
Growing up in Belgium there was a lot of techno / house / hardcore, specially because of the large hardcore scene in the Netherlands. So this definitely was my music of choice

https://www.youtube.com/watch?v=Pp2xYLdtNls

That whole channel brings back memories. Good and bad.
As a curious onlooker, was the calculated time below a reasonable minimum?
> Writes can be expensive even if uncontended, because they invalidate cache lines.

This isn't expensive if cache lines are uncontended, though.

> I guess you could say they contend with unrelated data but that would stretch the definition a bit.

I think you might be talking about "false sharing." This is real contention on the cache line due to co-location of apparently unrelated variables.

> Arc<T> (and it’s relatives in other languages) constitute textbook violations of this rule.

Definitely!

> In Rust they are everywhere in non-trivial code

Ehh.. only the hot ones matter. Most are not actually contended much, and the article's solution (unshared clone) is a very reasonable approach to scale these without an API change.
Have people here tried Bluemind and others on premise/sh solutions ? Are these viable and manageable for a small IT dept. ?
In Dubai, you can get a Gold card for the metro, which allows you to sit in a quieter carriage with more seats at the front of the train. Knowing I'll probably get a seat when I travel, I take the metro more often than I would otherwise.
Does this consider the fact that humans will always be either in facilities or space suits that have protection against such radiation?
I can understand the confusion.. the product is listed as 128Mb vs the 16Mb version here: https://pine64.com/product-category/ox64/

But that seems to be referring to XSPI Flash and not RAM.
A good life lesson in general. My version of it: "most of the most important decisions you make in life will be made in the basis of insufficient information."

As programmers we may be used to the notion that we can optimize if we know enough. We often can't. Decisions won't get better with more information because it's still insufficient. All you can do is use your best judgment -- of when to use your best judgment. And live with the consequences.

That doesn't help you make the decision. But it can help you avoid spending too much time kicking yourself over it.
The fundamental problem is that a non-technical person has specced out a technical product without input from technical people.

A restauranteur wouldn't develop a menu without input from a chef or prior experience as one. A layperson wouldn't design a real building without input from an architect or engineer.

Yet for some reason a myriad of non-technical people (read: laypeople) feel empowered to design, spec, and strategize about software. It still boggles my mind that "product management" is a real profession.
that's just multi-threading in general

i feel like the post i was responding to was talking about handling/pinning a thread to a specific CPU core?
Are all the workers insured?
Their FAQ mentions a hybrid system with better results:

> What’s the maximum distance you expect HEXA to be able to fly with this hybrid version?

> a. 60-90 miles in 60 minutes

source: https://www.liftaircraft.com/_files/ugd/ce21ec_0e727e43682b4...
Apple’s biggest competition in India? Used iPhone sellers
I'd like your opinion: channels or locks?

This is really for a program I'm writing in Nim, so perhaps it depends on how channels are implemented?
Yeah, I don't have time to rename every single one of 100+ episodes.
This is a good strategy for the pre-EV era but in the EV era 'vehicles' can and will be much smaller than what most people think of as a car today. This is because EV technology scales much better than ICE vehicles for cities. A small ICE car is still heavy and cumbersome and polluting primarily because of require pollution controls. Small EV's have none of that so they can be much lighter and smaller than similar ICE implementations.

In particular, EV's that are less than half a standard lane width wide would allow the grid capacity to double overnight at almost no extra cost. This will happen first in the busy city cores where the usual single occupancy gas vehicle will be dissallowed (already happening in a few cities in China and Europe). So basically this is a cross between and bicycle and a the current regular ICE cars.

But wait, there's more. Because EV's are non-polluting city core roads can be covered in poor weather and parking can be almost anywhere. This won't be your father's city core.
Thought there was research that they'd have to have some kind of artificial gravity as in the 2001 family of movies? If not brain fluids than bone mass.

Also, what's the weight in food that's required to keep somebody alive for 4 years? Will water be more of a problem than food? As per the Martian, they can pre-position food and supplies for the stay and the return, but it seems energy-expensive to chase down a capsule on the voyage to Mars to drop off supplies. Hell of a DoorDash, eh?
If you haven’t already, try the desktop apps when you can. They’re marginally better.
I get a lot of news for niche topics from subreddits, which I guess you're also classifying as social media. What alternatives are there?
Could Generative AI Kill the Stock Photo?
Here's my personal experience switching from Plex to Jellyfin. Everyone's needs are different, but, for me, Jellyfin has been a much better experience.

I used Plex for years and always hated it. It didn't let me customize the home screen in the way I wanted, so there was always a bunch of junk on there that I didn't want and couldn't remove. It also ran very slow on my Samsung TV (1), starting up slowly and responding to the press of a button after about a full second (it had done this for a long time through multiple versions of the app and factory resetting the TV without any improvement; also, the TV is only a few years old).

I got frustrated enough to finally switch to Jellyfin about 4 months ago. It was a pain to get the app installed on my TV (the app isn't in the TV's app library, so it needs to be installed as if you're a dev), but once I got it working it works well. The app starts up faster than the Plex app and is very responsive to button presses.

Back when I was using Plex, I really wanted to customize the home screen to remove certain components and re-order what appears and spent a lot of time reading over settings/customization stuff which never actually let me do what I wanted. With Jellyfin, I simply went to settings > home and the intuitive options there let me do exactly what I wanted to do in seconds.

I can't think of any major issues I've had with Jellyfin, but here are a couple of thoughts. With Jellyfin I needed to create separate folders for what what Plex called collections and add them as libraries instead of collections. At first, I thought this was a negative but ended up deciding it didn't really matter as it works fine. I had a series of videos that wouldn't play properly on Jellyfin until I used ffmpeg to strip out the extra subtitle tracks (they had 42!), but never tested them on Plex so not sure if Plex would have handled them.

(1) I will never buy another Samsung TV, but that's a rant for another post. I considered buying an Nvidia Shield just to fix some issues with the TV, but probably won't bother now that Jellyfin is working well.
You're correct -- the problem with userspace spinlocks is that the holding thread can be scheduled off. You can prevent this to some degree (probabilistically) with isolcpus and thread pinning, but that usually doesn't prevent hardware interrupts from running on those cores (which kernel spinlocks can avoid!). This isn't really solvable without running in kernel context (to have the elevated permissions necessary to mask interrupts).
I moved to Fastmail when they were threatening to end the grandfathered free accounts.

I've been happy with the results.
The site isn't currently loading. I get this:

> You need to be logged in to see this content. If you have an account on Dreamwidth Studios, you can log in using it. Or, if you have an account on a site that supports OpenID, you may log in using OpenID.

Here's a cached version:

https://archive.ph/jeBLA

TL;DR: it's a feature of iCloud Private Relay. Turn off private relay if you don't want a private relay.
There is something like that in Firefox. In the URL bar, to the right, a "paper hamburger" shows up that presents a Readability-like experience. The Mode is preserved during refresh, so you can often refresh a Javascript popup out of existence.

It is occasionally intermittent, however.
The paper was fairly recent, https://arxiv.org/abs/2304.15004. It was more thoroughly confirming what was generally agreed upon while debunking other reasons.

The key insight from the abstract, "Specifically, nonlinear or discontinuous metrics produce apparent emergent abilities, whereas linear or continuous metrics produce smooth, continuous predictable changes in model performance."

Yup that is another recent and interesting development for sure!
This is awesome! I actually had this exact idea 8 years ago, as a revival of the infamous "Facemash" app from Mark Zuckerberg.

I thought no-one else would be interested in it. Super happy to see it come to life.

To me, a killer app would be the ability for anyone to input their own "objects" or images to compare, and provide a way for teams to vote to find the best / preferred option.
Interesting to see that there’s both Google Cloud and Stability AI mentioned in providing the compute. Did Stability pay the bill for the resources used for training?
> which one will earn the creator more money?

The cheap ones. My memory of tv as a kid was "why is everything sports and news?" and, as a teenager "why is everything roommate simulators" and then later "why is everything cooking, dancing or singing competitions?"

Product placement used to just be part of ads until they brought it into the programs themselves.

I have no doubt the industry will chase their margins at every possible chance.

(I don't really mind the idea of paid writers using chat gpt, though. Maybe it's naive but I think they could offload some of their work and spend the saved time producing higher quality work - until a bunch of them get fired I guess)
Can I ask what legal jurisdiction you are referring to?
I would much rather these illicit activities being reduced or occur in private spaces rather than in public.
> How is this a drone if the pilot is on board?

Its remote controlled as well as being locally piloted. Its a drone that happens to also have local controls.

“Every second of your flight is monitored by our highly trained and licensed primary and secondary flight controllers, with whom you’ll have radio communication who and can take over remote control of your aircraft at any time, if necessary.”
You zeroed in on the core element of bullshitting: trivializing complexity into sound bites, simplest examples.
It's funny because the idea of "if you didn't succeed, you didn't try hard enough" is a cornerstone of the self-help industry and the charlatans peddling various self-improvement systems. If anybody follows their system and doesn't succeed, well, they either didn't try hard enough or they really didn't follow the plan as it was laid out. It's a foolproof way to show the next sucker that your system works.
Some of the same people were involved, no? They must have had a good time writing that. “Things we have learned the hard way”.
> a tracker composer who went on to cofound Swedish House Mafia

Axwell aka Quazar:

* http://ftp.modland.com/pub/modules/Protracker/Quazar/

* http://ftp.modland.com/pub/modules/Fasttracker%202/Quazar/
Stolen tools being sold on the blackmarket != tools being sold with government knowledge and permission.

Maybe there are actual examples, but this isn't one of them.
Ohh there is plenty of crime out there, but the FBI only creates the crimes they want to solve that align with political goals they want to achieve.

To be extra clear given recent events, this is not commentary on the case around Trump;s actions. This is about terrorism cases, drugs cases, and various other crimes (like the attempted kidnapping of Witmer in MI).

It all about political objectives of either the individual agents (in the case of Witmer is was for the personal advancement of the agent) , or the the agency has a whole, while they ignore wide spread crime such as insider trading of congress, interstate crimes by large corporations, abuse by local police dept's, etc etc etc etc
The Eight Fallacies of Distributed Computing: https://nighthacks.com/jag/res/Fallacies.html
I wonder what areas this impacts most. Since the dating market is highly local (most people don’t consider “the whole nation” their dating pool), areas with more ideological divide are more likely to be impacted, but the authors don’t seem to look at this very much.

For example, if the female ideological shift left is occurring mostly in blue states, it may matter most to blue states; if it is homogenous across the board, a different conclusion is to be drawn.
Maybe it's Notch. It'd make sense to me.
Yeah I was initially surprised when learning about the *arr stack for the first time, as my intuition was very insistently telling me: "I must be gettint it wrong, these ought to be all a single service!!"

They all definitely feel like small parts of a single package, don't look like they merit being their own thing. But it's not my thing, so what do I know.
I would have loved to go through the setup again and see where exactly I got confused. For this purpose I uninstalled Plex and re-installed it. Sadly for the last 20 minutes it only shows:

<Response code="503" title="Maintenance" status="Plex Media Server is currently running startup maintenance tasks."/>
The "go-to" GraphQL server implementation varies based on language.

Here are the popular ones to my knowledge:

- Node.js: GraphQL Yoga + Fastify, Apollo Server

- Java/Kotlin: Netflix DGS (built on top of Spring Boot)

- Scala: Caliban, Sangria

- Python: Strawberry, Graphene Django

- C#: HotChocolate

> "On the client side(for mobile), AFAIK iOS(Swift) and Android(Kotlin) does not support GraphQL natively?"

GraphQL queries are just HTTP POST queries with a JSON body. They're supported everywhere.

If you want specialized tooling for them, Kotlin and Swift both have great strongly-typed GraphQL libraries.

Apollo publishes libraries for both:

- https://www.apollographql.com/docs/kotlin/

- https://www.apollographql.com/docs/ios/
I am completely baffled by this comment. You're saying the _juniors_ are creating overly complicated modern frameworks, or are the ones pushing it?? It's clearly the opposite in my opinion. Big companies/teams are releasing tools that may work well for their scale but are overkill for most, and they're championing them as good solutions for everybody, and juniors are the force working in the opposite direction (trying to simplify/untangle all this complexity, they don't have the experience to recognize if it's overkill. They also want to get hired at all the companies that use these tools so they have to learn it).
Imaginary problems are the root of all problems

Maybe a Buddhist could say
We (Stability AI) trained it on our TPUs with input from the OpenLM team as an OpenLLaMA collaboration.

The 20b model is 780b tokens in, lots of learnings so we can optimise future runs.

Hopefully these will be useful bases for continued research, we will have some SFT/RLHF variants in due course from our Carper AI lab.
I mean a lot of projects that so far other people are using to build cool things?

Information that has helped other people fix problems or learn something they thought was hard.

What has your tearing down of others accomplished? Have you considered a deeper look in the mirror yourself? From where I'm standing your the only one who seems in need of it, all of this sounds like projection to me.
The FARs make no provision to exclude the weight of anything other than safety equipment (to include floatation). The battery weights don’t count only so long as they’re left behind.
Interesting, are these "women-only" cars usually at the front or back of the trains?
More than that, the Real Market (Earth) may solve this issue for good, when Texas regularly hits Wet Bulb Temp due to Climate Change, people will start heading north. So no more Texas.

This is crazy, I am sure the Lawyers are now looking closely to Case Law to e ready when the suite start flying.
Any decent alternatives to Pocket?
This is very cool. Thanks for sharing it. It looks like a nice project to keep me occupied until my Spectrum Next arrives.
I've been using json-api with graphiti in rails. And I gotta say the massive gain from it is that it's all rest and a trivial client impl from scratch if necessary.

Couldn't recommend it more.

Have to say. Most json-api impls suck, so graphiti has been a game changer for me.

N+1 are a problem buuuut it forces you into good model designs and good tools like graphiti and the latest rails show you the cause of the n+1s so it's not so bad to debug.
Ask Jeeves is hard to kill
How about just stop making microservices and go back to monoliths? Then you don’t have to shoehorn two things at the same time!
Much of Africa also, eg. in Tunisia they are known as louage and constitute the primary form of public transport. In mainland China they are called "breadvans" (面包车).