skysight-inc/HackerNews huggingface dataset:
The degree to which transformers scale, as measured by loss (training objective) is known remarkably well! See [1]. There's a formula in there for the minimum loss you possibly achieve even with infinite compute and training data, and it's hardly less than Chinchilla's loss. The recent GPT-4 paper further reinforces that these scaling laws are real, because they predicted with high accuracy the loss the model would have based on data+compute used.

Admittedly, the link between improvement in loss and improvement of capabilities may break down or be misleading.

However, there's just not much training data on the internet left unused. Maybe an order of magnitude. All books ever published (in English?) are a smaller dataset than the corpora already used for training. See [2] (which includes an easy summarisation of much of [1]). And the scaling laws show training data is already the bottleneck rather than compute.

[1] DeepMind, 2022, Training Compute-Optimal Large Language Models https://arxiv.org/abs/2203.15556

[2] Chinchilla's wild implications https://www.lesswrong.com/posts/6Fpvch8RR29qLEWNH/chinchilla...
The tracker for that torrent was taken offline by Meta. There was a story about it on HN a while ago. Don't believe me? Try to torrent.

Do homework. SMH.
> I never redeem points for purchases. I always apply them to a billing credit.

This may not be a good redemption. For Chase UR points specifically, you really ought to transfer them to Chase Sapphire Reward card and redeem them for travel ($100 in points becomes $150 in travel) or transfer them to airline/hotel partners for redemptions. For example, you can often find Marriott, Hilton, and Hyatt points redemptions that are substantially better (sometimes more than 50% off) than the cash value of the points.

My last Hyatt hotel stay, I redeemed 8,000 points per night for a hotel room that was listed at $267/night. In cases like this, you can more than triple the value of your points.
This project demonstrates the need to automate things that owners of sites don't want you to automate.
I think BTC comes out better than the other coins buts it's way down too.
>only if you are incredibly weird

Pretty sure people had the exact reaction when online dating came out thinking you must be some social outcast. Or when some people chose to WFH way before it became remotely normal and were branded antisocial for choosing to not be in the office with the colleagues.

Why be such a hater? I don't get it.

Just because some people are into different things than you or what society deems 'normal' doesn't make them weirdoes.
Outsourcing always has a lot challenges. AI is a completely different beast.
To be fair, didn't they actually do that with the UI element it's named after (windows...)?

I think the menu bar, the window with the header bar and the action buttons where all pioneered by them back then, or am I mistaken?

It's been 30 yrs though, so I get what you mean.
Weren't most americans supporting the "war on terror"?

And weren't all your president approving drone strikes on kids and families for decades?

The level of propaganda that americans consume is not to different to the one of russians.

Ofc it didn't help that Ukraine was harboring entire Nazi battalions.

Just think if China was putting a military base in the mexican border and Mexico hired Nazis to fight for them. What would the international response would be like? Not too difficult to imagine eh?
What risks are you referring to?

I think the fact that for most people there is almost no risk is why they are mentioned in the same Breathe
Yeah, I meant it this way. 5xx means I'm fixing it, right bloody now because I'm getting paged.
Depends if they used any of that money to make any other crypto bets to improve profitability. That’s what gets you.
hasn't everyone always said that "anyone can have an idea, implementation is what matters"?
Perhaps, though I now recall that one of the options was free. I tried that one too, but I abandoned it first in favor of the others since the checkout and "payment" experience failed in strange and unpredictable ways with that one (the others at least showed me a 'sorry this is broken' style of message).
People would probably tend to grow an aversion to Business Chat for its smartypants opinions. Microsoft may want to avoid that. ;)
People have worked out the amount of energy in lightning strikes, with the result being that it's not enough to be worthwhile.
Or Elim Garak, one of the most interesting anti-heroes in all of the Trek universe.

(Is he really an anti-hero? Well as Garak would probably say, "I'm not so sure, but there's hope for him yet.")
> the people who dared to think from those first principles are now becoming unbanked

Folks doing honest research are fine. Those scaling glorified slot machines are having a tougher time.
I was about the say the same. Moved out of the US five years ago. I can hop on bike and be at a national forest in 10 minutes, taking nothing but dedicated bike roads.
Now that Framework is coming out with AMD models, I find myself suddenly less excited about Linux on laptops from all other vendors.

Sure maybe this Thinkpad has nice hardware, but this laptop has three major flaws all others do:

1: Too many sub-variant models: Did you get one with a Qualcomm wifi chip, or an Intel wifi chip? Linux users do not have the luxury of not caring.

2. The ODM's never design these laptops with Linux in mind. Often a simple BIOS update is enough to make or break that experience.

3: No safety in numbers, no network effect: Maybe a few hundred people buy this Thinkpad model/variant to run Linux. The numbers simply are not enough for Lenovo and friends to financially care. There will likely never be enough eyes on this machine to make it a first rate experience.
>It's shocking to me how we still refer to paracetamol and ibuprofen in the same breath when their relative risks are so different.

And it's shocking to me how we still refer to paracetamol (Acetominophen for us USAians) and ibuprofen in the same breath, when paracetamol might as well be a sugar pill, for all the good it does and ibuprofen is the liniment of the gods!
>Profilers are not rocket science...

They are not. There are orders of magnitude more rocket scientists than good profiler writers. And no, bottle rockets with flight recorders do not count.
Users don't have choice. And alternatives aren't that much better...
Londo’s arc is just amazing. It made him one of my favorite characters in all fiction
Disney and Apple are close. Does this mean that there is not much to be expected from Apple's VR headset launch this year?
>Whhich specific part of the bill allows "VPN users" to be punished with "20 year jail sentences"? Does the bill even ban VPNs

The bill allows communication technology to be investigated for vague security concerns, and then allows punishing those that are deemed threats.

This means they could investigate and punish some VPN provider, and someone could wake up one day and suddenly be committing a crime by connecting to the same VPN as the day before (I think? They may need their subscription to renew before a crime, I only skimmed the law). Sure there'd be an announcement, but it could still end in a potential 20 year sentence for connecting to a VPN.

It could even be a vague connection, like Russia is using this third party VPN provider to undermine democracy, so despite really doing nothing wrong we're banning the VPN.

You can certainly argue it's unlikely the law would be applied this way, or that users aren't at great risk of being targeted. But the headline claim is broadly true.
yep, mixing lexical and dynamic scope was the hell indeed.

A convention I use with jsonnet is to use locals to "anchor" some important objects in the lexical scope.
My rule is to name the locals with exactly the same name as the field whose object they refer to. Example:

{
deployment: {
local deployment = self,
spec+: {
replicas: 3,
template+: { spec+: {
local spec = self,

containers: [
{
name: 'foo',
env: [
{ name: 'REP', value: std.toString(deployment.spec.replicas) },
{ name: 'SA', value: spec.serviceAccountName },
],
},
],
serviceAccountName: 'foo',
} },
},
},
}

Adding these locals gives the right amount of friction to avoid using this all the time, while at the same time having a predictable naming for the locals. The jsonnet LSP tool can easily resolve that local since it's only a lexical thing
I have doubts about their finances but that comparison makes no sense. SVB is a bank, Binance is a cryptocurrency exchange that doesn't have the fiat custody issue to that extend because they're mainly not dealing in fiat. It's more of a question of how companies like Tether have invested their dollars and the answer is nobody really knows.
How about rejoining the EU?
Wait a minute. How high is high? How much for a pint of something? $10, $20?
I guess you haven’t read their documentation…
It's not remotely comparable. Few people had anything to gain from cloning; These few people had a simpler, cheaper route via IVF; Cloning requires specific technical equipment easily controlled and specific technical expertise few other people had.
Since the LLMs are probabalistic is it possible for the inference engines to highlight lower probability content. That might at least make them more "human" rather than being confident and inaccurate.
> It's a pretty unclear why anybody would want to be a shareholder, though.

Yeah. It doesn't sound like a great idea. Sure, the bank can charge fees for maintaining accounts. But what do you do if you suddenly have a large influx of deposits? To maintain the 108% ratio you'd have to raise additional capital, fine. But what happens when deposits fall? Presumably that would reduce the fees collected and thereby reduce earnings per share with no feasible way getting out of the situation.
It's actually slightly easier, bZ4X.

The name does actually have a meaning: bZ(Beyond Zero emissions) 4 (based on Rav4) X (Crossover)

That said, I wish they had just called it the Rav4 Electric. I believe mass adoption comes from car companies integrating the electric models into what (non-cutting edge) consumers already trust (Chevy is the only one really embracing this idea)

Considering this model was announced before they asked Toyoda to step down for failing in EV adoption, I suspect it was named to not sully the reputation of an established model.
That’s because it’s very posed so it’s not that funny.
From a pure data amount point of view yes, but relatively little of that would seem to be relevant for our intellectual capacities. If GPT was a robot moving autonomously around in the world with full visual, auditory and tactile apparatus, it may be a bit different.
Can this get the ggerganov treatment so that I can run it on Apple silicon?
Everything can't become meaningless because what we call meaning and purpose describe subjective interpretations, not inherent properties. My children mean a lot to me, but the meaning comes from me and my interactions with my children, not from a quality they possess (which is why my children don't mean anything to most people). It follows that nothing can "become meaningless," it can only cease to mean something in relation to you or me.

We have to find our own meaning and purpose in life, not look outside ourselves. I assume people reading my comment understand the distinction between higher purpose or meaning in the sense of the world at large, the universe, or the hereafter if you prefer, and what each of us finds personally meaningful or purposeful.

For myself, I found meaning and purpose from having children to raise. If I didn't have children I might find purpose in accumulating wealth, or finding a partner I enjoy spending time with, or traveling to see the world. Even hanging out with friends and laughing has some meaning, just not likely a cosmic meaning.

If a person needs to feel their life and (subjective) interpretation of their place and purpose in the world has importance and meaning outside of their subjective experience to stave off depression they should seek professional help. To imagine that what one does has significance, importance, and meaning beyond subjective experience seems like a symptom of delusion or narcissism.
Of the show categories you mentioned, they don't exactly support your argument.

News has little rewatch-ability, and partially recaps what's going on, in case you're just joining. Game shows almost never have long-running arcs, and even if you had a repeat contestant, it's not necessary to watch a previous episode to enjoy their performance in the current one.

Soaps DO have long-running plot arcs, but are notably aired in the middle of the day, and aimed at housewives and retirees, who are MUCH better situated than the average person to follow a show regularly.

A better comparison would have been Twin Peaks, which also had long-running plots. People made a point to watch it, but it was much shorter and thus easier to commit to. It was also national water-cooler conversation because it was one of the most unusual things ever aired on TV before then.

I definitely agree about the special effects; it looked much worse than Star Trek:tNG, which started airing 6 years earlier. I also agree that the moral ambiguity was discomfiting at the time, and that sci-fi faces hurdles to mass popularity. I personally think B5 also suffered from a slow first season, and a lack of top-tier actors (like say, Patrick Stewart or Edward James Olmos).

> at a prominent point in the cold war

The Cold War might have been an influence on Straczysnki's writing, but technically, it had been over for at least a year (USSR dissolved in Dec 1991) by the time B5 aired (Feb 1993).
Why was it extended after the new year? COVID is over.
Exactly this. The financial system is designed to extract wealth globally and funnel it to well connected elites and the organizations they control. It’s not even a secret or a conspiracy, since all of the information is in the public domain. Rather the strategy is to maintain social stability, since for most people as long as their standard of living is stable or slightly improving, they won’t bother to take actions to defect from this system (such as buying assets that are not primarily in USD)
Sounds like you could apply the money to more efficient HVAC with smaller circuits and avoid the $40k path.

Also, you can scale the EV charger to lower amps. I had trouble with tesla's gen 3 charger. I had a 60A circuit, which should allow charging up to 48 amps. But it would overheat sometimes and STOP charging. (bummer to come out to drive a car that hadn't been charged)

so I reduces charging rate from 48 to 40, then finally 30amps and it has been stable. And although I've parked with as low as 6% charge, I've never come out to a car that hadn't finished charging by morning.
It only seems that way because it's dirt cheap and pharma can't profit off of it very much.
I like J. Blow's take on ideas vs implementation: https://www.youtube.com/watch?v=R3UrdwnAu3o
My experiences might not be typical. As always YMMV.

I've worked for several superannuation and insurance companies. During the early days I couldn't believe how poorly informed most of the management were. Since I couldn't believe that they could be that stupid, I kept things to myself did a lot of research and in that process learnt a lot about the underlying accounting, investing, trading principles. The technical aspects of the work were the least of my problems. But the unrealistic timelines made virtually everything feel like a death march. Burn out is the ever present danger.
Thanks, very helpful. Are llama and chatGPT essentially the same “program”, just with different weights? And is one better than the other (for the same number of parameters) just because it has better weights?
The board layout triggers my OCD :)

Why the weird angle of those main ICs?

Usually it's 45 degrees or parallel to the board.
Structural Alignment: Modifying Transformers (Like GPT) to Follow a JSON Schema
WiFi protocol flaw allows attackers to hijack network traffic
Both iPhone, but did make me wonder at the time
VR ping pong is awesome. You never have to chase for the missed ball!
Right, I'm European.
Ibuprofen being an NSAID is high risk for anyone who’s had stomach ulcers due to its risks involved in causing GI bleeding.

For people like me it’s simply not even an option.
In some cases it lasted even longer than that. In 2004 at a Canadian University I was told during the student orientation that CS was not a great choice due to outsourcing.
They are immersive, not using glasses, but projected environments and some kind of movement device being ridden. Why not just call it more expensive VR without headgear at that point?
Meanwhile, in the country of Georgia:

New "regional hub" announced this week.
https://gbc.ge/en/news/busines-snews/binance-announces-openi...

Meeting the totally not sketchy Prime Minister in November:
https://1tv.ge/lang/en/news/1685013/
Which features would a privacy-conscious person be missing in the webapp?
Yes, you can run any inference with any model on CPU, but here some examples:

To create a single frame with Stable Diffusion 4-5B parameters, 512x512, 20 iterations takes 5-30 minutes depending on your CPU. On any modern GPU it's only 0.1-20 seconds!

Similarly with LLMs, to produce one token with a transformer of 30-50 layers 7-12B parameters you will wait several CPU minutes while it takes few seconds on a Pascal-generation GPU and tiny fraction of second on Ampere.
And bailed out Circle for 3 billion in the process?
Thank you for taking the time; I learned some stuff today. Cheers!
> how dare the other guy suggest alternatives

that do not work
With respect, no it's not obvious to me. And probably not to many other people, either.

If you're going to claim obviousness here, then I think you need to be more specific about what exactly you see here that is "obviously" wrong.
"Anyone" already knows the EV transition isn't that easy. It is basically only lobbyists, politicians and journalists who seem to life in a world divorced from reality. Esp. journalists, who are fighting on the forefront of peope-manipulation. Journalism seems to be dominated by wishful thinking and political dogfights. Gone are the days when a journalist actually reported about what is going on, not what they would like to see.....
Ironically, Dacia are the best cars Renault sells :)
At least with Apple, they've been working on a "good" AR experience for over a decade - whereas any department calling itself "metaverse" is a low-interest-rate phenomenon
Those ones are correct.
Didn't read very carefully, but it seems that this is not about running ChatGPT on your own system. Especially searching for the term "install" didn't find anything.

This is not "private".
Hanlon's razor falls apart when there is money to be made by doing shitty things.
One Handed Typing (One Handed Dvorak, Left Hand Ngaih)
I've been reflecting on workstation ergonomics (specifically music production). Touch screens, tablets, mice with lots of buttons: all great - what's still not great...switching between keyboard and mouse....so it occured to me to look up left handed typing...and low and behold - wiki article with a few layouts.

Does anyone here employ a 1 handed typing workflow specifically for staying on mouse. The idea seems compelling - would require a serious commitment.

Please share your experiences, layouts, github links to keyboards!
That doesn't sound like no Homer J Simpson I know of.
How about funding vocational training, building more housing, rejoining the EU and courting the tech industry by any means necessary?
You can look at this two ways:

1. Feed your family. What will it take? An Amish-like techno-secluded community? Or stay ahead of the pack and look at where the jobs are moving to? (hint: it will still be computers)

2. Who needs to input into the GPT machine? At what point does typing the definition of the requirements out-weigh typing actual code? Will GPT ever be trustworthy enough to not have QA on its outputs?

Or maybe you are referring to the far future, to the point that AI + quantum computing + energy storage + automation becomes so self-contained, that humans are reduced to a life of constant entertainment generation for one another?
Wait, isn't that the Jack the Ripper episode? I found the idea that aliens are toting Jack the Ripper around laughable, honestly. I don't remember how the rest of the episode was, but I always found that idea one of the stupidest to come out of B5.
I set old computers up as gaming devices for my kids. They can't play the latest blockbuster, but there's lots of good older or low spec games. The oldest computer still regularly running in my house is 13 years old, it still runs well (2010 MacBook with Linux Mint).
~140 million or less than 5%.
I use nothing for reducing inflammation, nor any drugs since decades, when I'm ill from time to time (once or twice a year), I let the fever go, the body is just working actively, it's not especially uncomfortable
I agree.

How can these kinds of companies optimize their charge codes to get the max for the procedures, optimize their taxes to pay the minimum possible, and then do a poor job on these existential crisis kinds of things? I think they know what they're doing in all cases.
Is there a link available to the Goldman Sacs report?
To save on transaction fees perhaps, or to because they don't want to run the risk of looking after their own keys.
> Peugeot hasn’t made a decent car since 1962.

Pretty opiniated statement.

I once owned a 306 Peugeot (90s) as a student vehicle and it went way over 350'000 km without any noticeable problem. The TU series engines of Peugeot were beast of a kind and pretty hard to kill as long as you minimum service them.

Recent Peugeots are like any recent, EU-made cars: full of electronics, fragile piece of tech and with turbo-compressed engine that favor fuel consumption over reliability. VW and German counterpart (which I also drove) tend to be the same crap.

Nowadays, almost only the Japanese constructors stand off for their reliability.
Aspirin and other NSAID were supposed to go the way of the dinosaurs. COX2 inhibitors we’re supposed to be the golden child. Too bad it caused kidney and liver damage
Why do you think the fact that only select view control this technology today that it will always be like that?
neon.tech compute units looks costly as compared to mongodb atlas and cloud postgres
Italy Bans Synthetic Food
"it can cause detrimental side effects such as internal bleeding and organ damage"

NSAIDs are also ototoxic, meaning that they cause hearing damage.
Mind blowing simulation.
i do think having a relationship with an ai is pretty weird, but i can kind of understand it - a meme that has been around a bit: https://en.wikipedia.org/wiki/Idoru . and it doesn't mean i hate people who want to do this.
Why invest 200 million USD to make 1 billion when you can invest the same to make 10 billion? The problem is that expanding isn’t free, you take the most probable business first. The low end is growing rapidly, but the players already there will ensure that Tesla doesn’t make $1k of profit per vehicle. They can’t compete with a Wuling Mini EV for $4k, or whatever BYD has up to the model 3 price point.
Wasn't it every week for half the year, then? Barring stuff like holidays, seasons mostly kept to a once/week schedule.
> . . . though the sibling comment's GPT-4 response is clearly superior.

Nah. This sounds like Homer J Simpson. The GPT-4 one doesn't.
That's because the premise the EU Commission (and you, by extension) you are defending is so utterly ridiculous that it doesn't really need argumenting that it's bad.

The point the EU Commission is defending here is the need to spy on every word, every bit of interaction you have on the internet. You know, "to protect the children".

I mean, if you truly think like this, how about you give me a live dump of you traffic, desktop, cell phone, ... everything, along with all encryption keys, passwords, etc. You know "so I can check you're not a pedophile". Because that's what this is about.