skysight-inc/HackerNews huggingface dataset:
To extend this, there have been programs that have attempted to fix the problems of alcohol addiction but not require patients to remain sober. The core concept being that there is an underlying cause to the alcohol problem and the alcoholism is an expression of that problem, not itself a root. Thus once the root cause is fixed, the alcohol is no longer a trigger.

Another form allows participants to drink but uses a medicine which induces unpleasant effects from alcohol. Thus participants self train an avoidance pattern and break the positive feedback loop.

These should not be seen as contrary to the AA abstinance approach. For some people that appears to be the most effective means. For many other people, AA is not.

I suspect as we advance our understanding we'll come to find distinct subdiagnoses in alcoholism and alcohol abuse that suggest different treatment strategies. Right now our understanding feels very rudimentary.
> Ye olde ammeters were secretly voltmeters with a low-value but high-precision shunt resistor in series with the circuit to be measured.

"ye olde"? That's how every typical one works, till you go to clamp meter

> its resistance is apparently a known value that can be gathered from a datasheet.

that's... optimistic
Exactly. I think we haven’t optimized for hardware cost much with LLM training. Crypto is kind of like that but taken to an extreme. There are some reasons why it’s not comparable (crypto mining is embarrassingly parallel, doesn’t need a lot of memory, tends to burn at least as much cost in electricity as on hardware, whereas LLM training is memory-bound, etc), but it shows kind of roughly what scrappy, hardcore computer hardware cost-optimization looks like at scale.
The balloon is in X's court.
I’ve read that a lot of people, especially men, are deficient in magnesium. It’s an essential mineral so I wouldn’t call your use of it pseudoscience by any stretch.
That seems unrelated to the sub-thread in question.
> devs who mostly don't have a choice over the tools they use

I'm not going to assume that DynamoDB was forced upon them. I don't know. What I'm more sure about:

Developers have a choice in if they want to invest the time in understanding the tools they use, and learning about the tool's capabilities. In this specific case, we're not talking about a lot of time. 2-3 hours to read the documentation for a new database you're going to be building your business on top of.

What is your argument exactly?
10% fewer tokens on average.

The vocab size itself is doubled. (~50k for GPT-2/3, ~100k for ChatGPT)
A very simplified version of the component level. Component level is very good but not real time unless you sacrifice a fair amount. Ultimately it is a bit of a wash between other methods, just shifts were it fails and where it succeeds to somewhere else.
There is no difference unless you believe in some kind of supernatural influence in biological organisms.

The "brains are not computers" point has been moot for decades since it would require brains to be able to perform actions that cannot be mathematically described i.e. break the laws of nature. Which is to say "If a brain can do it, a Turing machine can simulate it" which pretty much everyone in the field agrees with.

You can stand on a dualistic platform and hold that the brain has supernatural abilities, but in mainstream discussions of the idea has been dead for a long time.

You can argue that computers aren't close to simulating a brain, sure, but that doesn't really get you anywhere, since the difference just becomes a matter of practical scale rather than something that escapes theory. Or even just a factor of efficiency, a synthetic consciousness might be able to run on current hardware if the right program is found. The brain might be grossly inefficient for consciousness, we don't know.
It still doesn't seem clear what the comparison is for.

Unless someone in Japan didn't believe that OpenAI/Micrsoft had access to 100x the FP16 compute that Fugaku can perform?
I'm pretty sure that some Venezuelans and Chinese people have used it successfully to smuggle wealth outside their countries.
That's the self-selecting part I'm alluding to - let's say Apple et. al. went bankrupt. With Microsoft and Gates then being the well known early computer. Would we today instead credit Gates as the man who really drove computers into households.
It's of course impossible to say, but it is something I wonder about - like who are we not crediting by focusing too tightly on Steve & Woz: especially when I think to the GUI.
Doesn't really matter. There's lots of positive transfer in individual language learning. Competence in one language bleeds into competence in others.
https://arxiv.org/abs/2108.13349

GPT-3 is fluent in many languages despite English taking up 93% of the corpus by word count. French is next with 1.8%

https://github.com/openai/gpt-3/blob/master/dataset_statisti...

Dunno the statistics of language presence with GPT-4 but it takes it up another level in terms of its multilingual capabilities.
There's dataset during training, and dataset for the tokenizer. The confusion here is that people are talking about the former, but you're correct that it's the latter.

Remember, OpenAI's tokenizer was created in an era when 125MB was considered large for a language model. It's hard to fault them for making something that lasted four or five years.
Thank you for pointing that mistake out, I just didn't notice it (the phone is set to small font).

The message was sent from the same Android phone I'm using now. Moreover, I'm still not sure how it happened because the KB app I'm using is OpenBoard and its long-press is '‰'.

I'm curious too because OpenBoard only has the one long-press option (as above) unlike GBoard which has two—the first being '‰' and the second the "care of" sign. Trouble is that GBoard is normally disabled [not just deselected] on this phone and I had to re-enable it to check.

I've noticed occasionally that I've had 'strange' characters appear that do not seem to be long-presses when I've been typing in a hurry so there must be some option for selecting them that I'm unaware of.

It's late here now so I'll investigate later and get back to you when or if I find the answer.
My current driver is a pre-2010 vehicle. I really don't want to buy any of these newer cars. Maybe I can import one from Cuba.
Ok, yes that's true, if you burn wet, green or rotten wood it's going to make a lot of smoke. Wood really begins to rot after the first year if it isn't cut, split and properly dried. If you have deadfall around you that you want to use then you need to process it into firewood as quickly as possible and store it somewhere it won't stay wet.
Windows Vista started a crackdown on hardware boot times that Windows 7/8/10 completed. It was one of the reasons Vista was sometimes considered unreliable because it would actively quarantine bad-acting XP era bootup hardware based on timing telemetry. Windows would tell it to boot up minutes or hours after actual system startup, sometimes leaving users with hardware "not working right" because Windows decided it didn't trust that hardware to wakeup right and decided to just not wake it up at all until it was good and ready. If the hardware kept acting up it would sometimes disable the hardware entirely and suggest to the user it was broken hardware.

That's a running thread in the article above and its related posts: "the PC boot is slow, let's do weird BIOS and dual boot hacks" only made sense for one weird, brief moment in around 2009 between a dying breed of XP-era hardware and just before/as Windows itself decided to be judge, jury, and executioner of hardware boot up times.
Most of the features you list are geek features. My favorite geek feature was that the hardware was proprietary but open - anyone could see how it worked and even buy schematics. Aside from geek features, Jobs and Woz only became better known later, after Apple was a success.

Apple IIs were in most schools. That was what stood out to most people - out of all the various and weird computers on the market at the time, and before IBM clones they were different, Apple was the one "endorsed" by the school system.

Macs and iPhones and whatnot aren't even part of the story. The pre-OSX Mac was part of the Star Wars prequel of Apple tech that tried to seem fancy and cool but was awful and no one liked it, so I suppose the iPhone was episodes 7-9.
> What makes it work is that, under the SEPA Direct Debit framework, the risk of fraud and insufficient funds is 100% on the party initiating the direct debit.

Additionally, you need to have a direct debit agreement with your bank to be able to initiate a direct debit. You need to show at least some legitimate banking history (and a government-issued ID) to get one, and they come with limits on how many and how much you can debit per period, and your bank will terminate the agreement if your reversal rate is higher than normal.
why are you being ageist? I have a new math teacher, therefore my previous teacher is my old math teacher.
I was creating software (mostly games) for a wide range of handheld devices at the time.

When you're doing that you can quite easily get an idea of the weaknesses and strengths of the platform, and I can tell you that PalmOS was quite weak but almost OK at the very beginning but it quickly deteriorated and at the end they could simply not push it forward at all.

Sony did a good job considering, but they simply bet on the wrong horse.

To be honest, Android also started in a very weak state, not the same kind of mess that PalmOS was, but it was riddled with over-engineering and absurd design choices, but with a huge effort they managed to fix the worst parts and still push it forward.

I was surprised they could pull it off.
Great way to get banned from Twitter.
> GPT-4 has 32k tokens IIRC. Including most significant alphabets would take less than a thousand.

GPT-4 has much more 32k token vocabulary (GPT-3 seems to have had up to 175k, GPT-2 in the neighborhood of 50k, based on the max value reported for their tokenizers). It has a 32k token context window (that is, the maximum size of prompt + response), not vocab.

But, tokens are generally semantically-significant parts of words (often whole words), not just letters or the equivalent. So, while you might get most alphabets in less than a thousand, you need a lot more than alphabet to handle a language.
"there's so much more English language for them to train on relative to most other languages" is an interesting assertion. There are billions of people on earth speaking languages other than English and they have access to the internet. Are you sure it's not just the case that we didn't scrape that data?

Everyone has to choose what data to train on, you can't train against The Entire Internet, it's a limitless amount of data. But it becomes an intentional choice with consequences, like the 15.77x seen here.
AI and Facial Recognition May Be Able to Spot Stroke and Other Diseases
Hey, yes I do like the braces ;}

The decision to differentiate procedures from labels was intentional, and taken due to some restrictions of our IR (which is not the best, issue is open to change that).

Also, the way to define procedure is this way (separate form labels), as I felt that might be a bit more familiar to newcomers to assembly, who are coming from other languages.

Call stack exists inside assembler due to the same reason, as in case someone accidentally bashes their stack , it would still not corrupt the whole code. Maybe we should do a better job at reporting this so users can know they have corrupted the stack, instead of silently ignoring.

The SP should be changing, it is probably a bug. Thanks for reporting, I'll try to take a look at it.
Same idea really, just that you have to bother disconnecting something and try one by one vs just measuring it fuse by fuse.

Other method is getting DC clamp meter with low range (say 2A). Then just clamp in on wires. Bit fiddly as they work on magnetic field so they need to be reset before measure (And can work as compass in a pinch...)
https://archive.ph/qcTIW
Well this is entertaining. Our 2012 Mazda CX-7 seems to die if we don't drive it for a week. I've sort of ignored this problem but now I'm going to go check some fuses and see if this is the same problem.
You can adjust the number of cards that get pulled into a given review session. You can also do multiple review sessions. I'm confused as to the problem here.

I will admit, reasoning through options is very much harder when you're under a lot of stress.
OpenAssistant – Alignment Livestream
> By default, those requests are denied.

This depends on your bank, mine allows them by default.
Amplify as other similar software stack choices are very good for a MVP or POC. If your project is thriving start early and migrate your strategy to something that scale better and its easy to change.
Thanks, I hope you find Gigerenzer useful. The paper is a bit academic, but he also wrote a couple of nice popular science books on the (mis-)perception of numbers and statistics, those might be useful in a business environment.

For real-world applications outside engineering and academia, I would rely heavily on confidence intervals and/or confidence bands. For example, the packages from easystats [1] in R have quite a few very useful visualization functions, which make it very easy to interpret results of statistical tests. You can even get a textual precise description, but then again, that's intended for papers and not a wider audience.

Apart from that, I would mainly echo recommendations from people like Andrew Gelman, John Tukey, Edward Tufte etc.: Visuals are extremely useful and contain a lot of data. Use e.g. scatterplots with jittered points to show raw data and the goodness of fit. People will intuitively make more of it than of a single p-value.

[1] https://easystats.github.io/easystats/
Thoughts on this post on the accuracy of IQ?

https://news.ycombinator.com/item?id=29798887
I actually replace Defender with a 3rd party choice (Eset) for this very same reason - to wrestle some control over my OS from Microsoft. I find Defender to be overbearing in so many ways.
The guys we know about
Exactly, you are measuring a change, so its the precision of the meter not the absolute V. Maybe easier to measure on a nearly dead battery?
you are right, thanks for pointing it out.
Hey, I'm sorry but can you be more clear in what are the typos? I'd be glad to fix them, but just seem to miss them in this comment :sweat_smile:
The behavior on Chinese is what makes me believe it's tokenizing on something like UTF-8 (hopefully normalized). I'm not sure how else you would get that behavior.

Tokens for non-english languages that are groups of characters just suggests that common groups of 2-3 characters from the training set became tokens, which feels unsurprising. The fallback behavior would be 1 utf8 byte = 1 token.
+1 for SMA. The man clearly takes you through the troubleshooting process and his train of though.
Looks nice for ETL like data processing. But to be honest, with how good the tooling of big data frameworks has become nowadays + ChatGPT I dont really see that much of an advantage using this. It looks like this project is trying to solve problems we had 10 years ago, which is in fact the time this language has been in development.
I think you could probably say the same thing about a lot of activities: how is jumping out of a plane fun? How is sitting in a field waiting to take a picture of a bird fun? How is blindly manipulating symbols in a computer fun? You can play that game for anything. But for every activity someone enjoys, you can bet that it's not the reductio ad absurdum restatement of that activity they find fun, it's something else about it.

It's odd to be in the position of defending trophy hunters, so that's not what I'll do. There are many defensible types of hunting, but hunting rare or endangered animals for nothing else but a trophy is ethically indefensible. However, for people who do that, I imagine it's not the ending of the life that's fun, it's the challenge, and especially the bragging rights it gives them afterwards. Just a guess though.
I've noticed that women are much less aggressive when it comes to salary negotiations. Even the bottom-bucket male engineers are more aggressive and persuasive than the more talented women.

The reason? I'm not sure. Maybe it has something to do with testosterone and confidence. Maybe they (male engineers) spend more time on researching salaries, talk among themselves, or whatever.
Coal makes only 12% of the electricity, in the US at least. Natural gas makes 36% and oil makes 33%.

https://www.eia.gov/energyexplained/us-energy-facts/
Atlanta does have trains, and in fact has the 8th most annual riders of any US city, right behind the Bay Area.

https://en.wikipedia.org/wiki/MARTA_rail
Everyone I know ripped those LLaMA leak models and are using them extensively in "open source code" / commercial products - super unwise, but not sure licensing is actually slowing down progress in this field and even though I'm sure OpenAI is using alternative methods to make the language stuff work so well, I just wanted to comment on that front.

I wouldn't release a chatbot based on LLaMA 65B, because of the legal issues, I'm not sure others are using the same restraint.
Not the original video, but a follow-up one by the same guy talking about results and future plans: https://youtu.be/aoczYXJeMY4
This: https://www.newyorker.com/news/letter-from-silicon-valley/th... https://archive.ph/V9z3G is as close as you're likely to get.
This must be the new astroturfing attack against concepts like public transportation. I've seen this phrase pop up too frequently at this point for it to be organic.
I'm lucky to not be alcoholic but isn't the headline wordplay a little gauche?
Make great work collaborations the center of what makes work fulfilling, not your status in any particular company.

Focus on your relationships with your peers at work. Pay it forward with them. Give them generous credit. Support them, learn from them, and teach them. Build cool sh*t with them. Don’t score points in the dumb internal games.

You don’t have much control over anything else. If you get laid off, it will suck, but you’ll have a support network to help you out. If you’re not a sociopath, you’ll land on your feet.
The credit crunch the Fed fears may already be taking shape
https://archive.is/eQhsc
CMS Cracks Down on Medicare Advantage Marketing, Prior Auth Practices
A piece of advice that is repeated here and elsewhere is to create atomic cards. I’ve long wondered whether that is good advice or not, or whether it depends on the subject domain.

The better I know a subject, the less atomic it feels. I don’t think and talk about the topic in discrete facts but in interconnected knowledge. This is why the complete independence between cards seems more like a weakness than a strength. The argument from the spaced repetition community is that purposeful linkages between cards builds in a contextual dependency. And that dependency makes the resulting memory contingent. But in some knowledge domains that seems more of a feature than a bug.
> The classic case would be if mathematicians wanted to assign a value to division by zero. It turns out that if you do allow that to take a value, then it becomes possible to "prove" that any number is equal to any other number. Quite simply, it makes maths less interesting to allow that, but instead having division by zero be undefined appears far more useful/interesting.

There are multiple extensions to the real numbers that allow division by zero. One is a real projective line, which has only one infinity so that 1 / 0 = -1 / 0 = infinity

https://en.wikipedia.org/wiki/Real_projective_line

Another is the extended real number line which has positive infinity and negative infinity, so 1 / 0 = +infinity and -1 / 0 = -infinity and they are different from each other

https://en.wikipedia.org/wiki/Extended_real_number_line

Those are all perfectly fine but they still can't define 0 / 0, which is a harder problem.
Thought this was going to be a business-related article, pleasantly surprised.
Reminds me of a memorable Ethernet peripheral. The peripheral would use the MCU's RAM for its own buffering. There were frame headers that both the peripheral and CPU would need to manipulate. Being an M7 the CPU had a data cache, though, and so the CPU couldn't safely manipulate the headers without first completely disabling the cache.

I ended up using a DMA channel to indirectly manipulate the headers, bypassing the data cache. It was pretty silly but worked, and was way more efficient than disabling the data cache.
CPAP works great for many people who have severe sleep apnea. It’s much more difficult to help people who have mild OSA / UARS. They don’t benefit from CPAP to the same degree.
- Substack

- Twilio

- Digital Ocean

- Spotify

- SoundCloud
I'm sorry, but "don't do the same thing twice and expect different results" is not science at all, and might even be described as anti-science.
Survey of Consumer Expectations
> Social liberals use immigration to advance minority positions they couldn’t achieve otherwise.

Isn't that like a losing team saying, "we'd have won the championship if only our star player hadn't gotten hurt"? Or, "I've got mine, so pull up the ladder." Immigration is a fact, and beneficial in so many ways — including, IMHO, a more-liberal electorate. If MAGA types want to shut the gate to try to preserve their political power, they need to offer better reasons than they have so far.
Anyone ever think about what a nightmare driverless cars will be if they actually work? Right now our crumbling infrastructure is loaded with traffic. Imagine if the max amount of driving a human can endure is removed entirely as a final constraint on the total utilization rate of this infrastructure and is replaced with a relentless driving machine that never tires or gets frustrated and has no fear of death.

People would commute up to 4 hours one way, napping in their cars, maybe even longer. Delivery vehicles running all hours of the night, perhaps with no one ever in them at all. People sending the cars to go pick things up or people that they otherwise wouldn't have time in their day to do.

Even if you don't want to live in your car that the pressure will still be exerted on you because you'll be competing with people that do. Cars instructed to circle the block in areas with no parking clogging the streets. You'll need a self driving car yourself to even get a spot since you'll never defeat all the robot vultures.

People will forget how to drive entirely of course so there will be no going back. The whole thing will feed on itself, people will need more self driving cars to get back the time stolen by other self driving cars.
If it takes 4 days to show, I would never be able to associate with my eating habits :(
The end is nigh for gas-powered cars
Same problem and same fix for my 2009 Acura MDX.
A better way than what? The snippet you posted has nothing to do with how a beginner (or intermediate) learns Lean.
Non-commercial licenses are not Open Source: https://opensource.org/osd/
What's the project about? What are you trying to achieve? Do you really need a reactive web framework?

If I were starting a project today, where my main customers are Windows desktop users, I would use one of their native SDKs/Frameworks. If I was trying to target iPhone users then I would use Swift... If I was interested in building crufty, unmaintainable, 3-year-rewrite, slug-machine software then I would pick Tauri or Electron... I was into developing a quick MVP then I would use Django or Rails... If I hated myself enough then I would use any of these wheel-reinvention JS microframeworks...
Love the books by mwl. Have physical copies of several of them, and the whole bunch of the ebook versions. Currently reading one of the physical copies. The one about Ed I have in ebook format only and didn’t read it yet. Will get to that one after I finish reading the physical books that I have from him.