skysight-inc/HackerNews huggingface dataset:
Hi! I lead Product at Together. We will be releasing a full suite of models trained on this data starting with the first models in the coming weeks. We will release RedPajama base models and RedPajama instruction-tuned models. All of the models will be released under the Apache 2.0 license, allowing commercial use.

Therefore, anyone will be able to fine-tune the RedPajama models using Vicuna or other datasets, given they will be fully open-source.

The RedPajama instruction-tuned models will be fine-tuned only with instruction labels from human labelers and OpenChatKit feedback (). We feel this will keep these models fully "clean" for use in commercial applications without using the output of other commercial models like were used in Alpaca or Vicuna. However, we'll be excited to see all the great fine-tunes created by the open community and are eager to see how close open-source models can get to the quality of leading commercial models over time!!

() OpenChatKit: https://huggingface.co/spaces/togethercomputer/OpenChatKit
I think AI will change how programmers do their jobs, not eliminate them. Messing around with ChatGPT, I was able to write a MUD server much faster than I could from scratch. But I still had to understand the code, tweak some thing.

I think of it as a tool to write a 100k line project in the time it takes to write a 10k line one. I think the potential will be fewer bugs and more productive programmers. That could mean less programmers. Equally likely is software can be much more complex, yet still manageable.

Even if AI replaces software engineers in 50 years, so what? People can move on to other fields of engineering.
Or just use Fidelity, which has 0 fee as well. Free wire transfers, free ATM reimbursements etc. On another side, it actually has branches scattered throughout too.
The article addresses this: it’s because it’s almost never well done.

They claim it’s super secure, and then apparently implement whatever with no oversight.
Nothing. Just like the technology that enforces something like "apps cannot record from the camera and train it on AI off-device" or the technology enforcing well-written and clear EULAs.

When an app on my phone asks for contacts access to work, I don't use it. The system works as-intended.

Edit:

> So Apple users can use FB on their phones

According to your logic, this is a net-negative. Is Apple trying to help or hurt their users here?
> On the one hand, you prevent Trump winning and maybe write some debt down.

You don't just write down some debt. You default on all sovereign debt and introduce a brand new monetary system, entirely digital so that everything can be tracked.
> Perhaps we are designing far more complicated solutions now to leverage these cloud services, whereas having the constraints of a self operated data center and infrastructure necessitates more ingenuity to achieve similar results.

Nothing about "ingenuity", just plainly having some friction in implementation makes for simpler designs.

If you have zero cost (aside from per request pricing but that's not your problem right now, that's management) to add a message queue to talk between components, now that's a great reason to try that message queue or event sourcing architecture you've read about.

And it works so "elegantly", just throw more stuff on queue instead of having more localized communications.
We don't worry about scaling, cloud worries about it(now bill for that queue starts to ramp up but that's just fraction of dev salary, we saved like a 2 weeks of coding thanks for that! Except that fraction adds up every month...).

Repeat for next 10 cloud APIs and you're paying at every move, even for stuff like "having a machine behind NAT". And if something doesn't work can't debug any of it.

Meanwhile if adding a bunch of queue servers would take few days for ops to sort monitoring and backups on it, eh, we don't really need it, some pubsub on redis or postgresql we already have can handle stuff that needs it, and rest can just stay in DB. This and that can just talk directly as they don't really need to share anything else on queue, we just used queue to not fuck with security rules every time service needed to talk to additional service.
Agree on the 64 bit guess. And note that digits are exponential so going to 38 digits (128 bits) can account for 10 million times as many people as 30.
Why 19 is important: log(2^63) ~= 19, which means a random 64-bit integer is not long enough to uniquely identify all human beings. A 128-bit integer or UUID is
In what way is the cybertruck moving forward? You still can't buy one and if you put money down on one, you're still not getting your cybertruck.

Reminds me of my Starlink experience: pay $100 to get on the waiting list, wait a while, pay an additional $500 to get the downlink terminal, wait, wait some more, try to figure out who I know who still works at SpaceX because there's no support contact info for people who have paid for a terminal but haven't gotten anything, send emails to about 10 people inside SpaceX until someone responds with an offer to refund $450, then take the offer, then wait for the refund, and wait for the refund and finally get the refund 3 months later. So I'm only out $150 from trying to subscribe to Starlink.
Top Boardgames
This is the most dystopian thing I've read in a while. Prison Planet Earth, where everyone is uniquely identified by a number, perhaps surgically implanted on an RFID tag? How much compute resource would be needed to create an AI minder for each and every human on top of that, constantly updating their social credit score on a daily basis?
To this day I occasionally attempt to run `emerge ssh` to update it and get back portage's version of "I can't do that, Dave". Then, "oh, right..." `emerge openssh`.
No, I got answers from multiple forums about as if not more often than from SO.
If you watch the full debate, the Muslim panelists were continuously mocking Hindu Gods, Nupur got fed up and replied to them in the similar manner.

What this fact checker cunningly did was to edit out the Muslim panellist mocking and simply showed her part of the clip. He has a mass following in Islamic nations and it got blown out of proportion.
There is a solution. A completely open source community driven model that can be run on your desktop (windows, linux, mac) with a click of one button: https://gpt4all.io/index.html
> You have to figure out how to meet your needs on your own

Do you see how easy it would be for an organized group to use a philosophy like that to exterminate another group? Imagine we only offered service to a certain group of people in a certain area. "Yes, you have freedom to trade and do business and have your needs met, but only in this five-block radius."

Now let's, for the sake of argument, call that radius a "ghetto."

Actually, we don't even have to invoke that grim specter. This is America we're taking about.

... We can call it a "reservation."

Actual free societies are made of better than this. This story is no story of liberty.
> There could be exponential or quadratic scaling laws with any of these black boxes that makes one approach suddenly extremely viable or even dominant.

The reason I like the CPU approach is the memory scaling is bonkers compared to GPU. You can buy a server that has 12TB of DRAM (in stock right now) for the cost of 1 of those H100 GPU systems. This is enough memory to hold over 3 trillion parameters with full 32-bit FP resolution. Employ some downsampling and you could get even more ridiculous.

If 12TB isn't enough, you can always reach for things like RDMA and high speed interconnects. You could probably get 100 trillion parameters into 1 rack. At some point you'll need to add hierarchy to the SNN so that multiple racks & datacenters can work together.

Imagine the power savings... It's not exactly a walk in the park, but those DIMMs are very eco friendly compared to GPUs. You don't need a whole lot of CPU cores in my proposal either. 8-16 very fast cores per box would probably be more than enough, looking at how fintech does things. 1 thread is actually running the entire show in my current prototype. The other threads are for spike timers & managing other external signals.
>I wish more companies would provide it - akin to the old TVs and other equipment that came with [full!] schematics inside. It would let me truly understand and modify the items that I purchased.

I had forgotten about that thing with the wiring diagrams; I loved that.

That was the only thing that enabled me to repair a 1940s pinball machine that was essentially a relay-driven mechanical computer. Without those prints the machine would have surely been a loss due to the insane complexity and lack of interested/trained people that know how to work on such devices.

One wonders now how many lost pieces of equipment that could help to save from the recycling bin nowadays.
Crimie movies make us think criminals are bright subversives, when the vast majority of them are dumb thugs.

There are much more lucrative paths for intelligent psychopaths in the professional world.
GPT2, GPT3, and ChatGPT had a bullshit problem. Turns out the bullshit problem is still in GPT4, but it just says the bullshit more elegantly.

I think it's safe to predict that ChatGPT5 will even more eloquently speak bullshit.

--------

This is useful for entertainment, creative writing, fiction, etc. Etc. But it's a critical flaw in other applications.
All those poop and doge emojis make a ruckus.
US arrests two for setting up Chinese 'secret police station' in New York
Printable§earch
It's a short post by a well know computer scientist about the birthday paradox. It has nothing to do with that stuff.
> Though I do wonder if "sounding out" words might be a less effective strategy in English than it would be in some other languages...

Sure, a language like Turkish (29 characters, 29 sounds) will be more phonetic, but English's eccentricities are overstated, with most boiling down to "unstressed vowels get shortened, shwa-ed, or skipped". Once you clear the first 50 or so words by frequency, it gets pretty sound-it-out for a good long time before you start hitting weird loan words.
In response to Facebook or WhatsApp requiring side-loading, one might remark:

> "Just don't use services provided by Meta"

There are insurmountable network effects.

For example, I must keep WhatsApp on my phone if I want to know when child's swim practice is moved/canceled/etc. There is only one swim team in the area. Getting other parents to use Signal ain't happening unless the head coach requires it. The head coach isn't moving to Signal unless parents already use it. Moreover, I'm a coach, so I have more say/power over this than typical.

Of course, I could always force my kid to find another after school activity... or, I can buy an iPhone. At least with an iPhone I can deny Meta access to my Contacts, which it incessantly requests.

This is just one concrete example. There are plenty of organizations land-locked to Facebook for the same reasons; dropping Facebook is tantamount to collapsing the community they built.

For me, checking the monopoly power of Meta by using an iPhone
is the least worst option. At least Apple has interests that are partially aligned with mine... as they want me to buy my next mobile device from them.
That's the price of an average at best 1 bedroom condo where I live. Shit is cray

To get into that, which would in most previous years be the next logical life step, I'd be going from splitting a $1500 studio basement suite with my gf, to splitting a >$4k/month mortgage after saving 120k for a down payment.

Those are CAD mind you

Might be van life after this one
That requires an overhaul of the American education system to focus more on STEM and technical skills.
What you're seeing is, however, a continuous regression to lower standards in Math and Science education.
Hi, thanks for the app! I've been using it for a few days now (a couple dips and dives) and enjoy it.

I do often find it immersive and sometimes notice myself generating mental imagery to match the sounds.

My one complaint is that after every session, it asks for notification permissions. For me, no, i don't want to give your stress reduction app the ability to pester me :) I have no problem that the app asks for this, but I don't think it should do so after every session.
Source? I'd like to read more about that.
It's strange that you need to separate functions and other variables. I mostly use Racket, but I'm using Python from time to time. I'm using some code like

def something(N, x):
f, g, h = method_1(N)
#f, g, h = method_2(N)
#f, g, h = method_3(N)
return f(x) + g(x) + h(x)

that use variables as functions.
Note that you also need about 5TB of disk for the full decompressed dataset. However, only common crawl are compressed in jsonl.zst, everything else is uncompressed jsonl.
I hope this forum was better than the typical

"Welcome to the Microsoft Support Community! Thank you for your excellent question. As a Microsoft MVP (Mostly Vacuous Pinhead) I am more than happy to help with your problem. I am sure this will help:

<useless copy-pasted non-solution>

Should you need additional assistance, you may also wish to

1. Set fire to your PC
2. Give up on life

Have a great day!"
OpenAI may have those internally though.
While this is all true (and I think the parent is mostly a joke...), my understanding is that the Roman aristocracy that Tiberius was born into considered themselves Farmers in the same way that the modern American politician identifies with the Small Business Owner (or indeed, if you go far enough back, the Yeoman Farmer).

It was more a moral/identity narrative than a thing they actually did. They certainly owned the villas but whether they engaged in any way with the actual work (even in the capacity of "boss") of such places... maybe their servants, or their wives...
Yeah, seems like it'll handle the accumulation of loading/unloading mishaps pretty well with the stainless body.
GPT4All Chat – Locally-running AI chat application powered by the GPT4All-J
GPT4All Chat is a locally-running AI chat application powered by the GPT4All-J Apache 2 Licensed chatbot. The model runs on your computers CPU, works without an internet connection and sends no chat data to external servers (unless you opt-in to have your chat data be used to improve future GPT4All models). It allows you to communicate with a large language model (LLM) to get helpful answers, insights, and suggestions. GPT4All Chat is available for Windows, Linux, and macOS. NOTE: Windows and Linux require at least an AVX2 chipset. Both intel and arm macOS machines should work. A future update should allow non-AVX2 chipsets for older machines. Check back frequently and will announce here when it is ready.
Inside A Ping Pong Ball
He Had a Heart Transplant. Now He’s Back Playing College Lacrosse
You're confused about who's who.
So... they're crisis actors? Maybe they're the same ones the government used for the school shootings?
If this refers to google maps on the web ... if one is looking for a location without luck, my guess it also uses google location which is a separate and broken service. It's broken as in part either deliberately as a dark pattern or just because no one there cares, despite some of the time, the map actually having the right information hard coded into them.

I only recently discovered ... or the penny dropped why various issues I'd been having in regard to being listed in a neighbouring suburb. I had bounced against the decline in google map information and accuracy for the last 10 years or so. In that same time most delivery services have stopped doing to the door deliveries out in my rural area because they use google maps, those that persist to try a to the door delivery and don't use a local driver in my area, usually waste a couple of hours driving up and down the road ignoring the road markers and preferring what their device is telling them.

Sure I could make an account, hand over more private data and fix my own issue, but so many addresses I've looked up via google in my area are not right. I now tell services to use apple maps which seem to be on the money and ditch their google since it seems to be waiting for half the population to make accounts to sort out their address.
I've seen Altman say in an interview that training GPT-4 took "hundreds of little things".

I don't find this implausible, but it folds slightly to Ockham's razor when you consider that this is the exact type of statement that would be employed to obfuscate a major breakthrough.

It just makes me crook my eyebrow and look to more credible sources.
I can’t say what inspired 19 in the mind of the author, but the thing on the page is that 19 is the tipping point. It goes from 96% collision at 19 to 27% at 20. It’s the most amount of digits where you’ll probably have a collision.
It depends on how Apple implements the sideloading feature. They always take the "malicious compliance" route when forced to do something by law and I think they will make installing apps outside their App Store as irritating as they possibly can.

I'm also going to stick with Android for now since it plays nicer with Linux and have no interest in buying an Apple laptop.
>but what if the LLM could take proposed question text and point the person at an answered question so they don't even have to wait for an answer or a duplicate?

Great suggestion!
What if no?
New version was just released for those who already have it installed with a number of bugfixes and improvements to the model. If you have it, then click "Check for updates" in the drawer that slides out of the hamburger menu button.
Wow, he did it. First manned flight to space.[1]

err. First Private manned flight to space. [2]

Err, First completely private crew to go to space... Is that actually something we're considering a first? Can you really tell the difference between a person who works for the gov't and a person who doesn't well enough for that to be meaningful?

If you have to explain in the accolade what it means, then it's not much of an accolade.

[1] https://en.wikipedia.org/wiki/List_of_human_spaceflights,_19...

[2] https://en.wikipedia.org/wiki/Private_spaceflight#:~:text=On....
You can also say that one forum discussion is worth a dozen blog articles. SEO ruins the internet.
"Hurting religious sentiments" by tweeting a screenshot of a 1983 movie is obviously not a war crime. Zubair is a journalist who was jailed for spurious reasons:

> Retired Supreme Court judge Justice Deepak Gupta on Tuesday said that questions arise on the Delhi Police for arresting journalist Mohammad Zubair for allegedly hurting religious sentiments even as suspended Bharatiya Janata Party Nupur Sharma is still free despite making controversial comments on Prophet Muhammad, Live Law reported.

> The first information report against Zubair was based on a complaint by Delhi Police Sub-Inspector Arun Kumar, who said he was monitoring social media when he came across the March 2018 tweet after a handle named Hanuman Bhakt raised objections.

> The handle had taken objection to Zubair’s tweet, showing a hotel signboard with the name “Honeymoon Hotel” repainted to “Hanuman Hotel”. The journalist’s lawyer has argued in court that the photo is a screenshot taken from a 1983 Hindi movie.

> On Tuesday, Gupta said that nobody had complained about the movie for 40 years. “How was it [the tweet] reported based on one anonymous complaint?” he asked.

https://scroll.in/latest/1027652/questions-arise-when-police...

As a journalist, Mohammad Zubair is like Maria Ressa. Both speak truth to power in countries in which press freedom is an ongoing issue, and both are not afraid to publish inconvenient facts that reflect poorly on the ruling party of their countries. There are plenty of Indian sources that reported on Zubair being jailed for "hurting religious sentiments", so I'm not sure how your dislike of Western media is relevant. Your comparisons of Zubair are also not very appropriate, since "hurting religious sentiments" is not the same thing as publishing false information.
I don't quite understand this. The returns to scale have always been sublinear (ie "diminishing"), but the scale-maximalists didn't worry about that before. Also I heard Sam tout on the Lex Friedman podcast how amazing it is that the scaling laws worked so well for GPT-4. So I wonder what changed?

Sure yeah the cost numbers are getting very large and we can't keep scaling forever. But Google could easily 10x the training cost of GPT-4 if they thought it would protect their search business. I'm still skeptical that scaling is enough to reach the thresholds we want, but I'm surprised that it's being claimed right now when there's a huge rush of new money into the space. I wonder if this is some sort of misdirection by Sam
A nice solution to this would be a new Parental Control setting. If I fear a parent may end up installing malware, then I would configure their phone to disallow 3rd party stores.
Well there used to be this thing called https://meetup.com/ ...
> Two long-time-EU, never-Soviet members joining NATO is as nothingburger as it gets

Finland has been occupied multiple times by Russia and ceded 10% of its land to the USSR in an attempt to make peace. Heck, some even argue that Finland did a "redo" of one of their parliamentary elections because the USSR didn't like the results. Joining NATO is a major departure from their many decades of attempting appeasement - it's far from a nothingburger.

It may be an even bigger deal inside Russia though: Putin directly triggered one of the very specific things Russia didn't want to have happen. This both arms his domestic critics and raises the pressure for him to deliver some sort of "win".
Speaking of birthdays, what is the probability of two people with the same 19 digit number colliding with the same birthday as well?
I hope this includes tenure. Few things are more threatening to kids in deep Uni debt than truly toxic professors who can't be fired.
What is "cool", (or a challenge if you design PCB like I do), is that this is not true for alternating current.

For example, if you have a track that does a L on top side, and copper plane on bottom side, with an alternating signal, the return path will follow the L and not go back in a straight line.

Those links have some explanations:

https://resources.altium.com/p/what-return-current-path-pcb

https://www.nwengineeringllc.com/article/how-to-design-your-...

https://electronics.stackexchange.com/questions/360472/real-...
I feel that one of the differences is that a wire is "full" of electrons already, and more are reluctant to enter the wire unless there is an exit path, but as soon as there is a path the current/charge/emf flow occurs all along the wire almost simultaneously.

This is not modelled well with the water mazes/analogy.
Yes, but maybe 5 times out of 10 the forum has your question, but not your answer. Add to this that guy on the Apple support forums, who has destroyed millions of lives by repeating the same answer to every thread opened for the last 15 years.
Nintendo is out of date. TTC verges on being a patent troll.
> And there's good reason to be skeptical of China joining Russia in a world war.

You don't seem to have an understanding of basic strategy. China will probably use this opportunity to take back Taiwan. And North Korea might as well invade South Korea while we're at it.
Our reason was pretty much "clients want to use it". One migrated to it for no good reason whatsoever aside from senior dev (that also owned part of the company) wanted to play with new toys. Other one halfway decided that their admins don't really want to start k8s cluster and just told us to deploy resulting app (which REALLY didn't need k8s anyway) on docker.
I love love love Tom Scott, but some of his recent videos are getting an eeny weeny teeny tiny bit Half as interesting-y, but with Tom’s face to camera instead of incongruous stock footage.