skysight-inc/HackerNews huggingface dataset:
All of this seems to lead to something like this paper https://journals.plos.org/ploscompbiol/article?id=10.1371/jo...

On the other hand, I find it plausible that it's fundamentally impossible to assign some functionality to individual 'neurons' due to the following argument:

1. Let's assume that for a system calculating a specific function, there is a NN configuration (weights) so that at some fully connected NN layer there is a well-defined functionality for specific individual neurons - #1 represents A, #2 represents B, #3 represents C etc.

2. The exact same system outcome can be represented with infinitely many other weight combinations which effectively result in a linear transformation (i.e. every possible linear transformation) of the data vector at this layer, e.g. where #1 represents 0.1A + 0.3B + 0.6C, #2 represents 0.5B+0.5C, and #3 represents 0.4B+0.6C - in which case the functionality A (or B, or C) is not represented by any individual neurons;

3. When the system is trained, it's simply not likely that we just happen to get the best-case configuration where the theoretically separable functionality is actually separated among individual 'neurons'.

Biological minds do get this separation because each connection has a metabolic cost; but the way we train our models (both older perceptron-like layers, and modern transfomer/attention ones) do allow linking everything to everything, so the natural outcome is that functionality simply does not get cleanly split out in individual 'neurons' and each 'neuron' tends to represent some mix of multiple functionalities.
This does not mean much for non encoder-decoder versions. GPT and the like are decoder only and wouldn't fall under this patent.

You can look at their supplied diagrams and general summary to confirm.
ok done :-)
> But some use cases do need quality, and quality will remain.

I believe this too, and that is why I find writers being fearful of LLMs a bit weird.
Software Patents – Obstacles to Software Development
Those were discovered by finding strings that OpenAI’s tokenizer didn’t properly split up. Because of this, they are treated as singular tokens, and since these don’t occur frequently in the training data, you get what are effectively random outputs when using them.

The author definitely tries to up the mysticism knob to 11 though, and the post itself is so long, you can hardly finish it before seeing this obvious critique made in the comments.
Not really, it can't resolve a conflict inside the file and can't enforce a distributed lock on changing the file. Ultimately there will be ways for the file to corrupt or get out of sync, especially if multiple writers are present. There might be a way to make things work better with SQLite's more recent WAL mode but I'm not familiar with it.
There's no delay, they're available immediately to everyone on the SEC EDGAR site (https://www.sec.gov/edgar).
It doesn't have to lag, though. You could ask gpt-2 to explain gpt-2. The weights are just input data. The reason this wasn't done on gpt-3 or gpt-4 is just because a) they're much bigger, and b) they're deeper, so the roles of individual neurons are more attenuated.
got it - so you should validate, but ultimately it's all a guess makes sense
It's really fascinating that you appear to register 'thanking' as 'apologizing'.

And I thank you for that, as I think it just helped me better understand a broad group of the general population I could never quite figure out.
I don't think Apple is comparable to any other corp, they're in a unique position of making the only hardware that officially runs the software they make and they also make industry leading software.

I'm not even an Apple user. I'm just calling it as I see it.
Broccoli sauteed with garlic and black pepper is awesome. Then served over rice with a cheddar cheese sauce and I'm pretty sure you can get up there in calories if you want to.
My favorite anti depression book is Feeling Good by Dr. Burns. I especially like the "if that were true, it would mean that..." exercise in the book, where you drill down to the root cause of your negative thoughts.

So I asked chatgpt about the book, and the exercise, and how to do it, and examples of the 9 cognitive distortions you're supposed to label your responses with. It was very helpful and knew the material well.

It made me wonder this exact point. If you wrote a book on a very rare subject that you were basically the only popular source of detailed info on... And now these models just answer questions for people without having to buy the book.. is that really fair?

Edit: I guess this isn't really that different than the fact I read the book and have described it to many friends and even done the exercise with them.
This video [1] explains how LoRA and Hypernetworks work. This is one way to change the output of the model without retraining the entire model.

9:55 LoRA

14:45 Hypernetworks

[1] https://www.youtube.com/watch?v=dVjMiJsuR5o
No, I think "different American subcultures having different attitudes towards food is the primary factor causing a 60% difference in obesity rate" is an extreme claim.
I'm right in the middle of Europe.

Why not bring it in? I don't understand why they should behave as if they lived in 19th century. They're people living in 21st century, making full use of new technology - nothing wrong about that.

It's bullshit to demand they have to go home to get their phone before they go on with their day after school - not to mention they use the phones before school too. My siblings buy breakfast and lunch with the virtual payment cards (from our parent's Revolut) they have in the phone.

Even their public transit tickets are apps - it's a QR code, and because the transit company wants to reduce staff, you pay 20% less if you buy tickets in the app. Will the school reimburse the additional 20% they caused them to pay? I guess not, right.

And remember Covid? Here in Europe the vaccination/test pass is an app too, and they needed it to get into the school building, the cafeteria, the public transit etc. Soon the ID and driver's licence will be apps as well.

The school itself is sending them homework and grades into an app, btw. It has web access, sure - but they access web on their phones. It's bullshit to make them unable to check their grades or homework assignments during schooltime.

Sure, they could go back to 19th century life with paper calendars, letters, money and transit tickets. But their quality of life would go significantly down. Schools have no right to demand that. Nobody has.

And as I said, school day is not 100% class time. What they do during breaks is their own business.

> Most schools in EU just bans cellphone usage during school hours either by taking it away or barred from bringing it in and it's just effective.

No, they don't. In my state it's very wrong to touch the phone - could be a fine and suspension (for the teacher/school employee) or even a crime, depending on what they did.

The school can demand it's turned off during class time (doesn't apply to breaks) but they have no way to verify or enforce. They can write a teacher's note in case of a disruption or take the student out of the class in serious cases, but they can't touch the phone.

Currently, the trend here is to integrate smartphones into the lessons. Make students use Google search, YouTube, Wikipedia, ChatGPT and other tools.
Well, the aerodynamics are different and the launch abort system would probably have to be somewhat different too. The structural integrity could also be quite different. Of course it won't be a completely new upper stage, as it is just a modification, but a few test launches are probably required.
The text output of a llm is the thought process. In this context the main difference between humans and llms, is that llms can’t have internalized thoughts. There are of course other differences to, like the fact that humans have a wider gamut of input: visuals, sound, input from other bodily functions. And the fact that we have live training.
Charging via roads is the stupidest idea ever.
How would "filter at the output level" even work? The output is arbitrary unstructured text. I don't see how that output could be reliably filtered except by another LLM.
No it’s a given that some people who attempt to wield AI will be adversarial.

In any case a similar argument can be made with merely instrumental goals causing harm: “I am an ant and I do not see how or why a human would cause me harm, therefore I am not in danger.”
This is a great question and I actually go back and forth on it myself. I do tend to be harsher to consumers, because that's who I'm around. My friends who work directly at the auto makers or their suppliers like to blame "MBA's". But find me an engineer that doesn't blame it all on MBAs.
I never said it's the same quality. I said why hire a famous DM to write the next D&D campaign book(s) if an AI can do it? This means the D&D sales/marketing/executive staff decide they're perfectly okay with mediocre production of chatgpt if they save a chunk of money and rely purely on their brand to make sales, since they reduce their costs they don't have to sell that much either to make the same profit as before. Maybe it comes to bite them in the ass, but that will happen later and the DM has bills/family/food needs right now.
That looks neat, thanks for sharing. Speaking of sharing, it seems your repos are missing a license file (and the source files themselves don't have a licensing block that would also serve the same purpose).

I would also recommend linking to https://github.com/wordbots/wordbots-core/blob/v0.20.0-beta/... since the app.wordbots.io version seems to boot up some horrific amount of javascript or something, because the gears just sit there for about 15 seconds before the content finally shows up

Separately, do you know if the vocabulary for wordbots would tolerate the vocabulary for M:TG? IOW, is it possible to "port-over" some of the cards?
> This kind of efficient feedback loop helps you learn

I feel like this helps you solve the problem, but doesn't actually help you learn. The time you're "wasting" trying to find a solution is time you're actually spending learning, not just learning how to code, but learning how to actually formulate a solution. Failure is also one of the biggest parts of learning. "Very hacky programming" is just a start, it's like a vomit draft of anything you're writing. Revisiting your code and figuring out what you can do better is how you end up with more eloquent code.

In my experience, no one really explores when googling for answers, they are just searching for an answer.
From the article:

> Prevention through basic cyber hygiene was simple: ...

> do not use software products acquired illegally.

So they may have unintentionally benefited the economy by discouraging people from using pirated software. However I don't know if the damage caused by the viruses exceeded the lost revenue from potential piracy, had the viruses not existed. Interesting.
i always heard it fucks up with git repos?
I did mean all time high. A simple word slip.
I use it for uploading pictures from my phone to my "private cloud" (an old RaspberryPi) and it works like a charm. I then move the uploaded pictures into organized folders, which also makes it delete the pictures from my phone, thus saving space.
interesting, never thought about it from the political perspective, but is an interesting lens to use.
> abilities of iPad and USB-C

I use iPad with RME ADI DAC-2 and I can't think of a single issue.
SF was a much different place pre-2010. And it's going to be rough getting back there from here. In particular the city's expenditures are way higher now (but without revenues to match), and the homeless crisis is way worse.
Would filtration be slow? ChatGPT already seems to have some filtration on the output level due to the fact that it returns one of its template responses when it’s queried something regarded as harmful. Although I imagine filtering out a list of specific information might be less straight forward than that.
Someone has to manage the membership fees, naturally.
I think you got downvotes because you misunderstood what people were taking umbrage with in the first example.

It’s not that birth time can never have real effects. It’s that if you keep rolling a die long enough, eventually you’ll hit a “statically unlikely” event like rolling 4 fives in a row or hitting 1 2 3 4 in order.

Extraneous sub group analysis are like rolling the die again. Say you’re searching for a p-value of .05 with a confidence interval of 95%. That means 19 out of 20 times it’s indicative of a real relationship and 1 out of 20 times it was due to random chance.

If you do a bunch of extraneous sub group analyses like the reviewer wanted, you’re banking on the statistical likelihood that eventually you’ll get the result you want even if it’s not a real relationship.
Somehow doubt he’s unaware of this.

I’m sure this move is primarily a financial one paired with wanting a bit of change from being at Apple. He joined Apple a bit over four years ago. I’m guessing whatever his stock grant refresher is wasn’t worth the stay.
> TeaVM vs Blazor comparison chart

Blazor has the full task API. Asynchronous tasks run just like Javascript promises.

Does TeaVM have true threading, or is it emulating threads via some higher-level concept? (IE, if I have a multicore CPU, will TeaVM take advantage of multiple cores?)

Unless you're trying to do true CPU-intense parallel computing inside the browser, where you need the power of real CPU-level concurrency, "real threads" in the browser has no gain over the task API.
Lacking plenty of common power user functionality to do things efficiently. It's fine for casuals, they don't know what's missing, but it's pretty poor versus a fully-fledged file manager on a desktop computer.
Don’t know any Norvegian but are there more months that end in R than September through December in your language?
> They mention directly that they collected eggs from the coup.

And if they thanked their chickens more often, the chickens wouldn't have staged a coup.
I think predicting the exact successor societies would be difficult, but there's a lot of SF out there that predicts potential ones. Like the Ousters in the Dan Simmons' Hyperion series or the Drummers in Neal Stephenson's The Diamond Age or various other flavors of u- or dys-topias.

Or even the Millenia of premillennial dispensationalists, for a religious alternative.

I'd argue some of those are more radical imaginations than much of what actually followed past ages.
How are they defining social media use in their analysis?

Because I'm not sure "estimated time on social media" is really the best way to measure things.

The specific social media services used, and how they are used. Some services can be pretty bad if used in some common ways, but much better if used in a more carefully curated fashion.

Spending endless hours are a sensibly curated subset of reddit could easily be a whole less bad for ones mental health than just a few hours a week on some other services, especially if the user has not (or cannot) carefully curated their feeds on those other services.
Last week my company launched an iOS app that gets music into Apple Music and Spotify.

Timing unintentional but neato that musicians can now record, distribute & promote all from the device.

(not mentioning name of app cuz promotion, also we're not the only app that does this)
I'm not sure this would be very straightforward at all as an engineering matter, but you could embed a microcontroller that looks for a certain pattern and then performs modifications indicated by that pattern.

An example could be a password, followed by something like a search and replace buffer. In Python pseudocode, something like

for i, v in enumerate(ram):
if v == b'\x9eP"\xcb\xde\x8fP\xcf':
for i2, v2 in enumerate(ram):
if v2 == ram[i+8]:
ram[i2] = ram[i+16]
break

Then if you could get the machine to internally store a string containing that password followed by a substitution, it could perform the specified substitution automatically elsewhere (in a database? in a kernel data structure?), having some desired side effect.

Of course, the microcontroller wouldn't actually need to be able to interpret Python code, and could be a very tiny, slow, and small one. (And it would have to be powered by the bus that the RAM device itself was plugged into!!)

Another similar thing would be, instead of a search-and-replace, giving patterns and saying "copy from after whatever matches this, to whatever matches that", so that you could get a data leak across users, compartments, VMs, etc., where the attacking unprivileged one would set up a buffer containing the "receive" string and then wait for that buffer to get filled with a copy of the location in RAM containing the "transmit" string.
It's increasingly becoming apparent that artificial sweeteners are not so biologically inert as might be desired: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8156656/ . Do what you will with that information. I make no judgement.
Ah, they didn't have us apologize to plants - only to thank 'em. It wasn't a guilty thing we did, but it was a lesson to appreciate that they were growing and that we could enjoy them.

I'm surprised you didn't stop at the idea that it also implies plants have hearing and can understand language and process some kind of human meaning - I feel like those are more absurd than the idea than a plant feels. (More organisms on this planet demonstrate something like feelings than the capacity to verbally communicate.) But yes, I project the idea the plants have something like human feelings, and that's definitely a product of that kind of education reverberating through my life. It was a kind of spiritual lesson, and the school incorporated other spiritual elements like performing the Haudenosaunee Thanksgiving Address during some school assemblies and camping trips. I'm not confused about those as an adult.

I also know that a plant's experience on this planet is alien to mine, and it's silly to apply human meaning to what I think it's going through. I think our brains have enough space to hold these ideas up there though and reflect on them, and I think children deserve more than a functionalist education. I don't think I'm messed up as a result of that education, and I'm living a happy life - fair to say I had a heck of a time catching up on math and language in middle school though!
I just don't understand it. Publishing space online is infinite and will continue to be infinite no matter how popular somebody else gets. Who gets overwhelmed by somebody else publishing something?
Closest memory I had to these are airline meal carts, and Sony camcorders. Maybe because mine is a used and beaten up example, but the latch is too solid for an aluminum luggage case, yet seems a bit flimsy for a military hardware. The body is light for its thickness, modules have gaps not enough to rattle but enough to be able to be removed in all situations, and if disassembled, it’s obviously at least IP5X just by the looks of edge seals.

Mine is CF-19 Mark 2, a Core Duo(32bit). Takes old ThinkPad AC fine when I need a paperweight with an LCD :p
I used the app dev side because I think it's more illustrative. There are various teams with various competing priorities who have collectively developed a product which is horribly slow. No individual developer is at fault. Some are efficient with their code, and some are less so. But there is no architecture team or mature SDLC to handle cross cutting concerns or a foundational platform for everyone to build from. Everyone is free to do their own thing and write code the way they want use whatever standards they can find on Google. In that world, just telling the devs to write more efficient code is insufficient to correct the course. The systemic problems that have developed require systemic solutions. A blanket "just do better" has never been useful to anyone.
It can be embedded in a program, but it doesn't automatically manage devices on a tailnet; i.e. there's no way to add all users of an app to the same tailnet (they have to explicitly create a Tailscale account and sign in and share and join) - AFAIK.
Proposed EU data laws leave researchers out in the cold
For teams building Layer 2 solutions for enterprise customers, bing/google based web browsing is a huge pain point. Being able to hit higher quality public stores of information is a great time saver.

Will be nice to know their approach to ranking and curation of these embeddings. Once you open the floodgates, signal-to-noise gets bad fast. But, if you can ensure clear differentiation between high-quality knowledge bases with SLA contracts and the huge number of 'free' user uploads then I can see this taking off.

Complete tangent. *embedding.store* - how is this url still available ?
If you wrote a book on a very rare subject that you were basically the only popular source of detailed info on... And now these models just answer questions for people without having to buy the book.. is that really fair?

What if a person bought a copy of the book, read it and learned the material, and then provided advice to people based on the material. I think most people would say that that is fair. So why is it less fair for the AI to do what is effectively the same thing? Is it simply a matter of scale? Or is there something more fundamental at work?
Could you share your understanding please? I can't quite wrap my head around registering thanking as apologizing.
So what you are saying is, the problem wasn't the internet, it was capitalism.

Only half joking.
Transhumance in the 21st Century
This looks like a great idea to me. I mean, why go through the trouble and cost of cleaning-up, embedding, storing, indexing, and querying a vector database for snippets of text when someone else can do it for you at significantly lower cost?
Consider that while you are one person, a doctor sees many patients. They see that prescribing Vitamin D helps almost none of their patients in the short term, and they can only rely on research for the long term (i.e. they are not seeing the same patient over decades).

Doctors run the whole gamut. There certainly are doctors who will recommend Vitamin D for any issue under the sun. I've been subjected to that, and it totally didn't impact the issues I was going to the doctor to see. At the other end you'll get doctors who will stick to the official guideline (as long as your Vitamin D levels are "normal"). And you have those in between, who will discuss it with you, give you the pros and cons, and will support you in your decision.

I've had enough doctors recommend treatments that have little backing that I'll happily take the risk and stick to the studies. ("No thanks, I won't go for that surgery which studies have not shown tackle the problem" (an assessment the doctor admitted to only when I asked him directly)). I know I'll be wrong on occasion, but I suspect I'll be wrong more often if I follow the other path.

Still, you'll get all sorts of doctors, and it shouldn't be hard to find one who will happily reflect back to you whatever you want to hear.

As for 30 years, the major study associating Vitamin D with mortality came out about 15 years ago.
Davinci Resolve is arguably a better program, and is already available for the iPad. It is largely the same program as the desktop version, with a few exclusions that are actually easy to enable with a little research.
It's like when you get a -Thank you for your services- note while getting fired or layed off.

lmao
Improve any email body in seconds
A pencil's exactly what I was thinking about comparing it to, actually. Spoon, fork, knife... hell, shovel, screwdriver? All easier. Pencils and chopsticks are more precise and require more fine motor control.