skysight-inc/HackerNews huggingface dataset:
The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasets

> Large Language Models (LLMs) have impressive capabilities, but are also prone to outputting falsehoods. Recent work has developed techniques for inferring whether a LLM is telling the truth by training probes on the LLM's internal activations. However, this line of work is controversial, with some authors pointing out failures of these probes to generalize in basic ways, among other conceptual issues. In this work, we curate high quality datasets of true/false statements and use them to study in detail the structure of LLM representations of truth, drawing on three lines of evidence: 1. Visualizations of LLM true/false statement representations, which reveal clear linear structure. 2. Transfer experiments in which probes trained on one dataset generalize to different datasets. 3. Causal evidence obtained by surgically intervening in a LLM's forward pass, causing it to treat false statements as true and vice versa. Overall, we present evidence that language models linearly represent the truth or falsehood of factual statements. We also introduce a novel technique, mass mean probing, which generalizes better and is more causally implicated in model outputs than other probing techniques.

https://arxiv.org/abs/2310.06824
They had that weird moment where they fired/rescinded a bunch of new hires after Peterson came back and basically said "oh yeah we weren't supposed to be hiring."
If you need a lot of RAM, usually you need to buy servers with multiple CPUs to which you can attach the memory. Because the amount of DRAM you can attach to one CPU is limited.

If you don't have the need for all the extra CPUs, just being able to attach more memory to a single CPU through CXL may be cheaper.
I didn't realize wanting healthcare while getting let go from a company I worked for was desiring to be "coddled."
Errors are values. https://go.dev/blog/errors-are-values

"Whatever you do, always check your errors!"
This is an even more subtle point. In Arabic, Allah is simply the word for "God". As it turns out, Allah is also the English word for "Muslim God".

To take an English example, imagine a Christian saying "God is great", with an option to translate it as either: "God (generic) is great"; or "The Christian God is great".

Sure, he was probably thinking of the Christian God when he spoke, but making that explicit in the translation still changes the meaning.
I was replying to a comment with agreement? not saying that this is an obstacle for me.
Not particularly. I value predictivity over "smarts" when it comes to productivity tools. For me, using the already existing autocomplete, that I know the outcome of, is faster than understanding (and subsequently fixing) copilot’s suggestions.

A colleague types no more than 30 words per minute, and is fawning over copilot. There’s probably a correlation.
About a year ago? The main issues I had mostly boiled down to "the app felt clunky to use", pages not rendering nicely, issues while scrolling pages and buttons not being in places where they seem logical. Similarly, the way Firefox handles external links from other apps feels... bad? Like that's really what a lot of it boils down to; Firefox as an app just feels outdated to use.

Then there's the fact that extension support in Firefox Mobile is aggressively locked to the Mozilla extension store and only a whitelist of stuff Mozilla approves (it draws extensions from a collection on the Mozilla extension store, so if your desired extension isn't in it, the only option you have is to override the entire thing by making your own collection and messing in about:config), and that kinda compounds to a strong "I'd not recommend it" for me. Firefox to me is a browser that at it's core should be respecting user choice and the Android implementation on that alone doesn't meed the sniff test; Mozilla lock-in even on minor things like this is a big dealbreaker.

Chrome's feel with the rest of Android, for all the issues I have with it, is really well done. Firefox makes you feel much more like you're constantly struggling against Android to make a square peg fit in a round hole. I personally do use a Chrome fork (Cromite, which is a Bromite fork since Bromite's lead dev is MIA), just so that feel is preserved (while also having a solid adblocker and other privacy oriented features).
fwiw, I'm considering craft.js and reka.js

https://github.com/prevwong

Also, Stackbit by ContentLayer, though for a slightly tangential need.

https://contentlayer.dev/docs/integrations/stackbit-b1141d65
The New Rust Project Directors
I don't think having discrete programs for subsets of the population is single-payer. Single-payer to my understanding means that the health system itself has a single payer. Having the government pay for some patients and a myriad of insurance plans covering the bulk of other patients is not single payer.

As they said, it is bizarre the lengths the US will go to to maintain its layered system. It seems purpose built to screw people over.
Related: some late Datsun / early Nissan cars used a miniature phonograph to play “Door Ajar” and seatbelt voice warnings.

https://www.autoweek.com/car-life/but-wait-theres-more/a1875...
Related:

Major cyber attack could cost the world $3.5 trillion

https://www.reuters.com/business/major-cyber-attack-could-co...

"The global interconnectedness of cyber means it is too substantial a risk for one sector to face alone and therefore we must continue to share knowledge, expertise and innovative ideas across government, industry and the insurance market to ensure we build society’s resilience against the potential scale of this risk,” Lloyd's chairman Bruce Carnegie-Brown said.
You still need to manage O(M²) rclone mounts.

The promise of Spacedrive is to have O(M) setup once, and then be able to access all files from all devices.
you can make a firefox bookmark with location set to:

javascript: (location.hostname="nitter.net")
I don’t consider just Microsoft to be healthy competition personally
Originally not, but they advertise strong read-after-write consistency as of December 2020.

https://aws.amazon.com/blogs/aws/amazon-s3-update-strong-rea...
There's a Nobel Peace Prize waiting for you if you can solve the problem at that level.
My guess is that "g" here is primarily the ability of the model to recognize and respond to multiple choice questions (the "performance" here is almost entirely measured on MMLU). Weaker models often do things like recite back the list of answers or predict that the next text will be another question.
Also, no monthly fees if you get credit of >700€ per month
> then Google does a sneaky thing and make it so that any in-app browsers will still be Chrome thanks to the System WebView. So nobody gets to escape the Google ecosystem.

Are you sure about this? I'm able to use (and have been using) Firefox as my Android system webview, just tested now. And this is literally on a Google-designed device. Maybe I'm missing something.

Disclaimer: Googler, opinions my own.
It’s incredibly common in every East Asian coastal cuisine.

If you live near the coast, you can easily forage your own too.
I agree, I have had my raw DNA data and all the analysis results publicly available since the day I took the tests. No problems.

https://globatic.blogspot.com/2013/10/the-23andme-full-and-r...
or smoke signals
yeah that makes sense. I think the challenge is how much you can automate vs the quality.
Awesome. I'm mostly curious what the path to monetization for this is
404 was sprouted out of Vice News. What were you expecting?
What 'freewill deniers' are you talking about? Feels like you're making something up to be upset about (or to be fair, reading things some one wrote for that purpose).

Because the position you are describing is incoherent. Frankly, it sounds like you misunderstood a conversation about socioeconomic factors in violent crime
That’s because it doesn’t make sense, at least if we’re talking about quality. If Google and nobody else had paid Apple a penny to be the default, Apple would still probably have Google as the default because it is still the best of the free options today. Of course the iPhone is so popular that it doesn’t make any sense for somebody to not pay Apple to be the default, and that is a lot of potential traffic that Google would lose out on if they took no action and remained complacent.

And if quality matters to the discussion (which might be a bigger “if” than I’m giving credit for here) Google today is worse than Google in 2009. Bing’s problem isn’t that it isn’t as good as Google today, it’s that they never even matched Google in 2009 and the decay in quality at Google hasn’t made it worse than Bing currently is.
> (the Google system webview reports back data to the main app about user behavior - IIRC the one Apple offers for non-browser apps is more of a black box though)

That's correct, SFSafariViewController does not afford app devs any usage information whatsoever, is run out-of-process, and uses separate cookie/localstorage/etc from both normal app webviews and Safari proper making tracking more difficult.

Also unlike Android's Chromium webview, SFSafariViewController utilizes the content blockers and extensions the user has installed unless the user specifically requests otherwise, so there's still some level of ad/tracker blocking happening.
TL;DR: actually, they might. If I'm reading the visualization correctly, and not just projecting my own prior expectations, it seems to imply that a distinct and general concept of "true" and "false" (or at least "known true" and "known false") emerges in the latent space.

It'll be interesting to explore how robust it is for statements crafted so that they surely did not occur in the training data, but their truth value could be indirectly inferred from information in the training data.
Honestly, sounds awesome.
If you really want to, there's also the `join` command, which has been part of the standard unix toolset for longer than many of us have been alive.
They have stronger language "we present evidence that language models linearly represent the truth or falsehood of factual statements"
The very nature of a startup, especially one funded like this, means that your whole existence is predicated on the hopes that you make it big.

As such, spending your last cent to try to find a lifeline makes far more sense than calling it quits early. It's also certainly not in the interests of investors to just call things off.
> Hell, during the height of this Comcast partnered with Speedtest, and now hav their own Speedtest servers all over the country, so you don't even leave Comcast's network.

Most ISP's do, and if you tell it to use the server of some other provider off-net they'll happily make the excuse that "we can only guarantee bandwidth to the edge of our network."

It's a crap excuse, because, duh, you have no control over the path traffic takes once it leaves your AS on hopefully the best route - but if you have poor connectivity to your peers that's still on you.
People that do proper ETL don't use python
Denny Borsboom: Measuring the Mind - about measuring psychological attributes, its philosophical foundations and how that translates to actual mathematical models; short, focused book written with great information density, but very readable.
Bull-bars on the front of emergency vehicles? /s
Well, it's different kind of things, on tgram you have usernames but lack privacy bc usual chats most ppl use are not e2ee.
On signal you have nr as piblic info but all messages are e2ee. Also signal's backup& sync mechanism is very bad.
Closest app to tgram is Whatsapp, without encryption downside. Next is maybe Element based on matrix protocol with signal type encryption for groups
Hey, nice detective work :)

This is definitely more of a pivot, though the ZTool product also went through a few bigger iterations itself. I think my learnings from building and talking to users the last few months boil down to two main things that led me to work on autotab.

1. AI-generated software isn't ready for non-technical users. With ZTool I was initially focused on making it easy for people who don't know how to code to create automations. For the reasons we talked about above, I think having the model's output be code is best for now, so autotab is focused on users that can review and tweak Python code.
2. How you communicate intent matters. There is a surprising amount of mental work required to go from "this task is annoying" to creating a structured representation of it (c.f. the whole world of process automation). AI demos have focused on short prompts to communicate intent, but those don't work that well for more complex domains. Using the browser to communicate intent seems really powerful because it's so intuitive/familiar.
After the twitter files I just assume the government has their grimy little fingers in every company that has access to a large amount of eyes, prime for manipulation
How is that logical? Why would you buy a phone for $150-300 that’s the same as the one you have, likely with ann old battery for that price, instead of replacing the battery for <$100.
Ask HN: How do I organize a team using deep learning in a cost effective manner?
Title says it all, but we're getting serious into deep learning, and I'm wondering how other organizations are managing their team cost wise in order to provide developers with the proper resources in order to do their jobs. Things like powerful GPUs and VMs can add up after a while. What are some of you doing to keep costs down while still empowering your employees to do their jobs effectively?
For non-Britishers:

https://www.youtube.com/watch?v=0n_Ty_72Qds
Probably they used those two months to try to find a buyer for the company
Books are like the ultimate "container". They are so tied to certain versions. I liked the books that came with CD's that included everything, even if they were almost immediately obsolete.
There's still one more higher court that can overturn that decision - SCOTUS. They could conceivably rule that no government agency, state or federal, has the ability to enforce such regulations.
That doesn't seem like a good path to follow. I recommend using serial as a transport, and layering IP over it if you truly need it (you probably don't).

Here's an example where SLIP over serial is used by ESP32s: https://docs.espressif.com/projects/esptool/en/latest/esp32s...
I've used Figma a lot in the last few years but I haven't used Dreamweaver in over a decade.

I've never thought to compare them as similar tools and I still can't really understand the comparison. Figma feels a lot closer to Illustrator than Dreamweaver to me.
A 2D game written in type-level TypeScript
NOTE: I'm not associated with UploadThing

I appreciate the transparency and the deep dive into what happened, why, and how they fixed it. It is always helpful to hear about the troubles of others AND the solutions so we can hopefully avoid some of the same issues
We have a small specialty cut flower farm and also grow plants for fun. I like to take people around and just start eating all the herbs and leaves and berries and bits, off of all sorts of plants. "That's edible?" "How hungry are you?"
I've said it before. If Mozilla stopped with their nonsense and charged an optional $9 a month for a Developer build of Firefox (which ALREADY exists mind you) under the guarantee that all proceeds would go to funding Firefox, I would pay it every month. They're not even needing to build a new type of Firefox browser build, Developer edition already exists. If you tell your potential customer base that this would be the case, I'm sure plenty of devs would buy into it. Especially if they invest in dev tool enhancements. There's still so many random things I'm astounded that not even Chrome Dev Tools can capture, like if I'm debugging postMessage, why isn't there a tool to see what messages are going from what document to what host and so on.

https://www.mozilla.org/en-US/firefox/developer/
Well, and JIT is not allowed as it is a security nightmare. So that means no custom Javascript implementations.
You can buy healthcare on the free market.

And you aren't being "let go" - the entire company is going under. If you are laid off and the company stays healthy, it makes sense to have some concessions. But if the entire business ceases to exist. I don't know why would you expect anything from it.
Makes sense, definitely if anonymity from conversation partners is desired then I can see how Signal's model falls short of your needs. I've also used Signal in the past for activist group chats, but in those cases my primary risk vector has been having messages read by someone outside of the group, people typically join those after being referred by someone they met face-to-face. I suppose there's always the risk of a wrecker slipping in, and having more layers of anonymity could reduce that downside risk. Hopefully this username approach is able to address your needs better! I really like the tool so would be stoked to see it cover additional use cases.
https://www.sparkfun.com/products/19038

im sure theres more
I hereby authorize any and all clones anyone ever wants to make out of my full DNA or parts thereof.
That's the definition of "little-c" calorie, not food Calorie. Food Calorie still claims a relationship to "little-c" calorie but its scale is in a further different magnitude and some of the numbers in its standard model can't be replicated so are just taken as given constants. But also the SI system dropped little-c calorie for Joules in part to shake up the over-reliance in some of the sciences of old bad Phlogiston theories, that "heat energy" is somehow usefully more indicative of energy density. (The physics formula for energy density of mass is the well known E=mc^2, nothing to do with heat.)

Over-focusing on "heat energy" and a model that assumes the human body is an ideal spherical furnace ignores most, if not all, nuance in macronutrients and metabolism pathways, and biases in favor of foods that aren't as easy to set on fire (such as grains over fats). (Not to mention the very dark flipside of "exercise calories" and that if you are optimizing the human body's output as an ideal spherical furnace you are optimizing for states such as "fever" and "stroke".)
While true, most of these startups that have already found product/market fit and go bust are operating off of unrealistically rosy projections.

Did this company need to burn their entire round in a single year? Probably not. Could they have established themselves with lower operating expenses and still grown over time? Probably.
Ok I feel less bad about struggling to port similar length scripts to Python 3 then
I can already answer you that question based on the "reversal curse" paper. LLMs trained on “A is B” fail to learn “B is A”. It will only work if you explicitly generate text connecting B to A before training.

More generally, the organic training data is almost always incomplete. Samples of text leave many assumptions and inferences hidden. Like a math problem, you see the statement, but don't know the answer until you work it out. Or like a puzzle, you see the pieces but don't know the big picture until you fit those pieces together.

That is how training text samples are like unsolved enigmas, we train our models on undigested text. Often the pieces are spread over many training examples that almost aways appear separately, never together have the chance to draw a conclusion from them. Search is needed, augmenting training examples with supporting data.

Neural nets are smart at inference time but dumb at training time. They don't make those connections when they train. Instead, we need to draw those connections out by generating new text. We need to benefit from inference-time smarts before training. That means we need to use current LLMs to write the dataset of next LLMs.

All the best LLMs today used a big piece of synthetic data, including GPT-4. Datasets like Orca, Phi-1.5, ShareGPT, etc. It's also the best way to create small models (<10B) that actually work, you need very high quality, high diversity synthetic data.
Well, Biden did say he would destroy Nordstream-2 and followed up, so Medvedev can deliver threats too.

https://www.reuters.com/business/energy/if-russia-invades-uk...
> ... quality happens only if somebody has the responsibility for it, and that "somebody" can be no more than one single person

So true, I've yet to see anything of quality produced by groupthink.
Just today my Thinkpad Trackpoint Keyboard II arrived and you might be interested to know, it uses 2.4Ghz OR bluetooth. The feel is great, and for me it's awesome because I don't have to accommodate a second keyboard layout. I'm either using a Thinkpad laptop or this Thinkpad keyboard, both with Trackpoint and the same layout / feel.
That's the whole point. Permabanning on the first offense ignores the reality that these large-scale moderation systems (automated or human) tend to lack nuance and context-awareness, leading to false positives. A system of escalating warnings adds slack to protect good-faith users from those sorts of moderation failures.
It's translating "alhamdulillah" to "Terrorist".

"Alhamdulillah" is Arabic for "Praise be to god" and (edit: to my ear at least) is used by Muslims (edit: by Arabic speakers more often) nowadays as an alternative to Allah u Akbar, Takbir, or Narai-e-Takbir because (edit: I think) those 3 terms have increasingly been co-opted.

This is the equivalent of translating "Praise Jesus" to "I love god and hate abortions"
I've tried tripe a few times and times and I can chew it, swallow it, sure, but its just so foreign to me that I don't seek it out any more.
Dreamweaver or Fireworks. I miss FW so much. It had that perfect blend of vector, bitmap, and text handling. Figma is the closest anything’s come to matching it.
It it surprising that science, which is the theory of impersonal necessity, should find individual agency a rather inconceivable thing?
On (1), everyone in this case, even Microsoft, says yes Google is much better; they just say Google is better for unfair reasons.

On (2), I think what the case said is that Microsoft would have had to pay more because it's smaller? But I'm not as sure here.
Apparently I was just ignorant. Thank you these look amazing.
Strawman. Nobody ever claimed that the only carbon or water is found on earth.

The presence of carbon and water in these asteroids is interesting because they preserve a record of what the early solar system was like.

We did not know if they had these materials in abundance. Maybe they had a bit, maybe a lot. Maybe almost none. We did not know. Now we do. If the finding was almost none, that prompts different ideas about their source on earth than if they had.

You may have thought this outcome was very likely, but it was just speculation on your part.
I always took the bank's sudden intense interest in my security as serving there concerns, not mine. Not only did it smell insincere and fishy, but it didn't make sense either. Why should I care so much for _their_ service? If they get scammed into giving all my money to someone else, that sounds very much like a _them_ problem, and not a me problem.
No, however, I do know that a big national company does this because the customers need to upload data directly. IMHO they should use an API instead, so no, I don't see any reason to do it. I wouldn't do it, it's a major security risk.
The reading part is what I find really valuable about these tools. As I'm trying to understand a new code base I can ask questions and get excellent feedback. It is a true accelerator for understanding code, especially when unfamiliar frameworks are being used.
So Convoy's UVP was based all on price? Wouldn't the CEO/COO have seen this before rapid expansion?
Wonder if it might make sense for the social safety net to include such a provision for workers of businesses that go under. If we're not going to have universal public coverage, might as well add provision for such an extenuating circumstance as that.