skysight-inc/HackerNews huggingface dataset:
> What will next-token prediction give us on such a dataset?

Haven’t we pretty much figured out these things are doing more than just predicting the next token at this point?

There’s probably a lot to be done with a “prediction machine”, birds aren’t all that smart but can catch bugs in midair.
I'd like something like this for exploration of graph databases such as Neo4j.
This is essentially how we are using ChatGPT to access our database of 3,335 cybersecurity vendors and provide responses.
To me, the main difference are the ones that ask why, the ones that don't.
End this sick Nation now
Developing a similar tool with 1-click connection setup and GPT-4 streaming (really improves the generated SQL). I think business analytics tool will have to change their pricing significantly soon due to AI (my pricing starts at $5 per month). I mean, have AI generate SQL and setup a proxy to run the SQL queries directly and display the results in a table. That is a really powerful and accessible tool for a lot of people and it is hard to justify spending upwards to $50 for Tableau and the likes.

[0] https://aihelperbot.com/
TI is most definitely not fabless; it is 80% in house. https://www.electronicdesign.com/technologies/analog/article...
Slight criticism: from the given examples, seems obvious that type 2 already knows the solution proposed by type 1 (apparently it was a very easy one), and also does one step further, asks how it impacts the users. So what this types theory really says is that there are devs who cannot think about their solutions in context, and devs who can. And then, in this case: it's really a continuum, and obviously it's not two types but just worse and better developers.
I'll give you an example.

Here's the official Ubuntu documentation about how to install WordPress on your Ubuntu server.

https://ubuntu.com/tutorials/install-and-configure-wordpress...

I want to focus on steps 2 through 6

They are all about configuring the system/envnironment.

There are some tools that automate some of that. For example, you have to install about 10 packages. The installation of each package is mostly automated, except when it breaks for random reasons, but aside from that, even if it was perfect, you still have to know which packages to install and type out the commands to install them.

Type 1 in the OP is the type that thinks this is very simple and is not a problem that needs solving.

Step 4 in the guide has you edit config files in specific locations and execute some commands in a specific order.

Again, each step, on its own, would sound "simple" to the type 1 programmer in the OP.

Step 5 would have you configure a database.

Again large parts of the process are automated .. but ..

The whole process is complicated because at each step along the way someone thought the task is simple and their job is done and they just move ball down the field: it's not their responsibility anymore.

A type 2 engineer in my book would try to design the system so that they _avoid_ the need for all this cruft.
> Why expose it

I read "expose" in two possible ways: (1) as a public- / user-facing API (2) existing at all.

When an error type is a public API that is bound by semver, I do think you should be very careful about what you expose. I suggest starting with an opaque [1] error type and only exposing exactly what you are comfortable with supporting. That may boil down to basically only a string (a.k.a. the `Error` trait).

> Why expose it as a programmatically-accessible information at all?

A few things come to mind...

I'm a huge fan in testing my error cases as much as possible. To that end, a bunch of my tests are semantically `assert_matches!(Err(MyError::Case { .. }), function_result_value)`.

Not all errors are equivalent. For example, if my library fails to read a configuration file, perhaps the caller of the library can recover from that by downloading a file. However, this requires the caller to be able to tell what caused the error.

Interacting with an external API, such as HTTP status or command line exit codes. In this case, you can categorize your errors into domains like "server error" / "client error" / "authorization error".

These could all be done by string matching, but that tends to be comparatively brittle.

> the same information in a string

Aggregating strings like that requires dynamic allocation, which isn't universally available in Rust programs. For example, SNAFU works fine in a `no_std` environment and I know that it's been used in cases like embedded and Windows kernel drivers.

> if the only purpose is for a developer to read it

I don't think that's always true.

[1]: https://docs.rs/snafu/latest/snafu/guide/opaque/index.html
They cheated on the ethics exam, THEN they lied about their cheating.
https://www.seattletimes.com/business/starbucks/starbucks-il...

Unfortunately, by reading the first article I'm paywalled from reading the second. But the NLRB judge found them guilty is in the first paragraph.
Unlike other hedge funds, Taleb's/Universa's records, like CAGR, are sketchy. Good records do not exist except what has been 'leaked' to the media by PR. It's not like Bridgewater in this regard.

His barbell OTM put strategy almost certainly did badly in 2022, because of the failure of the Vix index to spike and the decline of the S&P 500 being orderly.

https://greyenlightenment.com/2022/10/08/tail-hedging-strate...

So both parts of the barbell lost money, which is not supposed to happen. This is why you have to be warry of individuals and strategies that are overhyped. If a strategy is getting a lot of positive press, it likely means it's saturated. If a lot of quants are buying the same options for the same hedging purposes, who is going to sell them?
My understanding is that FlashAttention's memory use is linear, or close to linear in practice, but computation is still O(n²). I'm unaware of anyone being able to apply FlashAttention on, say, a million tokens, because it must execute ~1/2 x 1,000,000^2 x n_head dot-products, each in a subspace with d_head dimensions. That's not exactly computationally cheap!
What is suppose to come first?

An earth-spanning Metaverse controlled by countless human engineers (and countless managers) or LLM/AI (where tons and tons of the dirty work within the metaverse is off-loaded to sophisticated bots)?

I'd rather be interacting in the real world - assisted by smart tech - to make my real life easier/better. This means LLM/AI. There's real value here (if done right...).

The metaverse, for a long time, is still going to feel like gaming 2.0. Just another form of entertainment.

If the article is valid, it's a good move by Zuckerberg.
Sounds like the plot of a horror movie
If you have some really complex queries that you want to test to see if AI (GPT-4) can generate you are welcome to try: https://aihelperbot.com. After upgrading to GPT-4 I haven't had a single miss so far (when adding database for context).
If you're content with using cloud storage as "secure"…
Using GPT to automate translation of locale messages files
You could still do that with Cloudfront. It's simple to configure but makes it a deliberate action and not something that could be done accidentally.
Inline in Rust (2021)
Depends on app. I'm still waiting for web browsers to implement a way to schedule local notifications at specific time.
Probably similar to you, I couldn't read the FT article because it's behind a paywall; however, I'm familiar with the general story. It's not some corporate training. They, plus many other accounting firms, cheated on professional licensing exams. Egregious because the accounting firms are doing the opposite of their sole purpose - add trust to the financial system.
It is only linear in terms of memory, not compute. Flash attention is a big advance, but not enough for 1 million tokens
is it possible to use SetFit through some command-line interface of some API?
I'm from MENA. I can't speak to South Asians, but the immigrants I know overwhelmingly support secularism, multiculturalism and other progressive policies in their original countries. In fact, the biggest reason why they tell me they wouldn't go back is because they take issue with cultural attitudes and politics there, not because of economics as most feel they might be more prosperous back home.
Actually, I have to admit that you’re right!

The comment’s missing nuance triggered me. Also the word parasite. I should haven’t replied.
AI will soon become impossible for humans to comprehend
It's not that useful, except for artworks. The copy has less precision than the scan, which has less precision than the original object, which has less precision than its design. If you scan an auto part, you're unlikely to get a usable duplicate auto part.
The Great CPU Stagnation
Really great use case to be fair and congratulations on the launch.
Wanted to ask:
1. how well does it handle joins among multiple tables to find an answer
2. what happens if your tables and fields to not make a lot of sense in English?
Thanks!
Multiply Your Organic Traffic by Following Emilia’s Content Operations Playbook
Know of anyone who provides custom rails for IKEA drawers? Eventually they fail and ball bearing start to fall out and they do not sell replacements.
Games and the Rise of Transmedia
> (or even tweets made by Taibbi!)

And thus the whirlygig of time brings in his revenges…
If no people like doing that, than who will do it? Who will do the hard or nasty jobs that nobody likes to do? Where are you going to eat your next McDonald's burger? Cuz all restaurants will be closed cuz nobody really likes doing that full time but it pays the bills.

There are just so many jobs that need to be done and there's nobody that likes them. Who would pick the garbage up? Who would unclog the sewer? Who would drill for petrol or mine for coal? If I got my regular salary without needing to do anything, then I wouldn't go into any of these jobs for sure. Would you?
They were sharing private patient info with advertisers, despite promising not to.

https://www.theverge.com/2023/3/2/23622227/betterhelp-custom...
Ode to Simplicity
Oh, then I guess you better vote in a government that doesn't maximize gains for the wealthy. But taxation doesn't go well with the libertarian types here on HN. A few of us are millionaires in the capital class, and the rest are 'temporarily depressed millionaires' thinking we're moments away from enacting our own get rich scheme.
Why do you say most orgs hold debt?
Apple and other big tech firms have tons of savings invested.
And regarding people, in the US anyway, many hold debt, but many hold savings.

If i'm understanding your description, it incentivizes holding debt?
If you feel like that maybe you ought to learn it on your spare time, and then make up your mind whether you should or should not keep investing on it.
Cool! Down to work on this. Let me know where to reach out. Also I've contacted my lawyer about this and it's a very grey area. We'll see where that goes.
> As an engineering manager, I cannot imagine assuming that people would read something.

Engineers read code when they have to work on it. If naming and structure are good, it will be self evident what that code does and why.

Unfortunately it takes a lot of time to learn how to code in such a way that the author and coworkers can come to that piece of code six months from now and understand what it does.

A corollary is that everything should be automated or made impossible to do, because even looking at the company's wiki is something that most people prefer not to do.

Unfortunately it's difficult to know which automatic process is doing something, given that that something is a known unknown.
> A type 2 engineer in my book would try to design the system so that they _avoid_ the need for all this cruft.

So a go developer that reimplements all of that in go, using rewritten buggy libraries?
You are both exaggerating
> You should have to do something that benefits the public in order for the public to grant you that right

In our corner of the world we call that "taxes".

What proportion of property comes from "Being your rich uncle's favorite nephew"

Where do you propose we stop? Do we reevaluate your assets every day and expropriate them if some bureaucrat deems you are not "contributing" to society. Who makes that determination?

Why stop at property? If humans are deemed not beneficial maybe the state can take over your body and donate your organs?

Think that is hyperbolic? Nope. CCP started with property and is now doing forced organ harvesting.

https://www.nbcnews.com/news/world/china-forcefully-harvests...
By saying "replacing [the system of paying the workers] with nothing", you're arguing against a position which is held by no one.

You cannot in any shape or form argue that artists on Etsy are not getting paid.

The crux is in paying for free duplication. If you stop paying for that, you're not removing all sources of revenue. Commission is older than copyright, just look at the Sistine Chapel. For other forms of expression, other things exist, like concerts for music. The system of paying the workers will remain, even if some parts of it get torn down.

"There is no longer a music industry" despite that the system for collecting money for duplicated music is the dominating way to listen to music (you can't listen to a spotify track without money changing hands). Clearly, you recognize that this system is not working.
It's more of an interesting fact than an issue to be fixed.
That linked comment sounds a bit confused. Infineon, TI, and ST do not have lithography machine capacity to make all chips on their own at scale. However it is possible they do package their chips into components at their own Fabs.

This Bloomberg article might help clarify your understanding.
https://www.bloomberg.com/news/articles/2023-01-12/tsmc-chie...
There is one for arm64 is there one for the rpi4 ? I already run containers on mine this would be even better.
Well, is scraping Twitter an improper use? Anyone can see tweets and who follows who - that's public. Twitter might consider a nascent competitor trying to scrape a significant fraction of the whole thing unfriendly though.
I think with Langchain the LLM picks the tools/APIs you provide to it.

With Jarvis the LLM picks the HF models available.
All disagreements are about "weights", and it's instructive to ponder what this one is about. IMO giving people a process/documentation does help to some extent, so the dichotomy the author presents here is between those who think doing so mostly solves the problem, and those who think most of the way is still left to go: so this one is I guess about the weight one attaches to the question of how much the non-technical solution solves the problem / how much you can rely on people to do what you'd like them to do, etc.

And while experience may often involve lowering that weight over time, it's also important not to get too cynical (set weight to 0), and continue to attempt to estimate the parameter accurately: maybe the "ask people to do X" solution will give you a 30% probability they'll do X in any particular instance -- then ask how ok that is, etc.
We're acting like the programmers want to create the complicated software, but really its the sales team showing up to project management saying "We signed a million dollar deal because our product does X"... then the PM panicking telling the programers that the application needs to do X by next week.
Does he know what he is doing? Probably not but he has goals and a high tolerance for risk. He was one of the few folks who came along and was obviously prepared to risk everything to light the fire for the EV Market and Rocket/Space Industry.

The twitter play was a mistake but was too arrogant/foolish to admit it. He did attempt to cancel his bid but it was too late. He would have been better off to pay the penalty of a few billion and call it a day.

I'm not fond of his antics and trolling, but I am thankful he gathered up the right folks and took the insane risks to get SpaceX off the ground. It's easier to respect the guy when you focus on what he did right instead of wrong.

Would the world have been better without him? Not a chance.....
Twitter is now blocking Matt Taibbi from search results
More than just forbidding unsafe, but not enough to make this secure against competent adversaries by their own admission. They argue postgres itself isn't secure against competent adversaries so this doesn't matter too much.

https://tcdi.github.io/plrust/plrust.html#what-about-rust-co...

Rust keeps a list of soundness bugs via a tag on github - they're pretty common:

https://github.com/rust-lang/rust/issues?q=is%3Aopen+is%3Ais...
Oh I agree with the potential technical benefits. I think the business justification is pretty weak, though.

The business benefits you listed are defensive. That is, if the business is doing well, those are things you might optimize for. The same way you'd, say, try and decrease power consumption.

There are companies where an order of magnitude decrease in ongoing costs opens allows a whole new kind of product. But order of magnitude increases in the things you just listed are rarely developer process improvements or refactors.

Customer happiness is a fun one. If you have a buggy or unreliable app, you'll frustrate customers (I am very aware of this, if you check my post history). You won't _make them happy_ just by building reliable software though.

As someone whose #1 priority is reliability right now – fixing bugs faster very low on the list of things that matter. The problems users have with our platform are a combination of the wrong architecture, and non existent tooling for customer communications.

Which gets back to the original post. We want to hire devs who can identify out what our users need most today, figure out what we can do about it (if we can at all), and then implement what makes sense.
China simulates hitting 'key targets' on Taiwan
This shouldn't be a one-time affair
An AI Just Cracked Your Password
I'm not familiar with S7, and Google wasn't much help. What is S7?
Jarvis is just a real English name. Lots of people named Jarvis. Jarvis Cocker and Jarvis Landry off the top of my head.
Amazon and Apple Have Been Building a New Digital Duopoly
I assume the further away your system is from non technical customers, the more type 1 you can be.

I assume nvidia video card designers can be type 1, because other technical people will be interacting with their system. And if those people don’t do read the docs, and interact exactly how they should, it just won’t work.

Now if you work at adobe and are designing the video editing software that deep down actually uses those video cards, well you need to be type 2. The success of your product is more dependent on how well “the software does what the user intended” where intended might be a very subjective thing, likely based on other features that other similar software has, not related to anything technical.
Not quite, you would get an ellipsoid, I think. Not sure if that is close enough.
I don’t quite understand why context length needs to keep growing. It seems to me like many tasks (e.g. customizing your LLM on your own data) would benefit from the model doing some sort of sped up fine-tuning on any prompt that gets added. That way we don’t have to find all these hacks to find the most relevant context and repeat the same info in prompts. Curious if anyone has insight here as this has caused me some confusion lately!
The equivalent in Lovelace's case would be saying she's a woman from an area where most women are illiterate and work sixteen hour days in death trap factories. It's true, but ignoring that she was part of the nobility adds a disingenuous element to the statement.

And saying that privilege doesn't matter is nonsense, without it she's unlikely to have had the opportunity to do what she did.
Closing a stale SSH connection
what if they have permanent residence permit or more?
Ask HN: Suggest a speaker for a Data Science/ML meet-up group in Luxembourg, EU
Hey,

I'm one of co-organizers of Data Science Luxembourg meet-up group[1] and looking for suggestions for interesting speakers. We have a healthy pipeline of presentations from a local university and industry speakers; however I wonder, if our community would benefit from inviting someone else. In the past, we had a bad experience in terms of the quality by inviting someone from abroad, nonetheless, I am open to exploring new possibilities to enhance our community's events.

[1]: https://www.meetup.com/luxrgroup/
I find it deliciously ironic that a law firm focused on product liability is forced to pay damages off of this.
The table of numerical values is pretty interesting for a layman. I've often heard scientists (such as Brian Cox) talk about x-sigma probabilities, but putting it the context in this table is much more meaningful for someone like me who only has self-study reading as scientific understanding.
ChatGPT and Fortune Cookies
This might help you: https://github.com/flatcar-linux/Flatcar/issues/502
> In many library systems, the books that were the whole foundational reason for their existence have been pulped (literally, this is a source of income for libraries.)

How is this a source of income?
You'll only be allowed to do what the LLMs prescribe, even if you're an MD. Legal, compliance, and insurance may overwhelmingly favor that.

On the other hand, a HIPAA-compliant white-label LLM could be really useful to a doctor. Could this disrupt or enhance PA and NP roles?
Would you expect the deputies to remove their firearms just before arriving? Should they have arrived on bicycle instead of by cop car? Perhaps the ridiculous sound of the story is from the sensationalist writing.
Was hoping that the green flash was stretched out there.
Applause to the group behind this.

CoreOS "just the containers, ma'am" plus ChromeOS "set in stone" OS (but updateable) approach was so obviously good once you started using it that it was just begging to be picked up again.
Well, EY didn't get banned from consulting, but rather accounting work. And the latter is crucial, and even legally required for all and every public company. The reasons are, among others, Enron and , yes, Wirecard. And the fact that EY screwed up Wirecard is the reason they got banned.

By the way, it was KPMG that caught the Wirecard fraud. And KPMG is in the same league and business as EY.

One of the reasons, IMHO, that Wirecard managed to get away with it for so long is, that as a German company, they didn't have to switch Accountants and have another accounting firm helping them in preparing the books. That would be a SOX set-up, and it makes perfect sense. It helps to prevent fraud and it protects retail investors, both of which are good things in my book.

Strategy consulting, the stuff BCG and McK does, is different. As is the outsourcing and consulting Accebture does, which is also different from what McK does. The topic so, is EY and accounting.
Is this the same Jarvis that Karpathy mentioned he was building, or different?
If your "GPT-3 Enabled Robot Therapist" is not licensed anywhere to perform therapy (as I think it isn't), you could get yourself into much trouble, and very fast.
Developing a similar product and to my surprise switching languages isn't a problem at all. It also uses the correct tables when the user inputs "movies" instead "films" as the table is actually called. Writing this[0] here in German will produce the same result[1]. Now of course GPT version makes a big difference.

[0] https://aihelperbot.com/snippets/clg9n8zgi0000l60fx0yu8cbo

[1] https://aihelperbot.com/snippets/clg9nce140002l60fyf5r5bt0
No big disagreements here. The numbers are mostly useful in determining if the equity offer is "fair" or at least matches how the company has described it. That goes to their integrity.