skysight-inc/HackerNews huggingface dataset:
The problem with this kind of writing is that the AI space is moving so quickly that some of these criticisms were literally addressed yesterday.

https://arxiv.org/abs/2303.17491

> In this work, we show that a pre-trained large language model (LLM) agent can execute computer tasks guided by natural language using a simple prompting scheme where the agent recursively criticizes and improves its output (RCI).

I also agree with the GPT3.5 vs 4 comparison made by other comments here. Arithmetic and other emergent phenomena only begin to take off beyond certain parameter counts. Stuff as basic as 2+2 just doesn't work in the older models, but you can hit 50%+ accuracy in newer models. Much greater if you use COT & the above RCI techniques.
Mastodon is conveniently also AGPL...
Maybe a moratorium on the Haber process though.
I agree, GPT-4 has a much more "aggressive" confidence, I definitely noticed that, but I haven't seen much of it since the API is still behind closed doors. I'd also like to point out that even though it's better, it still can't reason very well and relies heavily on prompts and instructions, even for very basic projects.

It kind of reminds me a pseudo-visual code builder.

I was writing a Python script with it to put together documentation summaries, and over the course of an hour it offered me 3 different libraries to connect to an API endpoint I was using. It's distracting.
It's all fun and productivity, until the LLM takes your prompt for a social network and runs away with it to earn some crypto for itself, and you realize you've been Winklevoss'd by a computer.
I guess they haven't read https://peps.python.org/pep-0008/#indentation

"Use 4 spaces per indentation level."
Sure, look at the California Model Ethnic Studies Curriculum: https://www.cde.ca.gov/ci/cr/cf/documents/esmcchapter4.pdf. It takes Kendi's black-white oppressed-oppressor dichotomy, and simply shuffles asians into the oppressed, non-white category.

Lesson 14:

> It presents a false narrative that Asian Americans and Pacific Islanders (AAPIs) have overcome racism and prejudice. It glosses over the violence, harm, and legalized racism that AAPIs have endured, for example, the 1871 Chinese massacre in Los Angeles, the annexation of Hawaii, shooting of Southeast Asian schoolchildren in Stockton.

Lesson 16:

>Chinese Americans are Americans and have played a key role in building this country. Had it not been for this workforce, one of the greatest engineering feats of the nineteenth century (the first transcontinental railroad and others that followed), would not have been achieved within the allotted timeline.

It's a projection of how CRT views black history, where ethnic identity is defined in terms of historical discrimination. Meanwhile, do kids of German, Italian, or Irish descent in California learn about the intense racism their ancestors faced when they came here? Of course not.

What's especially galling is that German, Italian, and Irish Americans are at least the descendants of people who faced intense discrimination when they got to America. Meanwhile, virtually all Asian Americans are descended from people who came here after 1950, and mostly after 1990. California is teaching Asian kids to identify with historically discriminated people who aren't even their ancestors.
I did. Your mother sends her regards.

(Joking aside, you’ll find HN to be a wonderful place to hang out, but only if you get into the right mindset. In the meantime, enjoy your weekend.)
It's interesting to me that LLaMA-nB's still produce reasonable results after 4-bit quantization of the 32-bit weights. Does this indicate some possibility of reducing the compute required for training?
Large Language Labor Markets
For all the complaints about how GPT is a parrot or not GI, or whatever, I wonder what these folks are asking of it?

It gives me more relevant results than a search engine, and better answers than most of my coworkers. This tool is massively helpful for a mid-career professional who knows what questions to ask.

Really pays to have so a large bank of known unknowns right now.
So I tried applying. First the actual email form just doesn't load with an adblocker enabled. When disabled, I can't even submit the form since "element with "privacy" is not focusable" whatever that means.

How very ironic.
Maybe it depends on the relationship you have. Probably there wouldn't be a stigma when done with close friends.
How confusing! I thought the headline referred to the ultra-bitter chemical that stops kids eating things they shouldn't. But that "bitrex" just has one T.

Fun fact, Nintendo Switch cartridges are coated in it.
Most FAANG tech workers have a lot experience with that already...
Little money to any startup.
To add, insider trading and financial misreporting is rampant in Indian stocks. Just look at the recent Hindernberg report on Adani as a starting point. The shocking aspect is that this is accepted as the norm.

US stock markets and regulations are not without fault but they are leagues better than stocks in countries like India and China.

Oh and to add on to another excellent point you brought up - Indian regulations are unstable and change on a whim. India’s government recently proposed subjecting long term debt holdings to tax, a move that is widely criticized.
Cost saving measure. This sort of emotionalism is why engineers need to kept out of the C-suite.
> Books are under control, children can not enter a library and get Adult books.

What kind of dystopian library do you go to? Kids can get what they like where I am.
Even NYPD cops themselves can't do much about it: Here's one guy who tried to blow a whistle on his PD:

https://en.wikipedia.org/wiki/Adrian_Schoolcraft

The very people who were in charge of investigating police conduct reported him to his superiors. And then his own colleagues raided his house and forced him into involuntary confinement as an "emotionally disturbed person", handcuffs and all. The cops who delivered him to the psychiatric ward intentionally lied and misrepresented the whole thing to make sure that he remained confined and restrained.

Luckily, the guy had two recorders running during the raid, and the cops only found one, so there was ample evidence. I actually wonder if he'd still be in psych ward if not for that.
financial services, for speculation, is the biggest industry on the planet

saying “no use case” and “speculative” in the same sentence is always hilarious, yeah, service the speculators

its financial services and entertainment, the latter of which is also a big sector and valuable to humans
LeBron doesn’t get $84 of value from Twitter? Definitely not a political statement going on there.
I very nearly bought a heat pump for my house to replace (or augment) my natural gas furnace, but was dissuaded by the salesperson.

He who pointed out that, while heat pumps are miracles of efficiency, the electricity in my area is primarily generated by burning fossil fuels such as coal and natural gas. Due to transmission losses, it is cheaper, efficient, and greener to combust natural gas for warmth directly than to burn it at a power plant, feed the power into the grid, and use grid power to run a heat pump.

Of course, running a heat pump allows you to take advantage of greener power sources when they become available, but his claim was that in a lot of places they don't really benefit the environment right now. Anyone have any numbers to back this up or refute it?
> since my mother couldn't keep her mouth shut, somehow this information got leaked to the family tax consultant, resulting in a police search of my office, and a mandatory visit to a police station almost an hour away. this kind of stuff happens regularly.

Why ? is it illegal to do taxes online in italy?
One user said they got it ask
for help by having a prompt asking it to ask some, but not too many clarifying questions.

With the instruction tuning it feels like model really wants to single shot respond vs. do a back and forth. So like a junior engineer who does ask for help you have to give it a hand.
An Unstable US Threatens Canada’s National Security
Usually (and in almost all cases) the world follows the US so will be not surprised when governments will completely ban crypto into the dark web.
Nikole Hannah-Jones has a degree in African American Studies, so I think the label is perfectly apt. It's like "supply-side economics." It's a useful label for political ideas that are adjacent to an academic theory of the same name.
This would piss me off enough for me to start an advert-free audiobook pirating ring. And I suspect a lot of people would want to participate.
This isn’t existential for buying a GM product (I could probably just replace the head unit?), but for a rental, I’ll have to avoid GM EVs. Being able to rent basically any car on the lot and just have CarPlay work, with the only question being USB A, USB C, or wireless, is pretty nice today.
No kidding. I worked for a company that had multiple billions of dollars invested in a data center refresh in North America and Europe.
this alongside the ban on lab grown meat[0] and the recent proposed ban to use english words in government documents[1] is just proof on how antiquated and backward looking the government is. so glad i left almost 10 years ago.

[EDIT]
the privacy regulator is independent from the government but elected by the parliament every 7 years. nevertheless this is a testament on how in general, regardless of political party, the situation is at the moment and for the foreseeable future

[0] https://www.bbc.co.uk/news/world-europe-65110744
[1] https://www.open.online/2023/03/31/rampelli-fdi-parole-stran...
Why I’ll never work for intuit
Modeling of the molecular architecture and dynamics of the SARS-CoV-2 envelope
NYC in the late 70s had a major branding problem. It was widely thought of as a dying, crime-infested shithole (https://www.nytimes.com/2015/09/10/t-magazine/1970s-new-york...) Like per the 1975 headline "[President] Ford to City, Drop Dead".

Making it t-shirt worthy to say you loved NY was a major turnaround for the popular image of the city. No one thinks it singlehandedly saved NYC, but it's one of the most famous ad campaigns ever for good reason.
I think this is a good example of deep conceptual understanding, I suspect if you posed this same problem to adult humans (e.g. me) they wouldn't be able to do as well.
Coupons were just a means of identification; Groupon was supposed to be a way to organize bulk purchases by groups of people who didn't know each other. Investment turned it into a way to trick businesses into thinking that making their main product a loss leader was a wise choice.

Really the social networking version of a buyers' club.
That wasn't the same, clicking the sparkle button still included a lot of recommended tweets. The only effect was that it made the timeline chronological and included all tweets from people you follow.
We don't need to speculate on this. It sounds like he did actually fire engineers over his tweets getting less engagement than he wanted.

https://www.platformer.news/p/elon-musk-fires-a-top-twitter-...
… in layman’s terms they developed a theory of why the virus has the shape it does.
The only upcoming rocket that could disrupt Falcon 9 is SpaceX's own Starship.
Tesla's infotainment systems are in a whole another category from whatever the other manufacturers are attempting.

That being said, not supporting CarPlay (and Apple Maps) is a big factor of me not buying a Tesla.
I'd like to echo the GPT-4 sentiment.

Having used the API a bunch, the ChatGPT API (GPT-3.5-Turbo) feels like it has a 10-second attention span in comparison to GPT-4. GPT-4 is waaaay more powerful for actually building stuff on top of, adheres to your prompt in a much more stable way, and its reasoning is way less unstable in general as well. Writing long blocks of code without making "stupid" mistakes works much much better, etc.

The only downside is: it's so, so, soooooo slow in comparison to GPT-3.5-Turbo. You'll literally have to wait 2-3 minutes for the response with larger token amounts.
Right, that's why I say I understand what chasd00 is saying. I happen to disagree -- I think it matters quite a lot.

Even ignoring philosophical arguments, it matters to me on a personal level because I consider people to be important, and want to interact with them. If I'm talking to a machine that I can't tell isn't a human, then I'm accomplishing nothing of importance and am just wasting my time.
Uh, my Honda's factory radio is literally an Android device.

It happily allows CarPlay from my iPhone.

CarPlay is (very roughly) the phone pushing video to the car's head unit like it's an external monitor (with a UI tailored for the size/location/usage of a typical car display).
there may be a hint of which elections were of interest:

https://github.com/twitter/the-algorithm/blob/7f90d0ca342b92...
It returns factually incorrect data, and it returns code with subtle but important errors if you ask it anything that's not regurgitated a thousand times in the training dataset.

Don't get me wrong, it has emergent properties (more than you would expect from a fancy autocomplete), but factual output was never GPT-4's nor any other LLM's design goal.
I think it boiled down mostly to fear of being compromised by the CIA/NSA vs fear of being compromised by a mildly competent attacker while using an insecure "Made in EU" provider. Practically speaking: the first one winning against the latter is really of no use.
Using GPT-4 and a SaaS framework to launch an MVP in 2 days
You FAANG background doesn't impress me. I need colleagues I can count on, who make themselves an expert in what's needed in the moment. If you can demonstrate that from your projects, wherever you did them, I look forward to working with you.
I think around mid February https://www.theverge.com/2023/2/14/23600358/elon-musk-tweets...
Have you tried bigger models? Llama-65B can indeed compete with GPT-3 according to various benchmarks. The next thing would be to get the fine-tuning as good as OpenAI's.
> Looks like those remaining at Twitter have a knack for corporate survival.

If Green Cards quotas suddenly became available how many would stay?
I think you're talking about this?
https://viper.cs.columbia.edu/
This is the first step… any thoughts on step 2? How many steps until advance notice for API changes?
It would be ok having sane timeline for heat pumps conversion for coming decade. But now it’s fascism just telling, that no gas furnaces anymore starting next year. There is no plan, there is no strategy. Just pure ideological nonsense. Close nuclear power plants, ban gas furnaces. Bun coal and run heat pumps on coal power. Great plan!

Edit: and yeah, I just lost €100k tonight. That’s rough sum for house insulation, ventilation system and heat pump installation.
> everybody is supposed to work on "responsible AI" while nobody can really say what a "responsible AI" is really supposed to be

In my opinion, "working on" responsible AI at this stage is synonymous with figuring out how to actually define what that means. Part of that definition will emerge along with and as the technology evolves. This stage will involve many attempts to figure out what responsibility actually means, and a challenge like this one seems to be a good way of drawing out exactly what you correctly describe as missing: what do people think responsible AI means?

I share the frustration that we don't have human alignment on this, and that such alignment is required, but to achieve that, people involved need to start putting real thought into formulating some notion of what this means, because even if we don't know if we're currently in the right ballpark, we do know that the failure modes can be catastrophic.

Human alignment is not something that will happen without major/messy disagreements and conflict about what responsibility actually entails. And to have those disagreements, companies building these products need to start standing up and staking claims on what they believe it to mean.

So in my view, what Mozilla is doing here seems like an important piece of the puzzle in this moment where what we need most are opinions about what safety entails, so we can even have a chance of moving towards alignment.
I'm supposed to be going out in 20 mins....
I'm not sure what use case is a speculative pyramid scheme like crypto, where there is no intrinsic value at all.

It is a morally repugnant gambling speculative vice which destroys lives and is even worse than fiat.

Not to mention Bitcoin and the like burning the planet trying to solve useless puzzles.
Too bad DEXs can't actually get money into the ecosystem, they're only about swapping one funny token for another.
>It's an opportunity for an Italian company to create a model and grow in this window of opportunity. Italy has great engineers

nobody is going to invest a dime in a country where regulators and government are against anything that is "new". it's just not a place for new business or tech overall. it's a very hostile environment to be operating in
Ignoring that I don't agree with you, don't you think the current financial system is a complete mess? From the technical side to the trust side.
Interesting blog but the extrapolations are way overblown. I tried one of the 30bn models and it's not even remotely close to GPT-3.

Don't get me wrong, this is very interesting and I hope more is done in the open models. But let's not over-hype by 10x.
They wouldn't be able to. This conflict will explode because an unstoppable force (EU bureaucrazy) will meet an unmovable object (the GPT weights, where you cannot just surgically remove individual facts.)

If I could short LLMs in Europe, I would go all in.
The reason graph DBs exist is mainly to provide easier syntax for recursive queries (which aren't really recursive because they're tail-recursive, which means iterative rather than what most people think of as recursive).

Any questions?

It's not clear how one might make SQL syntax for recursive queries simpler. Clearly we can have syntactic sugar for "dereferencing" relationships, so one could say `SELECT child-->name FROM parent_child WHERE ...;`, and we could have aggregation `SELECT array_agg(child-->name) FROM parent_child WHERE ...;`, and `SELECT child--->name FROM parent_child WHERE ...;` to say "recurse all the way through the child relation", but if you want more than one column then things get tricky.
https://twitter.com/dril/status/831805955402776576
Three monitors turned black. Had to task manager out of it.
Squashing the commit history before releasing it was an interesting (and completely predictable) decision.
I’m in this boat. Living in California and seeing how far our tax dollars go (or rather don’t) us not inspiring
>We need the basics that deliver true equality, as I experienced growing up in the UK: free healthcare, good public schools, and good public transport. Maybe even ban the private options like they banned

To be fair.

You picked California.
Chicago , NYC, DC and I'm sure one or two other American cities have functioning public transportation.

The other two issues will never ever be fixed. Tbh if your quality of life was so much better in the UK why'd give that up ?
Good to know. The one Voron I've seen in real life didn't have an enclosure; I take it that isn't standard?

The X1 also prints ABS perfectly. I should remember to make a Nevermore filter one of these days, so I can take advantage...
> Responsible AI Challenge (impossible)

There, more accurate. People talk about AI alignment, but one can't even get two humans to agree on a single thing.
I'm confused, then why not just use your 'followed' feed instead of 'for you'?
Actually if I follow the conversation, the first person said “storage density matters”. The second person said “actually it does not because the energy gets recovered”. The follow up said “actually there are other reasons why weight is a problem.”

So the first person never set goal posts around efficiency, that was an assumption by the second person. The first person could always have meant that the collision risks from heavier vehicles are higher, while the second person misunderstood their meaning. No moving of goalposts here.
If you're hiring for a specific skill set it might be because you have a target you're trying to hit. In my experience purse strings typically open because the company has a new project they want to complete in N time, and need X additional headcount to accomplish the goal in the time required. If it takes 3-6 months to onboard someone, you might not get your new headcount fully onboarded before v1 of the project ships.
Spoiler - there isn’t.
I guess the issue I foresee is that many perp DEXes aren't available in the USA. Gemini is opening a perp CEX soon I think. May be the last bastion for smaller CEXes: having enough regulatory favorability/connections to copy DeFi until the music stops.
Yeah exactly this is why there’s hype. It’s the best model that you can use for free easily
Everyone should opt-out of Clearview AI here: https://www.clearview.ai/privacy-and-requests

Much easier for EU and California residents
I think this is directly related, furthermore, I think no company should take Apple's deal. "You build the car and screens...we use them to make money/get data instead of you". There's a reason CarPlay licensing is free.
I bet some partners backed out of the next-gen carplay too.

There's a good argument that Apple is the bad guy here too: Their restriction of iMessage APIs and App-data over Bluetooth makes Carplay (and in a like way, the Apple Watch) the only real choice for iPhone owners. One could say they are taking the whole industry over the coals with this lockout which allows them to have people pay them app store subscriptions. There is a running line that "Apple believes they own every dollar that is spent on your iPhone", with carplay, it's every dollar in your car too.
Thanks for the recommendations. I have concerns too, but it seems to me some are stoking fears for political and religious purposes. For example, talking about Golems and Sam Altman being Jewish to justify their antisemitism.

https://en.wikipedia.org/wiki/Golem
Ask HN: Should we be afraid of AI?
For someone who doesn't know much about AI, what would you tell them to get them better informed?

What's the good side, and the bad side?
Sort of. I know Tesla owners who've bought Bolts as secondary cars but would not otherwise be caught dead in a GM car. There are people who buy Corvettes who wouldn't consider another GM car. I avoid American cars at all costs but was still considering a Bolt before this news.
When your visa is on the line, you’ll do anything
Still smells to high heaven to me. Not the Elon part, I don't really care about that. But collecting metrics about "republican" vs "democrat" sounds like a particularly bad set of priorities at work.
Nowadays Kia and Hyundai target different segments, but quality is about the same. Kia also does more region-specific models, like the Ceed in Europe and the Telluride in US, while Hyundai seems to have a more global strategy where they choose what to sell from a portfolio of global models.
> But the underlying policies and models are almost entirely missing (there are a couple valuable components in [1]). Without those, we can't evaluate the behavior and possible effects of "the algorithm."

Haven't gone through yet, but yeah, if that's the case, all this is, is a glorified framework to plug your own in.. Not exactly what was promised.
There's no particular reason to believe anything about intelligence far greater than a human's either.

And there's absolutely no reason to imagine that current AI tech, requiring more training data than the whole of humanity has ever consumed to train on tasks that humans acquire in 5-10 years, has any chance to reach significant improvements in general intelligence (which would certainly require on-the-fly training to adapt to new information).
I would just use heat pump for convenience alone. Not having monoxide and NOx risks around the house is another one.