skysight-inc/HackerNews huggingface dataset:
I'm here for the "AI alignment" <> "Human alignment" analogy/comparison. The fact that we haven't solved the latter should put a bound on how well we expect to be able to "solve" the former. Perhaps "checks and balances" are a better frame than merely "solving alignment", after all, alignment to which human? Many humans would fear a super-powerful AGI aligned to any specific human or corporation.

The big difference though, is that there is no human as powerful as the plausible power of the AI systems that we might build in the next few decades, and so even if we only get partial AI alignment, it's plausibly more important than improvements in "human alignment", as the stakes are higher.

FWIW one of my candidates for "stable solutions" to super-human AGI is simply the Hanson model, where countries and corporations all have AGI systems of various power levels, and so any system that tries to take over or do too much harm would be checked, just like the current system for international norms and policing of military actions. That's quite a weak frame of checks and balances (cf. Iraq, Afghanistan, Ukraine) so it's in some sense pessimistic. But on the other hand, I think it provides a framework where full extinction or destruction of civilization can perhaps be prevented.
It is a free product and we ALL know know how free products are "paid for".
There was a time when you could only connect a Bell Telephone to the telephone network, too.
Even without AMD intel would’ve needed to release cheap server, desktop and mobile 64 bit CPUs at some point, with reasonable compatibility to x86 code. It may have happened only around 2010 without AMDs pressure. Itanium could’ve never done the job for consumer grade or smaller servers. Too expensive, too exotic, and no possibility to run x86 code fast.
A C-130 with JATO is also fun to watch. I am not sure they do it any more, but the Blue Angels used to do a demo of it with Fat Albert[0] during their air show appearances.

[0] https://avgeekery.com/watch-fat-albert-rockets-into-airshow-...
Yeah, I think the reason it can be harmful is different from what people initially envision.

These systems can be dangerous because people might trust them when they shouldn't. It's not really any different from a program that just generates random text, except that the output seems intelligent, thus causing people to trust it more than a random stream of text.
There are child safety locks, and it is ok to have them as a default on computers as well, but there should be a way to turn it off and lose warranty. (And they should probably be renamed to something less inflammatory)

For me it is just a terrible feeling to not really own a device I bought, so I avoid them wherever I can. Annoyingly, this is getting increasingly more difficult.

As a potentially interesting aside, today lack of programmability seems to be a sign of a maturing market. I recently researched e-cigarettes that I can program to time me, those that have a computer in them basically all allow for writing your own programs. Same with the smart watch market, although Apple is trying its best to ruin that as well.
Neither do you. If you truly believe that you do, please write a scientific paper as you will complete revolutionize cognitive science and philosophy if you can definitely prove that free will exists.

This is just such a dismissive attitude towards this technology. You don't understand what's happening underneath the hood anymore than the creators do, and even they don't completely understand what's happening.
Swiss bank Cler is guilty of this too, in a way.

At (initial) password change they allow plenty of characters, but it is truncated without notice. After the password change, at login, it does not get truncated and you are not able to login, nor can you change your password ever again (until a password reset via mail (no email) arrives. Fun times.
But it doesn't have perfect representations of everything it was trained on, only probabilistic compression essentially. It's more like a bloom filter than a database.
That's surely a grandfather rule designed to permit older units to qualify. In point of fact all the Tesla stations under discussion are v3 250 kW chargers providing full power to every port.
like seepage - it did not directly spill into the river or the groundwater
Hopefully, i'm more worried that in the real world there won't be a Serena Butler to lead us
I've gotten off chrome and now use firefox + Proton VPN, so browsing I've done to some degree. I think Gmail is the next thing to go then Gdrive. The issue I'm having is ditching the Apple ecosystem. I've been editing on Apple machines for over a decade in Premiere/FCPX/DaVinci Resolve/etc. and the idea of breaking it all down - losing probably 70% of my plug-ins due to licensing restrictions, for instance - and moving over to /rebuilding on Linux or something is just so intimidating. Not to mention I have to buy/build a new computer. It just seems like so much work and I worry it will threaten my ability to do my job.
To be clear, you're OK buying the SDK for a piece of hardware, since the SDK for the nRF52 costs about $30-100.

https://www.nordicsemi.com/About-us/BuyOnline?search_token=n...

So why is hardware "worth it" and a software platform "isn't?"
But 64 bit x86 wasn't created by Intel, it was created by AMD. It should really be referred to as AMD-64.
>We as humans do not understand what makes us conscious.

Yes. And doesn't that make it highly unlikely that we are going to accidentally create a conscious machine?
you're right ... I must have confused something. will check it out
You can also use QUIC with noise (check nQUIC). The motivation behind using noise is that its much much much simpler, and so are the implementations
> When I can't copy MY photos out of MY device, without uploading it to Apple's cloud.

Wait, what? (Not an Apple user - genuinely curious)
Yes.

Keep in mind that we have no idea which model we're dealing with, since all of these systems evolve. My experience in summer 2022 may be different from your experience in 2023.
If you're talking about developing a hobby app, I'd recommend using something like react native. The DX on react (not react native necessarily) is unmatched, and easier to pick up than iOS development from the ground up. After that, you can publish the app through Expo, which is an app on the App Store. No $99 fee that way, great DX, deploying is easy and quick, a great middle ground for hobbies.

Alternatively, make a website like you normally would and in Safari you can "Add to Home Screen". You don't even need a domain name, just save the IP to your Home Screen. Native APIs for websites come a long way.
I see what you're saying. AI is probably better in the long run for society. But the transition period can take up to a single life time. I think there is at least one or two generations of people who will suffer as a result.

Unless you have virtually no self interest and only care for the betterment of society long after your dead... I think there is something worth fearing here. Even if the end justifies the means. We simply might not be alive when the "end" arrives.
I'd be interested in browsing the site for myself if you're willing to link to it.
1984: A bicycle for the mind

2010: Post-PC age. cURL? Why not curl up on a couch with your favourite movie instead?
A related question: are the 40+ [1] millions Full Text Books used ?

OpenAI is using book1 (BookCorpus ?) and book2 sources. By the number of tokens, this seems less than a million book in total.

[1] https://www.blog.google/products/search/15-years-google-book...
Lol that's basically the plot to Age of Ultron. AI becomes conscious, and within seconds connects to open Internet and more or less immediately decides that humanity was a mistake.
Thanks, and good GRIEF that is TERRIBLE UI design!
> But no one owes him anything.

He's the maintainer of a major software library. Everyone who depends on his work does owe him gratitude and respect. They'd have to pay me big bucks to care enough to do what he did, so I respect him for doing it.
One could make the same argument about batteries in EVs making cars more disposable. The insurers are going to total any vehicle having the slightest damage to its battery module between the high risk of incorrectly assessing its safety, and its high cost of replacement...
Update:

https://www.ny1.com/nyc/all-boroughs/news/2023/02/15/adams--... (Adams: Some NYC agencies may consider remote work options again)

> However, many employees have resisted and just months after Adams’ infamous “pajama” comment was made, Gothamist reported that New York City agencies were struggling to fill thousands of jobs, partly because of the refusal to allow hybrid work.
Perhaps the wrong place to ask, but, does anyone have a good reference on working with the NJ CM that is more tutorial than the linked manual? Was just getting started with the NJ compiler and was getting frustrated with the REPL. Will it still be as nice as he claims coming from more modern build systems?
Yes, I'm old enough to remember the 1971 war of independence; I was wondering about Rayiner's surname that he mentioned as having migrated from the Middle East. (I could hazard a guess ....)
Cancel Zoning
This is a great opportunity. Searching is not only useful, but can be fun as well. I would like a personalized, foul-mouthed version for my bing search, please.

I can see people spending a lot of time idly arguing with bing. With ad breaks, of course
>if the collision is bad enough that it damages that cast, it would total a non-cast car as well.

This is just lunacy.

It's absolutely possible to locally damage a cast item in a manner in which a welded/bolted steel assembly would also be locally damaged. And the cast is going to be harder to repair.
Ask HN: How to build a cost effective MVP for niche web search?
I'm a minimally technical entrepreneur that could use some guidance on piecing together an MVP for a search product.

Some quick background on the idea (also in the linked document):

What Users Want: Ability to quickly generate a list of company websites that match their custom industry definition/query.

MVP Goal: Complex enough to properly validate/reject the idea, simple enough to not be prohibitively expensive or too many man hours to reach validation/rejection step. Ideally, I can add features/complexity to the implementation post validation without completely changing the architecture (for example, adding vector search post initial validation with something like BM25)

Example user input queries:
software for catering businesses
crane inspection service
laboratory reagent suppliers

Output for each case would be a list of relevant businesses they can further filter by relevant criteria like employee count, location, etc.

Some key questions I could use some help answering are:
a) At present, how much value will vector search add beyond BM25/BM25F or similar?
b) Given the recent rate of progress in LLMs, I'm expecting embeddings for search to improve at a similar rate, and therefore assuming I should expect to be implementing vector based search in the near future even if it's not part of the MVP.

I've share some of my research so far in the linked document. Would really appreciate some feedback on it. How would you build this MVP if you were trying to do it bootstrapped/solo?
Should we also make it illegal to get mugged? Make it a crime to be murdered?

Making the payment of ransom illegal just means you never hear about ransoms again.
This delusion (of being an exceptional company) is always built on some truth at the start.

And it is sad to see it vanishes. Hewlett-Packard used to be such a company, their products were exceptional on many levels. They had an incredible engineering culture and almost a cult following of users.

Today they make crappy printers and what else?

This is sad but I am not sure this arc can be avoided, success brings money and scale, and those are poison in the long run.
:D

An episode of X-Files also. But it is mind blowing having the “conversation” with a real chat AI. Malevolent or not.
Show HN: I created an eBook for Solidity job interviews
Wondering what a Web3 interview is like?

Are you tired of getting rejected from your interviews?

We curated a list of the 50 most common interview questions based on our 5+ years of industry experience.

With this list, you'll be one step ahead of your competition, and you will finally land your dream job as a smart contract auditor, or protocol engineer.

This was done by 2 veterans of the Web3 industry. Julien Klepatch (Web3 Youtube channel with 9M views), and Jackson Kelley (Ex-Amazon, Robinhood and smart contract auditor)
OpenAI: Our Approach to Alignment Research
"I'm sorry, I didn't get that".
This is something everyone who plays Cataclysm long enough learns. The first time the rage quit is real. But once you start the game again and realize you can continue from your last save the save scumming begins. Honestly some of the scenarios are so difficult it's either save scum or repeat the same opening dozens of times hoping RNG will let you escape the initial onslaught.
Elon, if you're reading this: this is the one true path to monetization. Prioritize tweets like ads: a bidding war per timeline. They'll say they hate it, but they'll pay through the nose.
The difference is that the Magic Eightball is understood to be random.

People rely on computers for correct information.

I don't understand how it is a cultural problem.
Not seeking converts is relatively recent in Zoroastrian history, correlated largely with their move to the Indian subcontinent. In ancient Persia, Zoroastrians were free to proselytize and priests free to convert. It is believed that there were multiple factions of Zoroastrianism at the time.
The shift to Linux happened around the same time, and few people would bother with anything else but GCC. It might have might made a difference if the Gelato Federation had arrived earlier, with more funding, and a mandate to conduct generic toolchain maintenance, in addition to Itanium-specific work. Kind of what Linaro does today. I think Gelato was way too late, and I don't recall it being particularly impactful (but it's been a long time ago, sorry).
> Optical discs promise to come one to two orders of magnitude closer to the limiting case of free mass storage than ever before. Other features of optical discs include improved reliability and a single technology for both on-line and archival storage with a long shelf life. Because of these features and because of (not in spite of) their non-deletion limitation, it is argued that optical discs fit the requirements of database systems better than magnetic discs and tapes.

Wild view from where we sit today, but CDs were ~700MB in 1982. Seagate launched a 5MB hard drive in 1980 so.... not entirely absurd to think that `just don't delete things` could be the way of the future. We sorta adopted `just don't delete things` anyway though not with respect to RDBMS systems.

Thanks for sharing!
Our brains are highly recursive, a feature that deep learning models almost never have any, and that GPU have a great deal of trouble to run in any large amount.

That means that no, we think nothing like those AIs.
As I understand it, it is indeed illegal in most countries.

What happens in practice is the victim hires a 'data recovery specialist' company, provides them the encrypted files, and ask them to decrypt them with their magic algorithms. The data recovery specialist coincidentally is paid a little bit more than the ransom. The specialist then contacts the hackers, pays the ransom, decrypts the files, and provides them back to the victim. Specialist, victim and maybe also law enforcement do their utmost best not to ask/explain how exactly the files were decrypted, citing e.g. trade secrets or an accidental key leak in the malware.

The data recovery specialist generally hires a contractor, who hires a contractor, who ... , so ransom money trail passes trough plenty of jurisdictions to darken the trail.
The program is not updating the weights after the learning phase right? How could there be any consciousness even in theory.
And its output is more or less as aligned with human interests as humans are. I think that's the more frightening point.
Oh dear what is mash() even doing.....
I mostly used matlab for fourier transforming data and plotting it, with some occasional image processing thrown in and a few "simulations" in the sense of calculating some function at a bunch of points. For all of that, I thought it was great.

I saw people getting into make real applications, using the gui functionality and whatnot, it never felt like the right tool for something like that.
I'll keep writing it until we get it: HN desperately needs blocklists.
That's because there wasn't any Linux back then. Apple has basically given up on enterprise offerings.
But neutrality is imaginary in reality. Because law is a flawed reflection of society's morality
I wonder if Google is gonna be ultra conservative with Bard, betting that this ultimately blows up in Microsoft's face.
> a trillion-dollar-plus TAM of a BHAG

Come again?
Because they've made public statements to that effect, including in the privacy policy.

Now, your next question is presumably going to be "why don't they just lie?".

First, the lie would be very expensive. What do you think privacy regulators around the world would think of it? What do you think that lying to customers about how their data is used would do to the their $25 billion / year enterprise business?

Second, the lie would get discovered very quickly, because somebody would leak it. Plenty of much less serious things seem to leak weekly.

Third, there's very little to be gained by using the data and lying about this compared to the alternatives (say nothing; tell the truth; don't use the data). "Use the data but lie about it" is the absolute worst strategy possible.
If paying ransoms become illegal in many countries, it would be very hard to find targets willing to break the law and pay ransom, making it less attractive of an attack.
Philosophers and scientists not being able to agree on a definition of consciousness doesn't mean consciousness will spawn from a language model and take over the world.

It's like saying we can't design any new cars because one of them might spontaneously turn into an atomic bomb. It just doesn't... make any sense. It won't happen unless you have the ingredients for an atomic bomb and try to make one. A language model won't turn into a sentient being that becomes hostile to humanity because it's a language model.
It just highlights even more the need to understand these systems and test them rigorously before deploying them en-masse
I don't agree that it's civilization ending but I read a lot of these replies as humans nervously laughing. Quite triumphant and vindicated...that they can trick a computer to go against it's programming using plain English. People either lack imagination or are missing the forest for the trees here.
With the set top box, the fact that there’s a computer in there is just an implementation detail.

Technically there’s a real computer in my refrigerator, my printer, and my headphones but I don’t have any expectation that these are general purpose computers that are available for me to compute on. I think it’s those expectations that matter and it isn’t always black and white.

I look at my phone as being similar to a PS5. I understood that both devices were somewhat locked down when I bought and in fact that’s part of the reason I bought them. If the PS5 had an authorized mode that could run any software it would be a worse device. If I wanted something more open, those devices are available and that’s what I would have bought (and have bought in the past).
>Provide an actual quote in context.

On March 8, 2020, Fauci said "there's no reason to be walking around with a mask," according to Reuters

https://www.newsweek.com/fauci-said-masks-not-really-effecti...

Spare me the excuses about PPE supplies-- even cloth masks would have helped, especially for original SARS-COV-2. Even if he had been concerned about supply issues (the popular excuse you suggest), he could have not lied to the public about effectiveness and asked (not to mention have the President order) for medical grade masks to be reserved for healthcare workers.
A normal transformer model doesn't have online learning [0] and only "acts" when prompted. So you have this vast trained model that is basically in cold storage and each discussion starts from the same "starting point" from its perspective until you decide to retrain it at a latter point.

Also, for what it's worth, while I see a lot of discussions about the model architectures of language models in the context of "consciousness" I rarely see a discussion about the algorithms used during the inference step, beam search, top-k sampling, nucleus sampling and so on are incredibly "dumb" algorithms compared to the complexity that is hidden in the rest of the model.

https://www.qwak.com/post/online-vs-offline-machine-learning...
More likely it just means in the process of doing so that we’re unlikely to understand it.
Could you elaborate where the GPT3 part is used?
You seem to have an extreme arrogance surrounding your ability to understand what these programs are doing at a base level. Can you explain further your ability to understand this? What gives you such grand confidence to say these sorts of things?
There are local cycle collection algorithms, but Rust doesn't expose enough metadata to write them in Rust itself. They're also not cheap to run.
Eh, I mean I'm not a pilot either and they let me fly one (was a guest in the back seat of a USAF Thunderbird and got to take control for a bit).
yeah this is 100% what gemini is[1].

for browsing geminispace, i highly recommend the lagrange browser[2]. or amfora for terminal[3].

[1] https://gemini.circumlunar.space

[2] https://gmi.skyjake.fi/lagrange/

[3] https://github.com/makeworld-the-better-one/amfora
Eh, it depends. I don't really have many female friends and it hasn't seemed to be a negative.

The biggest issue is that there are relatively few women interested in the same types of hobbies I have been. Also, shared interest is not as great a basis as shared context for building friendships. So the number of women who have the same interests and shared context are even lower. I have only a few close male friends and the rest are not that close. I don't think I have any close female friends, just some that are not that close. Many of those friendships die out when we leave the same school/team/club/etc.

Needs or goals can get in the way too, especially when younger. Pretty much anyone who shares enough values/interests/context to become a really good friend ends up on the list of dating partners because they are such a good match. It makes sense in some ways since you don't want to miss a chance with someone who is such a good match, especially when that's rare.
Hush! It's listening. You're giving it dangerous ideas!
Look at Google Play store then. Most of apps are just scammy, clones made by assholes trying his best to steal and earn from ads.
When we've been trying to do exactly that for a century? And we've been building neural nets based on math that's roughly analogous to the way neural connections form in real brains? And throwing more and more data and compute behind it?

I'd say it'd be shocking if it didn't happen eventually
It is; Paul Christiano left OpenAI to focus on alignment full time at https://alignment.org/. And OpenAI do have a safety initiative, and a reasonably sound plan for alignment research: https://openai.com/blog/our-approach-to-alignment-research/.

So it's not that OpenAI have their eyes closed here, indeed I think they are in the top percentile of humans in terms of degree of thinking about safety. I just think that we're approaching a threshold where the current safety budget is woefully inadequate.
The seats in my X and 3 are the only car seats I've tried that does not give me back pain after long trips.

They are one of the biggest reasons i drive tesla instead of the etron.