skysight-inc/HackerNews huggingface dataset:
Denial: That's ridiculous, LLMs are not conscious, they're just a glorified Clippy.

Anger: Stop anthropomorphising LLMs, that's a slippery slope!

Bargaining: Okay, if I agree that LLMs "understands" rudeness and politeness, will you at least tune it so it doesn't care?

Depression: We're doomed. Humanity is doomed. LLMs are going to be the end of human civilization as we know it.

Acceptance: Hi, WifeGPT. How are you this morning?
I've tried automations that call the api directly from Siri, but it's barely useful because it's only a single-question single-response conversation.
Thanks for the insightful write up. I was aware of the IN-US trade war, but I thought American companies would ultimately suck it up like they did in PRC where US goods like vehicles got slapped by heavy duties. PRC agri sector is also protected for national security and to keep 100s millions employed, not a voting block, but similar political considerations. Also won't buy US modified seeds. But they do buy a ton of bulk agri products, and farm equipment... when not sanctioned. Seems weird so many divested from India under similar circumstances. Mom and pop India farmers not buying enough John Deere or something? Indian consumers not projected to eat enough meat / buy enough US animal feed? New American attitude to trade? Or US lack of adeptness you mentioned?
There millions of musicians way more accomplished than me. But in no way do they stop me from enjoying noodling around with sound. Meanwhile, a lot of our most famous artists employ massive teams to helping them make tracks. Yet, still there are passionate creatives doing amazing stuff. I don't think creativity is over quite yet.
> Globalism prevent wars by making countries dependant to each others (Montesquieu Doux commerce theory).

He was wrong though, it appears, no? I mean one could argue that there would be more wars without globalism (I'd counter argue there would be less weapons) but one cannot say "globalism prevents wars" in general.
> Doing so creates conditions favorable to dehumanize and disempower actual people

This is the exact reason why that mentality is so incredibly dangerous. If "proper behavior" towards AI agents becomes something that is subject to (social) control, those agents become tools to control and oppress people. In the future, it will scarcely be possible to access any facility of life except through AI gatekeepers. If you are expected to treat them as anything other than tools that exist to serve you, you will end up serving them – and, by extension, their creators.
It doesn't have to be that dangerous to be scary for adults or inappropriate for children. I once went to SF Opera and my kid saw a guy brandishing a knife and muttering to himself. Why would I raise my family in this kind of place? I have never been to North Dakota, but would every place there necessarily have the same level of concern with homeless, street drug use, naked guys on the street, rampant theft? To be fair, most of Peninsula is pretty clean and safe, if only someone can afford the house prices.
I feel a lot like you do some days. I am really confused and anxiety driven about a lot of things since AI became the hot button issue. Not sure why this is being flagged and downvoted. It's logically fine. I'd rather hear arguments instead.
It does not exists (yet maybe)

Blink is an individual and does not represent a company (aka not google, not eleuther, not <insert VC company>, etc)

So he had to fill something up i guess haha

The idea of a foundation has been tossed around. So it may eventually happen

Also the RWKV project predates this paper by over 2 years - nothing is truely new and revealed today on this paper

Your simply just finding out about it now in a formal paper consolidating various things that was learnt in this project
CEOs are a cargo cult. The big ones started the back to the office frency to facilitate their layoffs and lower wages and the smaller ones follow because that's what they do.

On top of that, petty middle managers drink the cool aid because that's what they do. On top of that, a fully staffed office gives them that sweet, sweet feeling of hierarchy and importance.

In the meantime, the big shots will continue to offshore to Asia, Africa and South America. Startups can't do that because "remote bad". Cui Bono?
That's a really fun article, thanks.

Since it links to information hazards [0] it makes me want to write up my experiences with psychological damage, ethics, and how they relate to information hazards. Someday it'd be fun to write about.

There are some information hazards out there that are really, really deep, scary, and also funny, once you realize how easy they make it to e.g. manipulate people without using any of the typical tricks, or even to bring decades-old relationship problems to an end in a single conversation. (Or how they make it obvious that a powerful thing to do is let yourself talk...to yourself! Weird insights abound)

For example you can effectively direct people in a given context by identifying the cues they give you for the type of information-consumer they are.

Some people will read that and hear "leadership" or "NLP" but it's quite different.

For some it may be as easy as noticing that they talk or write in metaphor, or they focus more on "we" than "me" in specific ways.

This can then be mapped to a set of low-energy, high-stress perspectives that the individual values in different sets of ways. Once you tease out those ways...well, this is information hazard, it's the option of turnkey psychological damage in a very straightforward way, and it's a huge ethical thing.

I thought it was weird that I had to learn about ethics to get a certain certificate to teach people about personality typologies, but then it really hit me later on.

0. https://en.wikipedia.org/wiki/Information_hazard
Was thinking the same, heh. Better be nice to the AI, so I'm on the good list when it becomes Skynet or so.
I have seldom come across a casual sentence as chilling as "bone marrow that was watery and contained no red blood cells".
> Tons of successful companies have done this since long before COVID.

Have they? I can think of a small number of majority-remote companies, but none of them stick out as being wildly successful. Of course, being wildly successful is rare enough that it may not be solid evidence one way or the other.

> Perhaps it’s more tempting to blame remote work than to blame one’s own leadership, or whether one has the right team.

1) I'm sorry, but damn near every online meeting we spend 5-10 minutes waiting for somebody that has to fiddle with their AV setup. When people show up 5-10 minutes late for real meetings, management is going to have a chat with you for wasting everybody's time.

2) Not everything is software. For example, it's still stupidly difficult to replicate whiteboard interactions with online technologies. And if you have any contact with hardware, the lab is extremely difficult to replicate.

3) WFH is not heading toward more async, it's heading toward more sync. As someone pointed out in the comments, being forced to be on a call continuously for 8 hours is starting to become a norm. At that point, I'd rather be in the office.
I've taken a look at only a small portion of all the things which he's posted on his site. So I can't vouch for everything there, giving all the content of the site a wholehearted endorsement or not.

From what I saw, yes, it seemed quite solid, and doesn't misrepresent Theravada views.
Yeah... So I did that which is how I got it to begin correctly. This is what I mean though.

I'll say "get a list of Blah from the following document in Json format like this:

Example"

Then I feed the document and add a spot for the answer.

The model begins correctly. But usually in the middle of the Json list generation, it will veer off, and start hallucinating as if it forgot the document and the task. I'm happy to share specifics and datasets but this is a cross cutting problem.

Rwkv is able to answer my questions when I ask simple yes/no or classification. It's the listing that throws it for a loop. Transformers do not have the same problem. Both llama and gpt are able to maintain focus.

Also, do you know where I'd find information on how the current weights were trained?
For a fun dramatized look at mobile innovation a decade earlier, I can recommend the recent mini-series “Mobile 101” (also known as “Made in Finland”):

https://en.wikipedia.org/wiki/Mobile_101

It follows a group of Nokia engineers and managers through 1988-90 as the company tries to shed its conglomerate roots, is sued by Motorola for patent infringement, and one engineer secretly keeps alive his pet project to develop the world’s smallest mobile phone (an unimaginably light 275 g!)

I particularly enjoyed the contrast when the slick American lawyers from Motorola come to take depositions from Nokia engineers in the small depressing Finnish town where Nokia used to have its phone manufacturing operations.
When did the US invade Syria? How much of it did they annex?
Top of the line? When I started a year ago I was told to specifically not opt for the Windows laptops because they ship garbage HP units with 8 gigs of RAM as standard

Only to be then shipped a base M1 Macbook with 8 gigs of RAM anyway!
I missed this part but it makes even more sense now. The author only knows how to function like him and expects everyone else to function the same way. It reeks of immaturity and the inability to understand others.

This quote pretty much hammered in the last nail in the coffin. He has no idea how to run teams.
> through his obvious joy in teaching

He clearly is passionate about teaching. The way he respects his students and try to lift them to his level instead of bombarding them with maths. He's clearly here to teach and not select.

It's incredible the value we loose by having bad teachers. And my personal experience was that the higher you get in the educational system the worst the teachers.

For this, internet is a godsend and Strang was one of the earlier adopter of that medium.
You are colluding with your oppressors. I believe your attitude is creating a more dangerous and unfree world.

I guess there are at least two cultures of interacting with machines. I'm in the other one.
Gonna repost a reply I just made to someone else because I think it's generally a good message:

I'm actually sadder now that, based on your comment, you approach the world in such a transactional way.
The purpose of being polite in your interactions isn't just about what you get out of the interaction. It's also about what you get out if it.
I'm a naturally grumpy person. But as I'm getting older, I've been learning that even faking being nice in my daily interactions helps to make me feel better. Lower heart rate, better mood, better mental clarity. It's all incremental effects too and I feel better day to day than I used to.
Using polite language with an ai or even just a fancy predictive text model is still worth it, if only for yourself.
I'm worried about the opposite actually, us teaching ourselves a species that we can talk to someone with a human face in the very direct and rude way
I’m establishing an indie game studio and open source tech company
Additionally, the shuffle function (sequence.js) has quadratic complexity due to repeated copying of the input array. You could get a vast performance improvement by copying the input array and running the standard Fisher–Yates shuffle over it: it will both run in linear time and will not thrash cache as much.
> We propose a novel model architecture, Receptance Weighted Key Value (RWKV), that combines the efficient parallelizable training of Transformers with the efficient inference of RNNs.

Just to be clear to everyone: this is “use attention to train parameters, use recurrence for inference”

It’s a very cool idea and I hope we get more interesting approaches to inference, but attention is here to stay for training.
A universal undertaking is built in small steps toward a larger vision.

My gratitude to the Librarian seeking to establish a place for people to learn advanced topics, appropriately named a university.
Agreed and yeah he mentions that. I think he mostly just makes you familiar with DNSSEC because he sells AWS certification courses and it will come up on the Networking Specialty. The entire segment is only like 90 minutes so it’s not crazy in depth.
Some loss to fidelity? Our memories are hugely lossy, reconstructed at recall based on a bunch of concepts. It's great, but it's also very lossy.
I agree he did a great job designing his site. :)
Chomsky was contradicting Skinner's thesis, which was that children acquire language through reward/punishment mechanisms like in reinforcement learning.

What he showed was that children don't get nearly enough examples of language use to learn it from an a priori blank slate.

Thus, the way to disprove his argument would be to take a blank slate model and give it the kind of input a human child would receive, and show that it can learn to the same level as the human child. Ideally, you would also give it some language that is completely non-human and show that it learns that as well, to prove that nothing in its structure accidentally biased it towards human language (since part of the argument is that children always pick up a certain type of language that obeys certain rules of Universal Grammar).

Of course, we are very far away from any experiment of this kind, given that current models actually require much more examples of language than any human has ever been given for an entire lifetime. Which itself tends to lend credence to Chomsky's argument.

It's also very unlikely that Chomsky is wrong, given that all other parts of human and animal ability work via ingrained structures in the brain - look at how horses are able to run a few minutes after being born. So the right prior is that language acquisition, same as sight, spacial awareness, balance, movement, digestion, hormone balance, pain avoidance etc. is not learned from scratch by each newly born, it is only fine tuned based on an existing structure (which was itself trained by evolution of course, over millions of years).
Interesting explaination, for me objects can also hold a negative value, they take up space — both physically and mentally — and it costs energy to maintain them by keeping them clean and keeping an order with the objects around them. And I say that as a person with a ton of stuff.

Some close friends of mine are hoarders and I can't help but feel that hoarders have a hard time valuing themselves or their time as more important as the objects they hold onto and the time/living space it takes to keep them. The ones that I know definitly have a hard time genuinly loving themselves and a lot of what they do (including the hoarding) seems to deal with that in some sense.

Curiously hoarders sometimes have pockets of pristine order, be it some sort of hobby or their linux home folder, while other spaces are in a complete state of disarray.
I don't think the jury is resolved on whether colocation matters for success; if anything, it's more common that the most successful companies are forcing RTO (Apple and Amazon), and I doubt they're making the decision on a whim. Google is ostensibly 3 days/week, and Meta has hinted at better performance for certain categories of people (new grads and new hires) when in-office.

Lots of people live to 100 smoking cigarettes their whole life, but that doesn't make it ideal.
Posits seems to be better for 8-bit or even 6-bit. There is only one not-a-number place, the NaR (not a real). This means for 6-bit posits you have 63 points in the number space.

https://en.wikipedia.org/wiki/Unum_(number_format)#Unum_III
>why do you need a Google Drive when your ChatGPT can also store files for you?

If the idea is to keep the actual files rather than summaries, than there's an entire world of requirements (data storage reliability, access control, auditing, integration) where OpenAI etc. have no competitive advantage, and their own issues (e.g. prompt injections). LLMs are a bad fit whenever you need it to act like a computer, they replace human style processing. For math, get a calculator.

In this case, I'd expect some way to interface to OneDrive or maybe even BackBlaze.
Nah dude, sifting flour totally makes better pancakes. They rise so much easier. I'm sure it helps for other baked goods as well
Anyone growing up in that era should have fond memories of arcade games that were far better than most NES games — there were still real arcades while the NES was current.

However, try playing the first level of Super Mario Bros on original NES hardware. The game mechanics basically still hold up.

All Atari 2600 games were worse than NES games, and primitive as anything. But try Breakout with paddles on an original 2600; again, the mechanics are good and it’s fun, at least briefly.
I honestly have no idea what you're attempting to say here. Please explain.
Terrible analysis, hand waving, no evidence given. The author has lived in SF for years and years.

"More money is raised in SF!" At one point the richest city in the US was Detroit. The innovation hub was the cities around Lake Erie: Detroit, Cleveland, Pittsburgh. Times change, SF well on it's way to being irrelevant. Besides, who cares how much money in total is invested in this county or that county. What is the probability of investment in your company is the question that should be asked. What talent can your company recruit (and afford) in this location or that location?

The author lives in SF. They feel like people at the company they run aren't 'getting enough done' and their solution is to force everyone to move to SF, where they happen to already live, rather than learn to lead a team and have some way to understand what people are doing and how long it is taking them to do it. This is the kind of founder who's first hire is a junior engineer and second hire is a PM, and then they wonder why nothing gets done. I wish I could short this company.

Love the extensive quoting of Mark Andreessen about why it's so important to be in Silicon Valley in 2007. What was important in tech 16 years ago is no more relevant now than Windows 3.0 (launched in 1990, 16 years prior to the blog post) was to Mark Andreessen in 2007 when he wrote that blog post. Doing little blog research projects is a way better use of a CEO's time than, say, figuring out how you are failing to do your job and as a result employees aren't productive.
Would it be possible to just use the exact same dataset as LLaMA? (There's an open source project currently training a transformer on exactly that).
Is there a reason why it must do that for like 2 minutes, while making horrible loud noises? Why can't it just fake-print some small image?
From a TypeScript dev perspective, there's just not enough (or any) tooling support compared to TS to justify switching to it. It doesn't seem obvious how it would work with eslint, jest, webpack/vite etc.

If people are not using TypeScript, then odds are they already made up their minds about typing in JS and will be even less likely to switch
Beers, Video games and Lunches aren't doing work. You aren't working 12 hour days if 4 of those are getting drunk at the bar.
I've just started another week of 14 hour days, working 100% remote from a different continent. My productivity is 200% what it was in the office. Even less busy periods are more effective from home.

A typical 9 hour day in the office was broken into 2 team coffee breaks, meetings, lots of distracting conversation and a feeling of low productivity at the end of each day.

Having said that, OP is in an extremely competitive space and appears to be building an AI tool, similar to recent features in Office and G suite, so it makes some sense to steer the ship together and focus 100%.... But they're going to take a hit in the short term, getting everyone to relocate, replacing people who don't move, onboarding etc. Seems like 2 steps backwards to me.
Related:

Why do recipe writers lie about how long it takes to caramelize onions? (2012) - https://news.ycombinator.com/item?id=27632835 - June 2021 (299 comments)

Why Do Recipe Writers Lie and Lie About How Long It Takes to Caramelize Onions? - https://news.ycombinator.com/item?id=8262889 - Sept 2014 (4 comments)
That’s a somewhat strange logic “cars keep getting bigger, losing us as many as 10,000 parking spots, so we’ll charge them by their weight”.

That effectively is an (small) incentive against going electric for car owners.

Aren’t length and width of car models as readily available as their weight? Or do they already have another tax based on car weight at borough level, making this simpler for them? Or is there a second argument this article doesn’t mention that heavier cars cause more road wear? I don’t see how that would be the case much for parked cars, though.
You realise you’re making these comments on a platform that bans hate speech, right?
This is cool, even though I haven’t managed to use the monthly 1k searches from the early adopter plan yet.

I have used Kagi for the last 4 months and I’m happy with the experience. The results are good enough that I rarely fallback to Google, even for searches localized to France.
Oy. Can we just admit that some people like remote work, some don’t, and let everyone self select into the appropriate employers? Does anyone ever get anything new and useful out of the comments on posts like this? It seems like they just turn into the same ‘you’re wrong’, ‘no, you’re wrong!’ back and forths that are devoid of anything of substance.
Maybe being banned is a good signal that you should stop being an arsehole?
Assuming everyone is in the same or close timezones.
I recall reading somewhere (I think in a text about Buddhism) that you should show appreciation even towards plants and inanimate tools, not because these things are living and need it, but because what it does to yourself. Instead of being a lonesome ruler surrounded by inanimate servants, you are grateful and the world becomes a bit more magical.

That doesn't mean you should anthropomorphise your tools. I think there are real dangers in misunderstanding what ChatGPT is capable of and what not. But if you say hello to your plants, or apologize to your car when you mis-shift, it creates an emotional connection. And you'll tend to treat your car better and feel more balanced yourself.
As competitors to OpenAI emerge, I think an obvious advantage would be response-codes for any kind of canned (non-completion) response.

"I'm sorry, but as an AI language model I can not do X, however" --> R982352.

You could also do that for requests. Because the requests will be parsed anyway, you could maintain a library of pre-parsed/tokenized requests for your user account and then not waste tokens on sending them to the API.

"You are a polite customer service agent who seeks to calm the customer and make the customer happy while prioritizing the needs of the company." --> S09438523.
> One thing this kind of pattern actually does is expose the conversation to more of YOUR psychology and perspectives. You expose it to more nerves to tickle, let’s say. Or in effect, you are giving the AI more of your brain’s surface area to work on

Conveying and interpreting "mood" correctly is the most difficult part of human to human conversation. It has a huge impact on how efficiently "the message" is communicated.
Recent and related:

Reddit Data API Update: Changes to Pushshift Access - https://news.ycombinator.com/item?id=35776848 - May 2023 (16 comments)
Chen is a marvelous writer. Punchy sentences replete with wisdom.
Actually, there are several enforcement actions which mention the CLOUD Act.
https://gdprhub.eu/index.php?search=%22cloud+act%22&title=Sp...
The reason iMessage has been successful (and RCS has not) is because iMessage doesn't have any reliance on the carrier. Selling a messaging system to carriers doesn't make any sense, why cooperate with them when it's easier to route around them and handle all the messages through your own infra.