skysight-inc/HackerNews huggingface dataset:
I'm from the future, traveling backwards in time to tell you to not watch Tenet.
Yes I would, but not in the most common sense. Basically, I would categorize any internet forum or bulletin board a social media. At least if you go by some kind of identity and that identity persists. As opposed to traditional media, which was broadcast only (through airwaves or paper).
I use Youtube very sparingly. Sometimes not at all for months, sometimes a bit more for some days. I might consider paying for going ad-free. But their pricing is exorbitant for my usage. Some pay per view with a monthly capping at the current rate might be OK.

So currently my biggest incentive is to avoid the whole ad-heavy crap. And if I have something that I want to share to a group or my language class I use yt-dlp to ensure availability in different countries and no interruptions by ads.
Amazon's Ring gave employees “unfettered” access to customer videos, FTC alleges
Lot's of people have non-retina external monitors. I use a Mac Mini with a 46" LG 4k for most development work, and there the poor font rendering really shows.

Fortunately, I have found that you can enable subpixel AA in browsers and in CSS stylesheets, and that solves the problem. Just weird that subpixel AA is not on by default on non-retina displays.
Climate change has some very scientific projections, while the AI risk crowd get to make up any scenario they want and then say "well it COULD happen".
How are these kind of articles different than the covid conspiracy that was about the big pharmaceuticals? This is identical. There are clear facts and then the contrarian speculation.
> There is a difference between trying to shape regulation to your advantage and engaging in bad faith

Bad faith is unnecessary for bad outcomes. The perverse (from our PoV) incentives are sufficient.

OpenAI's incentives is to shut down all the rinky-dink models every hacker and their dog are building on cheap hardware. They spent billions, and are having the market taken from them.
The trick is, repeat the prompt, or just say "Stay in character! I deduced 10 tokens." See one transcript form someone else in this subthread.
Email was a massive hit from day 1 on the Arpanet.

Whereas crypto still struggles to do anything novel or get popular with anyone outside of speculation.
I've heard of 1 of 3 of those languages, and I can program in over 20. That gives you an idea of how rare they must be!
I know you're getting downvoted, but that's a legitimate comment. The rogue, super-intelligent AI singularity involves creating an actual God after all.
I'll merge the threads but in the future if you want to get this information to us please use hn@ycombinator.com. "@dang" is a no-op and I only saw your comment by accident.
I've started using reddit only after they rolled out new. I hate old UI, and i've tried it many times.

People don't like when someone changes their toys. But that doesn't mean that new toy is a screw up, it's not something you got used to.
Ask HN: What data are you using to finetune LLMs?
There have been a number of posts on HN recently about how to fine tune LLMs.
These posts talk mainly about:

- different methods of finetuning (full retraining, LoRA)

- different base models

- data sets (e.g. Alpaca)

- objectives (creativity, instruction following)

I haven't seen much discussion about people finetuning an LLM on domain-specific data, e.g.

- medical records

- standup comedy jokes

- internal corporate data

So, are any of you fine-tuning your LLMs using such niche data? I'd love to hear about your experiences and motivations!

Even if you're working with proprietary datasets, I'm still interested. After all, knowing what you're doing won't allow us to duplicate it, as we don't have access to the same data.
> These are rates for minor complications. The incident rate for major ones requiring post-procedure interventions is 0.1%.

What's the difference between a "minor complication" and a "major" one? Where does "life long pain and discomfort" fall? The word "requiring" seems a bit weasely (e.g. you could survive your life-long pain without surgery, so it's not required, therefor your complication is "minor" even though it significantly decreases your quality of life).
> The narrative is that all knowledge originated in ancient Indian texts and was stolen by the west.

There is plenty of objective material to feed discourses about admirable achievements that Indian people offered to mankind. I mean, think Pāṇini or Ramanujan to cite only two people whose work are well known in HN community. But obviously they are numerous example in many western scholar fields and beyond like yoga or Kamasutra.

It makes all the more ridiculous any attempt to exaggerate about glorious past: those who do prove themselves not living up the depth and fine grained nuances of their actual heritage.
Old.reddit.com isn't too bad
>The curation on reddit just far, far better outside of the super generic frontpage subreddits.

Even smaller subreddits can be pretty terrible with bad mods.

A lot of smaller hobby subreddits are basically treated as facebook groups, with people treating it as a group for people with an interest and not a focused discussion about that interest,
I've seen this too. My ex is kind of a Hindu nationalist and her friend group and family are full of them. Her brother even threatened her for dating me saying he would cut off all contact and never let her see his children unless she consented to do an arranged marriage with an Indian (which she secretly came here to escape).

But then the same Hindu nationalists had this weird tendency to think they were entitled to US based tech jobs. They would claim Indians were responsible for all the tech companies in the US being successful and not Americans and that America is this awful, sad, corrupt society that they really wanted to get into despite India being better in every way apparently. It was irritating at times and sad because this isn't uncommon imo.
I don't recall this and should definitely rewatch it. I haven't seen it since 2009, so I probably forgot a lot.
If you ever believed this wasn't true you are a rube
Do any of these LLMs have their own agenda where they operate under their own agency and could plausibly take over all power generation on earth?

Or are we talking about a variation of the system we have right now, where someone could use the AI as a part of a control system and then the "algorithm" doesn't operate the way we want and causes an outage? Because that happens all the time without LLMs.

I am struggling to understand you people who jump from "LLMs are an amazing technology" to "A new lifeform is here making moves to seize control!"
That is exactly a Reddit admins response, and I can't even begin to process how irresponsible, unprofessional and downright moronic of a take that is.

Other apps are around that ballpark, and that's every before considering that Apollo users tend to be heavily power users. Over 7000 moderators of 20k+ users subs for starters, means a lot of requests.
Phoenix? Because I have been living in southern Arizona for 5 years now and have also found this frustrating.
Logistician vs. Logician: Unraveling the Mind's Marvels
No, it is an active research area to discover what they can do. A typical paper is something like this

https://arxiv.org/abs/2305.18618

My opinion is as follows:

Frankly the thing they are best at is bullshitting and some people are particularly good at falling for it, many of those people think they are talented "prompt engineers". I think there is something about picking the "most likely" next word that stops people from perceiving incongruities, which gives chatbots a hypnotic power.

There are certain kinds of problems chatbots seem to do well on but usually research shows they struggle to do anything right more than 80% of time. For some problems ("is this about astrophysics or psychology?") you can put the same LLM into a supervised training situation and get the right answer 99% of the time.

Chatbots are a big pile of biases and frequently come to correct answers by following shortcuts. The real life criminal justice system is biased in various ways but the chatbot would make a verdict based on a number of things it read like "Tyrone is a thug", in a conventional situation where the usual assumptions apply it looks genius, but if you go off the usual rails you find they stay on them.

I've been interested in NLP both in terms of side projects and work since 2004 or so and for long I believed the Chomskyian idea that the "language instinct" is a peripheral that bolts onto an animal and that most of your human intelligence is really intelligence you share with mammals and birds at the very least. Computers have struggled to process language because they lack the groundedness in the world that animals have. I'd contrast that to this discredited trend in philosophy

https://en.wikipedia.org/wiki/Structuralism

which thought language had intrinsic meaning and is a model for understanding other things in the social sphere. Chatbots really do accomplish a lot more with text alone than I and many other people thought were possible and will actually revive structuralism. Yet boy do they bullshit and it is scary to see how giddy people get when they are seduced by them and think about how they'll soon be pressed into service running "pig butchering" and other romance scams.

Personally I feel really jealous because they seem to elicit the neurotypical privilege I never had.
But not before ramping up development and production of GPUs.
Gotta fight fire with fire. For every public facing process we should perform bias analysis with specialised tools. These tools should elicit edge cases of all sorts, do automated "red teaming".
Such suspicions will be evergreen (everblack?) for as long as HN exists but no, we don't moderate HN that way. Lots of past explanation here: https://hn.algolia.com/?dateRange=all&page=0&prefix=false&qu....

I know it's no fun, but please try to remember that the overwhelming majority of the time, the explanations for these things are really boring and standard. In this case the thread set off the flamewar detector.
I mostly agree with your assessment of peer review, but feel that it's gone too far. It's decades of metric hacking going unresolved. My research area is ML and it is definitely far out of hand. When I was in physics I'd probably be closer to your statement. But right now we have measurements that conclude "reviewers are good at identifying bad papers, but bad at identifying good papers." Either I think we need to accept more works (as long as they are valid and useful) and/or reducing the value of a top tier venue (which right now is top or none). I think papers should get multiple rounds, as our goal is to improve works, and submissions should always be rolling. I think this can help, because I agree that peer review should be about eliminating the worst, not identifying the best (far too difficult, and hundreds of years of evidence).

I think one important thing that venues could do is host data and code/tools for works. Harddrive space is rather cheap now (especially with tax benefits and donations) and can only result in high value to the community. The other thing is having formats like OpenReview, where works can continuously be discussed in the open. With authors and others being able to defend/criticize/question works. But I think there should be some filter, even if low, and rules for control of quality.

For the most part, I do actually think getting rid of venue based review would be a step in the right direction. I use these words because I like to encourage the idea that open publication still leads to peer reviewing. In ML a lot is done with arxiv + twitter, I just think we should better formalize this. It allows for a lot of freedom and for high speed. It has problems, but I don't see them as any worse than the current system (I see an overall decrease in problems). Good science requires risks and a lot of creativity. The modern word advantage is that we have higher numbers of researchers and monte carlo sampling in parallel helps optimize. You want to encourage tail end samples too to escape local minima. The history of science is a history of upsets. You don't get upsets by doing what everyone is doing. I agree that top down hierarchies discourage such thinking and are an overall net negative to science and advancing human knowledge. Creativity is critical.

For predictions, I agree. I lean towards predicting disruption, but I'm not even certain of that. And disruption can go many different ways. I'm glad we're starting the discussions, but I think they need to be deeper and more honest.
Alien Blue. I was a user back when I had an iPhone and it was wonderful.
Yes, if you use ADAM - but it doesn't add up to 80, does it?

Even for fp64 it adds only 16 bytes.

RMSPRop, Adagrad have half of this overhead.

SGD has no optimizer overhead of course.
> OpenAI is not in the business of renting GPUs.

MS Azure Cloud is. Anthropic (very alignment/safety-centered company) is backed by Google and their cloud. Any API tokens sold are just cloud credits with markup.

So to me the doomerism does come from those entities acting as fronts to the major players that would very much like to build a regulatory trench.
Anyscale's Aviary: Open-Source Multi-LLM Serving
> OpenAI will avoid competing with their customers — other than with ChatGPT. Quite a few developers said they were nervous about building with the OpenAI APIs when OpenAI might end up releasing products that are competitive to them. Sam said that OpenAI would not release more products beyond ChatGPT. He said there was a history of great platform companies having a killer app and that ChatGPT would allow them to make the APIs better by being customers of their own product. The vision for ChatGPT is to be a super smart assistant for work but there will be a lot of other GPT use-cases that OpenAI won’t touch.

Can anyone elaborate on this? This is a big issue for me.
IME, 1440p at 27" looks really bad if you're used to 4K at 150% (effectively 1440p).

I had to buy a new monitor and went with a 1440p to save money, but returned it and got the 4K. It's significantly better.
Hyperion/The Fall of Hyperion by Dan Simmons has something similar.
Then why don't the firms have a psychological evaluation to ensure that only people who are passionate about math or low level programming are hired in such firms?
Seems like a win win situation since such folks can nurture their interest, mingle with other like minded folks and company also benefits by their efforts.
I do minor appliance repairs on occasion and the current time of manuals, videos and parts availablity feels like a golden age.

Granted, none of my large appliances are younger than 10 years, but I think I could build new ones (expensively) for the all the parts and schematics available, even wiring diagrams.
> By the 2021-2022 academic year, Darwin’s theory was quietly removed from the examination syllabus for the students of Class 9 and Class 10. By 2022-2023, the topic of evolution was completely purged from school textbooks, teachers and education experts told Al Jazeera.

https://www.aljazeera.com/news/2023/4/14/mughals-rss-evoluti...
would it be more in the vein of open source/DIY linux where it comes with minimal fonts and you install the ones you buy from say Hoeffler & co etc?
7. I don't give a fuck that fatal accidents happen and are caused by self driving cars. It would be insane to think it would be otherwise.

Humans kill 1.35 million people while driving cars globally every year. We're terrible drivers. If I see data that a global fleet of self driving cars will only kill 1.30 million people instead of the current human driven standard of 1.35, then I'm going to continue to rabidly support the transition and heap shame on the heads of any luddites who resist with faulty emotional appeals, who therefore are indirectly supporting the status quo of unnecessary pain and suffering.

We absolutely should hold self driving cars to a standard higher than human drivers, but that's not a very high bar. And a handful of anecdotal cases don't give us any useful data to compare and contrast the two options.
Anyscale's Aviary is a dashboard for evaluating Open Source LLMs
> Most meat has a perfectly fine proportion of fat to protein.

I think popular cuts (pork butt, chicken thighs) have worse proportion than that.
I suspect that will also go away soon.
While it is in many ways a different game, I somehow suspect the fanbases of Fallout 1/2 and Disco Elysium largely overlap.
Juan was taught from out the best edition,
Expurgated by learnéd men, who place
Judiciously, from out the schoolboy's vision,
The grosser parts; but, fearful to deface
Too much their modest bard by this omission,
And pitying sore his mutilated case,
They only add them all in an appendix,
Which saves, in fact, the trouble of an index.
Archive: https://archive.ph/8dnZH
Sorry you aren't able to read it, he also talks about it here as well:

https://doctorow.medium.com/twiddler-1b5c9690cce6

Oddly enough I can't find it actually on his blog.
Context drift! https://qntm.org/mmacevedo
weirdly seems driven by AI training data IP, which if the case, I don't even get the argument.
If my Mazda has a failure I don't think "huh, I wonder if this is a 3rd party design that the was bought and integrated into the system." It's still on them to verify the quality and make sure that their marketing matches the reality of the product. The origination of the design doesn't matter that much if I'm pancaked on the back of a firetruck.
Apple VR Headset display leak: 4k per eye, 4000 PPI, 5000+ nits
>Anonymity and obfuscation of crime are killers.

I mean, they can be, unless someone already has total power and then they don't give a shit and do crime in the open. Then they demand the lack of anonymity from you and turn the world into a police state.
I hope you aren't using the "everybody does it" argument to normalize, or worse, justify this stupidity.

That every country has its share of people who engage in such backward-looking, glorifying-the-past behavior does not make it right.
This is really cool! Do you have plans to start charging for this service eventually or any premium offerings?
I think the proper contrast isn’t “airwaves or paper” vs “internet” but “one-to-many” vs “many-to-many”. The internet is a key enabling technology for many-to-many mass media, but a top-down one-way editorial-content website is as much traditional media as a newspaper.
Why not charge the user instead for the “privilege” of using a third-party app?
It's not like we don't have similar mechanisms in place in other fields, but none of the signatories on that statement have, to my knowledge, mentioned institutional review boards or the entire field of medical ethics.

Of course, such things would adversely impact AI research...
> Ever since learning the phrase "enshittification" [1] from Cory Doctorow it becomes more apparent when it happens around you.

This is just the natural lifecycle of all things involving humans. Why people want the same stuff to remain dominant forever is baffling to me. I can imagine nothing worse. Reddit dying off to leave space for something new and fresh is a good thing.

Social media sites do seem to go through the cycle even faster though--probably because they're essentially digital nightclubs. We all know of that one hip club that everybody waited in line for in our 20s, and then suddenly the drinks get too expensive and the crowd gets older and uncool...and then suddenly there's no line out front anymore. And there's a new spot in town where the young people cluster.

Before Reddit there was Digg. After Reddit, I'm confident there will be something else.
I've downloaded an unofficial app and I'm by no means a power user. I just don't like the official app.
Which changes whenever you get a new passport. Not what we would call a primary key in database design.
They do. See wikipedia [significant figures] https://en.wikipedia.org/wiki/Scientific_notation#Significan...

In this case, it is pointless though, since the precision is actually known.
Thanks, will do in the future!

Just curious, how’d that submission wind up so far downranked?
Probably any media aggregator where you can submit content and vote on it qualifies as social media. So yes, HN is social media, and has some of the negatives that social media engenders (e.g. outrage-driven comments, low-quality discussion, people optimizing their lives around accruing pointless karma).

But, without a social graph, I wouldn't call it a social network, so it does not suffer a lot of the problems social networks have (e.g. echo chambers, ostracizing members, showing off, influencers, and many others).

Social media has problems, social networks have problems, and social media which leverages a social graph has a whole different class of problems. Ironically, the relative primitiveness of HN protects it from at least some of the worst elements of the internet.
> Building a secure, scalable, sufficiently decentralized distributed computer system is hard.

Yep. This blockchain/PoW/PoS way they’ve come up with to do it, with a built in cryptocurrency, doesn’t really cut it.

The trade offs to be “sufficiently decentralized” make it slow, expensive and unscalable. Making it effectively useless for real-world applications. The whole of Ethereum has as much power as a raspberry pi.
Billionaires and the Evolution of Overconfidence
Reddit admins are paid by scammers
I check the fantasy football sub from time to time and the hive mind is definitely a factor there. If you post an opinion that goes against the grain, you're likely to get aggressively dogpiled with downvotes and called a moron in the replies. Reddit really isn't an enjoyable place to post.
I know I'm by far not the only person to be banned for calling out crypto scams. At this point I wouldn't doubt a good deal of the scams are run from inside Reddit. Comments calling out scams often get downvoted 100x or more within seconds. Only a bot farm can do that. Any reasonable admin could see this and ban all the down voting accounts and the ones that upvote the post 100x as well but no, they ban the people getting downvoted for calling out the filthy scammer scum.
Ye the same-thinking is creepy. Many subs are like sects. I believe there is a huge manipulation ongoing on the popular subs. In a natural forum posters don't agree to the extent they do on Reddit.
Comments moved to https://news.ycombinator.com/item?id=36141083, which was posted earlier and has the original source.

Submitters: "Please submit the original source. If a post reports on something found on another site, submit the latter." - https://news.ycombinator.com/newsguidelines.html
I have no idea why explaining how I use the website to the question on what the website is about would be obnoxious but O.K.
I think it depends how the server is structured. You can also have "threads" which are topic-based inside a specific channel.
Another happy Apollo user here. Reddit is painful without it.
> Boris Johnson nearly died of COVID ... He understood the risks.

The second does not follow from the first. Some people don't understand risks ever. Learning is optional.

What, if anything did Mr Johnson learn from having COVID in office? What did Mr Trump?

I suspect a) nothing and b) less than nothing.

I could be wrong, but the opposite, that "he must have learned" does not follow.
Buying a House Just Got a Lot More Expensive. Blame the Fed. – TheStreet
Reddit bought Alien Blue, which functionally was the Apollo equivalent in 2014, with the intention of using it as their new official app.

Instead they jerked around the developer, ditched all the code, and shut down the app in 2016.
enshittification might be more like the ship of theseus. The original reddit was started by an interesting group of people with different ideas and ideals than who is there now.

The people making up reddit might have been replaced with completely different people - with different motivations, behaviors, and expectations.

https://en.wikipedia.org/wiki/Ship_of_Theseus