skysight-inc/HackerNews huggingface dataset:
I share many of your concerns and frustrations, although I suspect what you're asking for their consider a moat along the lines of a trade secret, rivaled only by the collection of performance improvement techniques they've amassed in 1000s-10,000s of training runs, 100s of engineers, and (hundreds of?) millions spent on compute. People are hired and praised in the community for their skill in cleaning data.

A non-answer for you, but for curious others, [State of GPT] 10 days ago provides a through introduction to the process used to train, Karpathy speaking at a Microsoft event providing a deep summary review of concepts, training phases, and techniques proving useful in the world of Generative Pretrained Transformers.

[State of GPT]: https://www.youtube.com/watch?v=bZQun8Y4L2A
Sure, I own a few pine64 devices and an RPI4 too. I would like the raspberry PI community to synchronize on a manufacturer like rockchip for a while. I simply never see a useful broadcom chip in the wild that isn't in a RPI and the RPIs omit features I want.
"deadnaming" someone is enough to get you banned from a number of social media sites, or to have stories about the "deadnamed" censored from news sites.
Everything on the internet is ruined by "the phishers and spammers"

It's sad that we can't have nice things
"The researchers said the finding that pediatric COVID-19 transmission was negatively correlated with new community cases during most of the pandemic is consistent with that of a previous study."

They kind of incoherently try to explain away this, but it seems to run directly counter to their basic thesis. I mean, everyone who has worked in daycare or grade school knows that kids can get each other sick, so it would be surprising if it were different for covid-19, but this seems like the a significant issue with their data that is the more interesting finding, and they sort of shrug it off.

I may be a bit biased because I live in Texas, and we actually had the highest covid-19 rates when it was hottest, i.e. when schools were not in session, just like most of the Sun Belt.
I like this post so much. Not just for the suggestion per set, but for the underlining principle. We have so many dogmas: abstractions, testability, fat models, slim models, OOP, functional programming and so on. It all leads to obscenity.

We should keep the code inspectable, understandable and sweep the complexity under the appropriate carpet. We should use a responsible amount of abstraction.

Comparing a software to a movie, we should have the plot in one or a few defined places, not scattered around thousands of objects. Then we should abstract complexity away from the plot to keep it understandable.
They plotted to poison Assange, literally just out of spite, so you are wrong.

https://www.theguardian.com/film/2022/jun/30/poison-julian-a...
https://www.theguardian.com/media/2021/sep/27/senior-cia-off...
Seymour Papert, the inventor of the LOGO language thought that the whole purpose of teaching programming to children was to teach problem solving in a larger sense. You can find his writing about the subject online.
Climate-change related posts that tell us what we already know, but trigger carpet-bombing by deniers, whether those may be deluded earnest posters with their identity somehow stuck to denial, or russian/oil-industry/whatever shills muddying the waters with posts on adaptation or costs miscalculations as their main angles...
...are indeed tiresome, as I kind of feel the urge to respond, argue, debunk.
Is there any other intelligent discussion site that manages this better than HN though?
Mel Kaye – CV
small children do not have the grounding to deal with existential threats -- IMHO it does no good to have a "logical,serious" talk about such things in the first 10+ years
Meanwhile in 2023 a favourite argument of management who want everyone back in the office is that it's essential to have those casual interactions around the watercooler. When of course your keyboard and mouse won't be used at all.
war drums
OK, Thank you for the feedback. How much traction have you been able to get for your project so far?
I guess I tend to consider inputs and outputs the same in the context of most of these metrics.

From the viewpoint of outcomes, everything beyond outputs is simply too obscured to make sense of.
Basic ethical principles should make it acceptable.

We live in an age where you no longer need a printing press to manufacture and distribute books. And public universities already get enough of my tax dollars that they should be publishing the text books required for their clases. For free. Public funding equals public availability and ownership.

When a university demands a $300 book from some private publisher, it amounts to fraud and all involved should be investigated, prosecuted, and convicted of federal felonies. Stop the grift.

What the fuck are we paying professors for, if not to write the written materials they deem requirements to learn the curriculum they teach? Get to work motherfuckers.
100s of TBs then. Nothing crazy.
> I'm guessing that is more of a Californian thing?

I live in Portland, but yes, it is more of a Portland thing. The visible things that create opposition to our homelessness policies are:

- Store looting, which is mostly driven by a scheme developed by gangs. Gangs are often enlisting the homeless to carry out these stunts.

- Open air drug use, which requires drugs facilitated by gangs

- Property crime, which is either done by gangs or is incentivized by gang-related activity

"Organized crime" is probably a better term than "gang" here. Gangs are generally recruiting in places where opportunity is low and costs are averagely above peoples means. My point is that there's some overlap with homelessness and we'd benefit by looking at them equally empathetically.

> We really need to do both? The choices definitely need to be demonized, lest our kids think they are OK choices. My greatest fear would be my kid somehow makes these bad choices in the future because our schools taught him that these people were just victims of society rather than victims also of their choices.

What you've said here and what I've said are slightly different. Holding people accountable is important, yes. If they are unwilling to change their ways they should be held accountable. At the same time, when someone struggling with drugs or mental health says, "I want help" there's a short window of time where that help can be transformational. Once they've chosen to right their life, and demonstrated it, we need to provide them capacity to move on, which is where we fall short these days. If you've been convicted of a felony, regardless of whether you're homeless at the time or not, then it'll be difficult if not impossible for the person to gain and maintain meaningful employment that pays their bills in a capitalist society. This situation can put people right back into the cycle of drug use, homelessness, a mental health crisis, or all of the above. Mainly, what I'm saying is when someone has demonstrated reform we need to stop punishing them at some point.

> We've found this to be problematic because cases will be misdiagnosed as mental health problems when they are really severe substance abuse problems (or the patient will say they don't have a substance abuse problem given the stigma associated with it), to predictable ineffectiveness.

I wouldn't call it problematic, I'd call it frustrating, because typically it's both. Again, addressing one problem ends up persisting both problems. I blame this, again, on policy that doesn't understand the systems it's up against.
Even firefox doesn't offer a built in ad-blocker.
Yes, this is the Mel from The Story of Mel. (Links at the bottom of the page.)

> Mel’s Loop is a guide to the epic hacker folklore tale "The Story of Mel". It also aims to collect the stories and sub-stories around the tale, its author, and its main characters, as well as early computing era stories and other related tales.

Interesting to learn more about the real Mel!
If I were Putin, I'd keep Snowden as some sort of bargaining chip, although as years go on, Snowden's value as such a chip would continue to decrease that the Americans would probably refuse that barter, preferring to see Putin get screwed rather than to capture Snowden.

But if I were Snowden I'd be worried about the regime after Putin, imagine a backroom deal where the US government secretly says "We'll help you get to power in Moscow if you agree to withdraw out of Ukraine, and give us Snowden."
The so-called "systemic" racism is mostly a conspiracy theory unsupported by evidence. But even if it exists, your theory makes no sense here, since nobody doubts that racism was more prevalent in the past. So free speech can't be blamed to have caused it.
> I’m more inclined to closely watch geopolitical events unfold, as US hegemony becomes slowly unstable and potentially untenable.

Wait until you see what millions of people displaced by rising sea levels are going to do to political and economical stability worldwide. That's not going to happen in a far distant future, that's within 30 years. Bangladesh for example is expected to lose 17% of its land by 2050, displacing millions. Miami-Dade county will be 60% under water by 2060 when current projections come to pass.

> If climate change were really really as dire as some say it is, we wouldn’t be half-assing our way via renewable energies which don’t have a power grid or power store nearly capable enough to handle a “fully electric future”

The realities of climate change and its dire consequences aren't some doomsayers internet theories. We're completely half-assing our response to it despite the scientific consensus on the brutal consequences of our doing.

> We should “go nuclear”

That ship has sailed at least 20 years ago. Starting now with average construction times of 10 years plus they would come too late to make a difference.

Renewables are cheaper to build and faster to construct so that's were the world is heading.

https://www.iea.org/news/renewable-power-on-course-to-shatte...
I bet if they put the displayport inputs on the inside with an optional passthru bracket in the box to get them out of the case as needed, we'd start to see GPUs offered with internal displayport outputs too.

Basically the CD-ROM analog audio cable all over again.
As far as I know, it's only been used by me, once.
> Quit the bad ones, join the good ones.

This is why universal income is extremely important, so that people can pursue better jobs without risking being vulnerable.
Has anyone managed to get got-4 access on azure? It’s also heavily rate limited, 18 RPM I think.
'Stakeout Diary': A killer on the run, two postwar gumshoes – noir at its finest
Do they really know exactly what the raw text looks like? It seems so huge that no human could read all the text from each corpus. And the models have been fed text from many different languages. I doubt they have people who understand all the languages.

Regarding RLHF, I also hope that they kept the logs of all the human decisions. But since it was (at least partially) outsourced to African companies like Sama.com, do they really get back all the logs or just a new fine-tuned model?

But they must indeed at least know what is done with the text submitted to the prompt or to their API.

(I’m really not an expert so my questions may sound naive)
Cool! Flickr actually has a group "Field Guide: Birds of the World" and it tags photos of birds with their species. Combined with Flickr's API this is a gold mine to retrieve freely licensed photos of birds by species. The majority when I looked were tagged "All rights reserved", but most common species have at least a handful with Creative Commons license.

https://www.flickr.com/groups/birdguide/
Thank you for your feedback. I added it to my comment. Where else should I add this information?
At a minimum, it would be really nice to demand some more transparency into the training content of the models and clarify how copyright status is affected in the inputs versus the outputs.
I have never built an agent before, nor am I knowledgeable about the latest studies in this field. So what I am saying below is likely to be nonsensical.

I was thinking that perhaps we have been working with abstractions that are too low-level. Instead of providing a set of tools such as API calls or text splitters, wouldn't it be more reliable to give agents templates or workflows of successful tasks, such as trimming videos or booking restaurants?

These templates would consist of a set of function calls, or a graph of connected components in low-code tools like LangFlow. I believe auto agents already use a similar concept where they cache successful tasks for future reuse. The idea is to populate these caches with the most common use cases, and use retrieval if they become too large, so that we don't experience cache-miss most of the time and work with lower-level abstractions (tools) as the baseline. Templates, like prompts, should be portable (e.g. JSON) to avoid the need for everyone to reinvent the wheel. While this solution may not be as impressive as a full autonomous agent and may not work for a generalized case, it should produce a more predictable outcome, I think.
I would love a local Google Home. The response time is abysmal and the results are often poor. I should at least be able to control my home lights without internet.
> and potentially land both Microsoft and the employer with expensive penalties.

Yeah, but that's not going to happen for another few quarters, and it'll come out of some other department's budget.
I m win it shares.are rounded to four places during a dilution event, what happens to the cumulative rounding error?
>And instead of replacing them with new single winners like Mastodon, I'm hopeful the new trend will be to spread our activity to multiple sites, and to be a bit less online in general.

I, too, want to be hopeful, but how do you think this can possibly happen?

Metcalfe's law is a thing: https://en.wikipedia.org/wiki/Metcalfe%27s_law?useskin=vecto...

TLDR: The more people share a method of communication, the more value that method of communication has. Social networks organically evolve towards monopolies.
The first thing the right wing party does is to roll back such rights. In the US they did it by installing authoritarian Supreme Court justices. You're worried about speech? Women no longer have control over their own bodies! Meanwhile books the right don't like are banned.

At the time of this video, the UK supposedly had free speech rights as it was still part of the EU, but of course, the EU's version of "free speech rights" is actually "you have free speech except when we don't want you to". And in any case, as demonstrated in the video, it doesn't matter if you have the right to free speech or to protest, if the government can simply arrest you for something else. For example, if anyone causes property damage during a protest, the police can and will arrest you for it. People in the UK don't realize that their life can be truly fucked by such a charge. You go out for a nice peaceful protest with your teenage kid, and a few months later you have to sell your house because insurance companies will not insure it because of your criminal record, and your mortgage company can and will foreclose since you don't have insurance.

Authoritarians (be they on the left or the right) are incredibly good at procedural totalitarianism. You may have a nice piece of paper explaining your free speech rights, and you may eventually win when you get your day in court, but guess what? The courts are underfunded, the lawyers are over-priced, the pro-bono liberal lawyers are stretched too thin, and you got denied bail. Who is going to gofundme your legal fees when all your friends are in jail too?

A government is simply the application of force. The enemies of freedom have done a fantastic job at using "free speech" to get voters to elect authoritarians. When trump talks about being friends with Russia, that is not hypothetical, it's not bemusing. Russia is literally an ally of the the confederacy 2.0, and this time they aren't going to lose. Your pretty first amendment isn't stopping them now and we have a "democrat" president.
If AI is really some huge threat to humanity that these tech CEOs are altruistically protecting us from, how about they convince us of the earnestness of their position by working to fix the last humanity-enslaving mess they created and passing comprehensive privacy legislation ala the GDPR? Bonus points for it applying to the traditional financial surveillance companies ("credit bureaus").
That's not a trade-off you have to make. There are full remote jobs with no surveillance.

Workplace surveillance needs to be regulated swiftly and strongly.
> splitting up tech isn't much more overhead.

This is the fallacy. Splitting up tech has huge overhead.

There’s lots of good reasons to do it. But “operational efficiency” is not one of them, even though it’s oft cited as one.
Site seems broken for me (both Chrome Canary and Firefox with NoScript with all scripts temporarily allow: both on macOS, all latest versions).
Research itself isn't valued much in the software industry, but working on monetizable products can pay handsomely.

You mentioned AI. It seems like much of what we used to call UI research will quickly be swept away by generative interfaces which are not based on pixel designs. Have you thought about helping an employer move in that direction? It's certainly a special new skill.
To me, the frequent posts about RPi projects, sourcing, and the like that reach the front page of HN suggests otherwise.

What is your suggested favorite replacement? All the less that I’ve looked into are either just as hard to get and expensive or are discontinued before they gain ground. Happy to consider other options.
Getting graphite from CP-1 would be a dream of mine. Some of my friends have been given some after climbing the corporate ladder better than I have.
The recommended torrents aren't actual though, some things are not working.
As an American, I am not afraid to acknowledge the true history of my country.
For “Breach of Fiduciary Duties” because:

> OpenAI has constantly confirmed via public messaging their mission is to “benefit all of humanity;” the only logical conclusion to these statements is that all of humanity, you, me, and people on every continent, are beneficiaries of OpenAI’s mission. I firmly believe, and state in good faith, that every human being on the planet has standing to sue OpenAI for these egregious actions.

LOL
This post isn't telling us most of us "already know." It's telling us that there's something really unusual going on with ocean temperatures right now, specifically, over the last 80 days. There have been a couple of posts on this before, but the last highly-rated one is over a month ago and so this was an important update. Chart: https://climatereanalyzer.org/clim/sst_daily/
What if we could link our own knowledge to a search engine like Google, such that we can search through our own notes (e.g. Notion) by asking questions in natural language?

I wrote about how I built a semantic search interface on top of my 800+ notes using #langchain, #llm, and #chroma (a fast vector DB).
> In reality, what they make visible are the people who do little to nothing for 3+ days.

I am that worker. I've been praised for "carrying the team" on more than one occasion. If I'm doing my job to a high standard, why is this any of your business?
Funpvp network Minecraft Server – Updated June 4, 2023
There are plenty of genuinely good reasons to split up monoliths. I’m not attempting to say that all SOA is bad.

What I am saying is that companies who break apart monoliths as a code organization tool are making a very bad decision. They’re getting all the downsides and none of the upsides of microservices.
Elon Musk and Twitter face growing brand-safety concerns after execs depart
Sure, there is that, but also any Russian administration will want the employees of their enemies to feel safe defecting to Russia. I.e., if the Kremlin gives Snowden to the US, future employees of the US intelligence community become less likely to choose to switch their allegiance to the Russian side.
Zaslav, of course, is famous for killing a lot of in-production Warner Bros. projects to take a tax write-off on them when he took over. This includes the Batgirl movie, which was in post-production at the time. Crazy to think how many people worked for years on that film only to have it all thrown away at the end like that. If I'd been heavily involved in making it I might have left the industry after that.
Headline is misleading and the tweets are delusional. The whole ycombinator topic he rants about has nothing to do with the lawsuit he filled.

>> So as a member of the group ‘all of humanity,’ the reported beneficiaries of OpenAI, I have filed a claim for Breach of Fiduciary Duties. Breach of Fiduciary Duties is the umbrella my complaints generally fall under. The board members of OpenAI have a legal duty to serve the mission of the non-profit in good faith, to act prudently, and to obey the law, all of which they are not doing. OpenAI has constantly confirmed via public messaging their mission is to “benefit all of humanity;” the only logical conclusion to these statements is that all of humanity, you, me, and people on every continent, are beneficiaries of OpenAI’s mission. I firmly believe, and state in good faith, that every human being on the planet has standing to sue OpenAI for these egregious actions. Further, I look forward to hearing the legal team of OpenAI explain how this is not the case. If anyone has any illusions about the altruistic intentions of OpenAI, their explanation should put these illusions to bed.
Halfway through the article, they spell out what they mean by "cuts risk of death by half":

> After five years, 88% of patients who took the daily pill after the removal of their tumour were still alive, compared with 78% of patients treated with a placebo.

...which is still remarkable, but doesn't sound quite as good as "cutting by half".
It is actually quite a lot. For example, there are 6400 mammal species.
I really feel like file systems aren't used for enough things. File systems come with so much useful metadata.

I've experimented with using the file system for storing configuration data where each config value is a single file. Nested structures just use directories. The name of the file is the field name. The file extension is a hint about the data type contained within (.txt is obvious, but I also liked .bool). Parsing data is trivial. I don't need any special viewing or editing tools, just a file manager and text editor. You can see when a specific config value was changed by checking the file update time. You don't have to load the whole configuration just to access one field. And you could conceivably TAR up the whole thing if you wanted to transmit it somewhere.

I use it to configure little sub-projects in my personal website. I really like it, but I shudder to think of the complaining I'd hear from other developers if I ever used it in a work project, just because it's not whatever they've ever seen before and would require a moment of two of thinking on their behalf to get over ingrained habits.
I haven't had many problems buying one if I need one, but Buy a PI's Canadian store is selling them for $185, which is a little much. At least they throw in a case, some heatsinks, a power supply and some cables.

For those who have been having problems getting one, is it because they've been hoarding them? I'd really like to know what people are doing that needs more than two or three Pis.