skysight-inc/HackerNews huggingface dataset:
I might be having a moment - but I can't find any links to a git repo, huggingface, or anything about the models/weights/checkpoints directly from the article.

I just see a zip download that AFAIK also doesn't contain the weights/checkpoints. I find this a bit odd, the contents of the zip (from the gdrive preview) look like they should be in a git repo, and I assume they download the model from somewhere? GDrive usually has rate limits which I'm concerned about.

If anyone from databricks reads this - are there plans to publish this on a git repo somewhere, as well as the weights/checkpoints?

EDIT: Oh I just noticed

> Contact us at hello-dolly@databricks.com if you would like to get access to the trained weights.

This... seems odd for a article titled "Democratizing the magic of ChatGPT with open models"?
Highly paid middle class white male (statistically) compares his existence to the brutal oppression of women in a fictional book.

What insight!
And do you know for the Framework Laptop 13 ?
Depends on the country, and state. Norway? Sure. California? No. The funding levels for public mental health facilities is abysmal, and the chances of being abused and "locked" in the system is huge. Would you rather be strapped to a bed all day, mistreated, assaulted, and forcibly medicated, or choose your own path?

If it's between a mental hospital or death, I will choose death.
And here I thought FB was going to try a more open approach than OpenAI. Silly me.
I think they call these canary GUIDs. If you manage to generate one from an LLM then you can conclude with certainty that the model saw that document during training.
I have my share of problems with big tech, but none of them compare to the rotten garbage that is sectors like payday loans and BNPL. These are industries exclusively set up during rough economic times to prey on the poor.

Just think about BNPL for 3 seconds. How do they make money? By selling people shit they can't afford, waiting for them to miss payments, and charging hefty interest and fees – sometimes totaling up to as much as the product itself.

You can argue "it is legal" "they signed the contract" "they should have known better” all you like, but just like payday loans it is a social ill that we need to deal with.
This is terrifying. Googling this definitely raised my stomach acid levels.

Who holds all the debt?
A video of his 2019 speech that got him into trouble.[1] For those who don't understand Hindi, he is saying: "A small question. Their names, the names of these thieves, why are they Modi, Modi, Modi. Nirav Modi, Lalit Modi, Narendra Modi. And if you search some more, you will find a lot more Modis."

The implication is that all Modis are thieves. The surname is common among the "Teli" community which is categorized as an OBC (other backward classes) community in India. And a man from the community who carries the same surname and is a BJP politician filed the criminal defamation case.[2]

People may not like the British Raj-era law. But no one, including the three prime ministers of the Nehru-Gandhi dynasty, bothered to scrap it in the 60 years that they ruled India.

What are the courts expected to do? Make special exceptions for political royalty? But, that is exactly what will happen. A higher court will intervene and fix this problem because it is a Gandhi that is being inconvenienced.

A Gandhi, a Bush or a Clinton will never see the inside of the prison. Political systems and courts do not work that way.

[1] Rahul Gandhi 2019 Remark: "How Come All Thieves Have Modi As The Common Surname" (https://www.youtube.com/watch?v=A5-h5tu9z_A)

[2] 'Teli' community leaders seek apology from Rahul Gandhi for ‘Modi’ surname remark (https://www.hindustantimes.com/india-news/teli-community-lea...)
Is this the same as Knowledge Distillation (teacher-student training)?
It's a not so well guarded secret that the claims by many linux distributions that they support old systems with security fixes for many years are not really true. The number of security flaws constantly found and fixed is just too large to make this even remotely feasibile. This is just another instance of this.
SBNation did a great little video on this: https://www.youtube.com/watch?v=TbuD-6BbnQw

I recommend the entire "Weird Rules" series from that channel. Not only is it amusing, but it's filled with examples of accidentally creating wrong incentives for your users-- er... players.
plink is part of PuTTY right? In which case I think the host keys are in the registry, under HKEY_CURRENT_USER\SOFTWARE\SimonTatham\PuTTY\SshHostKeys
This comment is the AI singularity.
I was trying to lobby for those exactly… 14 years ago!

https://ploum.net/207-modify-your-application-to-use-xdg-fol...

Some things never change…
Do you have plans to launch the 16 in India?
> But this is smaller than the alternative of a model which contains the large matrix of original weights, and an equally large matrix of alterations.

It's actually larger. If you just have two equally large matrices of the same dimension, one original, and one of "altercations"... then you can just add them together.

> Why is fine-tuning done with separate alterations, rather than by mutating the original weights?

Then you'd have to compute the gradients for the whole network, which is very expensive when the model has 7b, 65b, 165b parameters. The intent is to make that cheaper by only computing gradients for a low rank representation of the change in the weight matrix from training.
Funny you say that because OpenAI just sent out an email saying "another user may have inadvertently seen your billing information when clicking on their own “Manage Subscription” page." for a nine hour window yesterday
Not really. The SPLC now just exists to bilk coastal liberals, who think that anyone who ever had a Trump yard sign is a 'domestic terrorist,' out of money.
> ask clarifying questions, "am I required by law to answer that?" and only give what you have to.

I was under the impression that the police in the US are not required to be truthful and it's perfectly legal for them to give false legal advice if it'll make their day go smoother?
We will see a los of OpenAIs (FAANG first) soon. It is the kind of innovation where anybody will catch up.
I loathe mouse buttons that are integrated into the touchpad. Is it possible to get a keyboard/touchpad for this with separate mechanical mouse buttons?
Wow, just discovered that the American pronunciation for Dalai Lama is Da-lee. Well, that's a discovery.

This is like when Khan Academy came out and there was a guy online saying it's a terrible brand because it sounds like Con Academy which it doesn't in my dialect.

Took a while to get it.
I am thinking that the latter might eventually emerge, probably as part of a bigger tool chain e.g. langchain. Something like java bytecode which is low level and portable, but optimized for the ways that LLMs (perhaps interfacing with other tools) work.
Great usage / application! I'm using it to both understand legal documents and to create a law firm's new client ingestion assistant. Potential clients can describe their legal situation in any language, which gets converted into the language of the attorney, with legal notations of prior cases.
So Ohio is literally everyone, everywhere?

Look, my initial response to this is here[1]... I don't condone misconduct... but I am at least attempting to have a level head and see more sides to this. I'm someone who would generally like to see most of the govt including police and military end.

[1] https://news.ycombinator.com/item?id=35289247
While that's technically a valid potential future, it's unrealistic just because society would tear itself apart long before it reached that limit state.
Developers can't be trusted with SSH private keys. I'm stunned by how many times I've asked a developer to send their SSH public key only to see them dump their private keys on Slack, in a Pastebin, or in a Git commit or wherever.

It would be so much better if standard practice was to generate and store the private key on a smartcard or the TPM, so that the only file a clueless/careless developer could upload would be a stub.
I'm definitely a lot better off than my parents were, but as a Millennial, I feel like I'm in the minority.

I don't (and won't) have kids, but if I did, I think they'd definitely be worse off. Between stagnant wages, corporations buying all the housing stock and constantly rising rents, yeah...they're basically fucked. The threshold for being able to buy a house has gotten ridiculous.

The 638 sq ft 1-bedroom apartment I lived in in 2011 for $650/month is now $1,600/month. The 900 sq ft 2-bedroom I lived in in 2015 for $900/month is now a whopping $2,200/month. That's absolutely bonkers.
Now junior devs don't have to build the product of someone else's dreams; they can build the product of their own dreams.
These things are trained on internet content right? What will they be trained on years from now? I bet it would end up being a lot of their own or others model output that they end up retraining on in the future, or they continue training on the internet as it was before chatgpt and information in their datasets grows stale.
The panic is needless. If one hour of design work generates $100 income, then one might assume that MidJourney/Dall-E/StableDiffusion will generate trillions of dollars, but the world doesn't work like this. What will happen is that the design jobs will transform.

As you might have noticed, the AI boom will decimate the code writing jobs as well, something that the EU is behind on. Europe missed the "tech" age, but notice how the EU is not any poorer than the USA. Sure, some countries are poorer than others, but not everywhere in the US is Silicon Valley. Why? Because despite the EU missing out on "tech", actually the EU is very technologically advanced. Tech doesn't mean only low-touch high-scale computer-based businesses. There are chemists, biologists, anthropologists out there who don't know how to write a single line of JS and are paid like 1/5th of a junior JS developer, but the work they do is very valuable to society. Guess they don't need to learn JS anymore.

Also, notice how despite the thousands of layoffs, the US job data keeps coming out very positive - there's no unemployment problem. This is because of the markets, but AI will have similar effects. The world no longer needs that many CSS experts and React gurus who pull in $200K; the world apparently needs more hard-tech engineers and retail workers.

The AI thingy is devastating just for a subset of the "tech" workers and creative industries. It will enable other types of people and industries.

Startups who are trying to solve food production issues, for example, might finally outshine the next grocery delivery startup.
It does break the ToS, and for puritan rules like OpenAI's it's common to expect them to be offended by anyone working around the tooling.
With a properly designed keyboard (ortho-staggered or ortho-linear without a huge spacebar) the numpad is not needed, you can have it right around your home row)

But am very glad to hear there is at least potential for innovation here!
Yes and when you're google then that might work out for you, but that point is that anyone who creates an llm can now integrate a whole range of services without the services needing to provide their manifest to each of them individually.
This increases competition between ai companies, which is why it is a surprising move.
The market is up 3x since then.

Bad move.
Depends on what you mean by AI blockers. If they identify themselves honestly, yes. https://platform.openai.com/docs/plugins/bot
Why couldn't you just use OpenAI's API to feed prompts and then take the outputs and use them to train your own model to exfiltrate the best features of GPT?
If you didn't go to college, your poverty is your fault because you should have.

If you did go to college, your poverty is your classmates' fault because there were too many of them.

It's funny how the system is never to blame.
Thanks! Hard to follow this stuff sometimes with all the news
>But, interventions during the worst parts of the pendemic really did work.

I'm not sure the jury is entirely in on that yet; but I'll be the first to admit it's painstakingly difficult to with any degree of confidence tease apart disparate threads of systemic dysfunction to isolate the COVID contribution.

Like the supply chain: did we get into dire straits because of the bullwhip effect + lack of people actually able to make things? Almost certainly.

But could that also have been a symptom of over-reliance on centralized industry, which makes a fundamental tradeoff for efficiency of consolidating people + equipment in a single place at the same-time at the expense of fault-tolerance?

I won't opine on the strictly medical interventions since that isn't so much my bag, but logistics-wise, COVID demonstrated our industrial architecture has become a house of cards waiting to go up in flames to a pathogenic match. Socially speaking, I'm tempted to say we were as close as I've seen in living memory to completely unprepared for people to get forcibly physically denetworked to a high degree. I'll also be one of the first to admit that besides 9/11, I've never seen American civic life get quite as ugly, quite so fast, and to such a high degree as it did during the pandemic; and I can't isolate the Administration at the time as a contributing factor; but I also can't deny that in spite of the ineptitude at that level, things developed disturbingly fast and not in an ultimately comforting direction either; but rather reinforcing the same disturbances we haven't even reeled back from from the War on Terror era.

There has to be a correction. There has to be a hard line we aren't willing to let fear shephard us to cross. If there isn't, I fear for us all.
extracting 5s of a video feels pretty trivial. Not that this isn't extremely impressive, but it doesn't feel "come for your jobs" impressive.
This is a question to ask when this actually becomes a reality. The AI taking jobs narrative is more of a marketing ploy to convince companies to buy AI services but the truth is, none of this stuff is anywhere near market ready. If a person is doing a job an AI bot can currently replace you've probably already replaced that person with cheap labor overseas. Regardless of whatever optimism is being channeled into the hype about AI's "potential", it hasn't convinced many businesses.
This is hardly the first such weird outcome for a match that reflects a larger strategy of advancing in a tournament rather than simply attempting to win the match. It has been an ongoing scandal that teams collude to fix world cup matches during the qualifying rounds to ensure they both get a favourable position in the knockout rounds.

That is considered cheating in soccer, but if you look at a sport like cycling, it is common for "rival" teams to team up and work together to chase down a breakaway, just as it is common for "rival" members of a breakaway or echelon to cooperate to beat everyone else.

Why is one "match-fixing" and the other "the beauty of the sport?" Nothing more than expectations.
This comment is pretty much Peak HN. The article is about people who are, in general, financially not well off and likely living paycheck to paycheck:

> People who use BNPL for purchases tend to be more financially distressed than nonusers, according to a March report by the Consumer Financial Protection Bureau. They’re also more likely to be an active user of other credit products such as payday loans and credit cards, the report added.

HN comment: "This is a smart way to hedge interest rates vs. inflation risk in their portfolios!"

I love this place sometimes :-D
What are the barriers to a junior dev creating their own product?
I’m glad that worked for you, but for some people with allergies each attack can make the allergy worse, as the immune system sensitizes itself to the allergen in the presence of inflammation.

One treatment for allergies is exposure, but that is done using extremely small doses to allow the immune system to “see” the allergen without inflammation and thus lessen the response.
BNPL doesn't make much sense if you have access to typical quality credit lines. The x% cash back on groceries, plus a month of interest on deferred payment, is probably a better deal than the extra duration on the credit line you might get from BBPL.

The major difference between some BNPL apps and credit cards is that the apps don't require a credit check. So, y'know, there's a certain segment of the market they are targeting.

I think the ethics are fairly mixed -- access to capital is important and capital is expensive to some people for a really good reason. Of course there are fairness issues and predatory lenders, but there's a balance between the two concerns.

But the risk modeling for CCs and BNPL are quite different. I expect there to be a BNPL blow-up at some point.
> contractors can write off the expense

there's an opportunity cost for that expense. it reminds of this episode of Schitt's Creek - https://www.youtube.com/watch?v=hg1Uk60rBsc.
Perhaps to you, but to all the fashion fans and all the super hero fans it would be a must have.
How does someone gaining access to "Crypto Prices Plugin" ChatGPT "plugin" a security issue?

I suspect they probably just don't care. They are working on a very very well done language model, not trying to protect customers data. In anything customers data is their data. And having more of it in any form is better for them.

If anything it's probably a security issue that people are using ChatGPT as it is. And certainly a security issue if you are using ChatGPT behind firewalls or VPNs.

Pasting in random proprietary code samples asking for help fixing it, is WAY more of a security issue then some terrible API authentication that they clearly don't care about.
> non-temporary polyfill

Isn’t that what the compiler generated shim is that something like Emscripten emits? The Emscripten wrapper code is… frustrating.
That’s my point. The jailbreaks are if not explicitly against the terms of service, they are certainly implicitly against the terms of service and within OpenAI’s discretion to ban people for. Yet they appear to be letting people get away with a lot. I mean heck just the other day based on a HN comment on another topic, I whipped up an Jailbreak prompt to see how hard it is to get ChatGPT to flirt or be sexual, and how well it does at writing that kind of thing. Now sure it was just a one off experiment and while they were dealing with the history incident, but it’s not like it’s hard to have something flag the three letters “sex” and have some kind of telemetry, because they explicitly mention sexual content in the TOS… they aren’t targeting the low hanging fruit because it’s pointless. They’re letting the red team (the public) try and really test the boundaries to make sure that much more serious issues aren’t hiding, waiting for someone to find much later if they were more aggressively limiting the amount of implicit TOS violations that appear to be happening.
> 1% of all purchases in 2021.

Percent of purchases seems like the wrong statistic. It is likely the case that most purchases are very small, people buying a single pack of cigs at a gas station and things like that. Furthermore, people with a lot of money likely make more purchases than people with little money. The percentage of the population making such everyday BNPL purchases is the interesting statistic, and I suspect it is higher than the % of all purchases.
I doubt anyone would want their livelihood to depend upon being able to create genuinely new things with extreme consistency.
I suppose that is true. You can even train the prompt with gradient descent. But in practice, it ends up being fairly different.
Which rebellion? The Civil War? Yes, that was THE main issue that led to the Civil War, fullstop.

>Our position is thoroughly identified with the institution of slavery-- the greatest material interest of the world. Its labor supplies the product which constitutes by far the largest and most important portions of commerce of the earth. These products are peculiar to the climate verging on the tropical regions, and by an imperious law of nature, none but the black race can bear exposure to the tropical sun.
Last week I used ChatGPT for the first time for a real world task at work. It was a self-contained lambda function to perform some admin tasks, so it seemed like an ideal fit. Although the experience was good, it's far from the end of programmers. This was my experience:

* Although ChatGPT is pretty good at generating code, it kept making simple mistakes such as calling non-existing APIs or introducing bugs. Some of them it could fix itself, some I had to fix.

* The code provided worked well for the "happy path" but failed miserably for some corner cases. I had to fix that manually.

* The code was working, but I wouldn't consider it production ready. It required some cleanup, unit tests, etc. Again, some of this with ChatGPT, some without.

* Not to mention that I was the one with the knowledge about the domain, what problem to solve, a vague idea of how...

Not to pick on OP but extracting a few seconds of video from a file is a pretty straightforward task, you can essentially do it with a bash one liner [1]. My biggest question is how ChatGPT performs with a large codebase, contributed over time by different authors, with complex domain logic and layers of abstraction.

I also had a brief existential crisis, but I just shrugged it off and got back to work.

[1] https://askubuntu.com/questions/59383/extract-part-of-a-vide...
If you are mostly wanting to play written classical music, you might consider just not learning "theory" per se. Much of what you might learn studying theory directly has little application for musicians early in their practice.

My experience (as a practicing musician who works in several generas) is that theory is great when it's explaining things you already kind of understand, and that gaining understanding comes from a lot of playing and performing things other folks have written.

That is, first we learn the music by ear or eye, then we have a feeling for what sounds "right" in some situations, then we find a theoretical explanation for that feeling so we can replicate it quickly.

If you're just wanting to get to where you read faster, more reading is the answer, and lots of sight reading easy material. The more you do this, the more patterns you'll see and the logic of what you're seeing will be easier to understand.

To your question, though, a jump start on "learning theory" can be had by learning to play songs off lead sheets (like the Real Book or (better) the Great Gig Book). This Django book is an example of what I mean:

https://geosci.uchicago.edu/~archer/jazz_band/sheet/fakebook...

It may seem daunting and it might seem like if you're just wanting to read faster or learn theory that it's a bad path.

However, the process of learning the chords in a tune, figuring out which inversions work for the progressions, having to figure out a bass line that work, and being able to play with ornamentation can be an excellent playground for generating the kinds of questions that music theory can help answer.
In Windows we get dotfiles from any tool badly ported from unixland, plus the myriad ways specified by various Windows standards over the past several decades, plus the innumerable ways that different entities have chosen to interpret those standards, plus whatever bullshit non-standard locations some asshole thought up and decided to ship.

Where is the config for program X?

It could be in the same directory as X, HKLM\Software\X, HKCU\Software\X, The HKLM\Software\XWOW6432Node\X, AppData\Local\X, AppData\Remote\X, AppData\LocalLow\X, ProgramData\X, USERPROFILE\.X, USERPROFILE\Documents\X, USERPROFILE\Saved Games\X, USERPROFILE\Documents\My Saved Games\X, USERPROFILE\.config\X...
Phishing PDF in official EU site