skysight-inc/HackerNews huggingface dataset:
Show HN: Finetune LLaMA-7B on commodity GPUs using your own text
I've been playing around with https://github.com/zphang/minimal-llama/ and https://github.com/tloen/alpaca-lora/blob/main/finetune.py, and wanted to create a simple UI where you can just paste text, tweak the parameters, and finetune the model quickly using a modern GPU.

To prepare the data, simply separate your text with two blank lines.

There's an inference tab, so you can test how the tuned model behaves.

This is my first foray into the world of LLM finetuning, Python, Torch, Transformers, LoRA, PEFT, and Gradio.

Enjoy!
His book is great, highly recommend, especially if you like hands-on tutorial style. I am a pytest convert now after spending a decade using unittest.
I'm a big fan of the Commander knob on my Mazda (despite absolutely everything else about their infotainment being hot garbage). It's so easy to use without being distracted, more so even than physical buttons. But unfortunately, it seems like Android Auto is going more and more away from supporting non-touchscreen inputs. First they added forced "look at the road" breaks when you were scrolling a large list, which actually made it more dangerous when scrolling with the knob in a Mazda since it would just take longer. And their new layout is pretty terrible for a rotary input as it has no clear tab flow.
Is there an open-source alternative to this AI pfp generator?
Never once got someone with a hardon for Gantt charts to make an honest graph of what depended on what, so I have nothing but bad, borderline traumatic experiences with Gantt charts.

Management always tried to ride them like it was sheet music for an orchestra. This has to be done before this, so we’re going to schedule one to start the day after the other finishes. Sure. This whole scheduling process is a farce so I’m now entirely checked out, so it’s just going to get worse as the meeting goes on.
Everything about the meat industry from farm to table is dehumanizing.
No, this is highly misleading, if not outright wrong.

First, a picture taken of the Mona Lisa is only covered by copyright if it contains additional human creativity. Now, the bar for that is very low, and in practice many people don't challenge that copyright very often. But a perfect recreation of the Mona Lisa with a camera is not covered by copyright. You need human creativity as part of the process, and merely taking a picture is not enough on its own. There's actual case-law on the books about this[0].

Second, the additional creativity protects the photo, not the original picture itself. So in the most recent case with AI images used in a book, that additional creativity protected the book and the arrangement of those images, but it did not protect the images themselves -- in other words, entirely consistent with a photograph of the Mona Lisa.

To analogize that to AI art, it would absolutely be the case that doing additional modifications on an AI image would make the resulting image eligible for copyright. It would not make the base image spit out by the AI eligible for copyright, only the derivative work.

Where prompts are concerned, the US has argued that some prompts would be eligible for some kind of IP protection on their own. But a prompt that doesn't meet copyright muster on its own would not be eligible, and the same rules apply to photography.

[0]: https://en.wikipedia.org/wiki/Bridgeman_Art_Library_v._Corel....
I'm new to HN and new to ChatGPT-4 concepts but it's becoming impossible for me not to form an interest.

How does ChatGPT-4 interface with something like playing chess? Do you need to write an implementation or prototype to extend it's capabilities or is the AI able to exchange strings based on a language definition? If the latter is it limited to strings-only since it's a "Chat" bot or could you show it a picture of a chess board and could it interpret what's unfolding and come up with a strategy of how to advance the game?
That's why we are very very far away from General AI and don't need to worry so much. These products are interesting but they are still basically pattern matching. There is no intelligence involved.
There are far more negative externalities to production of meat than energy expenditure, especially if the alternative can use renewables
inb4 5 levels of back-and-forth comments no-true-Scotsmanning of great GPL-licensed GUI-based software.
Instead of storing the original in a vault, you can just burn it. Meaning the NFT is the only 'authentic' piece now.
I think this very site, like a few others, is a cooperative content filter, with some fun / informative / insightful comments added.
> I’m a life-long vegetarian and kind of wish I could eat meat, it would make life simpler. But I just can’t bring myself to chew or swallow it without plenty of water to wash it down.

If you really want to, and I'm not sure if you do, you probably need to add meat slowly. It would work best if you often eat with someone who eats meat, but add a pea sized bit of meat to one meal a day for a week, then two pea sized bits, then four, etc. Kind of hard to do if it's only you / only vegetarians eating, because meat doesn't tend to come in appropriate sizes to do that with. Prefer tiny pieces mixed into dishes where you take larger bites of many things --- a burrito is a great place hide things.
Yep, my entire takeaway from six months of doing Duolingo is that ‘stark’ means ‘strong’ in German.
https://twitter.com/ChrisJBakke/status/1638323074205614082
Bing is basically ChatGPT-4 with search retrieval integrated.
Its like saying why does an engineer want payment for work done.It's book which are notably hard to write, what your are saying is why is it not free?
Imo freeloaders are exhausting and you are free to search for content and release one for free.
And this is exactly why I don't feel bad about blocking ads and not purchasing YouTube Premium and the like. There are zillions of people out there who actually like looking at all these annoying ads, so the advertisers don't need to bother me when I'm not going to buy their crap anyway, and these other ad-lovers will happily do so.
its early days...

it will get better, and it will get better faster and faster.
this is what terrifies most people the most. its limitation is mostly resources. If we hooked it up to a robot and funds... we'd have a Matrioshka brain / Dyson Sphere probably by the end of the century.
ChatGPT-style AI should be called AC - Artificial Communication. It is trained on an extremely limited selection of utterances - most of our thinking is never written down. But no matter how many utterances are plugged in, the system will never be able to learn how to think. Its capabilities are stochastic and generalising, not systematic and generative.

An utterance is the expression or outcome of an internal thought process. A machine learning model is trained on the outcome, but not the process. Utterances look like thoughts to us; like pareidolia, we can't help but find thoughts in utterances. This is what makes ChatGPT so compelling.

People don't learn how to think either - it's a capability that grows from a genetic endowment. After the next AI winter, when we get over the spectacle of Artificial Communication, we may begin to examine our own generative capacities for thought. We'll know we're on the right track when AI is slow, uncooperative and childish, fails to thrive when exposed to nonsense training data, and requires very little of the right kind of training data to acquire its language.
Yo rektide thanks for your honest words, this evening on HN I’ve read many critical comments about chat bots and am glad to see them.They’re inline with my own opinions but separately it’s refreshing to see people elaborate on these points from different angles.
There was also a post titled “what’s your hottake on chatgpt” or something and everything (at time of writing) is relatively critical of the technology and the future impact.

It’s just such a strange time right now. I’m certainly impressed with the technology-side of things but it just leaves me feeling flat. Meanwhile at work today a manager broke the beginning silence of a meeting with “so who’s gonna try out the new Google Bard?”; blink, table flip. But also HN audience is probably way oversaturated on this stuff by now.

“This is not intelligence”
I am using an AT&T SIM card while physically located in Canada (they removed all roaming restrictions years ago). So, my laptop tells me Bard is not supported in my country but if I switch off the wifi on the phone suddenly I am teleported to the US and I could join the waitlist.

I am not afraid of Skynet yet.
I have a personal gripe against Pytest. It extremely implicit, does so many things behind the scenes that it makes learning the library difficult for new comers. I had a hard time. For example, fixtures are passed as arguments in function. You can't use IDE tools to find out where they are passed from. There are dozens of things that go completely against the philosophy of Python: Explicit is better than implicit. Pytest is full of magic, it irritates me. The kind of questions asked on Stack Overflow reflects my personal experience with libraries of this kind. So many people are confused.
It sure is ok. It's also ok for a customer to disagree and leave.

First up, ensure they'll stay once you start billing for this in the future.

Next, see if they are willing to cover the cost of services provided in the past that was unbilled due to your error. It's good to offer some incentive (like your back-charge for 6 months only) to make it clear that your mistake caused this to go unnoticed.
I've enjoyed the ORM in adonisjs: https://docs.adonisjs.com/guides/models/relationships#preloa...

Having used it on an actual product and dealing with some of the pain points, it's my go-to since the typescript version (v5) came out.

The ORM uses Knex.js internally, which is very simple to drop into if you just want a query builder. Having Knex be accessible also makes it simple to just write your query in plain sql as well, or as the Lucid ORM has available, just fragments of your query (say the join statement) as raw sql: https://docs.adonisjs.com/reference/database/query-builder#w...

Along with debugging, printing out the sql, and support via the Adonisjs REPL "Ace", it makes for a very nice experience.
I'm starting to feel like this AI gold rush is a case of the emperors new clothes, where nobody is willing to call bullshit on the actual utility of any of this, because they're too caught up in the hype. Is this Web 4.0?
It is now available again. I was wondering if Amazon had issued a takedown request.
At least it's hands free unlike the pile of shit that is Subaru Outback's infotainment. Takes upwards of 20 seconds to change any settings after the car turns on because it lags so bad.
Dall-e is far behind Midjourney and Stable Diffusion.

As we speak I’m generating images of my dog as every Pokémon type (for fun) that are frankly quite a bit better than the art of most Pokémon cards.

I’ve also used it for a photo composite: https://youtu.be/c_1mRWthhek
I know there are legal distinctions between commercially reselling a product and reselling it. But there shouldn't be.
I could live with auto-connect, but the assumption that I want to immediately start playing anything seems like a nuts assumption to me.
This is an older supreme court case (90s/2000s I think) but my recollection is that you've got it totally backwards--the decision turned on whether or not there is a real victim. Their reasoning was that videos of real kids create a market for the exploitation of real kids, which is a harm that overcomes first amendment protections, whereas depictions need not (their reasoning, not mine). I don't believe verisimilitude was even addressed. Now, if you mean a depiction's similarity to a particular, real child, I'm not sure how that would play out (or if it was addressed in the decision).
I mean, do I care about a promise for this? If I'm in the market for a car and they're important enough to me, I'll just buy a car that does have buttons. If they break their promise, it's not like I'm screwed. My current button-full car still has them. Next time I need another car I'll buy one that does have buttons.
I really liked Malcom Gladwel’s take on Thomas Midgely Jr.

https://www.pushkin.fm/podcasts/cautionary-tales/the-invento...

> Midgley and his employers didn’t set out to poison the air with leaded gasoline or wreck the ozone layer with CFCs – but while these dire consequences were unintended… could they have been anticipated?
> In the 1.20 series, Kubernetes changed its terminology from “master” to “control-plane.” And in 1.24, they removed references to “master,” even from running clusters. This is the cause of our outage. Kubernetes node labels.

Wow, so the word police brought down Reddit. Why on earth did someone think it a good idea to screw with existing names in running clusters in a cluster management tool?
I connected GPT-4 to the Tesla API
Yes. Capitalism.
India: Electric vehicles are driving a green transition
Opposite. If you take acid in liquid form you have full assurance of the dosage. Then dilute it as you need. With natural substances, idk how about ayahuasca, but say with mushrooms of all sorts it gets to be a real pain: concentrations may vary WIDELY.
I shared these to my facebook and had some legitimate queries from people I consider to be very objective on looking at news, this seems to be almost a watershed moment for AI image generation where the output is so good that at a glance it is indistinguishable from a real news photo.

Obviously the technology has been able to fool people for a while, but this seems different somehow.
I clicked on the 'z's and noticed the same for "WHIZZ"

I guess the article does say:
> Note that these words only represent the list Wordle uses for possible solutions; there are many more guessable 5-letter words.
> What does ChatGPT have to do with “AI-assisted interactive Web search”? Did they roll out something new?

The GPT-4-powered Chatbot agent in Bing. But I think GP is pointing out that, since the models underlying ChatGPT (both GPT-3.5 and GPT-4) are trained on a wide corpus including substantial content from the public web, even when they aren’t integrated into something like the new Bing, they are inherently a kind of (potentially somewhat stale) AI web search on their own.
This is exactly what the CEO of TikTok wound say if their platform was sharing data with the CCP.
I feel like this author gave up prompt engineering much too soon.

ChatGPT 4's responds well to prompts that remind it to improve the composition. Eg. "Write a story about X. Make it funny and dramatic with a surprise ending. Don't be obvious. Follow best practices for writing fiction. Be sure to show, not tell."

Adding "Make it compelling" adds a flavor of a try-hard writer.

I would guess that getting great writing in a response is quite possible with a great prompt.
:waving_hand:
I fear those who hold the bombs would sooner detonate them than give them up.
I leased a Kia Niro EV last year (EV FOMO made me unwilling to commit to a car right now, plus the used car market was obscene). I’ve been generally delighted with it, excluding the stupid Bluetooth auto connect nonsense.
I don't know what that's referring to.
> hold our journalist partners accountable

What does this exactly mean?

I personally don't think a journalist is "held accountable" if all that's being done is an email to them asking for a correction or clarification in an article.
what you say is somewhat correct, but this site says that these are the valid answers, not including the valid guesses, so DUCKY wouldn't be expected here.

personally, I'd prefer a tool that included all balid guesses and wouldn't lead me so precisely to answers. there's small c cheating and big C Cheating :)

the tweaks introduced by the Times, etc., yes.
From a practical perspective, because of inertia and all managers seemingly being "burned once, twice shy" on re-designs.

If my company already uses spreadsheets and teams of people skilled at manipulating them, it might not be very hard to convince my manager that good AI use cases (quick formatting, intelligent auto-completes, intention detection from sheet structure) could probably speed us up by 20% - but convincing management of the value of a full system re-design by comparison would likely be a very tough sell, if not viewed as an insult or sign that I'm not a team player.

Just because the future may prove these methods antiquated doesn't mean management is liable or likely to change their tune today.
I'll give this some thought and I'll DM you on Mastodon if I can come up with a working example
They also were aware very early on of the health risks lead caused. Midgley himself suffered from lead poisoning. Then they poisoned the world for those few cents per gallon.
>remote javascript

When Google says "remote" they really mean "remote to Google". You cant execute any of your own code from local drive, everything must be controlled by Google.
Kansas City's new airport, which opened just a month ago, was finished on budget and a day early. So, it's not always bad :)
You have not understood my point at all.

If anything, pointing to various scholars with Arabic names in a large geographical area which hosted "advanced civilizations" before their conquest by Islam only strengthens my argument.

It is the achievements of the native people which were built upon by the now larger group of people of various ethnicities which is being pointed out. Islam was a conduit for the spread of ideas and not their originator. The Arabs were as "primitive" as the Mongols after them. Only after "mixing" with other ethnicities, converting them to Islam, making Arabic official lingua franca were these countries "Arabicized".

The difference between Arabs and Mongols is that the Arabs gave themselves a specific identity i.e. Islam which they then imposed on others while the Mongols integrated themselves into the native cultures.
I fully support this for basic environmental controls and audio, but there is a limit. I test drove a Kia EV6 GT recently and it has, IIRC, 4 up-down levers and about 8 or 10 other buttons on the steering wheel, flappy paddles, and stalks. Compared to Tesla (which I also test-drove), which has only two pushbutton scroll wheels and two stalks, and a big screen. the polar opposite.

I think neither gets it exactly right. physical controls of things that can get obtrusive - wind and noise - are appropriate. But it's ridiculous and distracting to have too many buttons for features that are not really necessary to drive. I think that a common one like rear view mirror adjustment, or even seat adjustment, should not be physical buttons, but menu items.
I did an experiment where I got ChatGPT to rewrite headlines in neutral tone based on the content of the article. Works great. What you want is a great idea!
One of my college profs, back in the day, alleged that all the news worth knowing about would eventually show up in, IIRC, the New York Times Book Review. Not necessarily in a timely fashion, but that's kind of the point: slow news. Seems legit.
TXR Lisp:

1> (time-struct-utc (time))
#S(time year 2023 month 3 day 22 hour 4 min 25 sec 0 wday 3 yday 80 dst nil
gmtoff 0 zone "GMT")
2> (match @(struct @type year @y) (time-struct-utc (time))
(list type y))
(#<struct-type time> 2023)

We don't want to capture the type: use the @nil pattern which matches an object without capturing a variable:

3> (match @(struct @nil year @y) (time-struct-utc (time))
y)
2023

Wrong/nonexistent type:

4> (match @(struct foo year @y) (time-struct-utc (time))
y)
** expr-4:1: warning: if-match: no such struct type: foo
** match: @(struct foo year @y) failed to match object #S(time year 2023 month 3 day 22 hour 4 min 29 sec 32 wday 3 yday 80
dst nil gmtoff 0 zone "GMT")

It's all macros, found in one file:

https://www.kylheku.com/cgit/txr/tree/stdlib/match.tl

If a student handed in a pattern matching system that didn't have a "null variable" pattern, I would not award full marks. That's just useless beyond words; you can't do things like

(match (@a @nil @nil @c) ...)

to match a four-element list, capturing the first and last element; you have to name the variables and then tell your compiler they are deliberately not used.
I’m surprised how often people are wrong about simple things like this. If a build takes five minutes, that’s the absolute least amount of time before you’ll have a binary. The CI tool could have a queuing glitch. You could have a flaky test, you could be failing to isolate multiple integration test runs properly and one could ruin the other.

But that’s just the simple stuff, the stuff without humans. Most of the time if something will take five minutes, we often try to find something to do that will take a few minutes. Well guess what, we always underestimate how long things will take, ususally by a factor of two. So a five minute build can take ten minutes for you to notice if it succeeded. And if it failed thirty seconds in, you might still be looking at fifteen to twenty minutes to the end of the second build (the more failures the lower the likelihood someone will multitask, but for some they only watch the third try closely).

This doubling and tripling is why it’s more important than you might expect for compile and test times to be very fast. An extra minute can turn into three way too often.
I'd cut the country stereotypes out of the picture, but there's definitely more than one kind of corruption, and the kind of damage it does changes.

You are absolutely correct that large construction projects are very vulnerable to corruption: Anything that has as high a budget is going to be rife with opportunities. But a project's culture will alter the kind of corruption you get. I was quite close to the construction of bridge spanning over a river, a little under a mile wide. Significant slippage in the delivery date was going to be very annoying to the powers that be: Being able to finish the construction prior to the next election was important, and being seen as the cause for a delay was going to lead to losing more projects that some of the very same people were going to keep overseeing in the future. So the bridge was done on time. It's just that a lot of palms got greased, and extra 'cement money' really went into things it shouldn't. For instance, the bridge's main engineer had just bought a derelict house that was completely restored by 'elves', from the construction company.

Sometimes the fact that something took 4 years too long is tolerable to the powers that be, while the construction definitely remains safe. Other times, the construction is just going to prove really faulty in 15 years, because things didn't go over budget, and someone took the difference between what the spec called for, and what could possibly appear to be a completed project.

Same with permitting. In some cities, corruption means you don't let people build something because you don't want it. In others, the mayor tells their friends to buy land zoned for low density, and then rezones to let them build 20 story buildings, making a mint. Still corruption, but different parts of a project suffer the consequences.

Only truly cursed projects manage to take 4 times as long, 20 times the costs, and end up with something awful in the end.
Raghu and I had desks next to each other when we were students - we all knew he was brilliant!
Agree to all. I wasn't commenting on the global impact. From "the cable companies" viewpoint, they are not paying for that energy (each subscriber is paying individually). And they cared more about reducing their "help desk effort" than about the global environmental impact of their change (i.e., they ignored that which did not directly impact them).
Firefox makes them pretty easy to use. One key stroke (Ctrl/Cmd-B) displays/hides the bookmarks sidebar where you can search your bookmarks. You can drag the current url to the bookmarks bar to add a new bookmark.
This is gonna be a bumpy ride. Glad I have saved up a nest egg.

Though if the US dies it is not gonna save me either way.