skysight-inc/HackerNews huggingface dataset:
Right, but transformers are artificial neural networks though, so it's not clear to me what you mean.

The leap from RNNs to the Transformer architecture in 2017ish is similar to vision networks' leap from fully-connected layers to convolutional layers in 1987ish. In both cases, the key is to change the architecture to exploit some implicit structure in the data that wasn't quite used effectively before.

For images, each pixel is strongly related to its close neighbors, so convolution is a natural way to simplify models while capturing that locality.

For language, the opposite is true - almost any part of the text implicitly reference anything that's been said previously, so you need representations that are somewhat position-independent. Approaches that can model that structure naturally work better than an RNN munching tokens one by one.

Each one was certainly a leap forward that unlocked its respective field, but at the end of the day, it's "just" an architecture tweak, you know?
> So even though I am not a fan of the Apple monopoly, I am really really afraid that by allowing third party app stores and sideloading, the western apps will race to the bottom and become just like this.

This did not happen with Windows, so why would it happen with Android, that is much more restrictive in terms of permissions?
Does it happen with a new profile? Sounds like it could be an addon issue. 30 seconds to start Firefox would be expected on a spinning drive but 2 minutes is quite a long time.
There was some noise about spotify choosing to recommend "fake" in-house artists who they had to pay less royalties to, but according to this article those concerns were overblown: https://www.theverge.com/2017/7/12/15961416/spotify-fake-art...

honestly, I don't know who to believe about anything anymore, but luckily this particular controversy is pretty low-stakes relative to a number of other current topics.
Can you link the blog? An AGI that can generate on demand UIs could be the last interface we ever need. And those UI could be adapted and projected to different form factors, if you think about it there is a massive amount of waste in developer developing the same UI widgets over and over ad infinitum. Not sure I agree it is imminent though.
Happy Fiftieth!!! Cancer!!! Yay!!!
I know it’s not exactly what you have in mind, but with the App Library screen you can have an app installed yet not on any Home Screen. It’s just with the rest of your apps in there.

Apple is between a rock and a hard place with your request. What you want would require another way to delete a web app from your notification list. Right now they went with the simplest method: just use the way the native apps do it.
With an established TCP connection? Yes? It is. That’s not really spoofing, it’s proxying. For starters, it’s more effort than the majority of these DDoS kiddies are going to. And let’s not be the perfect be the enemy of the good. When the cops rock up and tell Mum that little Johnny has been running amuck online, he’s going to shit his britches and fess up immediately.

I trust that law enforcement knows the pattern with this one.
Yes, just a joke, but I understand your point.
Most EV sales happen in urban centers, not rural areas. Not to mention that battery cars doesn't really solve the problem for rural areas too, due to limited range, less charging infrastructure and much higher cost.
I sometimes wonder why 'compact flash' rather than 'SD card' or 'USB stick'.

Is it because compact flash cards are generally older and cheaper and (more likely) more of a size-match for the older hard-drives of the 1980s and 1990s?

I can't remember seeing a compact flash card on general sale for quite some time.
Outperforming CEOs seems like a very low benchmark in many cases.
GPT-4 training was finished last summer.
Karpathy is working on a JARVIS there.
I think they already have something quite good for internal use, maybe trying to make it "safe" before releasing it.

My guess: we will have a competent JARVIS(minus the holograms) this year.
It already is, as you can have wildly different outcomes for models of the same size, and if you can get a similar output from a ten times smaller model, that's not equivalent, that's overwhelmingly better since it takes ten times less compute and for current model sizes the cost of inference is quite relevant.
The point is that one of the externalities of EV materials production is CO2 emissions. Mining and processing the materials is incredibly fossil fuel intensive. By the time you have enough materials for a meaningful percentage of the world driving with EVs our CO2 footprint will be significantly worse than if we had focused on hybrid vehicles with small batteries.
If your credit card pays you back 0% in rewards/cashback, you're the one leaving money on the table.

If you pay a credit card in full, you also don't pay interest, and you usually get at least a month to do so as well.

If you don't pay on time, though, you lose big – with both credit cards and BNPLs.
For self-directed learning, my favorite has been actually using ChatGPT (GPT4, especailly), because you can just ask as you go along. Some questions I asked:

I have a pytorch ml llm gpt-style model and it has many layers, called "attention" and "feed forward". Can you explain to somehow who is highly technical, understands software engineering, but isn't deeply familiar with ML terms or linear algebra what these layers are for?

Where I can get all the jargon for this AI/ML stuff? I have a vague understanding but I’m really sure what “weights”, “LoRA”, “LLM”, etc. are to really understand where each tool and concept fit in. Explain to a knowledgeable software engineer with limited context on ML and linear algebra.

In gpt/llm world, what's pre-training vs fine-tuning?

in huggingface transformers what's the difference bertween batch size vs microbatch size when training?

how do I free cuda memory after training using huggingface transformers?

I'm launching gradio with `demo.queue().launch()` from `main.py`. How can I allow passing command line arguments for port and share=True?

Comment each of these arguments with explanations of what they do (this is huggingface transformers)

args=transformers.TrainingArguments(
per_device_train_batch_size=micro_batch_size,
gradient_accumulation_steps=gradient_accumulation_steps,
warmup_steps=100, #
max_steps=max_steps,
num_train_epochs=epochs,
learning_rate=learning_rate,
fp16=True,
logging_steps=20,
output_dir=output_dir,
save_total_limit=3,
),

In the context of ML, can you explain with examples what "LoRA", "LLM", "weights" are in relation to machine learning, specifically gpt-style language models?
raiding existing services with rep and getting the owner to fold by promising leniency is a tried and true strategy, there's no reason to start from scratch.
Good software developers often expect their peers to also be at a high standard and will speak in very plain, rude, and blunt language if they feel others are not pulling their weight.

Speaking bluntly isn't what is meant by being an asshole/jerk.

What we're talking about here is the completely gratuitous, "I'm so valuable here that I can get away with it" abusive behavior that has no correlation with performative ability.
Sure, the powerful countries all have them, which cancels out their threat. Should the US not develop this tech and let the Chinese be the sole AI superpower?
That was an option in windows 10, but is not present in windows 11 (last I checked anyway).

It's very important to me. :/
Hahah that's not a bad idea. Maybe you could be more subtle, for the rare cases that a human is actually reading your post. Thanks for your kind and helpful response.
Allowing immigration is a long way short of the dystopian scenario painted by the racism of the replacement theory. Iceland willingly calling for people to move there is nothing like the European colonization of the Americas.
they're probably slowly rolling out the update over time, but yes, it's all going to be gone.

The i.reddit and .compact interface was so good. It is excellent design for mobile, low javascript/page weight, and has consistent UI for all subreddits (instead of the often custom CSS/layout stuff that i don't want).
What's the complaint exactly? Unrestricted global free trade isn't something every country is expected to support or the WTO is meant to enforce. China can ban foreign companies and services from operating in their jurisdiction for any or no reason. Other countries are free to do the same.
- Mild attack: Caffeine, i.e., dark chocolate, coffee, or caffeine pills

- Moderate: Aspirin (250 mg) + Acetaminophen (250 mg) + Caffeine (65 mg)

- "Break glass" emergency: Imitrex (sumatriptan)

https://www.ncbi.nlm.nih.gov/books/NBK553159/

https://www.ncbi.nlm.nih.gov/books/NBK513274/
I don't for a minute support what Russia is doing but I think if we lived in a less hostile, conflict focused, conquer all share little world, that conflict wouldn't happen.

As an American I know you think Russia is wrong, but it doesn't take a LLM to see that the invasion of Iraq was not all that different, the excuse for that war was that they had access to weapons of mass destruction so they needed to be wiped out.

Did you ever see any weapons of mass destruction?

The world is too small for these mindsets now. We need to grow up.

Don't hate the player, hate the game.
> Devout Christians in tech are extremely rare in my experience. HN is a tech news site. Have you experienced otherwise?

What counts as "devout"? But I can think of a number of well-known Christians in tech, who by all accounts are serious about their faith. Larry Wall (inventor of Perl) is an active member of the Nazarene Church. Donald Knuth is a Lutheran, who has even published a couple of books on the Bible, and plays the organ at his church. Fred Brooks, who managed the IBM S/360 and OS/360 projects, and wrote the famous book The Mythical Man Month, was an evangelical Christian. D. Richard Hipp, inventor of sqlite.

Yukihiro Matsumoto (inventor of Ruby) is a Mormon, and apparently has even served as a low-level official in the LDS Church (counsellor in the bishopric of his ward). Also a lot of Mormons in the Utah tech scene, which produced a number of well-known companies, including WordPerfect, Novell and Qualtrics, all of whom had LDS founders/CEOs/etc. (I know some people claim "LDS aren't Christians"–I think sociologically they clearly are, and as to whether or not they are theologically, there's no point debating it here.)

In my personal experience, you often don't know what your colleagues believe religiously, because the culture encourages people who believe to be quiet about it. I have no doubt religious belief (and especially serious religious belief) is less common in tech than in the general population–there is likely a partially neurobiological explanation for that–but you've quite possibly worked with some religious believers without realising that's what they were.
You're probably right, but that ship has long sailed, I fear. In order to solve for the externalities you've got to get broad buy-in, and people are already hesitant to spend money on a small device that captures participates and emissions at the source, to say nothing of a carbon-tax. So you're stuck with a political problem.

On the other hand there is already a market for recycling of metals and batteries. So you've basically avoided the political problem entirely buy just telling people "you'll get X dollars back when you recycle your car's battery". Just practically speaking, a person has got to do something with their old battery, might as well get a few bucks.
Using AI to classify AI: Using GPT-3 to evaluate Replicate models
Older OSes and apps used gray backgrounds to mitigate the visible flicker due to low refresh rates.

On a modern display, if a white background bothers your eyes, it often means that the brightness is turned up too high. After all, hardly anyone is bothered by black ink on white paper.

Try holding up a white sheet of paper next to your screen and turn down the brightness until the display matches the paper. You may find it more usable.
My issues: Pictures, headers and footers, the amount one can fit in a page (varies between versions). What will happen to the Teams version if I download it, edit in the native app and save?

Downloading a lot of files off Teams usually fails and gives a load of html files.

The ‘integration’ nag for one drive which can’t be dismissed or enabled but seems to work.

It’s an absolute mess and I’m very surprised to encounter someone who finds it works well.
> a world in which only certain non-renewable scarce resources have any value

If you think this is the world "AI" is leading us toward, I think you need to think again. There are a huge range of skills that only humans can provide, and that will continue to be true. GPT-3 can't fix your plumbing or your HVAC when it breaks. It can't fix your car. It can't build houses. It can't build roads. It can't build computers. And on and on and on...

Nor are AI enthusiasts trying to get "AI" to do any of these things.

Humans are real-world creatures with real-world needs that we supply to each other by free markets, specialization, and trade. The "tech community" might take all this for granted, but that doesn't mean it just happens by magic. It happens because real humans do real work. "AI" is not going to take that over any time soon.
I suppose it depends on the extent to which you're impressed by the concept of LLMs, I can see it both ways.

To explain the other way to your thinking: human intelligence is the same; holy crap they cracked robotic 'human' intelligence, it works exactly the same way.
How does one find out what the max input size is?
I don't know if I just use Python "wrong" or something. When I worked as a TA, I've written a lot of untyped Python as Blender/Houdini plugins, and I think it worked pretty well for this purpose.

But later I did some backend stuff, I tried to use typed Python and wrote safer code. Then the whole toolchain becomes so cluncky. MyPy, Pylinter, Flake8, etc. They're so slow, and their VSCode extensions are so weird to configure. And I never got the best practice to work with other untyped libraries. It's not that I don't know how to use typed language. Actually I do backend stuff faster in Rust than Python.

It's probably just me or my VSCode acting up.
Oh is that how it works under the hood?
The infrastructure is harder than the vehicles. New power plants take longer to get built than new vehicles.

Electric vehicles offer opportunity for innovation, but they don't have to be innovative. The zooming Teslas and Mach-E Mustangs get the attention. But that's not
where the volume is. The electric Ford Transit is just a Ford Transit with electric drive. It's boring, but useful. Commercial vehicles which make many stops, from Amazon to the U.S. Postal Service, are rapidly going electric.

The real question is, when do electric vehicles become cheaper than IC vehicles. Last year, the same vehicle in electric seems to cost about US $10,000 more. This year, the Ford E-transit is about $5000 more than the IC version. It's harder to tell for passenger vehicles, because manufacturers are treating "electric" as a premium option and dumping in all the high-markup stuff such as leather seats. At some point somebody will come out with something comparable to the Toyota Corolla at a comparable price. BYD already has, but they don't sell in the US. Then electric sales will take over.
A brilliant guy with a great legacy but he does seem to be in his declining years. He's in grumpy old man mode.
God. LOIC. I haven’t heard that in a while.
Why bother with the weights when you can just take the literal output of another model and consume as part of your training corpus?

What kind of copyright claims can be made against the content generated by a model wielding the desired weights?
Not sure if this fixes a problem that has plagued Apple music products since probably day one:

You cannot play an album as it was recorded.

Not sure if this has changed in any way. I abandoned Apple music offerings a long time ago (iPhone 3 time scale).

You can't play "The Wall" or "Dark Side of the Moon" or the "Brandenburg Concertos" as a unified piece of work and listen to each in order from start to finish. Apple thinks in terms of songs, not albums.

Albums exist in classical and popular music. Not sure why Apple thinks this way. In a sense, it represents total lack of respect for the artist and their work.

It's like a book reading app not having a way to read a book from start to finish. Imagine if it showed you a massive list of chapters from different books and you had to manually find and order chapters to make-up a unified book.

Windows Media understands albums. My entire CD collection is digitized under WM. I can create playlists that consist of of them and play them that way. To continue with the example, I can add Pink Floyd's albums into a playlist and play them one-by-one, in the order they were recorded.
Or do the obvious: move them into management. This sounds snarky, but I'm not being sarcastic. Part of management is making people feel happy and supported, and you don't need the same level of competence in management that you do in IC work (or rather you need a different set of competencies, which they may have).
Just announced that, of course, it will include follows.
Just hope that there are multiple winners in multiple cultures with different takes on intelligence, meaning, purpose.
I dropped out of medical school after the first year and the misery that my then-peers face NOW is astounding (quarter million in student loans isn't even considered "that bad" to the doctors that self-funded, young). Fifteen years later and I still owe debt on that one expensive year!

If your doctor is under forty years old, you're probably doing better than (s)he is, financially (particularly less-specialized practitioners). IMHO, you cannot pay a person enough money for the sacrifices required to enter medical school within the past two decades (i.e. since computer-adoption revolutionized industries).
Yeah, it used to be privatized, but 8(?) years ago that stopped.
There’s a big difference between copyright for material produced by a model, and copyright on the software and weights for the model.

As far as I know, USPTO has said that works crested primarily by AI may not receive copyright protection, but I don’t think there’s any indication that the software to run AI is not copyrightable. Maybe?
God you libertarians need to pick your battles. This is embarrassing.
Something more approachable would be dropping payroll taxes to zero, or even making them negative for some positions, and significantly increasing corporate and capital gains.
Not a solution for everyone... but I have to ask, since you have the time to go to the EU for routine medical work, why not move to somewhere in the US that has doctors?

Also looking at a primary care wait time is fine, but what is broken in most single player systems is specialists and "non-emergency surgery"... which is often stuff that significantly affects your quality of life.

https://worldpopulationreview.com/country-rankings/health-ca...

(the colors represent a primary care, but actually hover over each country...)

-

I ruptured a ligament in my knee and since it wasn't a traumatic injury, the surgery to repair it was considered a non-emergency and I was sent home from the ER.

My uncle is an orthopedic surgeon in Norway and was shocked to hear I was already scheduled for surgery to repair within a week. He said in Norway that would easily have been a month or two wait, which is alarming to me.

At the end of the day the US system is broken, but I think this illusion that single player is some strictly better concept that the US is just rejecting is also wrong. Care is noticeably worse in many EU countries when you look past the singular measure of "Time to see your primary care"
For what it's worth, it's (still, as of writing) possible to turn off forced autoupdates via Group Policy if you buy and use Windows 10/11 Professional.

Any power user would be well served to reuse one of their old 7/8 Pro licenses or buy a 10/11 Pro license instead of cheaping out on a Home license.
Whatever. It's a private company and they can value it as they see fit. A fool and their money will always be parted.
EXACTLY! there's so much research and citizen science being done, and even the field of CS is no good at identifying, preserving, and disseminating the good ideas that our lossy proxies miss. (proxies like "university prestige" or "went to grad school" or "was accepted at top-tier conference")
Yeah the foreign transaction fee is annoying on many cards - I don't have too many cards but I keep a travel focused card (capital one venture) for international travel.
Noisrucer/girok: Beautiful and powerful CLI scheduler
I'm guessing the 75% figure is a proportion of the entire population, not taking into account those who actually voted or were even eligible to vote.
Freedom of speech?

How is that even legal...
Doesn't Windows 10 use TPM for FileVault? I might need it enabled.
Precisely. Especially in India - which is almost as large a time zone offset as you can have. Furthermore, India pays competitively enough that you’re not saving that much money for top talent as compared to e.g Eastern Europe. When I ran engineering teams, the language/dialect barrier between our US mothership and India was much much wider than South American and European devs, even though India is technically the largest English-speaking country in the world.
That is often the case, but not always: It can make perfect sense for a merchant to effectively pay the interest on your purchase, if it means the difference between making a sale now (and getting a bit less than list price) vs. sitting on inventory.

If it's not the merchant paying for the loan, the story is very different though.
U.S. colleges face loss of racial diversity if race-conscious admissions banned
Right, but homo sapiens go back 200,000 (!!!) years. That’s a lot of hunting and gathering, shamans, generations, and gradual process where life wasn’t changing much generation to generation (for thousands of iterations).

And here we are going from electricity to AI in 3 - 6 generations.
AI in 2025: Predictions by an OpenAI Insider and ex-DeepMind Research Engineer
People aren't "strugging" because there is no work for them to do. They are strugging because the powers that be have jiggered our economic system in order to hamper, instead of facilitate, free market cooperation, specialization, and trade. Governments micromanage everything. That is what needs to stop.

If "AI" ends up making governments think they can continue to micromanage and get away with it, yes, that will cause more suffering. But that's not the failure mode any critics of "AI" are trumpeting about.
"getting a 0% loan"

Smart people don't do loans for a $300 purchase in the first place.
GPT-4 (Bing) solves them correctly.
I'm less inimical to the idea of an electric car than I am all of the Orwellian control mechanisms that will come with it.

Contra all of the Really Smart People who seem to view the rest of humanity as livestock, a huge swath of people don't care to be bossed around and treated like livestock by those who are (a) too full of themselves and (b) demonstrably incorrect on pretty much every issue.

Get stuffed, global elite, and leave my diesel vehicle alone.
I think your framing makes it seem like the negative impact of failure comes just from the judgement of others - I'd say it's much easier to build a positive self-image if you remove yourself from the environment in which you were found to be unfit.