skysight-inc/HackerNews huggingface dataset:
The biggest win here has to be the context length increase to 128k from 8k tokens. Till now my understanding is there hasn't been any open models anywhere close to that.
Usually cruise control refuses to activate below a certain speed, feels like it’s about 28mph in cars I’ve driven. If “many of the incidents occurred when drivers were parking”, this doesn’t line up.

Unless VW lets you engage cruise control when you’re very slow?
I think anyone who has thought deeply about the topic recognizes that NIT is probably the only practical implementation (if you search this thread it gets mentioned a lot). There are the MMT folks that think you could finance UBI with deficit spending, but I think the recent bout of inflation we experienced has them on their heels.

At the end of the day, if someone is making $500k/yr and we give them $12k/yr in UBI, that isn't really going to move the needle for them. And from a practical standpoint, we are probably going to have to raise their taxes by a bit more than what they are getting in UBI to pay for the program. So it is kinda pointless. NIT solves this. And as an added bonus NIT can be implemented by the IRS, eliminating the need for another bureaucracy (although some UBI folks suggest that the social security admin can handle things, but I would argue that we should get rid of social security and just have a bigger NIT for seniors).

I still consider NIT to be "universal", because everyone would qualify for it. You do not need to apply for it. And it will kick in automatically when you need it. A lot of our current welfare programs are a bureaucratic nightmare. There is an entire industry of non-profits that exist solely to help people navigate that mess. A lot of people don't get the help they need because of this, or because they don't like the stigma of being on welfare. NIT/UBI eliminate that, so that is why I consider both to be "universal".
Yes in the fullest. For one thing it's against the ToS of every site. But it's also just plainly unethical. Even the most elite players are merely reaching a moderately accurate approximation of optimal play, which completely pales in comparison to a bot that can find it on every hand. Of course a bot that simply assumes opponents are playing co-optimal strategies will only be minimally exploitative, but more sophisticated bots can easily incorporate historical data and find correct maximally exploitative deviations against opponents in real time, which again is something that even the best players are only able to do accurately a fraction of the time.

Also it's laughable to suggest that playing optimally is "just the given" in MTTs, which are arguably the softest format available where almost nobody in a given field is playing anywhere close to optimal. And even more laughable to suggest that modern bots are akin to players adhering to SuperSystem, a poker strategy book written nearly 50 years ago which was already extremely outdated before the advent of solvers 10 years ago.
Is Steve Ballmer the Most Underrated CEO of the 21st Century?
I can't expect all my users to have 3090s and if we're talking about spending millions there are better things to invest in than a stack of GPUs that will be obsolete in a year or three.
>In the early days of high-performance computing, the major tech companies of the day each invested heavily in developing their own closed source versions of Unix.

Because they sold the resultant code and systems built on it for money... this is the gold miner saying that all shovels and jeans should be free.

Am I happy Facebook open sources some of their code? Sure, I think it's good for everyone. Do I think they're talking out of both sides of their mouth? Absolutely.

Let me know when Facebook opens up the entirety of their Ad and Tracking platforms and we can start talking about how it's silly for companies to keep software closed.

I can say with 100% confidence if Facebook were selling their AI advances instead of selling the output it produces, they wouldn't be advocating for everyone else to open source their stacks.
Boosting fruit intake during midlife can ward off late-life blues
There is also the risk of companies like Meta introducing ads in the training itself, instead of inference time.
I thought they meant the founders were already billionaires before founding Wiz...
Im doing both and yes its very different. The stress at the big companies is nothing.
Here's one that I have dealt with personally: paying taxes as an American that lives abroad (and wants to use the foreign income exclusion) is a nightmare filled with misinformation and tedium.

I don't know if this is actually a market worth pursuing, but I do know that I paid some company $500 to fill in a form for me and help figure out the process. They probably spent an hour or two on my case.

With the increase of dual citizens, digital nomads, etc. this seems like a growing market to me.
Switzerland now requires all government software to be open source
Wow… it’s like imagine those accidental mouse clicks I always make on my macbook pro’s touchpad when I’m typing, but instead the car starts accelerating with cruise control. Yikes!
“ Although there were no differences in the likelihood of CSEW headline victimisation by sex, women were more likely to experience sexual assault, stalking, harassment and domestic abuse”

https://www.ons.gov.uk/peoplepopulationandcommunity/crimeand...
Be careful what you wish for.

A Gibsonesque global Turing Police is a sure sign of Dystopia.
OK, I am curious now: What kind of hardware would I need to run such a model for a couple of users with decent performance?

Where could I get a mapping of token / time vs hardware?
How does one access the a rise in reports? A rise in reports could be bad or good. A) it could be good because the rate of crime is fixed, but more crimes are being reported. B) it could be bad because the rate crime is rising (with the same proportion of crimes being reported). C) it could even be bad because there is an increasing number of false reports.

I am also very intrigued by how one actually estimates rates of things like false reports, unreported crimes, and false convictions. How given that by these categories definitions they are being miscatagorized by the system does any academic or institution estimate these statistics? It seems one would need an independent body to conduct separate investigations to properly estimate any of these
The employee, under current laws, does not get to skip out on taxes; they have to pay the self employment tax rate of 15%; We're talking about 40 hour weeks, that kind of regular pay doesn't go un noticed by revenue offices.

Yes, the employee must file and pay taxes, even if they've reported their employer to the IRS for mis-classification.
Ask HN: How to celebrate TiddlyWiki's 20th anniversary?
TiddlyWiki (1), the versatile personal wiki and note-taking tool, turns 20 in 2024 (2). We're seeking ideas from the community, especially those involved in other open-source projects, on how to mark this milestone.

We're considering various options: refreshing the visual design, creating merchandise, producing a comprehensive history, or even reaching out to tech journalists and YouTubers for coverage.

Our goal is to honor TiddlyWiki's legacy while potentially attracting new users and contributors. We're open to suggestions that could modernize its appeal without losing its essence.

What creative ways have you seen other open-source projects celebrate significant anniversaries? How can we best use this occasion to highlight TiddlyWiki's unique features and community?

1: https://tiddlywiki.com/

2: Community discussion: https://talk.tiddlywiki.org/t/tiddlywiki-is-almost-20-years-old/8068
> "Capacitive buttons require only the lightest of touches to register a button push."

So they put them where they'd be brushed accidentally. On the steering wheel.

This is so ridiculous. I'd like to see exactly who decided that was a good idea. Was it engineers, or was it design/marketing/management?
If this is malice rather than incompetence, it seems... extremely unwise. A big part of what Twitter has left are journalists who are there through inertia; if they have to go to Threads or whatever to reliably get the presidential candidate's Tweets, that's quite bad for Twitter.
It seems to be advantageous to a significant portion of the political class that people hold this misconception - this type of misconception explains much of the widespread public support for tax breaks for the ultra-rich...
> if Facebook were selling their AI advances instead of selling the output it produces, they wouldn't be advocating for everyone else to open source their stack

You're acting as if commoditizing one's complements is either new or reprehensible [1].

[1] https://gwern.net/complement
What are you even talking about? Every piece of desktop software you have ever ran has more permissions than a browser extension.

Is your stance that hobbyist developers should not be allowed to develop desktop software or CLI tools? The entire software development ecosystem would collapse in an instant. Or are you just not familiar with Windows & Macs (lack of a) permission system?
thanks. hoping the Nvidia 50 series offers some more VRAM.
You might have some probability distribution in your head for what will come out of GPT-2 on your machine at a certain time, based on your knowledge of the random seed. But that is not the GPT-2 probability distribution, which is objectively defined by model weights that you can download, and which does not correspond to anyone’s beliefs.
"Use it for whatever you want(conditions apply), but not if you are Google, Amazon, etc. If you become big enough talk to us." That's how I read the license, but obviously I might be missing some nuance.
This website traps me on mobile, can't use the back button. Fennec on android
I own an ID.4. I absolutely hate the capacitive controls. They can easily be activated accidentally, and you never know what happens if you touch a certain area. Some places/buttons are sensitive, some are not. It's a UX nightmare. Like volume buttons on the steering wheel, where if you try to feel for them without looking, you end up accidentally "swiping" and turning your volume up to the max.

For example, the whole touch cluster on the left of the steering wheel, just below the vent, is a disaster. If I want to check the temperature of the air that's blowing into the cabin, I end up accidentally turning off the lights, turning on rear antifog lights, and turning on defroster heating for the windshield. The next minute or so is spent trying to get everything back to normal.

Also, all of the software on the ID.4 is a dumpster fire, but that's a story for another time. I'd be ashamed to ship something like this.
Doubtful that GPUs purchased today would be in use for a similar time scale. Govt investment would also drive the cost of GPUs up a great deal.

Not sure why a publicly accessible GPU cluster would be a better solution than the current system of research grants.
Some of those benchmarks show quite significant gains. Going from Llama-3 to Llama-3.1, MMLU scores for 8B are up from 65.3 to 73.0, and 70B are up from 80.9 to 86.0. These scores should always be taken with a grain of salt, but this is encouraging.

405B is hopelessly out of reach for running in a homelab without spending thousands of dollars. For most people wanting to try out the 405B model, the best option is to rent compute from a datacenter. Looking forward to seeing what it can accomplish.
Probably not. The US nuclear triad is very well known and doesn’t rely on exact numbers. It isn’t like Russia would think “maybe they decommissioned all their SSBN nuclear subs and we are in the clear” until they saw the yearly numbers. The point is that we already have plenty enough to obliterate any nation on earth in either a first or second strike. The arms reduction treaties and transparency have always been to reassure war hawks that we still have plenty to kill everyone, so we don’t need to spend money making more and risk an accident.

If you want to saber rattle, you test new systems like hypersonic missiles that are capable of carrying nuclear warheads. Or you perform “military exercises” to show how capable and/or stealthy your nuclear subs and bombers are.
Yes, most consumer home security products have a security subscription attached because they require monitoring (and many jurisdictions require monitoring for alarm permits to help reduce false alarms). For Ring, that also means the features listed on their product page (cloud video access and history, etc).
I never really liked Zuck due to Facebook's massive black hole of user tracking, but you've gotta give it to him: the Llama models are insanely good, and the commitment to making Horizon OS available to other VR manufacturers is commendable, although I'd like to see it truly open sourced.
Touchscreens appeal to a lot of knuckleheads, but mainly the main reason they're so popular is because manufacturers can do the wiring once, then change the UI as much as they want without having to redo it. In other words, it's cheaper for them. One thing touchscreens don't do is perform better than physical buttons and knobs.
Only until they're found out.
Interval trees or ordered segment sets are the "correct" answer but sometimes you can accept constraints in your domain that radically simplify– for example, with equipment availability and time slots, you may have a fixed window and allow for slots to only fall on 5 minute marks. With those 2 constraints in place, a simple bitmask becomes a viable way to represent a schedule. Each bit represents 5 minutes, and 1=avail 0=unavail
Sure, I get that. But are the people trying to maximize income as an employee really looking for the low stress route in the first place?

I suppose I should have qualified my comment by saying it's if your primary aim is to maximize income.
Open training dataset + open steps sufficient to train exactly the same model.
Groq Supercharges Fast AI Inference for Meta Llama 3.1
> you can't meaningfully modify them given there is almost no information available about the training data, how they were trained, or how the training data was processed.

I was under the impression that you could still fine-tune the models or apply your own RLHF on top of them. My understanding is that the training data would mostly be useful for training the model yourself from scratch (possibly after modifying the training data), which would be extremely expensive and out of reach for most people
Can’t you do fine tuning on those binaries? That’s a modification.
That was the punchline of a joke.
Could Microsoft put pressure on UEFI vendors to coordinate a way for such reinstallation to be suppressed during this failsafe boot?
Given CL and Guile (never heard of Janet), with a focus on practicality, I suggest CL.

I go into more detail in the posts I linked. While a few months old they still hold up.

https://port19.xyz/tech/other-lisps/
https://port19.xyz/tech/clojure/

I suggest you be careful with non-repl-based lisps. Noone I talked to in Racket circles seriously uses the repl superpowers you'll get used to in CL, Clojure or Guile.

Beyond the beauties of homoiconicity, that repl workflow, programming at runtime, has been my favourite part
Another case of "open-washing". Llama is not available open source, under the common definition of open source, as the license doesn't allow for commercial re-use by default [0].

They provide their model, with weights and code, as "source available" and it looks like they allow for commercial use until a 700M monthly subscriber cap is surpassed. They also don't allow you to train other AI models with their model:

"""
...
v. You will not use the Llama Materials or any output or results of the Llama Materials to improve any other large language model (excluding Meta Llama 3 or derivative works thereof).
...
"""

[0] https://github.com/meta-llama/llama3/blob/main/LICENSE
This is the first good data on direct cash transfers in developed countries. The results in developing countries were quite different:

https://www.givedirectly.org/2023-ubi-results/

People in that study were receiving a lot more money, relative to typical local incomes. But it seems like they used it quite differently. I think there are major differences between poor people in rich vs poor countries.
Should have "in react" in the title
I assume that any piece of technologically backed infrastructure is a potential target for state-level actors. If rando security researcher finds the vuln in 15 minutes, I guarantee China already has it.

Anyone operating infrastructure hardware is negligent if they won't take basic measures to harden it against disclosed threats.

I’m not worried about malfeasant citizens mucking with the traffic lights, there are simpler ways to make mayhem. But in the event of a war, you can bet every unpatched vulnerability in your infrastructure will be used against your country.
Given how easy it is to expose functionality from the host language using existing facilities [0], and how complicated a reflection based FFI could get; I would rather not, at least not right now. It's also one of those decisions that will drastically limit my choices for future evolution of the implementation.

The general idea is to use both languages together, as complements; not calling one from the other.

https://github.com/codr7/sharpl/blob/main/src/Sharpl/Libs/Co...
Okay, I have to ask: why on earth would someone downvote this?
Unfortunately, it also could be an intentionally false statement in order to push a specific political viewpoint. For example, flat tax rates without income brackets. I don’t think it’s wrong to correct falsehoods strongly in general.
The Rule 34 of system design
The 405B model is already being served on WhatsApp:
https://ibb.co/kQ2tKX5
Probably paying for the ability to save video recordings in the cloud, as opposed to paying them monthly to ensure they dont send goons to break into your house.
I also think that something like Chromium is a better analogy for corporate open source models than a grassroots project like Linux is. Chromium is technically open source, but Google has absolute control over the direction of it's development and realistically it's far too complex to maintain a fork without Googles resources, just like Meta has complete control over what goes into their open models, and even if they did release all the training data and code (which they don't) us mere plebs could never afford to train a fork from scratch anyway.
Exactly so.

Here's the script, should it be of benefit to someone, even if it of course needs to be modified:

#!/bin/sh
success=false
teardown() {
umount /mnt/backup/var/lib/docker || true
umount /mnt/backup/root/.cache || true
umount /mnt/backup/ || true
for lv in root docker-data; do
lvremove --yes /dev/hass-vg/$lv-snapshot || true
done

if [ "$1" != "no-exit" ]; then
$success
exit $?
fi
}

set -x
set -e
teardown no-exit
trap teardown EXIT
for lv in root docker-data; do
lvcreate --snapshot -L 1G -n $lv-snapshot /dev/hass-vg/$lv
done

mount /dev/hass-vg/root-snapshot /mnt/backup
mount /dev/hass-vg/docker-data-snapshot /mnt/backup/var/lib/docker
mount /root/.cache /mnt/backup/root/.cache -o bind

chroot /mnt/backup kopia --config-file="/root/.config/kopia/repository.config" --log-dir="/root/.cache/kopia" snap create / /var/lib/docker
kopia --config-file="/root/.config/kopia/repository.config" --log-dir="/root/.cache/kopia" snap create /boot /boot/efi
success=true
The link was changed at some point, from the original Medium article:

> Unlike traditional workflow orchestrators that only support Directed Acyclic Graphs (DAGs), Maestro supports both acyclic and cyclic workflows and also includes multiple reusable patterns, including foreach loops, subworkflow, and conditional branch, etc.

https://netflixtechblog.com/maestro-netflixs-workflow-orches...
> People need to realize that code is a liability

Code that you own and intimately understand is less of a liability than some 3rd party dependency (paid or free). Stitching together a patchwork of dependencies is not likely the optimal result. The more aligned your codebase is with the problem you're trying to solve the better, and if functionality is core to your business better to own than borrow or rent.
Even if you're uniquely good at what you do, a lot of companies won't reward it. You do still have to look hard for those opportunities.
Bird in the hand
I have a sit-stand desk from Costco with capacitive height controls set under the glass top off to the right. The problem is not so much accidental human touches, but setting anything slightly conductive on the switch will trigger the height control, including things like computer mice and ceramic coffee mugs (as long as they have some liquid in them), exactly the sorts of things that a right-handed person might want to set on the right corner of the desktop.

The desk is otherwise great and was really inexpensive for what it is but it's a super frustrating design decision.
MMLU PRO is the benchmark I trust the most. I noticed they are using 5 shots and CoT. Is that true for GPT4 and Sonnet as well?
Because respiratory virus is an oversimplification of COVID, yes that's why people die from it, but it affects all cells with ACE2 receptors, for example neurons and blood vessel linings.
Now you start to get into the differences between the various standards :)

In NEMA TS2 (and the more modern ITE ATC), the MMU does enforce a yellow clearance time - you need the light to turn yellow for a period of time before a conflicting phase goes green. Usually this is a few seconds. Changing phases rapidly would likely confuse drivers, but in _theory_ shouldn't cause a collision if people respect yellows.

(believe it or not, in some localities a "red clearance" time - all red - is not required and lights will go from yellow in one direction to green in another.)

In CalTrans TEES, I do not believe the standard calls for the MMU to enforce clearance times - the attack you describe would potentially be possible.
Isn't async/await "scheduling heterogenous work with nuanced dependencies"? Or is that what you were implying?

Although my real guess is ECS but that's more like the "everyone gets every thread for a time."
Accountants, when they saw how much cheaper they are.
> Doubtful that GPUs purchased today would be in use for a similar time scale

Totally agree. That doesn't mean it can't generate massive ROI.

> Govt investment would also drive the cost of GPUs up a great deal

Difficult to say this ex ante. On its own, yes. But it would displace some demand. And it could help boost chip production in the long run.

> Not sure why a publicly accessible GPU cluster would be a better solution than the current system of research grants

Those receiving the grants have to pay a private owner of the GPUs. That gatekeeping might be both problematic, if there is a conflict of interests, and inefficient. (Consider why the government runs its own supercomputers versus contracting everything to Oracle and IBM.)
Is this a widespread issue?
I don't know

How significant is it?
Not significant to me

How are freelancers currently dealing with these challenges?
Various tools like QuickBooks, HubSpot and Chatgpt
If you are a tiny business, you just need an indemnity clause. If you have employees, you pay for E&O insurance.

Im not saying any of this is obvious, but if you are applying to work at a FAANG, I will assume you are both smart enough and ambitious enough to do a bit of research.