skysight-inc/HackerNews huggingface dataset:
> Isn't that awesome?

It depends. In a world where commands produce, expect and consume well defined and highly structured data streams, it is actually great. It works well in Windows but only because scripting as the concept is relatively new to the Windows world.

In UNIX, however, it is usually a mess and data extraction using the PowerShell approach would almost never work due spurious characters appearing in the output of a command (for any reason, really) as the UNIX style is precisely this: «cobble things together, use a sledgehammer to make everything work and move on. If it ain't broken then don't fix it». This is why running the output through a «sed» and searching for stable string patterns to cut interesting parts out and then (optionally) running them through cut/awk/et al is the Swiss army knife.

Life has become somewhat easier recently with the advent and more widespread use of JSON, YAML (and to a certain extent XML before) as we now have jq, yq, dasel, mlr (Miller), xmlto etc – to capture, for instance, the JSON formatted output and do something with it just in the same way it is possible in PowerShell whilst also retaining the extensibility (see below) without having to rely on the availability of the source code of the producing utility/app.

> One of the nice things about it is that you can add stuff easily. You don't have to worry that every script that parses the output of your command will now break because you added an extra column or added extra functionality.

You can only add stuff easily if you control (own) the producer of the data stream. If the producer is a third party provided script/app you don't have the source code for, I believe you still have the same breakage problem, however PowerShell experts might want to chime in and correct me.
That is certainly a reasonable goal, but it is not found in a straightforward reading of the Eisenhower quote. The words clearly suggest a 1-to-1 trade-off between military spending and intrinsically valuable things.
By Node, you mean JavaScript?

If yes, it's fascinating to me, that jq is so powerful, it's even useful when handling JavaScript Object Notation in JavaScript.
I had the exact same experience at a state school in Texas (Computer Science, graduated 2012). Worked the whole time, paid off what I could, and ended up with ~15k in debt that I paid off within 2 years. I completely understand how college isn't for everyone (or even most people), but it worked perfectly for me. I was not exposed to any CS concepts until college, and probably would never have had this career were it not for my education. I know CS is an extreme outlier in terms of earnings potential, so this is definitely a YMMV situation. I don't think I'd go to school for anything other than something that guarantees a lucrative career, which is unfortunate.
I think many parents pay for it because they want their kids gone
That's why I dealt with median and not average :)

Sure, there are a minor handful of nutty expensive (and cheap) markets ... but they're just that - a handful
>There might well be good reasons for these exclusions that I’m not aware of.

Is it possible that these reasons are more obvious or known to some folks and they just didn't list them, or they just wanted to see what happens without those groups, and it's not about shenanigans?
At the very least it's a nice illustration of why you can use plotly but just take a screenshot and post that.
You went to college for a film degree and then found out you couldn't get a job with it. This should not be a revelation. We tell people to "follow their dreams". That's a nice sentiment, but it's just not how the real world plays out. If this guy had gotten a nursing degree, his experience getting a job would have been entirely different.

I'm not saying higher education is perfect, but it's always been the case that some degrees do nothing to further your career or get you a job.
"it teaches you to read, write and think."

Most people learn that by grade 10. College should be for highly specialized skill learning.
I don't understand and agree at all. If information is from public sources, why should spreading it ruin someone financially or mentally? If it's not illegal, what kind of repercussions are acceptable here?
> What matters are connections, professional experience, and the ability to raise large sums of money.

I have yet to find a job where these things are not true. In fact, I very much doubt there’s a job where it is your diploma that gets you that job. It’s almost always your connections. Your diploma from Stanford is more l likely to get you a job because of the name than your success in studying there.

I finished my degree 15 years into my career as a self-taught developer. I probably didn’t need to get it. I do think it made me a more well-rounded person. And I’m proud of myself for accomplishing something that was not easy, by any stretch.
We should perhaps compare having a kid to support and having a job to having a kid to support and using loans to go to film school.
Quite often people will fork so they can tinker locally. It's not odd to see forked repos without any changes, it's just someone being curious or wanting to make a contribution but not having time to go through with it.
This is honestly awesome, copy editing is such a pain point that we schedule weekly 3 hour blocks to go through all changes live. This would greatly streamline our workflow.

Signed up and saw extraction can take several days — is this done manually? I assumed scanning would be done purely automatically but I can see why there would need to be a manual review component.
Did the industrial revolution and green revolution require military expenditures?

I think the most profound revolutions are orthogonal to the conflict-pacifism axis. When a revolution is seen primarily as conflict, the key ideas of the revolution are clearly not yet ripe.
The total spending does not say as much as you'd think, since a large percentage of the Russian military budget goes to the Strategic Nuke forces (which are not very useful for the war in Ukraine) and another sizable chunk goes to the navy (most of which is not even present in the Black sea atm). There are also sizable inland forces for "maintaining political stability" that take up money from the budget but can't be deployed abroad.

This means a large portion of Russian military spending can't be used in the current war. OTOH, almost every Ukrainian military asset they have was acquired with an eventual defense against Russia in mind so they have a much better rate of available fighting power per dollar spent.
Just like much of the healthcare system, government jobs, military contracting, etc., college is a glorified welfare-jobs program for much of the staff and arguably entire departments and schools as well as a business for much of the vampire administrators. Too much welfare relies on the current college system and there have been too many “EdD”’s, MFAs, etc. awarded for us to meaningfully back out of this system. I think the bough will break on society as a whole before anything happens to the school system, considering all the other additional subsystems sucking out resources. These degrees in certain fields have always been a fine vacation for the rich, but unfortunately we’ve beguiled the poor into pursuing them as well. Might as well call it an MLM scheme at this point.
I guess the unanswered question is did we humans make a society because we like people or did we make it simply because we needed goods and services?

If it’s the former, then society will still exist because we yearn for human interaction. I might buy a book written by a bot, but I’ll still discuss it with my friends. Could my friends be replaced by bots? Maybe, but in the same vein my friends could be replaced by strangers but I don’t do that because of human fixation on individuals (e.g. I care what Joe thinks because he is Joe, no substitutions are allowed).

However, if the later applies then society collapses except for the very few people who can create bots better than the bots can create themselves and the monarchs who managed to seize ownership of all the armed drones first.
Indeed! Jq is basically something like grep for JSON.

It might actually make sense to embed jq functionality into your favourite language (as a library or so), as it is quite a nice and well-chosen set of functionality.
Not sure if this came across in the article, but all the "boutique" z* formats are all representations of the same zed model https://zed.brimdata.io/docs/formats/zed/
Home ownership is not an investment - because you "have" to have a place to live, it's just a cost of living somewhere

It might happen to grow in value during your stay, but the home you live in is not an investment: it's just a house
The weakness of the shell is that it did not emerge as an LR-parsed language that could easily be expressed with a concise yacc grammar. The "one true awk," for example, bundled a yacc grammar as part of the build until relatively recently. The complex grammar of the POSIX shell is ambiguous in the extreme in many situations.

The shell language was further constrained by POSIX that removed much Korn shell functionality, even though a public domain implementation of Korn existed. This was done to allow the shell parser to be very small, and Debian's Almquist shell compiles to under 100k on i386 (unlike bash, which trails it also in speed).

This new Hush shell looks a bit too wordy and reminiscent of javascript.

Anyone designing a new shell grammar should also design in such a way that Busybox could bundle this new interpreter, should popularity justify it.
Thanks! That’s a good point. General purpose analytics tools can’t cover specific needs because that will blow up their product and make it even more difficult to navigate. That’s true when using them in other specific industries as well.

While the IoT industry is pretty broad – home appliances, wearables, scooters, etc. – the fact that there’s physical hardware involved means the apps are used in similar ways: connect the device, control the device, read data from the device, etc. In that context, pre-configured charts and industry benchmarks work really well.
How much of this increase is due to inflation?
Well the money can be enticing.. if you manage to get an apprenticeship. Notwithstanding that trades aren't created equal.

I initially went to tradeschool, before college. This was a reflection of self-confidence. I hated it. I often didn't have important tools or had them stolen, I didn't connect with anyone, and there was frankly a lot of standing around and waiting for your turn, there was a substantial lack of written reference material if you so happened to miss what a prof says (and their attention was always monopolized by 1-2 guys). I also didn't want to work graveyard shifts and 12 hour days.
RE [1]: very interesting. Thx for the heads-up about this. I found this related anncoucement, https://www.bic.org.uk/files/pdfs/Press%20Releases/Press%20R... which says the replacement will be the Thema scheme: https://ns.editeur.org/thema/en
This is correct.

And there will need to be some other mechanism to replace vested with payouts over time.

Just saying “you’ll keep vesting” isn’t good enough. People will say ok I’ve got a good grant in 2023 and then my comp falls off a cliff.

They’ll either leave when that vest happens or sooner.
> "... What matters are connections, professional experience, and the ability to raise large sums of money."

That's kinda true about everything though and it's called business. I still remember a speaker from my stem undergrad first year who came in and asked whether we were more interested in :

A. Learning stem theories.
B. Making money.

Maybe 3 out of 100 raised their hands to go with option B. Most of us where like, this guy doesn't know we're not in a business school right...

It took me a long time to realize it's all about business :/
No, Pulseaudio has been the standard audio system on Linux for most of the last decade. Pipewire is the standard one on some more cutting edge distros (i.e. Fedora). If your Linux install comes with a GUI, it will have one or the other.
> the python example is a ton more readable to me.

The python example is also wrong, as in it produces the wrong output: Maybe if you are only worried about your own consumption you can ignore all those poor souls running literally any other application besides ssh and tmux, but at some point you're going to have to stop admiring how "readable" it is and fix it, and then what?

I don't buy that conservative coder mentality of keeping the code clean and readable, because one drop of shit is going to be impossible to remove later. In fact, I think that's bananas. Get correct first, then improve.

> Re the paralell stuff and python it's easy to import multiprocessing and take advantage of all cores

You jest.

> I think where python wins is how easy it is to handle errors

Pray tell what errors do you think we need to handle?
I went to a state school and got B’s and C’s. I got a degree in Political Science, did NOT get into law school, and somehow still turned out successful. College taught me some responsibility, but mainly how to use my head to think through life instead of just reacting. Had I not gone to college I’m convinced I would be in jail, or worse.

College doesn’t make success, it just gives you a set of tools. Ultimately you have to do the work. I am not convinced this author has really put in the work.
> One point of view arguing for a non-stem degree is that it teaches you to read, write and think

This is where these critiques often go wrong in my opinion. There's no mention of what was learned, what value was gained over that time, because I highly doubt it was nothing. As you mention, there is an aspect of project management in making a film. You have to write a film, you have to select roles for your film, you have to delegate tasks. There are all kinds of soft skills that are learned in the completion of any degree program, and people usually take them for granted because they never studied for that specific thing, their project management skills were never tested directly.
They'd written "feeling like I was playing pretty tight and in time", so it doesn't sound like they had a problem with monitoring latency. Probably not using any monitoring?
$47K for the degree itself leads to much larger debt if you're in the sizeable contingent of students that also needs to pay for things like a place to live and meals rather than relying on parents. You're paying $12K/year for the degree and likely $18K/year for rent and another $18K or so for other expenses. If you're making $30K/year from a part time job and paying $4K of that to taxes. you end up with a $22K/year shortfall which after interest is likely to be $100K of college debt.
A great example of something that does not need a blockchain. You're just asking for the relevant government departments to publish their books.
>You cannot examine the what the world would look like if there was no military spending; that's a counterfactual. But we know from essential economic science that spending money on non-productive activity does not serve to increase the general economic welfare

Right, but it's not exactly "non-productive", from the article:

> One way in which defence spending might be said to boost the economy is as a jobs programme. [...]

> Defence spending may deliver better returns as an undeclared form of industrial policy. [...] On average, they found that a 10% increase in government-financed R&D leads to a 5% increase in privately financed R&D in the targeted firm or industry. Moreover, there are knock-on benefits for productivity.
The difference I see is that an ML model is at first glance not a compiled binary with hidden mechanics: It’s a network graph with weights on the edges and where all nodes work in the same easy-to-understand way. The model also isn’t a unique function of the training data in the way that the compiler binary is a function of the compiler source — you can get slightly differently behaving models from the same training data, so you can’t totally predict the model’s behavior from the training data like you can predict the compiler’s behavior from the compiler source. The model itself is generally the better “source” for predicting (well, simulating) its exact behavior. That’s why it is surprising that the presence of a backdoor can remain undetectable by inspecting the model. There would be somewhat of an analogy if there was a backdoored compiler where the backdoor cannot be detected by analyzing the compiler binary’s machine code.
I agree with most of what you say.

I disagree with 'leaving for a higher level language'. Jq is an extremely high level language.

What it is _not_ is a general purpose language.
Bootloop on beryllium, should have waited couple days to upgrade.
time to move to Fidelity
> It's not as arcane as it seems.

The issue with jq is that I use it maybe once a month, or even less. The syntax is "arcane enough" that I keep forgetting how to use it because I use it so sporadically.

In comparison awk – which I also don't use that often – has a much easier syntax that I can mostly remember.

Not entirely convinced by the zq syntax either though; it also seems "arcane enough" that I would keep forgetting it.
I manage the laptops and desktops of a >50 company.
And I've installed PopOs on almost all of their systems (some have Ubuntu)
I'm very happy with the stability and indeed the sane defaults.
Most users are happy with it and a lot of them are new to Linux.
Learned of PopOs through buying some System76 laptops.
Being able to download a nvidia version of the iso image has really helped as well.
Demonstrate its use as such. Extraordinary claims, etc.

The level of scrutiny on SpaceX is incredible, and rightly so. Any unethical conduct or illegal money shuffling would be caught out quickly.
Thanks for the list and your thoughts. Now I know I’m not giving up much from using a Mac with MacOS instead of a linux desktop distro. Because, I don’t have the needs that you have.

I need a computer that works without too much fiddling required for 80% of the way. When I shut the laptop lid, it should sustainably go to sleep, and when I open it up, it should let me work from where I left off instantly. It may be possible to do this with some linux distributions, but then I would either have to know some black magic or give up something else like have a decent battery life.

I love and use Linux for all things serious _on_ _servers_!
Desktop Linux has been a democratic tragedy of the commons. Too many chefs in the kitchen comes up with a meal that has too many flavours in a single dish.
My guess is their low-end usb mic did not accurately report its latency, and so the Ableton wasn't able to automatically adjust. It's still a possible to adjust manually, though.
Sounds like planned obsolescence is permeating software. The idea that new = better while old = bad is wrong to me. There is such a thing as finished software. If your app is a compass, or a game, and it works, why barring it? Especially when there's no constraint for space
(maybe 5-10k, been a while now and I don't remember)

How long ago was it? I only ask because my eldest child is currently at university, and I believe the experience I had in the 1980s and she has now are fundamentally different. The academic, financial and employment landscape has changed a lot in the past 20-30 years, and that creates different pressures for both students and institutions.

I now firmly believe doing a vocational, or at least employment-friendly, course at a local college or university, and probably living at home as a result is the best course of action for most students.
No matter how convincing you are, you can't succeed at fundraising if all your friends are broke.
Maybe it's a bad idea, but I wonder if tightening up the API would be a good idea.

Something like a throttle or disabling js redirects if it's breaking the history buttons.
If I had gone to college I might have ended up with a social life and probably wouldn’t have done much better/worse economically.

I have this current theory that there are a lot of domain/industries even in software development are made much harder to get into for the “uneducated” because the companies tend to source less experienced employees exclusively through university hiring pipelines.

Now I have no qualms absolutely tearing into the current implementation of higher education, but I’ve spent most of my life as an observer and I definitely see now some huge benefits of higher education outside a piece of paper and lectures.

My biggest frustration is that non-traditional students (outside a single demographic being ex-military) are thrown to the wayside or straight up scammed by otherwise legitimate colleges. When I first started looking at going back I was dumbfounded when schools were more interested in my high school disciplinary record and not really interested in my established professional and experience.

One popular state research university near me started offering online programs for “professional and non traditional students” but the only degrees offered are “useless liberal arts degrees” (think degrees that are used as the punchline in political slurring battles) or “made up” degrees that aren’t remotely related to any on-campus program, are often worse than the aforementioned liberal arts degreee and are designed for no other reason but to extract money from poor people. A lot of them also have jumped in the bootcamp hype. I can’t tell you how much spam I’ve seen from universities wanting me to join the Cybersecurity bootcamp.

Again this is not your typical For-profit university, this is a respected state school with best on the nation programs in certain areas.
Marks left on the keyway.
The extrapolations the author of this pastebin makes reminds me of the charts that plot how fast people ran the mile (or the 100 meter dash) - if you pick the right scale, you can predict when someone'll break the 3 minute mark for the mile

And the 2 minute mark (which, btw, is an average of 30mph)

But if you keep it up, eventually you can see where someone will run the mile in negative time
Why the downvotes ;-) Thought that was funny
Don’t want to jinx it but the process has been painless. Technically I’m using EndeavourOS. Had to install with a USB wireless adapter but after the driver, it’s great. Everything “just works” including suspend/wake with lid, keyboard backlighting, brightness/volume fn keys etc.
Don't tell anyone, but jq is secretly a pretty well thought out functional programming language.
Wouldn't it be cool if you could short Bitcoin and have it reverse the environmental consequences?
I probably didn't learn much in the college but but it was possibly the biggest leverage I had to leave a declining country and come to Europe at a young age. The effect has been wildly life-changing.
The site has a note that if the devs think they haven't made enough money by this time next year, "refundable" donations will be refunded, minus the 4% processing fee.
The scam is in convincing (very young) people that they need to pay six figures to acquire those experiences.
The idea that almost any 18-year old can take on large amounts of unsecured debt to go to film school is the problem.

Making the debt non-defaultable isn't the solution. It's eliminating the credit.
The WSJ had an article about how graduate film programs are even worse...

>Recent film program graduates of Columbia University who took out federal student loans had a median debt of $181,000. Yet two years after earning their master’s degrees, half of the borrowers were making less than $30,000 a year.

https://www.wsj.com/articles/financially-hobbled-for-life-th...
#WagonWheel