skysight-inc/HackerNews huggingface dataset:
Two more, edited for HN of course. These are scripts/snippets that would often be used in or by other scripts. Unlike Python, these scripts will keep working for many years with zero "maintenance". They will probably still be working long after I have passed away.

Task 1: Transform (a) the BIND format of stub resolver output, i.e., the format used by "dig" and many other stub resolvers, to (b) some other format, like HOSTS file, BIND/tinydns zone file, haproxy map file, etc. The input would typically be catenated stub resolver output for hundreds to thousands of domains. The epoch program is three lines of C.

NB. For large input on Linux, dash is significantly faster than bash. I wrote a C program that does the job of this script, faster than dash, and much faster than python. However I still prefer the shell for testing ideas, quickly.

EPOCH=$(epoch);
tr -d '\12'|tr ';' '\12' \
|sed -n '/ANSWER SECTION/{s/ ANSWER SECTION://;
s/\.[^-0-9a-zA-Z].*IN[^-0-9a-zA-Z]*A[^-0-9a-zA-Z]/ 1 IN A /;
# list domains to exclude
/www.google.com/d;
/^$/d;/^.$/d;p;}' \
|{
exec 2>/dev/null 3>&3 4>&4 5>&5 6>&6 7>&7 8>&8 9>&9;
while read NAME TTL CLASS TYPE IPADDR ;do
echo $NAME $TTL $CLASS $TYPE $IPADDR;
echo $NAME 1 $CLASS $TYPE $IPADDR >&3;
echo $NAME $IPADDR >&4;
echo $NAME $IPADDR \# $EPOCH >&5;
echo =$NAME:$IPADDR:1 >&6;
#_IP_()
# {
# echo $IPADDR|grepcidr -f $1-ips.txt >/dev/null;
# }
#if _IP_ cloudflare ...
#if _IP_ aws ...
#if _IP_ cloudfront ...
#if _IP_ fastly ...
#if _IP_ akamai ...
# etc.
done;
}

For example,

drill example.com|1.sh 3>>1.zone
kdig example.com|1.sh 4>>/etc/hosts
drill example.com|1.sh 5>>1.map
kdig example.com|1.sh 6>>data

Task 2: Extract and transform CloudFront domains and their CNAMEs from BIND format stub resolver output to haproxy map format.

grep -A1 ANSWER.SEC|tr '\11' '\40'|sed -n '/cloudfront.net\.$/{s/\. .* / /;s/\.$//p;}'

For example,

drill blogs.aws.amazon.com|2.sh >>2.map
I mean... I stopped reading after the first dozen paragraphs... because I hate the reductionist logic here. I am neither irish, nor and expert in irish history (though I actively listen to a pretty thorough podcast about it), but I am a philosopher by training, and this read like big fat True Scotsman logic.

Perhaps the author misdirects in the opening (I hope so), but they seem to be caught in the reductionist culture=identity trope that much my home country of America suffers from. Examples here include absurdisms like "Obama isn't black enough" as if a black man isn't black if he doesn't act a certain way.

Many cultures are built in opposition to other cultures, yes, and while that is true, the entire of culture is that it's made up of the people within it. When that starts to change, it just changes, it doesn't go away. In my life America went from being known for it's light lagers, now it is know for over hopping all our beers. We went from Safeway to Trader Joe's being the dominate grocery chances. Is America not America? No! Is California more Californian? No!

Culture is the culture that the people in the culture choose to celebrate. There are no True Scotsmans, only Scotsmans, who occasionally disagree.

Ireland is the people in it. If they change their religion, and their national sport and drink, then they will be a different Ireland than they were, but they will still be Ireland so long as people identify as Irish.
I think the difficult part would be that tagging and indexing the relationship between a single tweet and all of its component hashtags (which you would then likely want metrics on to avoid needing to count indexes on, etc.) is where it would really start to inflate.

Another poster dug into some implementation details that I'm not going to go into. I think you could shoehorn it into an extremely large server alongside the rest of your project but then you're looking at processing overhead and capacity management around the indexes themselves starting to become a more substantial part of processing power. Consider that for each tweet you need to break out what hashtags are in it, create records, update indexes, and many times there's several hashtags in a given tweet.

When I last ran analytics on the firehose data (ca. 2015/16) I saw something like 20% of all tweets had 3 or more hashtags. I only remember this fact because I built a demo around doing that kind of analytics. That may have changed over time obviously, however without that kind of information we don't have a good guesstimate even of what storage and index management there looks like. I'd be curious if the former Twitter engineers you polled worked on the data storage side of things. Coming at it from the other end of things, I've met more than a few application engineers who genuinely have no clue how much work a DBA (or equivalent) does to get things stored and indexed well and responsively.
Huh? Did we read the same article? This was explicitly a critique of the techno-libertarian ex-hippies, along the lines of everything you just said. Read it through the end and read each paragraph.

I read and loved this and propagated it around my friends when it came out in the mid 90s. It was a poignant criticism of the bullshit fake utopia being sold by Silicon Valley and the .com boom at the time.
I wouldn’t go that far. However it just doesn’t effect EVERY photo in a bad way. At this point users are in the habit of taking lots of pics and throwing out the bad ones. When the software misses it just goes into the trash. But other times the software doesn’t miss and it’s appreciated.

I personally have a nice photo shoot with my partner but everyone noticed that I kinda look like a cardboard cutout in some. the post processing was def not missed by very none technical users.
It is how I learned to read, early on I could read lots of words I had no idea how to pronounce.

Makes reading sci-fi with funky alien names much easier! :D
I think the most important problem is to move the society towards the next stage in which everyone can pursue whatever they want, be it art, science, technology, etc., and have the total freedom to do so without being burdened with financial or others. All people are inspired, not forced, to pursue whatever topic they are interested in and are given sufficient resources to do so.

So that the human society can move through the Great Filter and become a galactic species eventually.
Not at all a bad take. The PE model has only existed during the ~40 year period that were an extreme outlier in terms of bond performance, liquidity, and equity return averages. They've never had to suffer a tail event that wasn't papered over with cheap money, even though we know historically that the papering over of business cycles is not a game that can last indefinitely.

Demanding "data" from other people without explaining why that person has the burden of proof to produce data for something they have already explained while the requester has simultaneously also provided no data on anything is one of the laziest and lowest value takes that frequently gets repeated on here.
Well, rBST is banned in the EU, non on health or safety but on animal welfare grounds, as cow udders are not made for that level of milk production and mechanical milking causes distress and injury (mastitis) to the cows.

Also there is a difference between BST (bovine somatotropinnatural) and rBST (r stands for recombinant, the manufacturing process) the synthetic kind. The FDA's "concerns" are transparently based purely on the commercial interests of rBST producers like Monsanto and their customers'.
I'm impressed with your complete lack of snark in response to my asininely snarky comment, edit or no. I went from thinking you're a bad maintainer to thinking you're one of the more level headed ones I've interacted with. I feel like there's some kind of lesson here about Bayes' Law.

I never used i3 much beyond trialing it for embed stuff(went with dwm). I'm too much of a Lisp nerd not to use StumpWM. I like the fact that your stumpwmrc is essentially just a live patch for your WM. You can redefine arbitrary functions, classes, variables, define commands with arbitrary code in them. And you can patch the WM while running via Emacs.

How is i3 support for more obscure unices like OpenBSD, Illumos etc? StumpWM is kind of a pain to get working after they dropped support for all compilers except sbcl...

And I agree completely general in about the tradeoffs of adding features.

It's tough to do, though my philosophy in this specific case is also that customization is a core feature of any good tiling WM and should be priorited almost above all, except performance and minimalism.
Especially frustrating is the slow animation on the autocorrect suggestions. It significantly slows my typing speed and annoys me every time I have to use it and there's no way to turn it off.

This alone pushes me towards Android phones since the keyboard experience there is in a completely different class.
That would explain taxes, and to some degree regulations, not taking away control entirely.
Challenges with capturing and storing rainwater for drought in California
To a limited extent, sure, but kids books are also written to be very emotive.

The linked page actually has examples of the same text being read with different emotions, demonstrating that for even a single sentence a lot of variance is possible.
I was skeptical about 1PB in 1U, but searched and learned this was showcased by Supermicro as far back as 2018:

https://www.supermicro.com/en/pressreleases/supermicro-unlea...
When ChatGPT first arrived, it felt amazing and revolutionary. Since then it's been so neutered that while still feeling pretty cool, it's settling into gimmick level :( .
> It isn’t. People saying modeling is indistinguishable from analog gear are just incorrect.

It's actually the opposite. Modelling can absolutely reproduce any audible effect you can find or imagine.

What is true is that, for any specific effect or device or technique, there probably isn't a ready-made model for it. Or there is, but it's for some variant of the amp that the software author used and not the one you want. Modelling is expensive in engineering time.

But if you just want a stable of high quality effects from which to assemble audio for recording or performance, analog junk frankly has nothing to offer in the modern world.
Sometimes I want deep discovery and filtered UI for product searches.

And other times, I want Star Trek-style omniscient chatty search: "computer, select a blue woolen sweater $50-100 that ships before Tuesday."

Both types of searches are necessary. ChatGPT is already one of my frequently-used search engines now, especially for conceptual overviews.
Musk seeks to move trial over Tesla tweets, arguing SF jurors biased
The government routinely compels speech. It's weird that we'd be trying to derive this from first principles: you can just go to your pantry and pick up any packaged food item.
I think people that require that level of security don’t run around talking about it. I could be wrong…
This is a really good list.

I head engineering for an enterprise SaaS startup in the manufacturing space. Wanted to add a few points to this:

1. Software Integrations: Enterprise software is almost never deployed in a vacuum. There will be a ton of existing software that companies use that they would want you to integrate with - most commonly being either some CRM like Salesforce or an ERP like SAP, Oracle. When pitching to a customer, it would be great to try and learn what existing software tools they use and see if opportunities exist to try and integrate with them ultimately. This will make your software very very hard for them to get rid off later and will also help distinguish you from your competitors who might try to be avoiding integrations. Designing your architecture with integrations in mind is a good idea.

2. Audit logs: Depending on the industry, there might be a strong requirement for compliance/auditing. The enterprise would want to ensure that every action undertaken on the platform is audited and can be reviewed on-demand later.

3. On-premise vs Cloud deployments: You might find certain clients that operate their own hardware and software and want you to just hand them some executable that they can deploy in their systems. On the other hand you'll also find companies that have gone all-in on cloud and won't bat an eyelid as long as you are deployed on some known cloud like Azure, AWS or GCP. Increasingly more and more companies are going the private cloud route and ask you to deploy on their cloud accounts (most commonly Azure - Microsoft has a much stronger hold on the enterprise market). Be prepared to handle requests like these. In several cases, you might be able push to have the SaaS being served from your cloud accounts but not always.

4. IT departments: Enterprise companies will invariably have an IT department that is supposed to ensure that the procurement process goes smoothly from a technical perspective and that you are compliant with all of their technical requirements. Their primary job is to ensure their asses are covered and nobody blames them later for technical/compliance issues later. Do not cut them out of the sales process. While they don't have the ability to approve the sale, they definitely have the ability to block it. Involve them closely and get their strong buy-in so that they don't become a bottleneck later.
Surely the abuse scandals played a role in the de-Catholicization
Really? I'd +1 for kagi too.
But I have 2 problems with it. The first is the load speed. Sometimes it just takes so long that I just repeat my search to Google, especially on phones. By long I meant a few second so it's not that bad. Just long enough that I lose patience.

I'm not sure if it's issues with my connection since I rarely go to Google nowadays. But I never felt the same problem with Google.

In case you're curious, the second issue I have is with private browsing. The session is not carried over so I'm not logged in. I keep forgetting this and kept having to manually open Google and retype my query. I guess not technically Kagi's fault but still.
Polling doesn't necessarily find you the truth here. It's like when you poll business owners in California and they say it's a bad environment for business, by which they mean they want lower taxes, not that somewhere else would actually get them more customers.
Hi Debbie,
given you were at New Statesman, I am wondering if you had a chance to meet and interact with Christopher Hitchens? And if so, if you have an idea of what he would think about this subject?
I’ve been going to ChatGPT first for most questions these days and then using google to verify. It’s easier to verify than find an answer from scratch. And often ChatGPT will rephrase my words to use the standard terminology for the topic which makes searching even easier.

To complete the cycle, ChatGPT just needs to be hooked up to verified sources on topics so it can show me exactly where what it says is proven true.
The government routinely compels speech.
If they don't take the canary down when they're served a sealed warrant, the canary isn't doing anything. In fact, it's actively misleading users.
If writing systems-level code solving for non-trivial requirements, the majority of the state has a lifetime that outlives any particular function call. That's when you need to move that state to the heap.

There's no clear scope anymore, ownership has to be moved from function scopes to RAII managed container structures. Things are quickly getting more complicated and expensive (software complexity/bloat, compile times, binary size...) when you have to nest your structures in templated containers that don't know what you're nesting in them...

This is where all the complexity with 17 constructor types and 99 move semantics with const, non-const, r-valued references and abstract virtual base classes came from, and there might be less than a dozen persons left on the planet who really understand it all...
Yes but if one of the two lies, successfully, to the other player or players, is that even really still the Tango? Partner dancing involves trust in your partner - that you're not going to dip them and then drop them to the floor when the opportunity to make a bit of cash arises, to abuse the metaphor.
Egyptian Afterlife (Dr. Bob Brier, Ancient Egypt) [video]
No they did not. it was 66%
Remove friction and annoyance from the team, help with scheduling, ensure you're pointed at useful work rather than what you personally want to do, hire new people, write performance reviews, politely stack rank you.

Especially good lower level managers also hang onto some of their tasks from when they were an IC.
Trying to use biofuel to replace ALL sources of energy sounds pretty silly. Is anybody actually suggesting that?

What about how much land would be required to replace the _gasoline_ usage with ethanol?

"Each year, one acre of corn produces 551 gallons of ethanol, which is the equivalent of 386 gallons of gas."

"According to the U.S. Energy Information Administration (EIA), Americans consumed 140.43 billion gallons of gasoline in 2015"

363.8 million acres to make enough corn to replace gasoline - not factoring in all the other negative externalities. A little more than 4x land area what the US uses now.
This is empirically not true when you look at the data on who owns financial assets in America. The "average person" owns essentially no financial assets. The median person especially owns approaching zero financial assets. The top 10% and then again the top 1% own a drastically disproportionate share.

The one exception is Pensions and 401ks but this does not even come close to skewing the math in terms of "normal people" owning a significant portion of financial assets. All US pensions and 401ks combined have a total value of something like 10T. And that's before the fact that a huge value of the 401ks are still held by the top %s.

And that's aside from the fact that a lot of US pensions are in deep deep shit right now and may never pay out even close to face value on their obligations as denominated in 2023 dollars.
[2] wasn't meant as a question, but as a demonstration that who is tolerant or intolerant can be, in some cases, entirely subjective. Apply some clever rhetoric to make your opponent the intolerant one, and you not only win the debate, but prohibit his view from even being discussed - otherwise, society itself will descend into intolerance!
More distributed so they break in random places at random times. They never go fully down and they never fully work…
What do you use it for?.my tablet is primarily used for reading comics and technical books, at which it excels. If I need to do anything more challenging then it makes sense to use my laptop, even copy and paste between applications is a ballache on any tablet compared to a pc. So what is the extra apple price getting you, or more usefully what are you doing on the iPad that an alternative tablet could not do?
It is trivial to index the same amount of content as Google as the web is mostly static.

The hard part is in being able to translate a search query into a list of pages.

And that requires a level of sophistication that far exceeds a laptop.
The critical targets keep moving, yet the models keep improving. What gives?

Where's the wall? We don't appear to have hit one yet. The stuff just keeps getting more and more mind blowing by the month^W week. I'd hate to make confident predictions against AI when the shape of the graph keeps going up and to the right at an exciting, almost alarming, pace.

As an aside, this kind of analysis strikes me as what advanced aliens must think about human life on earth.
This is not how "to each their own" works.

I don't care about the shovels that you sell to developers, and you shouldn't care that some people want to have a little fun with their desktop. You don't do that, and don't think it's a "real" use-case. Fine, we get it. You made that extremely clear several times.

There is nothing to refute. We don't agree with you, we don't care about your opinion, and we're tired of hearing it.
The linked site appears to be run mostly by American Catholic activists in their early 20s. I doubt they know anything about the reality of Catholicism in Ireland. I'm Irish and I've never heard of the author either. If he thinks Ireland is still mainly Catholic or that the Church is still widely respected or influential he must be living in another reality.
Since Snowden we've discovered just how lawless the government is, and what's worse, the spooks also got away scot-free with no consequences whatsoever for wanton violations of the Fourth Amendment.

Saying that you shouldn't rely on legally untested warrant canaries as a sure-fire protection is not the same as agreeing with the executive branch's overreach abetted by a supine & craven Congress and a Judicial branch all too inclined to defer to the executive when spurious security justifications are trotted out.
I'm in the same boat. I've got an ipad pro, meaning m1 and a good enough amount of ram and storage. I'd love for it to be able to run MacOS.

I bought it because I wanted a good tablet. I'd just like to be able to have a good tablet and not have to buy a Macbook too since I have decent windows machines anyway. It's a want, not a need, to be able to run macos.
Thank you. From reading that, car makers are scraping the very bottom of the ideas barrel. My reaction was meh, except for the Sony-Honda JV, where it was "OK, next up, Safeway and McDonalds announcing a joint venture to make burritos"?
Obama is very far from the "median black guy", but it's irrelevant, especially since both median Londoner and Dubliner shifted towards the median NYer...
The third GPT smear article on the front page today. Interesting.
rauc, swupdate, even docker/balena are all tools that handle the FOTA problem really well.
We used rauc and swupdate in my last job as they came with yocto/buildroot (our build system for generating custom distro images).

It is always these 3 basic partitions + a boot script to check if the boot is successful and if it isn't roll back the update or boot from a recovery partition: root A (usually around 500GB), root B (500GB), common application data (usually mounted as /home/app and is around 500 MB). The distro + application usually takes up about 50-100MB. We usually left at least 10X that free space to not worry about the future..
> which is computed at compile time. However, MACH_VM_MAX_ADDRESS differs on iOS and macOS, since iOS has a smaller address space and uses more bits in the pointer for PAC signatures.

I wonder if there's a point of even having these differences in the first place as the specs of MacOS and iOS computers converge. It's weird how little MacOS has changed since like 2012, I'm surprised apple hasn't ruined it yet
In the context of a raid such as this ... you'd want, at least, visible hard wired camera's (not WiFi - jamming) going to a NAS box (for storage) with a distinct colour network cable from that NAS apparently direct to the main router ..

The cunning part is to have additional hidden cameras hard wired within the studs going to a second well hidden NAS box that takes the direct mirror feed from the first NAS box via a hidden diversion of the seemingly direct cable.

The intent is to have sacrifical cameras and sacrifical storage .. along with additional cameras and mirrored sacrifical camera + additional storage .. and then optional encrypted offsite backup.

Cables Vs WiFi is interesting - cables can be traced, but they are harder to remotely tap or jam.
"Ugh, artificial deadlines are the worst. They hurt morale, productivity, and quality."

But sometimes/often required to actually get things done and shipped.

On the flipside, waiting around for an engineer to overoptimize something that matters only in their head, or doing something they believe is necessary when it totally isn't...not stellar for overall team performance either.

(I am speaking in general, not referring to the parent comments...)
Can you expand on why this is worth pointing out in this context?