skysight-inc/HackerNews huggingface dataset:
This requires a bit of backstory; I grew up in a very small village with a very small library. The village as a whole was very religious and most books in the library were screened by bible thumbing community members. I had ‘internet’ of sorts through BBS systems which gatewayed to international gopher, ftp and other systems but books were books. One of the books that slipped through the cracks was a outer body experience book. I am an atheist; always was while raised christian; I always asked the questions I was not allowed to ask and I never found anything in religion remotely believable even though everyone around me (without exception) was devout. I do not believe in outer body experience but it was something else to read for a change. So I read it and it contained a training for doing OBE, which is, in fact, lucid dreaming. And I can see how someone can see lucid dreaming for OBE or even signs of god and an afterlife. It is pretty convincing. I have spoken to dead people, next to my bed. I remember the conversations. I have met and talked to people I have never met and so forth. I have seen angels (as our earthly brain would imagine them; lot of light and very friendly). But these were all dreams and we all dream like that: most people just forget what they dream. This book gave me the training to do this at will and even change my dreams significantly.

The all fail the tests that come later in the same book (I will try to find it); the book trains you to fall through your bedroom floor and check the table in your own house for something. Then to prove it is OBE, someone puts something there, like an ace of spades and the next day you tell what it was. Cool so ofcourse I tried this; I fell through my bed, through the floor (which was made of wood which it was not) and floated over the livingroom table, saw a big white paper with a square. Told my sister this: there was no square, there was an ace of spades. It was, ofcourse, a dream but I was far more amazed I could get my brain so far as to do what I set out to do: create a dream in which I do what I wanted before I went to sleep. That I can no longer do at will; that required a lot of training.
The icon you normally see up in the tab is the "favicon" - simply a file at the root level called "favicon.ico" usually - that your browser knows to fetch.

Some sites do not have one. If you run a webserver with streaming logs, and point chrome to it - you'll see requests for this favicon 404.

This extension replaces missing favicons with emoji for easier visual scanning
I doubt there are statistics on such things, so we'll have to deal in anecdotes, and I've had the total opposite experience (I make this comment so that any young people or academics aren't prematurely jaded). When a lot is at stake (e.g. high revenue, medicine, infrastructure, etc.), especially when a team has been burned by loud people, a person who says, "I don't know, but let's figure it out" (that's my job) is prized.
With 100 threads running like that, not only do you have the overhead of the OS scheduling 100 threads to run on ~8 or whatever cpu cores, but also I would assume these threads are all running different code, so there would be some overhead with context switching / cache. Presumably these threads communicate, so they're likely using some form of synchronization primitives.

Here's a pretty enjoyable video about how they handled this sort of engine design problem using something sensible: https://www.gdcvault.com/play/1022186/Parallelizing-the-Naug...
Check out DataFramesMeta, which unfortunately isn't working on 1.0 yet. They have basically a 1-1 matching of `dplyr` verbs to julia versions.

I don't think a standardized and idiomatic data-cleaning process has been established yet, which is for the best right now. There is `JuliaDBMeta` for metaprogramming with JuliaDB tables, and the `Queryverse` for working with a wide array of objects.

One way that Julia's metaprogramming shines is with the ability to go into the AST and replace symbols, enabling local scopes that are more readable than other scopes. One workflow I'm excited to experiment with is something like this

@as my_long_dataset d begin # make d = my_long_dataset in this scope
@with d begin
t = :x1 + :x2 + x3 # these symbols are arrays inside this @with scope
d.new_var = t # assign the variable
end
end

Of course, with the `@as` macro you probably don't save that many keystrokes if you are just doing `d.x` or `d[:x1, :x2]`... The ecosystem is still evolving but the point is that I like how you can replicate something like `attach` scoping in R without all the headaches. I think it makes a cleaning script feel more like you are only working with the data you care about.
It didn't 'prove' used car markets don't exist, it showed that naive car markets with high amounts of information asymmetry can't exist, and in fact they don't.

All real used car markets have multiple layers of either testing and warrantying (which solves or reduces the asymmetry to a manageable level), legal remedies (many states have 'lemon laws' that push liability back to the seller), or are filled with sophisticated buyers (e.g. car auctions) who can actually tell which car is a 'lemon' because they bring a trained mechanic who will inspect the car in person.
One of the lessons I took from this article is to never go through self-checkout.
Early on (as a heavy Stata and Python user) I tried Julia and got quite discouraged by its messy treatment of missing values (and weights, etc). I've also tried R but also found lots of inconsistencies, so not enough reason to switch, besides when plotting nice graphs.

But I would say Julia is increasingly getting there. Comparable packages are WAY easier to write in Julia than in Stata/Mata, while being faster, so any gaps will keep disappearing in the next hears.
M4 is an interesting macro language, but developed (IMO) a somewhat undeserved reputation for being awful because it is how you build autoconf inputs as well as sendmail configuration files. Guilt by association.

M4 has some "interesting" quirks but I have used it to build a static site. I briefly was maintaining my blog using make and M4. I no longer remember what the precise reason was that I stopped doing that, probably just that I wanted a through-the-web editor for content. I could dig up the "code" if there were interest in that.
Probably because they take 30% of PC gaming revenues.
The other day i posted a rant on p2p here on HN and everyone was like, huh! Use whatsapp.

We need to build our own p2p and e2e secure chat client like whatsapp which works on every platform.

Sure, it's possible - skype was exactly this before except for the e2e part.

Why we techies can't? Let's make a group and dissect the problem in our free time. Who is up for it?
Mr. McDonald said that if Ms. Thompson’s daughter took
the groceries without scanning them properly, it was
by mistake. Video surveillance, reviewed by The New
York Times, shows her daughter trying to scan and
rescan groceries at the checkout machine for about 17
minutes.

I really have a mixed impression of self checkout lanes, as they currently exist. Ten years ago, if you had asked me if they sound like a good idea, I have responded with an emphatic yes.

But experiencing them on perhaps a monthly basis these days, I’ve developed an overwhelming urge to avoid them at all costs. And not because of incidents as described by this article.

It’s reached the point that even when I’m holding a single item, and there are five people with full shoppings carts in front of me, I get annoyed at people who suggest self checkout to me. I know damn well that there’s a self checkout lane, and it’s my time to waste. I’m waiting in precisely the lane I intend to be in.

Even though I totally agree that working a cash register should very nearly be an anachronistic job at this point, self checkout lanes are a horrid abomination in their modern form. Waiting for these machines to prompt me through the task of ringing my own items up is so far from my own experiences of actually working as a cashier, that I shake my head in dismay nearly every time.

When I used to work register at no less than ten other jobs, I could rip through a collection of 20 or 30 items in a minute or less (as long as barcodes or price tags were legible), and accept payment as fast as you could hand it to me. But self checkout prompts. Stops. Waits. Prompts. Stops. Fails. Back to square one. Prompt. Wait... Wait... Prompt. And so on.

Why is it so bad? Why is it worse than vending machines? So much worse. And restaraunts are trying to pull the same trick. Self service touchscreens leave you sitting at tables, unserved for half an hour, until you walk over to the bar and complain.

The future is hell.
"But nature wasn't trying to create intelligence"

That may seem true... but what if it was/is though?
This is such a silly, blow-hardy meme (like Marissa Meyer suggesting that you can get ahead by limiting how often you use the bathroom [0]).

It doesn't take a meaningful amount of time to submit a tweet or use the bathroom. (And, even if it did, human effort isn't fungible.)

[0] https://www.washingtonpost.com/news/on-leadership/wp/2016/09...
Usually “production” in those contexts means running on a cluster or supercomputer somewhere. That, or code being run on a machine not controlled by the developer by users who do not write code but just run a pre-existing program with different inputs. That’s how I (and colleagues) typically use the term ‘production’ in the academic/research environment that I work in. The issue with things like MATLAB in production is the lack of a license on the machine you want to run on - often people have it on their workstation, but if you get time at a supercomputing center or department cluster, odds are your local license doesn’t translate over to the system you want to run on.
So true. The exchange on twitter[0], between Atlassian's co-CEO Cannon-Brookes and Musk, that lead to the 100MW battery being installed in South Australia was only about a year ago.

0: https://twitter.com/i/moments/840050021521268736
Well written post, I enjoyed it, it makes sense.

The part tearing into the man page was especially excellent!

Following your point a little further.. the thought of updating the man pages with warnings like the following made me laugh:

“AES, SHA-3, RSA, Diffie-Hellman, Elliptic curves, and all those crypto packages you're using, OpenSSL, GnuTLS, Keyczar, your operating system's crypto API, are all theoretically vulnerable to a cryptographic attack. Knowledge of how to do this is not available in the current unclassified literature, but it is theoretically possible that such an attack may exist. If this is a concern in your application, do not use them.”
You should definitely put that in GitHub or the like :-)
While this is true, the guy lives, sweats and breathes his companies. If youve ever seen the interview when he talks about pouring his last dollars into spacex and tesla and having NASA come thru as well as his VCs at the 11th hour around xmas (close of fiscal year) he talks about stress. He said “if i was capable of an emotional breakdown, this is as close as i have ever come”.

He works for his goals 100% of the time and regardless of whether he is fucking up, he defends his companies like children. He goes on Twitter for both PR and defense. It is both emotional and tactical to different degrees. Like or hate the guy, he’s fucking all in all the time. It both helps and hurts his companies, but on balance i think it got him where he is.
Dealt with a narcissistic psychopath who behaved like this. They made a lot of money negotiating big deals.

Don’t understand how you dealt with them. It seems like you just played against them the entire time.
How to work smarter not harder: Remove roadblocks with the Theory of Constraints
I've probably shopped at Walmart less than 10 times in my life. It's probably because they aren't conveniently located for me. But also they have so much bad press that I just don't want to be associated with it. At the same time, I also have the feeling that this will never happen to me so I'm indifferent.

That indifference is a bug in our society. It allows this injustice to be farmed out to 3rd party law shops using a system designed by corporate lobbying dollars to harass powerless individuals. Walmart isn't indifferent and they are mildly evil so the world is made worse by their presence.
Drowning out the truth about the Great Barrier Reef
I think you could say Visual Studio Code is to Visual Studio as GIMP is to Adobe Photoshop? Decent, and still useful/handy, but honestly still not even a comparable substitute.
I started drinking diet soda because drinking regular soda like it was water was suboptimal. I drank regular soda because water in restaurants often tastes funny, or it comes out in tiny glasses that rarely get refilled. I hate coffee & tea. So when I stop drinking diet soda, I usually end up drinking more alcohol because I don't like or want everything else :P
The problem with the battle of Zama is that it was a head on pitched battle where both Scipio and Hannibal had very little input in how it actually played out. Hannibal was pressured by politics to not abandon any ground.

Alexander philes like to invent all sorts of glorious calvary charges for Alexander, but he won his victories off the point end of the Sarrisa. If we look at how the Phalanx worked, it becomes clear that operating it does not require a highly skilled driver. A rapidly advancing wall of pikeman. Opposing formations were pinned, encircled and routed. The spear wall was the anvil against which the hammer of the Hellenic calvary could smash. It was simple and effective and inflexible.

Terrain is not a major factor in almost any historical battle from antiquity. You underestimate just how wide ground can be for that scale of battle. Even in mountainous terrain. While rough terrain did play its part for the Romans fighting against Philip. The Phalangites at Cynoscephalae were actually just beaten by a much more versatile and effective formation. The Maniple System the Romans devised of checkboard like spear units could engage the Phalanx wall directly. The so-called 'phalanx with joints' could not only attack the Phalanx from the front, but it could break up its ranks and then the Gladius goes to do its work.

This is repeated again and again in history. Technological and material superiority will often lead to victories. Who knew an army of untouchable horse archers would be unstoppable in three continents? Who knew thousands of next generation tanks would break through the most heavily fortified militarized defense of its time? Many Generals have taken advantage of their side's superiority in strength and earned their place in history. But it was Hannibal who was handed every conceivable disadvantage and turned the impossible into not only victories but flawless victories in so-called battles of annihilation. That is why he is the father of military strategy and the greatest general in history.
A shareholder approval won't go through if the price is "low".
Seems well opinionated but I disagree. He's thinking too much in absolutes while in practice people care about relative security.

Computer security has gotten a lot better,many organizations have acheived a security posture they are comfortable with. I think he's focusing strictly on application security,in reality you care about maintaining C.I.A. for the data.

I don't care if the entire software stack is riddled with vulnerabilities and the CPU has unfixable vulnerabilities so long as that does not result in attackers (as defined by my threat model) fail to compromise confidentiality,integrity and availability of data I consider valuable.

The software might get exploited but there are post exploit controls,those may get bypassed but attacker facing machines would ideally not store valuable data. The attackers can move laterally but there are detection and prevention measures for that. I mean, both in life and computer security,one shouldn't expect absolute security, acheiving and accept level of a security posture should be enough.

I'm not prepared to handle 10 guys mugging me as I walk home,but that isn't my goal. My goal would be to defend myself against one or two attackers of the same weight class as myself.

There is a reason so much security appears bad,easier to clean up a breach of security or to just ignore it than to implement a SDLC and have independent security staff. In the end,security improves only if it's cheaper to do so.
The Ugly Truth of Ugly Produce
So here's the thing - the NYT has painted a picture of a exhausted on the end of his tether Musk...

But then we have an actual video interview given hours before: https://www.youtube.com/watch?v=MevKTPN4ozw
How is this not defamation of character as well as illegal imprisonment for /mistakenly/ claiming someone is guilty of a crime to the point that they become INCARCERATED?
I have customers that are still using it!
Scale API is hiring engineers to build the AWS for AI
I've only been learning for about a week, but I think if you're a nerd for language design, you will appreciate it on an aesthetic level as a very tight design around a powerful concept. Common Lisp also has multiple dispatch, but I feel the integration of it into all the nooks and crannies of Julia really pays off. Julia's performance doesn't appear as a side effect of building on the LLVM or because they over-optimized the core, as it does in many young performance-oriented languages. Instead, it appears as a tangible benefit of a multiple-dispatch oriented design that makes it easy to add information to the system to improve performance without compromising the clarity of a sketch.

I have often felt that there are many discontinuities between "pretty" Haskell as it is taught and pragmatic Haskell. I haven't used Julia enough in anger to say it for sure, but I see in the way it works great potential for the pragmatic code to be as beautiful as the high-level and abstract code.

For a long time I have felt that Haskell represented the most mathematical language. Julia really shows that there are other ways of building a mathematical language with taste and style. It's oriented to practitioners and applied math folks rather than computer scientists and pure mathematicians. I have enjoyed seeing the differences between these systems quite a bit, and I think Julia has a bright future as a practical, daily-use system for science.
Just spitballing here, but "this Linus guy" might rather a lighter laptop [1] with a better screen.

[1]: https://www.cultofmac.com/162823/linux-creator-linus-torvald...
Thats the thing, there is no video interview... its just NYT's description.

There was another video interview done hours before: https://www.youtube.com/watch?v=MevKTPN4ozw
> But in this case alumni is in common use in that way and has been for some time.

I dispute that. Googling doesn't turn up many examples of official usage of alumni in the singular.

I also disagree with your second claim, which is a projection. When I said "common or not", I meant that frequency in itself does not automatically make something correct, and I gave reasons why in a follow-up comment. I didn't claim that usage was common.

I'm not trying to be difficult, but alumni really is plural. Using alumni as singular is not correct.
If a tweet takes 30 seconds to conceive, type, and submit, Elon Musk has spent 45 hours of his life tweeting -- no way to estimate how much time spent reading, which is usually a higher proportion for non-egomaniacs. Judging by the way he talks, he could have used that time a little more productively by reading a couple books. Conveniently, also much harder to tank your stock price while doing.
One thing that makes Julia cool is that adding the types improves performance, but you don't have to add them if you don't want to.
ExaDNS – Free Global DNS Resolver
he looks exhausted. whats your point?
What's the logic behind not taxing 100% juice? It has just as much sugar as a Coke; the fact the sugar comes from a grape/apple/guava etc changes one thing - it's now "naturally" sweetened sugar water.
In my experience at several startups, and discussions with numerous friends and colleagues in similar positions, yes the eng comp at startups is much better than it was 5 years ago.
no, it means nothing of that sort, it just means the DNA is five times longer, not that there are five time as many genes encoding five times as many proteins. It is more like there is more DNA padding around the genes as a protection from virus which tend to jump limited distances along a genome.

sorry for leading with a negative, I know it can come across more strongly than I intend.
Obligatory Big Bang Theory reference:

https://www.youtube.com/watch?v=-e5CtbbZL-k
> The correct implementation was not enough until the hardware was fast enough.

This doesn't refute his argument, which I read as being, essentially, against performance optimization of software during initial construction. Knuth famously bemoaned premature optimizations, as well.
Perhaps there are long nested paths, e.g. `/usr/local/share/foo/{many files}` with nothing in the directories before `/foo` besides the child directory?
That there are going to be shop lifters, is accepted in the industry. It is called shrinkage. Every year or every 6 weeks, retailers hire inventory audit companies to calculate shrinkage.

Some consulting company like McKinsey might have advised big retailers on how to reduce/recoup the shrinkage. These cease and desist letters, vague laws, etc are product of that effort.
I would also love to see that!
Well the Yankees wanted a big federal government so here you go. Big brother taking your $$$ to subsidize others. Should've left the southern states alone.
Did you see how Julia does missing values now?

https://julialang.org/blog/2018/06/missing
This article naturally leads to a question that I didn’t see addressed, perhaps you can answer it here:

If it’s unnecessary to ever prefer /dev/random to urandom, then why does /dev/random’s current blocking implementation still exist? Surely between all of the kernel developers, between all of the Unix-ish OS’s, over the last couple of decades would have realized that /dev/random should simply act like /dev/urandom?
A war story: Developer re-implements Google Maglev in Rust for networking
m4 is a fantastic utility. I only recently discovered it but was using it + make to create alternate builds of docker images.
You might want to check out https://github.com/dbro/csvquote which helps awl and other text tools handle csv files which have quoted strings as values.
Musk looks haggard in the interview - Cramer commented if he were on the board he'd insist on medical time off, can't say I disagree.
Low and high carb diets increase risk of early death
Every action on Musk's part now seems to be intentionally manipulative. It's hard to tell if he's being genuine.
Stockholm’s deepest subway station is also an ecological wonder
Yes, you've made that comment twice now. He's exhausted and kind of scattered in that interview. Not surprising that he was at a breaking point by the time he got to the NY Times.
Kali Linux Revealed
You should try Visual Studio, on Windows if you have to ;) it's not just CLI vs. GUI that I'm talking about, though that's of course a significant part of it too. Eclipse is a GUI too but I still find it painful. (w.r.t. Xcode I've only barely touched it, so hard to compare, but nothing particularly good or bad stood out to me in the little bit I used it.)
Pushing Left, Like a Boss – Part 1
Rusty rail is a line rate distributed load balancer
It is inspired by the Google Maglev paper(http://research.google.com/pubs/pub44824.html).
Here is the video talk: https://www.youtube.com/watch?v=_GRM1Ij_3t0