skysight-inc/HackerNews huggingface dataset:
Well, your 12 years my senior so age is something else eh? ;) I started out at 19 working at a FANG (because of privacy and such I don’t want to drop which one) not as an engineer but doing support work. Within a year I got the chance to be a junior engineer no questions asked (basically) because my manager at the time was impressed at my grasp to “get it” when it came to application usability.

That is to say I got extremely lucky. I know that. My takeaway since (I’ve been a software engineer for ~10 years now) is that the way I was treated as a junior is what I described throughout this post, and my mentors were the ones that drilled home what the hidden costs were taking jobs based on salary, how to properly evaluate benefits etc. I learned a boat load.

So I want to preach to developers and companies alike that things can and should be evaluated differently and to avoid pitfalls that are easy in this industry
In what universe is this true?

In all the companies I've worked for, referrals for ICs meant that these people were prioritized for interviewing, not that they skipped the process.
And no one, not even the manager of the hiring manager, had enough say in hiring someone that they could simply decide to skip the process
okay, so programmatic behaviors in the game are specified with a graph of virtual wires between “gadgets”. It seems like this is the always the metaphor that gets chosen to replace coding in text - but I don’t think it’s exactly good! How do you refactor? How do you share code?
So much for free tax filing. If you can't beat them, Intuit buys them out.
On the contrary i have seen a lot of growth in live video based sales in the US, the younger generation seems to really like it. Ive seen IG boutiques move $100k in product in under an hour, many times.
Another helpful distinction I think here is architect != engineer, however you often see data architects that are also data engineers. I do feel there is a clear difference of focus though.
Ok, makes sense then, thanks.
I think a lot of non-technical business people and journos didn't fully understand that the Bitcoin blockchain is more than just a Merkel tree, and so have started using "blockchain" to mean a bare MT, despite the fact that the blockchain in Bitcoin is only meaningful because of how it's computed.

So maybe proof of work can be replaced, but without some consensus protocol it's not a blockchain in any meaningful sense.
Using the Gecko/Servo like desktop Firefox, not WebKit like Safari.
> Owning in a high cost of living geographic area is not a right, it is a luxury obtained mostly by luck

This is kind of a weird take. Whether someone can afford to fulfill as basic of a need as housing shouldn't be about luck, no matter the qualities of the area concerned. It's kind of like saying whether someone can afford to eat on a given day should be based on luck—we would think that's crazy, and for good reason. The housing crisis is currently ripping families and friendships apart, not to mention fraying the very fabric of civic and community life—all so a select few lucky folks can feel like they've made it. House prices in the Bay Area (and in other currently high-priced metros) will revert, sooner or later, but in the meantime, we're willing to cause a lot of pain and suffering in the name of picking winners and losers, if only momentarily. And speaking as someone who owns a home in a desirable part of the Bay Area and is 100% pro-housing, I don't really get it. It's really sad to see a lot of my neighbors supporting regressive anti-housing policy—it's almost like sociopathy on a massive scale.
You're assuming quite a lot. First, I'm not saying it's broken, so what is there to "fix"? Second, I'm not using this library, so why would you expect me to submit a PR?
People aren't expected to contribute to libraries just because they noticed a smell in the code. Open source is about contributing to stuff you use. You don't have to (and shouldn't be expected to) fix everything you see broken in in the world.
I'm not sure what larger issue you're pointing at and I don't think it makes sense to chalk this up to anything else; no sound server can magically figure out how to read that data sheet either. A random userspace daemon (that is optional) is just not the right place to put a fix for that. The burden for a fix likely falls on your distro to ship the correct udev rules, but figuring out what those are for all variations of hardware that use that driver is another story.
With that who knows, the Windows and Mac driver could actually be doing something strange by default that just happens to work for most users, but isn't worth replicating if someone writing udev rules decides they want to do the "right" thing. See where I'm going with this? It's not just a quick fix, and I don't even know if it's the right one. Some other distro somewhere might even have a different way to do it. If you're really interested to make progress on this, you'll have to ask your distro's audio maintainers.
Not to bad-mouth Clickhouse but the original python implementation of graphite + carbon was setting the bar very low, though, and transitioning from there to anything would have increasing performances by orders of magnitude.
Monobloc chairs are ubiquitous here in the Philippines. You see them everywhere. Of course, this country embodies all the qualities that fuel the growth of these chairs: poverty, a massive population that is multiplying rapidly, lack of environmental awareness, and an absence of aesthetic sensibility and urban planning.
What is considered “merit-worthy” is defined by the society implementing it. There is no such thing as objective universal merit across time and culture.

I don’t see why this is controversial. It’s no different than “fair” or “justified” or innumerable other values that a society has to work out a definition for.
You can objectively point to them. The prices are visible for all to see.
> I only want to quote you from a couple days ago

You are invested in this. That's the type of religious zeal I'm talking about.

> Maybe you should really think that through in the context of economics.

Only if economics worked like brokerages work.

The fact that you have to go "3 days back into comment history" rather than using the "science" in economics to support your argument should tell you something. That's the difference between religion, economics, political science, etc and physics, chemistry, astronomy, etc. One responds with straw man and red herrings, the other responds with actual science and facts.
You're right, they break down and get brittle quite rapidly in sunlight. Here in the Philippines they don't last long outdoors. They have a much longer life as indoor mass seating.
Traditional e-commerce is absolutely ubiquitous in SEA. Their primary e-commerce channels are web-page and app-based shopping carts, just like we have in the west. While it’s typical to support local payment methods, most sales are processed via credit/debit cards, just like in the west. Non-traditional channels certainly exist, but they are absolutely a fringe channel. Tupperware Parties are still a thing in SEA (although they’re mostly for MLM products), and a lot of businesses will let you order via DM, but those sales are nothing compared to the volume on sites like Shopee, Lazada, Tokopedia... They caught on a bit later than the west (I was personally involved in one of the first major e-commerce sites in a particular SEA economy), but their growing middle class does online shopping pretty much exactly the same way we do.
For scale, the submarine is 2,200 tons total, so it’s a little over 3% overweight.
This is immensely useful for my vying attempt to produce a compact lookup-tableless perfect hash generator for big datasets using ML.

Naively one might think, why not just do a standard loss - a point to point metric like mean squared error. But this is deeply flawed. Because it requires assigning each sample to a specific natural number, effectively reducing the solution space by an order of magnitude, n!. In practice, believe me, I have tried - the network never converges because the mapping is entirely arbitrary and has nothing to do with the samples.

To remedy this, we need an innovation in loss functions / mathematics. The loss function for the output of the net needs to be a set function [1]. This set function should measure the distance between the Set of outputs of the net and the Set {1,2,...,n-1,n}. This is different from KL and all the other standard loss metrics, because we do not care about the point to point mappings, and have no ability to histogram or compute the probability distribution since those are non differentiable operations.

On sorting: tensorflow has a differentiable sort but it is a hack and simply propagates the loss backwards to the position the original data was in before it ended up in its sorted position. This loss of dist(sort(Y_pred),[1,n]) provides better results but still fails for large data sets due to the fakeness of the sort derivative.

I have a hunch that there is a mathematical way to uniquely measure some arithmetic quality to optimize for, that is maximum when the output set is the discrete uniform distribution.

The mean, standard deviation and other statistical measures are terrible identifiers and actually, via statistical theory, we would need n moments for a dataset of size n, to uniquely identify the distribution..so scratch those off the list [2].

So there are two ways to achieve this milestone in ML:

1) a truly differentiable distance metric between two sets d(S,T)

2) a differentiable measure of ideal dispersion / density that forces the output set S to converge to the discrete uniform distribution (this is more problem specific to perfect hashes.)

Perhaps this sort is the key to doing #1 generically so we can have a new type of NN based on the output Set instead of the specific points. It is late here but I am excited to hear feedback.

[1] https://en.wikipedia.org/wiki/Set_function

[2] https://en.wikipedia.org/wiki/Hausdorff_moment_problem
Node Timer Tutorial in 20 Minutes
> If it's true that e.g. women have a harder time getting engineering jobs due to unconscious bias

Cite this.

For the tech sector, in developed nations, this is nonsense.
Static vs. Dynamic typing in the context of game development (why I use Ruby)
Don't click - there's nothing at this site but a link to https://www.ft.com/content/0c8d9bf0-51ab-11ea-8841-482eed003... (paywalled)
It's not instead of, it's an additional failure mode.
I've never heard the term diseconomy. Sounds to me like Tragedy of Commons.

> stagnation resulting from bigness is a self-inflicted dysfunction that is independent of size (that is, it doesn't only happen when companies get big).

A book with a strong argument why this MIGHT be incorrect is called, "Big Is Beautiful" by Michael Lind, who argues that productivity, research and development stagnate when companies get as big as google, but relatively medium sized companies like BMW (I did say "relatively") have solid research and development and productivity that can't be found in smaller businesses.

The book also gets into why some of the mythology of America like "small businesses are the backbone of America" and "It's good thing that so many people work for themselves" are probably false. Either way it's a good one to read alongside "The Curse of Bigness" by Tim Wu.

Also this article goes into almost no detail by what he means. No fault of the author, it's just a lot to go over. I haven't read this author's book personally but another book I recommend on this subject is Michael Lind's "The Land of Promise: and Economic History of the United States."
Correct; this doesn't make any sense.

$0.02 - two cents

2c - two cents

0.02c - 1/50th of a cent

$0.02c - does not compute
We are barely beginning to understand things about the universe, based almost entirely on wholly local observations. Nothing seen in the wider world should be considered surprising or out of bounds. Expecting to be able to simulate the development of the whole universe accurately with our primitive sticks-and-rocks equipment is nothing short of foolish. Do we see things different from what we predicted? Fine, we see them. It's a big universe, and we have another billion years to figure it out, provided we manage not to blow ourselves up first. The next generation will not lack for mysteries. Savor them.
That link should be a top-level comment to preempt further dumb takes.
1. Books are still one of the primary uses of libraries. It's just that they no longer are their only use.

2. Why do we call our smartphones phones at all? I mean, sure, they can make phone calls. But most people use them mostly for things that are not phone calls or phone-related at all.

That's how language works. Look at the etymology of any word you like. More likely than not, the literal meaning refers to something historical that may or may not apply or exist anymore. For example, software developers are called engineers. Does that mean they are experts when it comes to engines? And not just software. Civil engineers don't know much about engines either. Yet for hundreds of years, they have been called engineers and for thousands to come, they will be. This is not a bug. This is the natural life of words in human languages.
Should you use Google fonts?
Amazing. Thank you very much for your message on this.
As someone who browses with "browser.display.use_document_fonts=0", virtually no site breaks without its fancypants fonts.
I see this problem a lot, and in my experience there are at least two pieces to this puzzle - 1) many data science tools were originally desktop oriented or required specialized, siloed engines to run, causing a parallel universe of data to need to be imported into those tools and environments (for example SPSS) and 2) traditional infrastructure teams need to think of data infrastructure and architecture as a different subdiscipline running at layers 5-7 of the OSI model.

My problem as an infrastructure provider and data architect is how to provide a globally consistent, governed platform and model on top of which different classes of users have different levels of access rights to data in different forms and qualities, through different interfaces.

My 2 cents, I accept silver bars too lol :)

For what it’s worth, I don’t buy the argument that data folks should operate in an isolated infrastructure - we just need to adapt how we serve their needs, which can be quite extensive when you are talking about essentially anything ranging from someone writing highly complex algorithmic code to process large volumes of raw data (high level of support and access may be needed) vs. someone just designing a report or dashboard using just a graphical tool on top of a predefined data model (much lower infrastructure access needed).
he was using email addresses on the same few domains, cards, even using the same IPs, wasnt very clever at all. Radar would have been an easy fix.
"Merkle graph" may be a better term, since both Git and Bitcoin may have multiple hash references to the same node [in some sense].

I pretty much agree that "some consensus protocol" is probably the right place to draw the line. I'd add "decentralized", in the sense that no single entity can control the "consensus", which I think may be what you mean: "some decentralized consensus protocol".
iPhone 11 Pro, iOS 13.3.1.

Pages will render blank, scrolling shows content but then gets wiped blank. Once the app loses its mind it needs to be force quit before it works again. I’ll try a screen recording sometime. I can’t be the only one seeing this.
this. this. this.
Schools aren’t losing anything, they still are well funded, just by a high income tax instead of a high property tax.
Back in 2017, I was wondering about this in the context of the 80-20 rule, and believe I have a simple answer (posted to hacker news way back, https://news.ycombinator.com/item?id=16618385). Basically you need two things: 1) Some slight advantage 2) The network effect, that is, the probability of competing depends on the current winnings.

If you have these two things, you get 80-20 like distributions, you get the explanation for why winners keep winning. If you are interested, you can find my simulation and analysis at

http://www.cs.toronto.edu/~arnold/research/80-20/

Kind of shocking how well this works. The intuition is, why has coke won, well they had some initial advantage, and so they won a bit. Now that they have won a bit, they can finance themselves into more competition. For example, they can place themselves into more stores, into more restaurants etc. Now they get a chance to compete more.

Running the simulation yields interesting results, for example, in the two columns below, the left is Household income in 1970 broken into quintiles. The right column is simulation results.

4.1% 6.7%

10.8% 11.5%

17.4% 16.0%

24.5% 23.3%

43.3% 45.6%

Interesting how well the top 3 or 4 quintiles match between the simulation and the real world data.

If you run the simulation with different rules, the real world quintiles do not match the simulation quintiles nearly as well. You can tweak the simulation to see this as well.

The simulation can be tweaked to handle cases such as inheritance, so an actor with different ability inherits the wealth of a past actor.

I modified the simulation as follows:

I allowed it to evolve for a single generation, enough time for the top 20% of the population to have 80% of the wealth. I now choose a random sample from the top 20% of the population to follow, lets call them T20.

I now repeatedly

1) pass the wealth of all actors to actors with new, random abilities

2) let the new actors compete for a generation (the same number of competitions we used above)

Result: After 3 generations of steps 1 and 2 above, 80% of T20 has lost almost all their wealth, 10% has lost 75% of their wealth, 10% has done really well, growing it by a factor of 8, due to capable ancestors for three generations.

Amazing, it matches the statistics in https://www.theglobeandmail.com/globe-investor/globe-wealth/...
Do not use this. Use standard net/http or gorillatoolkit or one of the other existing options. Code smells.
> we'd be more efficient if we could get someone else to do this for us

This is spot on.. I don't mean to vilify the data folks, they were hired to do a job and unless an explicit part of that job description is "make your stuff play nice with the existing stuff" (which it never is), why would they swim against the current and spend their cycles doing things that aren't going to get them promoted / that they're not naturally inclined to care about?

The sentiment of the quoted statement really highlights that they want to be in their own world and do things the way that makes sense to them.

Again, I can't fault them for it. It just turns into an absolutely staggering problem later when the company tries to get some certifications. Maybe engineering leadership needs to see this particular iceberg earlier.
Or a long, cold winter season where the clothes won't dry and may well freeze =(
shouldnt something be tracking the BOM and thus calculating the weight of everything being added in. It seems like catching this could even be automated.
Somewhat similar is the effect of income on a man's popularity: https://miro.medium.com/max/1400/0*N0OGjZ9WDff4gOrf.png
There's a niche for a completely new type of fiction on the Internet. Creating a world through a wiki style website. Readers explore by searching for phrases or following hyperlinks instead of going linearly from start to beginning. I've spent hours at a time reading things like the star wars wiki, Depp diving to solve my own questions like "where did the sith originally come from?" or "can you have a black lightsaber?"
Depends on the webmaster on each site. Some of them have embedded images. Some papers offer specific feeds for certain sections, others will only offer the firehose feed of everything. Many RSS readers offer some way to categorize incoming articles from feeds, akin to rules for email.
Or maybe every structure built on a lot decreases its value?

I just dont understand why real property should appreciate just by existing and being bought and sold. Isnt that just money for nothing? Doesnt that run counter to the old calvinist ethos of WORKING for money?

What? Are people just going to live and sleep outside just because there's no more profit in drawing imaginary lines on the ground?
Tangential questions: has anyone done an analysis of share of originals in Netflix library as a function of time?
Right! Also I suppose I'm feeling very disagreeable today. :)
> a few letters had to be invented to write letters in Persian and Turkish that Arabic did not have (such as g or p).

Both the Farsi and Urdu alphabets have consonants for those particular sounds گ "gaf" and پ "peh". Given that a lot of Persian words were used, then it would stand to reason that they used the existing letters that were used in Persian.
We had this unspoken of law back in school where you better off write any answer than leaving the question empty. This is quite possibly drives some of these answers (at least here in my case)
I agree especially on these two points:

* it's counter-productive in a number of ways to create a data ghetto where they can do whatever they need to do. It doesn't engender trust or communication between Infra/SRE/DataEng/DataSci teams, and leads to "throw it over the wall" behavior.

* we need to adapt to how we serve their needs, not the other way around. It's a lot more likely to be successful if we are the ones who start bridging the gap. Data engineers are pretty specialized at enabling data scientists to do their job, they don't necessarily share the same skillset as Infra/SRE engineers.
There's still FreeTaxUSA.
Just use firefox + bypass paywalls. It's free and good.
A small minority biased towards homeowners who stand to benefit economically from constrained supply and rising costs are the ones voting, not the majority of people who live in these cities.
I switched my blog over to self hosted fonts the other day; that helper made it so easy. Do notice the tabs and checkboxes, it has many options.
Could very well be for you, note the (to me) part :)
Hey - sorry your startup didn't work out. If you decide to try again, I'm sure it will be easier :)

And thanks for open sourcing your tech! I see some legitimate critiques in the comments here - "it's not production-ready but you claim it is", "you shouldn't have built your own e-commerce solution" -- but even if no one uses your open source project, people can learn from it.
Potentially. I’ve dabbled in TLA+ a few times and have had mixed results; one project turned out spectacularly well, one ran into a problem where I really couldn’t figure out how to model the problem, and one was a failure but TLA+ proved that it was impossible to build a reliable system based on the hard requirements (interfacing with hardware from a 3rd party vendor).

I agree with you in the sense that, after the spectacularly good project, it would have been great to run code gen and get a skeleton to fill in.

I disagree with you in the sense that TLA+ as a language forces you to think about the problem you’re modelling from a very different perspective than how you’d actually write it in an OO/FP/whatever language, and in my experience so far, that has been a very powerful thinking tool. TLA+ doesn’t constrain you to thinking about “how would I write this in Java”, but more in a “how should the communication patterns in this system work” way.
Even in Europe, where there's even a metric horsepower that's often used in advertising and such:

https://en.wikipedia.org/wiki/Horsepower#Metric_horsepower_(...
How would allowing more engines increase monoculture when the current situation is webkit only which is very similar to blink?
> I just interviewed for one "Data Engineer" position which consisted of nearly 100% stored procedures.

How about data or database programmer? I've also heard "Data Analyst", "SQL Developer", etc.

But I agree that "data engineer", "software engineer", "network engineer", etc are too general to really be meaningful.