skysight-inc/HackerNews huggingface dataset:
Intel's integrated GPUs have different goals than NVIDIA's dedicated GPUs. Power efficiency and video decoding and encoding is more important to Intel than raw gaming performance.
Python probably has a set type, but a common general use case for use an associative array as a key is when making a set.

dict = { "foo" : "bar" }

set = { dict : true }

set.has_key?(dict) # true

I'm sure there are other use cases where dict keys can be convenient.
waste of energy

I wouldn't be surprised if having to read several pieces of any kind of text, be it a commit message or code, which are not written in a consistent manner is more of a cognitive load than reading pieces which are. (And higher cognitive load probably leads to litereally more energy being used). So if those assumptions hold, and assuming you want tto waste the least amount of energy possible, the question becomes: what process costs more energy? Making sure the text is consistent and adhering to certain standards, or not doing that and waste more energy interpreting it and/or having to worry about that.
Because people on HN are cowards who'd rather downvote and flag instead of discussing things rationally - much like the moderators of the site.
Joe Armstrong has died
100GB actually sounds like the job for command line tools on a single computer
The RDBMS advantage is that you can update your records and you can append to them without having to rewrite the dataset. That makes ETL much easier. Eg recalculate a column. It’s also that referential constraints can make sure your database is coherent for you. This saves a lot of time and a lot of mistakes. You also get well thought through scheme management and other benefits besides. Pg11 will scale happily to 10x his requirement. I don’t see why you’d want to build infrastructure for the next 10 years on Spark... since Spark is unlikely to be the thing by then anyway.

I don’t know about cstore being slower at all at 100GB. Nor do I know that it matters for the use case. Spark runs like a dog on a single machine and requires far more resource to do so. PG also has options like pgstrom for gpu acceleration if speed is even s thing.

Also EtL is rarely written once ... it’s an ongoing body of work that changes as the data does.
Quantum mechanical experiments get replicated time and time again. There is nothing even resembling the reproducibility crisis in quantum mechanics. The issue discussed in the article is only about interpreting why the results always come out exactly like we predict, not any issues with the results or reporting of them.
How to Crush It When You Know What Successful Entrepreneurs Have in Common
It's easy to blame China for everything these days.

https://nos.nl/artikel/2280789-samsung-had-rol-bij-spionage-...

Google translated:

'He probably refers to Samsung. That company would have "spoused" the spies to steal the software and start their own business, thereby creating a competitor for ASML. The software is needed to set up chip machines for optimum production of electronic chips.

In 2016, Samsung became a 30 percent shareholder in Xtal, and ASML subsequently lost Samsung as a customer for this software.'
This is an excellent example of why @qntm called AI "money laundering for responsibility":

https://twitter.com/qntm/status/1030846375213379584
Yep. There I am. I put in an old address, and it found me at my current (new state). Job is way wrong. Relations are mostly correct with a few unrelated people.

But I didn't want to click. I'm paranoid about click-through. I just scrolled past. Nothing to see here. Who's this guy? Who cares... (>_<)
Loved the interview by the way!
Did a computer write this "article"?
Do you want one cent of your money to go to farm subsidies, corporate welfare, or making defense contractors rich?
I think the point is that if you have money to begin with you can leverage that against those that don't.

In the UK a mortgage is generally cheaper than rent.

You "choose" to rent when you have no other choice.
Quite a few scientists and engineers have those requirements. I wouldn't choose it for writing a web server or text processing, but Fortran is actually a pretty nice language for dealing with numbers and arrays. It also has decades' worth of well-tested numerical libraries, which can be very subtle and hard to get right.
Both Intel and ARM will tell you that their patents are required.

(Questionable if that's true.)
True but if you need to replace the roof tomorrow you suddenly have an unexpected expense of $20K+.

But in general I agree with your point. Buying a place is about stability and control. Especially no one can kick you out as long as you make your payments. I don't think it's a better investment option out there but it's safer for most people than investing in things they don't understand. And if you happen to buy a place in an area that is booming in the next few years then it can really be worth it. But that's the same like buying early a stock of a company that makes it big.
Around here there are tons of image memes about vegans and anti-vaxers. On websites that are mostly associated with the more liberal side. Apparently not. I guess it's just a desire to unite by having a common enemy or at least a target for ridicule.
That should be the standard for every device, regardless if it spies on you or not. It's so weird how the above article even had to be written.
Having a higher end ($350+/night) house on AirBnB was pretty fun. The higher price plus AirBnB screening kept out the rifraf so we had very few problems.
Hacker News: Graduate Hacked Government Database and Employ Himself
It's nice to hear from Cameron Purdy and TheServerSide. Two important sources of Dev Info from many years back. (Circa 2000 or so for TSS?)
BlackBerry Is Killing BlackBerry Messenger, Shutting Down on May 31
I agree. The non intuitive reason stated is that there is a standard that specifies a sign for zero, and numeric IF doesn't distinguish between them, and it depends upon labels which are hard to optimize.

Another notable capability is that procedures default to recursive and there is a way to state they are non_recursive.
"ELM" = "Extreme Learning Machine" is apparently heavily based upon previous work, if not outright plagiarism. The Wikipedia article on ELM discusses this only briefly:

https://en.wikipedia.org/wiki/Extreme_learning_machine#Contr...

Yann LeCun' opinion on ELM: 'What's so great about "Extreme Learning Machines"?':

https://www.reddit.com/r/MachineLearning/comments/34u0go/yan...

A sort-of "How-to plagiarize successfully" guide including "Easy but Proven 5 Steps to Academic Fame"
with Huang's work as a gleaming example:

https://elmorigin.wixsite.com/originofelm

Two very detailed plagiarism analyses of two of Huang's papers. They are quite sarcastic, funny and enlightening:

https://docs.wixstatic.com/ugd/5256f1_ac3a0f6b08524a3ca6101d...

And finally, as one poster says, the provenance of "Deep Learning" itself has some controversy:

https://www.researchgate.net/post/Why_Extreme_Learning_machi...

"But, just recently I also found that there is also a problem with the inventorship of Deep Learning.
http://people.idsia.ch/~juergen/deep-learning-conspiracy.htm...
For this, I post a question for discussing these issues.
https://www.researchgate.net/post/Any_enlightment_on_the_ori...
https://docs.wixstatic.com/ugd/5256f1_556b42c00d0d4d5bb199fb...
Taxpayers may have thought that mental asylums were expensive, but jails are very expensive. It's a lot cheaper to keep a schizophrenic in a state hospital. So I'm not sure that the decision to empty the state hospitals was driven by taxpayer stinginess.

The whole thing is complicated. Drug companies in the 60s and 70s advertised their antipsychotics very hard. They persuaded the public that drugs could cure mental illness. That was a big force behind the emptying of the hospitals.

Lots of short-sighted thinking.
Forgetting the specific problem space and technology for minute...

You have a team of 10, only one an employee, and 0 being dedicated to infrastructure.

This screams for a managed/hosted solution. I'd select one that is least disruptive to the team, versus what's technically best.
And I think it's hard to blame me for this because where I live there are very few Muslims. Muslims, homosexuals etc are always something you read about, not people you can distinguish on a street. They're afraid to identify openly, so you can't go and talk with them.
Doh, the poster != me, it's the person whose posts we're discussing :)
Really frustrating. I went through this process recently. The data was a couple orders of magnitude bigger and so I tend to agree that maybe just straight to Redshift / Bigquery would probably work best, but here were our steps:

1.) Insure that ingestion / S3 jobs were stabilized (in our case, the legacy were in Informatica, and maintenance took up all the teams' time). We moved to Luigi for this, but Airflow is great too.

2.) Get Presto schemas defined and make Presto the interface for querying / basic pipelining.

3.) Add Mode Analytics or another basic query UI on top for ad-hoc queries. This cleared a massive bottle-neck for our teams because Analysts and data scientists now have direct access to data w/o technical help.

4.) Build "gold" records, for specific sets/types that are valuable, and get them piped from S3 into Redshift/Bigquery (we built a streaming layer for this). This speeds up querying, makes governance easy, and is extremely reliable.

Honestly, the hardest part here was the change management among our legacy teams.. That said, it's incredible how widely this has been embraced now we have it up and working.
An Unexpeted Scandal Threatens to Cripple Amazon
I think they meant that money begets money, so if you have some to start with, life is easy by default. Not a right wing sentiment.
The solution depends a lot of the problem at hand. Many people focus on the data size saying it is "trivial", but depending on what kind of data and the format, it may not be trivial. I have e.g. inherited a project where we have same order of magnitude of data over 100 millions files, and nothing was trivial about managing that.

Before recommending any solution, you need to ask yourselves the following:

1. Data ownership: do you own the data, or do other department rely on it ? Or worse, are the data customer data for which you need to guarantee some kind of clear audit trail and access control ?

2. What are the data ? Structured, semi-structured (Log data ), unstructured (images, sound, etc.).

3. What is the data for ? Analysis, training some models, viz ?

4. Can you put the data in the cloud, or do you need to store it on prem ? Questions to consider: data ownership, regulatory constraints, budget for cloud, IT quality in your company, etc.

5. Are the data write once, or are they often modified ?

Generally, I would try to create a single source of truth, but the difficulty would depend a lot on the answers of the above question. If the data are not often modified, then it is much easier to do it: you keep a single source of truth as whatever format is currently used, and you create a pipeline to create derived data (e.g. parquet/hdf5) as simple as possible first. You make sure that the derived data are RO if you can (technically and "politically").

This way you decouple the SST from the format used downstream, at which point you have much more latitude to improve things. If the SST format sucks, you can change it w/o impacting downstream users. You can also "export" the data into different format for different usages, including a DB which is indeed nice to build app/dashboards/etc. on top of. I avoid distributed platforms like the plague, especially if it is managed by the data team.

The difficulty of that decoupling phase depends a lot on the questions above. If you can use the cloud, you don't need an IT team, and backups are much easier to manage, as long as you have the budget for it (and the budget will be small for that amount of data). Another difficult is data consistency: you can often decouple w/o completely consistency (e.g. format consistency is enough, values consistency is not strictly required).

The choice of technologies is in my experience completely secondary to the problems above.
Battle to save frogs from global killer disease
The problem is that to properly understand the structure of the code you need to load in all dependencies of the code (both in other files and imported third party modules). That's time consuming and has to be done somewhere.

As a note, in Scala, scalameta will do just that and then dump out a structured view (in a specified protobuf format) of your code which you can work with.
I Volunteered at 200 Food Banks Across the U.S. Here’s What I Learned
A great loss to the community. Even though I don’t use Erlang, I’ve always been enamored by it’s unique features.

Black Ribbon please.
I'm not arguing that a welfare state is a bad idea, I'm just saying that you won't get it for what you'd currently pay in the US. I believe that many people don't actually know what it would entail - for example that you'll typically land in a federal income tax bracket about double the rate compared to the US for a similar income if you're in Germany.

If it works out for you to live cheaper in Norway, that's great, but Norway has a very special position due to the vast oil wealth, that's not typical for Western Europe.

Also, I'd love for HN to stop flagging just because they disagree politically. It's so annoying to get timed out because of a civil exchange of arguments and opinions. Always look for light in the dark: this community has convinced me that direct democracy isn't a solution for moderation - it means giving the power to censor to those who are most willing to use it.
What are the worst jobs in America?
Pension growth over time (and depletion after retirement), and investments in the stock market with compounding gains would be good ones to make. Also perhaps one predicting the probability of lottery wins over a lifetime?
Appearance of Leprechaun
Can I select all?
> What is important is maintaining the institutions that have been wildly successful in mediating conflict between diverse groups

This is indeed very important, but "empathy", while not such an institution, is a baseline cultural requirement to make these institutions feasible and sustainable in the longer run. There's not much ambiguity here; intensely tribal, closed and corrupt societies do a lot worse at managing conflicts (e.g. consider the Middle East, and why violent conflicts flare up so often there), not just empathy.
Just wanted to say that uMatrix can disable this. Browsers have been anti-user control for so long, we can't rely on them anymore to provide basic configuration even.
>and is another factor to take into account when hiring Chinese people.

I understand what you mean, but it's literally illegal to take any factor into account when hiring Chinese people (literal racism). It's literally a protected status.

Is there some other way to interview and test whether someone will steal your code and send it to China, other than the fact that they're Chinese?

If you can come up with an alternative test you give everyone, it's okay. Using nationality as a shortcut is not OK.
https://en.wikipedia.org/wiki/Joe_Armstrong_(programmer)
An Introduction to Category Theory For Software Engineers [pdf]
Functional Examples from Category Theory
Do people really use StackOverflow for answering job-related programming questions? The only time I found the questions on there useful was when I was a first year student learning programming. Maybe I am just bad at searching / asking.
RIP Joe. Every interaction I had with you in the past was always a great time. You'll be missed, but never forgotten. Thanks for everything you've done for the Erlang community and distributed systems design.
This is indeed sad news (I feel he deserves the black bar of mourning once confirmed). Although Elixir gets the most attention these days the solid engineering of BEAM is the foundation that Elixir is built on.
Nah, screw your seatmates. If they didn't want to have to wake up every two hours they should have taken a window seat.
Yep -- old-school fixed-format Fortran had one column for the "c"(omment) marker, seven for the statement number (maybe 5 plus spaces on either side?), then 72 for the code before you fell off the end of the punch card.
Mirror as the site's busy pining for the fjords at the moment: https://web.archive.org/web/20190420110129/https://larrysang...
This -1000x. Get a property manager. Mine takes 8% and does everything. I enjoy a monthly direct deposit. Every once in a while something breaks (just got a new oven), I send them a check, they do everything.
–Hello Mike

–Hello Joe

https://www.youtube.com/watch?v=uKfKtXYLG78&t=2m7s
Couldn't disagree with you more.

"most questioned" is some combination of:

- many beginners

- incomplete or outdated documentation

- not taught (or taught well) in schools

- SO users who don't search for old answers before posting again

See how none of those things, even mixed together, are a good proxy for popularity?

We don't know the mix of the above factors for Python, but without better analysis, the headline here is meaningless outside of its specific claim.
> With proper medication and treatment people can live with schizophrenia.

Am I supposed to just repeat myself? Schizophrenics refuse treatment a lot of the time. They can't tell you want to help them when they have paranoid delusions. Then what do you do? Unless they're provably a threat, you have to let them go their way, unmedicated.

> Overall, it's not clear to me what you were trying to say. Given that the obviously immoral solution is out of question, that there always remain some problem with the outliers for which the help doesn't work?

Your "obvious solutions" are not solutions. You make it sound like a solvable problem. It's not. It's really a tradeoff between public safety and personal freedoms.

Mental illness is not an "outlier". About 30% of the homeless suffer from severe mental illness:

https://web.archive.org/web/20121231000856/http://www.calpsy...
Joe was also a part of the Elixir community. He learned the language early on and participated in the mailing list and forums. Actually, he had just very recently become an admin at elixirforum.com. I will really miss him.
> I have yet to see a project fail because commit messages

That could be said about a lot of things. I have not seen a project fail because they didn't use tests, so you shouldn't bother to write any?

To use a close analogy, surprisingly many professional developers need to be reminded about the proper use of indentation and comments. Not because the project doesn't build otherwise but because code generally needs to be read much more than it is written. The only code that is never read again is failed code.

The same is true of version control. A couple of years ago it was very popular to think in terms of storytelling. Your version control system is the story about why your software ended up the way it did. It's a story that every new developer will need to read, partially. Even if you are the masterful engineer that instinctively knows why "made bugfix" was written that way and not another, at least put in the effort for those of us who aren't.
It can be a good way to finance a vacation home that you eventually want to live in. There are other more niche cases such as student housing, corporate furnished, Airbnb, etc, that can be interesting, but you need to know the specifics of each case. For ex, in student housing, everything needs to be thought of in terms of durability and security (steel cased doors, durable surfaces). It also pays to be handy - when you turnover an apartment plan on a repaint. You can hire this at $750-$1000 or you can put on your face mask, rent a sprayer, and knock it out. We’ve been lucky not to have extreme maintainable issues but there are usually minor issues that you’d expect to see. In my view, stocks are entirely more liquid and it’s not that difficult to find high yielding companies where you don’t have the complexities of tenant relations, marketing, repairs and fixed expenses like property taxes.
Well, 2+N companies depending on what servers the people you correspond with use. That's the nature of a federated protocol.
What's a use case for needing to be able to do this?
I've been really interested in learning Fortran for a while- I work doing a lot of computational stats/ML and typically my tools are python, R, or Golang. Is there any use-case for Fortran in production settings or should I just accept it would be purely a personal satisfaction project?
@dataclasses?
Maybe psychiatry interns should spend a month taking antipsychotics, just to experience the side effects. It would greatly reduce their faith in big pharma.
Calculations of this model are misleading. One hugely important parameter missing: inflation rate. This would tell us what part of that 2.1 million in 30 years is real return and what part is simply inflation, i.e. depreciated money. Put it differently, it’s important to know what the investment will yield in terms of today’s dollars - not depreciated dollars.

For such a long horizon of 30 years modeling without accounting for inflation makes little sense. For instance that 7% stock market return used by the model as a default, which perhaps may be used as proxy for inflation, would return 661% over 30 years.

Default values for other parameters and their distributions also look very optimistic to me. Like 4% annual appreciation which maybe drops to 2% annual appreciation. How about 40% annual depreciation, your mortgage being 30% underwater, and foreclosure? How about the bank that issued your mortgage going bust, then the bank which bought that bank going bust, and then you 30-story building being shut off from public utilities? What am I smoking? Neh, I just bought investment properties in Miami and other places in Florida in 2007. Anyone too young to know what I’m talking about: I urge you read up on the 2008 crisis before you start buying up investment real estate, after 10 years of unprecedented growth of both real estate and stock market.
Enhance Gmail to get your Google Inbox features back. Productivity awaits!
One situation I had was storing consent forms for medical patients. If we enabled their care in the DB and lost their consent form we could be sued for quite a bit.
Note that a physical switch can be overridden just as easy as a soft switch, the vendor can just put a soft switch in parallel with it and you would never know it. The hard switch could turn off the display, speaker etc. while the processor and radio can stay on.