skysight-inc/HackerNews huggingface dataset:
> That's why ultimately, it is difficult for me to envision a path for many of these people that does not involve some sort of education, training, or similar. It doesn't have to be STEM type work.

Just take Japan's NEET problem and multiply it (at least) a few fold. That isn't just what is coming for us, it's what is here now, and getting worse.

Other commenters have said it better than I could but many people in our society are just not suited to the solution being offered here (and elsewhere), of more education and training. They just aren't.
I have been at Ivies in some capacity in each of those decades. There have been "average at best" folks in each of those decades.

While the "average at best" folks may have increased in proportion to above average folks (something I am not sure I agree with), I think it may have more to do with the admissions process being more transparent with the rise in popularity of the Internet than it was pre-internet.

My personal and anecdotal take is that I have seen an increase in the proportion of tryhard bookworms who lack creativity, leadership skills, and/or raw intellectual power. I am not sure that this is necessarily a bad thing (these folks make great worker bees), but their proportion in the student body needs to be balanced with folks with other strengths like those mentioned above.
Sounds like a branding refresh for the Multimedia Super Corridor: https://en.m.wikipedia.org/wiki/MSC_Malaysia
Turns out knowing more than one language isn't a rare or sought after skill. In Europe maybe 40% of the population knows multiple languages fluently. Perhaps a third of these write well enough to translate.

You're not going to get paid well for a job that close to 15% of the population can do with no training
>"How do machine learning and statistical analysis tools distinguish between a causal relationship and mere correlation?"

They don't.

>"And how often will they actually demonstrate the latter, yet be treated as if they had found the former?"

Every time the former occurs it is incorrect.
Url is https://www.ivpn.net
Yeah, I mean, there is no doubt that there is a fundamental disagreement about homosexuality between Mormon doctrine (and religion in general) and the popular contemporary understanding.

The Church condemns a set of behaviors, not a state of being, mind, or attraction, so regardless of one's opinion on the origin or fixed condition of sexual attraction, there is no need to feel guilt for inclinations, inherent or no.

There is already ample theological justification for proclivities toward any sinful behavior, which we all have: Earth is a "fallen world", a testing ground where temptation must be presented to all and adequately resisted. This covers forbidden sexual activity, which is not limited to homosexuality, just as well as it covers any other inclination toward sinful or negative behaviors.

Unlike other issues that brought Mormonism into conflict with the prevailing social dogma, this is not flexible and should not be expected to change.

Despite all this, far from hunkering down and drawing exclusionary barriers, the Church is trying, as best as it can, to communicate that everyone is welcome in the "hospital for sinners" that the Church comprises.

Everyone fails to meet the standards that the Church defines along some axes, since Christ literally commands men to be perfect [0]. The goal is to get people accelerating and proceeding toward the ideal, and to provide support in their attempt to do so. Everyone is welcomed to that effort, with as much participation as they are willing to give.

[0] https://www.biblegateway.com/passage/?search=Matthew+5%3A48&...
Several people are typing.
> scholars working with culture and technology love to make a huge deal about data leakage

one of the fundamental considerations is that if things are very sensitive, they need to be on their own air gapped network. Or at least not on the same layer 2 fabric as a ton of other things that it can arp. Network engineers who understand all of the myriad possible ways that topology can be set up (both at OSI layer 1 and logically) are key.

Properly set up with a secure gateway/VLAN delivery for a critical workstation that has a special route outbound to the internet through a firewall, there will be only two MACs showing up on the fabric: The workstation itself and the device that is serving as its default route/gateway.
Lot's of religions have the "I believe God wants me to do x" component without their followers then actually doing X. Non of the Catholics I know, for example, are particularly catholic or overly christian in their day to day behaviour, while all the Mormons I know try very hard to be, well, Mormon.
Are we talking about the same national guard that mowed down unarmed students in the Kent State massacre? You'd be surprised what strong structure can cause a person to do.

https://en.m.wikipedia.org/wiki/Kent_State_shootings
Modems work over VoIP for low baud rates (9600 or less.) Check out the bbs subreddit.
Kink-Shaming and Outing in Tech – Valley of the Dommes – Medium
Doesn't it help ensure the user is using a phone and can get notifications when you couple it with a text message code entry? Then you can skip the typical authentication flow? I would think it would be quicker overall for signup and for making the code simpler but I guess weird for users not used to it.
Social aspect of this are also interesting. We use the stock ticker as a reward and punishment for the companies involved, so introducing a new product that sells in unexpectedly large quantities generally leads to the stock price going up, while any bad news, e.g. pollution, poisoning, product recall, illegal behavior by the exec generally lead to a sell-off.

In an index-centric world if neither of the events cause the company to leave the index, I wonder if we'll still see such price adjustments.
> Do you think the people behind AWS didn't model the potential cloud services market, and were taken by surprise by the success?

Yes.

The project was born out of Bezo's edict early on in the creation of Amazon that everything the company does internally must be able to be turned into a service. Almost every analyst in 2006 was against the idea and Bezos admitted it would not be a forseeable revenue stream:

> Stifel Nicolaus & Co. (SF ) analyst Scott W. Devitt notes: "There's not going to be any economic return from any of these projects for the foreseeable future." Bezos himself admits as much. ... "We think it's going to be a very meaningful business for us one day," he says. "What we've historically seen is that the seeds we plant can take anywhere from three, five, seven years."

From this 2006 story: https://www.bloomberg.com/news/articles/2006-11-12/jeff-bezo...

In 2011(or 2010?) AWS revenue was still listed in the "Other" column on their 10K, even though it was by then their #1 area of growth.

So yes, I think the scale of the success surprised them. It certainly surprised analysts who think like you do, nearly all of which expected AWS to be something between a hobby and a folly (read the Bloomberg article).
Softgun: The embedded system simulator
It can't possibly an AND operation, can it? If your MAC address has a lot of zero bits you'd get a ton of false positives?
Exactly, how can algorithm investing be truly passive investing?

There's a lot of confusion in the article.
This is for mutual funds, which are ultimately intended to operate under given parameters -- balancing a cocktail of risk, reward, timeframe etc. Seems natural that you'd eventually move to algorithms for this, particularly as information asymmetry drops or is negated by other factors.

This is really now becoming a form arbitrage between the mega-funds on a sizable, but discrete, chunk of the trading market. Probably the same chunk that's already reserved for market-makers who can (usually) succeed through volume and brute force alone.

I think this is a good thing - arbitrage is a terrific leveller for the rest of us. It opens up the real market for us small fry.
HOWTO: Convert android phone into headless linux machine
I am looking for a way to convert my old android smartphones into headless 'over the network' linux devices.

What I am looking for is, I should be able to:
a) SSH onto the device
b) Use linux command-line (BASH preferably), once I have SSHed onto the device
c) Run programs on the device (let us say java microserices to begin with)

Why do I want to do this?
a) Because I have 2-3 old android smartphones lying around. I could leverage their hardware instead of buying a new laptop.
b) Because I am curious about it.

Any help is much appreciated.

Thanks,
Amit
The "some confidence level" is the problem - how do you come close to quantifying and removing all the other effects that are involved? This stuff always just becomes something that can be debated away if the advertising lead is popular, or otherwise used as an excuse to fire him/her.
Not sure if I like or dislike Perl6 decision to use rationals by default; so 0.1 is saved as 1/10 and 0.2 as 2/10 and the calculation is precise. But also possibly slow.
Delivery numbers may become slightly compromised as the existing infrastructure (not just assembly but the whole pipeline of getting them to customers) is routed to include Model 3 deliveries.

This may make Q2 slightly worse than Q1, making them miss the projections, even if it makes Q3 really great! Situations like this may be why they've been including the "in transit for next Quarter" numbers so often.
I'm not expert but the value of a stock is not only tied to profit, it's also tied to how optimistic people are about a company and where it will go in the future. That drives up the price of a stock and thus how much you can sell it for. This is what Elon Musk is a master at - whether his strategy is feasible or not. I personally believe Musk will not give up.
https://www.tunnelbear.com/ has been great for me
Lou's page is one of the reposts that I'm always happy to look at. And it has been reposted frequently.
Non-homogenized milk will also not spoil like regular milk does [though it still needs refrigeration, but it will last for 2-3 month pass its expiration date].
Lots of claims to correct the historical record, notably lacking in evidence.
It's interesting how happiness works. Think your situation is bad? In Zimbabwe unemployment is something like 80-90%. However this article proves even in situations like this, something simple like friendship can make you happy!
Most of this story is about slow-motion in videos,
not about the amount of data.

To add to it, data-gathering by NSA can indeed lead to the wrong conclusions. Or statistics in scientific experiments that are wrong, due to selecting only a part of the data-set.
Sorry for the late reply. It's true that unions tend to have more success forming in monopsony employer situations, usually because of the labour force abuses that tend to follow. The other context where unions have high coverage (and tend to be unusually militant) are industries where the job carries a high degree of risk for the worker.

Historically this risk has almost always taken the form of physical danger (e.g. miners, steelworkers, construction workers etc.). Whether intellectual labourers will be motivated to organise by less proximate, but no less real, risks (e.g. the risk of being automated out of a job, being denied ownership of one's own IP/thoughts etc.) remains to be seen.

The other interesting factor is that there seem to be parts of the tech industry where a worker produces orders of magnitude more surplus value for their employer than they are paid for their efforts. I suspect this may have been a factor in the unionisation of screen entertainment workers and professional sports people (particularly when radio and TV turned those markets into 'winner-takes-all' markets).

And I'm not sure I'd personally characterise many of the markets in the tech industry as competitive. The most lucrative markets seem to be either dominated by a de facto monopolist (e.g. search, social networking) or duopolists (e.g. Windows vs OSX, GFX cards and CPUs, the android and iOS platforms etc.).
I was actually very surprised when I first moved to UK to find that milk here spoils within a few days of purchase, I was so used to UHT milk that we would normally buy several cartons of, and then it would last months(obviously only few days after opening, but we could conceivably buy a 6-month supply and just keep it in the basement for later consumption). Nowadays I found where to buy UHT milk in the UK, it gets me some weird looks from my friends but the convenience of not having to go to a store to buy fresh milk every few days is absolutely worth it.
The article makes many good points about how upward mobility works. These points generally fit with what I understand: That stable marriage is one of the best ways to become and stay upper middle class; that poor neighborhoods with too few middle class people have much more serious problems than poor neighborhoods with X percentage of middle class residents; that spending on education is not the most critical metric for education effectiveness. etc.

It's a really good piece. The conversation here, not so much.

I am not hugely familiar with Mormonism myself, but I grew up in the Deep South, a place full of hellfire-and-brimstone Christians. That does not mean all Christians are like that. I am not personally fond of Christianity, but there is a line in the bible somewhere where someone tells Jesus "People will do terrible things in your name someday" (or words to that effect) and he replies "I will say I did not know them." (or words to that effect). Christians behaving in a way that gives Christianity a bad name is not definitive proof that Christianity is an inherently evil organization. Ditto Mormonism.

I am somewhat disappointed that so much of this discussion is about Mormonism and so little about upward mobility. I am deeply disappointed that the topmost comment here is one that outright mocks Mormonism. Bad enough it was said, but then multiple people apparently upvoted it. Ugh.
Quit your job, hire your non-technical friends. Train them up and run your consultancy that can beat everyone on price and is at least as good. Riches await.

Use the fact that you have the experience to sell the consultancy. Then use your army of once non-technical friends as your code farm. You can pay them less than market (since they were otherwise making nothing) and you can charge market.

You're promising an easy market opportunity. And that always raises the question, "If it's so easy, why aren't you doing it?"
This is why I'm really hoping RDMA [1] will catch on soon. It would be great if there was a cloud provider that would enable this feature on some of their offerings. Amazon has done something similar by allowing kernel bypass via DPDK [2] with their ENA offering but Kernel bypass is inferior to RDMA in so many ways IMO.

At this point we have 200Gbit/s NICs being provided by Mellanox [3]. CPUs aren't getting any faster and the scale out approach is extremely difficult to get right without going across NUMA domains [4]. Based on the progression of CPUs lately there just isn't going to be enough time to process all these packets AND have time left over to actually run your application. There's a lot of work focusing on data locality at the moment but at this point it's still not fool proof and the work that has been done is woefully under documented.

As the article mentioned we've already added a bunch of hardware offloads. RDMA is just a continuation of these offloads but unfortunately it requires some minor changes on the application side to take advantage of which is why it's probably been slow to be adopted.

RDMA has so many great applications for data-transfer for backend services. Whether it's queries between a web-server and a DB, replication/clustering of DBs, or micro-service fabric with micro seconds latency. Overall there's a lot of low hanging fruit that could be optimized with RDMA.

[1] https://en.wikipedia.org/wiki/Remote_direct_memory_access

[2] http://dpdk.org/doc/nics

[3] http://www.mellanox.com/page/products_dyn?product_family=266...

[4] http://rhelblog.redhat.com/2015/09/29/pushing-the-limits-of-...
Why someone can not say growth without modeling it? If someone tried to model amazon in a very early years by the number of books they will sell in a few years, or model Apple
before iphone. It would be fairly pointless. People very well might be valuing potential for innovation (TSLA is not just a car company).
Opposite viewpoint: http://www.mrmoneymustache.com/
Hopefully, we can eventually cut down on fees with those mutual funds too.

You don't have to worry so much about algorithm engaging in insider trading or some other securities fraud. The auditors just have to look at the algorithm's data sources to verify the fund stays compliant with securities regulations.

Fewer costs (hopefully) mean fewer fees
A division stationed in a blue state isn't going to be made up of locals. It's going to have the same mix as the US military in general (read: Mostly southern states).

The National Guard will be more representative of their home base, but that is going to be smaller forces that complement active duty, not replace it.
Funnily, my intent was to show that y was the dull stuff. Maybe another addition would be "I believe God wants me to do x because y, in the context of s, therefore I do x because y and/or z"?

For example, take a thing Mormons are commonly known for—not drinking alcohol. It came about in what we call the 'word of wisdom' [1] [2].

s := The story part would be "In consequence of evils and designs which do and will exist in the hearts of conspiring men in the last days, I have warned you, and forewarn you, by giving unto you this word of wisdom by revelation—"

x := don't drink (and other health related things like eating meat sparingly)

y := to be healthy in both body and mind/spirit

z := I have faith (faith is effectively trust in someone who has shown that they're trustworthy) in God

[1] https://www.lds.org/scriptures/dc-testament/dc/89?lang=eng

[2] https://www.lds.org/topics/word-of-wisdom?lang=eng&old=true
Thank you! This is starting to make a lot more sense! I guess what's still confusing to me has to do with the seriality (continuity?) of the process vs the OSI model, which seems like there are more discrete stages.

Does each stage of the model need to complete for the whole packet before moving on to the next stage? For example, does A/D conversion take place until all of the packet information is converted, then the whole binary blob is enframed as a header and a packet... then we filter for MAC address and move on up the stack in discrete and consecutive stages? Or are the voltages read off the line and once there is enough information to construct the header, compare it, then choose to continue reading the rest from the line or stop the A/D conversion because it is just a waste of energy? The latter makes a lot more sense to me.

EDIT: words
It seems plausible to me -- I don't claim any more than that, and I am no expert on this stuff -- that:

1. If possession (in public places) of knives above (say) 3" is illegal, fewer people will go about carrying knives above (say) 3". It probably won't make any difference to someone planning to get into a knife fight, of course.

2. If fewer people are casually carrying big knives, then there will be fewer opportunities for conflicts to escalate to fights involving big knives. For instance, a bar fight is less likely to end up fatal if fewer people in it are carrying serious knives. A burglary is less likely to end up fatal if the burglar isn't. Some muggers may choose to make do with musclepower rather than knives (so they're less likely to get into serious trouble if a policeman thinks they look suspicious). Etc.

3. Fights involving big knives are less dangerous than fights involving smaller knives, e.g. because a bigger knife is more likely to end up doing serious damage to internal organs. (If an expert fighter is specifically trying to do you serious harm, I'm sure they can do it with a small knife. Or a toothpick. But in cases where the goal is "establish dominance" or "get away safely from the house I just burgled" or "make my victim sorry he didn't just hand over his wallet" and there isn't serious intent to kill, I expect smaller knives to do less harm on average.)

Astute readers will notice that I'm now talking about knife fights rather than knife crime. My guess is that premeditated crime-with-knives probably wouldn't be much affected by this sort of ban. So, though I'm sure all the things I'm hoping would be reduced would technically be knife crimes (i.e., crimes committed using a knife), I think my use of that term was unhelpful. Sorry about that.
> companies sell what people want to buy

That doesn't really sum it up. There are lots of things people would love to buy, but there are strong enough disincentives to marketing them that they don't get sold. A simple example is raw milk, but there are myriad reasons why a company would not sell a product, and often times those reasons line up across an entire industry.

In marketing specifically, there are cultural practices that make certain products easier to market than others. It's not that those products are unmarketable, or that people don't want to buy them, the tools to do it just don't exist.

For example, I could invent a marketing tool for marketing some of these products, adding 0.01% to the typical marketing professional's revenue... but learning that tool isn't really worth their time. They can manage maybe a half dozen tools max. so each of those needs to provide tens of thousands of revenue per year. If we start from a presumption that marketing will be done by people earning $50-200k per year, only tools that fit into that lifestyle can exist.

Of course, there could be a market of part time freelance marketers capturing those smaller contracts, but there's no incentive for the existing marketing industry to build the tools they'd need.

In fact there's disincentives: having a big step-up in the cost to get started makes it harder for newcomers, which decreases competition for professional marketers, which makes it easier for them to keep their contracts. And for the tool builders (software companies, etc) it is just more manageable to focus on one or two tools that capture the lions share of the market. Product teams get bogged down in trying to build too much, so management has an incentive to keep it simple.

A startup could capture that value, but as startups grow there is pressure for them to go after the big fish clients, and again that causes them to turn away from the long tail.

Open source will get to it, but the open source software development world is still in its infancy compared to the IP-based software development world. And OSS is currently in a crisis due to software shifting from downloadable executables to software-as-a-service. We'll pull out of that, but until then the end-user OSS market is languishing.
The "f" suffix means they are single-precision (32-bit) FP numbers.
So, no citations
Choosing the right keys
> he spends paragraphs talking about how there is a growing pool of able-bodied, middle-aged citizenry yet he advocates bringing in even more people to maintain GDP.

This makes no sense to me. The US economy exists to serve the people of the US, and GDP isn't an end to itself.
I don't know what you mean by "in practice", but if everyone in a network is always either uploading encrypted bits or random bits, then the problem of tracking the history of that network reduces, in practice, to the problem of distinguishing between the two.
What Orleans like systems are there in other languages?