skysight-inc/HackerNews huggingface dataset:
Clearly popular:

Discussion: https://news.ycombinator.com/item?id=10627472

A more complete list, including many subsequently deleted:

https://news.ycombinator.com/item?id=10627328 (medium.com)

https://news.ycombinator.com/item?id=10627329 (medium.com)

https://news.ycombinator.com/item?id=10627365 (medium.com)

https://news.ycombinator.com/item?id=10627369 (medium.com)

https://news.ycombinator.com/item?id=10627402 (medium.com)

https://news.ycombinator.com/item?id=10627425 (medium.com)

https://news.ycombinator.com/item?id=10627472 (medium.com)

https://news.ycombinator.com/item?id=10627527 (medium.com)

https://news.ycombinator.com/item?id=10627558 (medium.com)

https://news.ycombinator.com/item?id=10627633 (medium.com)

https://news.ycombinator.com/item?id=10628190 (medium.com)

https://news.ycombinator.com/item?id=10628209 (medium.com)

https://news.ycombinator.com/item?id=10628373 (medium.com)

https://news.ycombinator.com/item?id=10628455 (medium.com)

https://news.ycombinator.com/item?id=10629194 (medium.com)

https://news.ycombinator.com/item?id=10629385 (medium.com)

https://news.ycombinator.com/item?id=10630124 (medium.com)

https://news.ycombinator.com/item?id=10632852 (medium.com)

https://news.ycombinator.com/item?id=10635859 (medium.com)

https://news.ycombinator.com/item?id=10637320 (medium.com)

https://news.ycombinator.com/item?id=10637917 (medium.com)

https://news.ycombinator.com/item?id=10638236 (medium.com)

https://news.ycombinator.com/item?id=10640073 (medium.com)

https://news.ycombinator.com/item?id=10640738 (medium.com)

https://news.ycombinator.com/item?id=10641029 (medium.com)

https://news.ycombinator.com/item?id=10643754 (medium.com)

https://news.ycombinator.com/item?id=10644197 (medium.com)

https://news.ycombinator.com/item?id=10644805 (medium.com)

https://news.ycombinator.com/item?id=10645925 (medium.com)

https://news.ycombinator.com/item?id=10654469 (businessofsoftware.org)

https://news.ycombinator.com/item?id=10695584 (m.signalvnoise.com)

https://news.ycombinator.com/item?id=10744643 (m.signalvnoise.com)
Exploitation of irrationality is how rationality evolves in biological systems. In other words, if we get the government to play the role of a protective nanny, we the citizen will remain intellectual equivalent of infants.
I've tried Haskell 4 times. No joke. I have no problem with currying, higher-order functions, foldl, etc., but Monads. Get. Me. Every. Time.

My brain just refuses to fully "grok" them. I still don't see why they're so awesome. I know I use them day-to-day - LINQ, the "List" abstraction (supposedly also a monad??) but I just don't see why it's important to understand them on this whole new fundamentally different level.

It's like - loops. I use loops every day. But if someone were to say - "Hey, did you know that loops are just the Andifuncsplursx abstraction applied on Crazofors?? This is why Crazofors in Haskell are so awesome" I still wouldn't "get" Crazofors or why I should care enough to attempt to "get" them.

I've just given up at this point.
Because more people have time to invest than have money. And because investing time in a fast-growing startup is a hell of a lot more fun.
The species of despicable primates of which you are part.
Amazon to Roll Out a Fleet of Branded Trailer Trucks – Fortune
In the sense that agriculture, as well as triggering the ecological changes discussed in this report also allowed the formation of dense populations capable of building structures like that, yes.
SecLists: the Security Tester's Companion
Couldn't agree more. I've used QML for a Go app and the sanity prevalent in QML vs. web standards is like night and day.

I actually don't want anything more to do with web front end development - leave all the react/flux/angular nonsense to the JS package manager of the month crowd.
I "roughly" got it using the DOI txt I linked above.

I tried again with the pre-mapped text you linked to, and got `e o a p s p` which is an anagram for `appose`... perhaps that is the word? "Appose" means "to place (something) in proximity to or juxtaposition with something else." Maybe I'm grasping at straws here...

Offset of +1 yields `b s a i t h` which is an anagram for habits.

Offset of -1 yields `a t a l b t` which is an anagram for Alt-Tab (which is roughly what I'm doing right now to get out of this :p)

I also tried all offsets within 0-7 for each character, to see if "CIPHER" could fit in that range. CI_H_R is possible but there is no P or E within +/- 7 offset of 201 or 337.

Here's the python:

txt="""<<Pasted from http://cipherfoundation.org/older-ciphers/beale-papers/beale-papers-transcription/>>"""

import re

codes = txt.split(' ')
codes = filter(None, codes)

code2word = {}

words = []
for code in codes[0:-1]:
try:
index = re.search(re.compile(ur'\((\d+)\)'), code).group(1)
except:
index = index + 1

word = code.replace('(%d)' % int(index), '')

code2word[int(index)] = word

print index, word

for code in [89, 263, 201, 500, 337, 480]:
word = code2word[code]
print word[0],

Good luck
California’s new DMV regulations may kill the state’s robocar lead
Absolutely agree with this. I haven't even played the game yet, but what I find compelling is the "worked on making this for 6 years" / "I'm a self-taught programmer" / "I can't afford a domain" story. If there was a website with a Buy Now button I'd already be clicking it.
Do i win if i cant even turn on the test because of my addons? (noscripts, RequestPolicy, Ublock Origin)
Awesome! Thanks for sharing.
I think you'd be surprised that it's actually a lot easier than one might think.

Unless they are references from people who those involved with hiring personally know.
^^ Great advice. I had a college student ask me for input on this very question this morning and my response was not to stress too much about finding "the best, most ultimate company ever to work for," but to find a position where you can learn a lot and develop skills you know you need from people willing to invest time in you. (As an aside, something like 70% of people say the most stressful part of their job is their boss. So if there are ways to screen for working with someone who is willing to take the time to cultivate you, amazing.) I think it's tough, especially for the generation of students graduating from college right now (millennials coached to believe they need to have a HUGE impact wherever they go and to believe that their contributions are insanely important), to understand that a first job is just a first step and is not career-defining, in my opinion. You can work somewhere, get some good experience, and then leverage that to get a job you're really excited about.
What is "engineering": just mechanical, civil and such? If I'm designing part of the circuit board for a tablet, is that "tech industry" or "engineering"?
I would like to add to what graham1776 said https://news.ycombinator.com/item?id=10759722. This is great advice about kickstarting your networking. When I did a retrospective on my career, I realized that the various jobs or gigs that I had were directly related to my informally-developed network.

Networking is a bit time-consuming, but it will serve you well in the rest of your career.

The other thing I would say (as one who has gone through this more than one time. The actual number of times is a trade secret) is don't delay the start of the search. For example, if they parted company with you on Friday, start working on it on Monday. And it sounds like you have a jump on it already.

The other thing to keep in mind is to not spend more than say 30 hours a week on a job search. Despite your relatively positive outlook, it will be quite stressful and it is important to break away from the search activity regularly.

Edit: typos
How Mobile Carriers Skirt Net-Neutrality Rules
Except that'll impact everyone, not just office workers who might be able to do that kind of thing.
> It is high time for all of the tech companies of Silicon Valley and San Francisco to come together and lobby the hell out of municipal and county governments to push for more housing and better transit.

The problem is fractal. The reason why the companies locate in SF rather than, say, Gilroy is the same reason why the companies locate in Silicon Valley rather than Tulsa, OK, for example.

The first problem here is that the executives in these companies want to live in those rich communities, so they don't locate the headquarters somewhere sensible. And lack of telecommuting is driven by the fact that executives can't telecommute as everybody now realizes that they actually don't do anything.

Second, there is a recruiting advantage when your company office is in the "cool" area. If you put the Facebook HQ in Gilroy, for example, a bunch of the younger folks would choose to work for a company that is located in SF proper.
Probably the differences from the alphabet are just mistakes. Ward meant to just encrypt the alphabet, but just copied down a couple numbers wrong, and did a couple twice.
"But of course newspapers and grotty rags like to perpetuate this narrative that derivatives are going to blow up the world."

It's no secret that Warren Buffet is strongly against these derivative products and considers them to be one of the most dangerous financial products in history.

So why is he "perpetuating the narrative" as you dismissively claim?

I want to bring him up because you're hiding behind attacking the newspaper and "rags", so let's instead point to one of the most successful investors in modern history who agrees.

Why is he wrong? Please don't hide behind dismissal and attacks, as a man of Warren Buffets caliber has proven through real world demonstration that he possess a vast understanding of these markets and products.
Allowing rationality to evolve by allowing irrational actors to be exploited is going to take thousands of years at the least. I'd rather figure out some way to improve things sooner than that.
Remote has other benefits like getting more women involved in tech: http://www.wired.com/2015/04/powertofly/

However, companies praise "high-bandwidth" face-to-face communication, and which we most all agree can be useful.
The issue though at many companies is they lean on it to try and paint over communication and process issues they have. It's not a problem with remote per se, but it's an easy scapegoat.
Well, I wouldn't say "likely" comes into it. I'm explicitly describing what happens with a choke_and_die() function if say the software crashes with no recovery, or major sensors are damaged - unpredictable by definition. The "I don't know how to navigate this situation" case would be handled by gracefully pulling over, and should rarely happen because developers would be encouraged to work out the kinks rather than having such a terrible user experience be common.

My point is that giving developers an easy out of forcing a human to take over just encourages sloppy non-robust software. And if there's anything that consumer technology companies are good at creating, it's non-robust software that has no place in a car.
Had a family friend sell a house 5-6 min from the future spaceship for 1.2 million. It's a tiny box and they had 8 offers over their 800k asking price on the first weekend. The highest bidder was quoted saying "It's close to work(apple)". That area is already expensive for the schools.
If the low salary and no advancement are simply due to having XX chromosomes (similarly skilled and productive males at the same organization do get paid more and advance), then she's in fact leaving due to sexism, not simply working conditions.
> leave after one year

I've been trying to leave my small company for a mid-sized startup in NYC (currently in NJ). Started just before my year mark. Almost every startup wanted someone with more experience under their belt. Of the few that were willing to take on someone with one year, I was still in competition with others who had much more experience. I got the same line over and over again - "strong technically, passionate, good fundamentals, but we need someone more experienced". So I waited a few months and tried again. It's gone a lot better so far (no offers yet) but I've had to shift my image from that of a young up-and-comer to one who knows how to Get Stuff Done. I stopped asking about mentorship opportunities. I still really want to work at a startup but I need a new job ASAP - I don't think I'll be attractive to them for a few more months at least.
Disclaimer: I'm a Canadian expat who's been living and working in the US tech industry for a few years.

> "Google Raids Threaten Canada's Lead in Artificial Intelligence"

This seems like an unnecessary specific title, I'd suggest the following edit:

"US Tech Company Compensation Threaten Canada's Trailing Status in All of Tech"

For one thing, this isn't just an AI thing, US companies have been moving Canadian tech workers south of the border for years across the board, regardless of specialization or focus area. Everyone from the humblest code monkey to the brainiest algorithms wrangler is being exported from Canada at a rapid pace.

This has been happening for long enough that a significant fraction of Canadian tech talent is already residing in the US, which sort of raises eyebrows about any claims that Canada "leads" in tech currently. If there ever was a lead the brain drain has certainly put that to bed long ago.

And it's not just Google, all of the major companies recruit Canadians heavily, and even startups have gotten in on the game in recent years.

And these aren't "raids". Google isn't marching off computer scientists at gunpoint. There's nothing predatory about this - if Canadian companies want to play in the same league as US tech, they need to catch up, the least of which is narrowing the pay gap.

Right now I am literally making 500% the salary a similar position pays in Canada. Even accounting for the living costs of SF/SV/NYC it's not hard to see why people make the move. Canadian tech pays incredibly poorly in comparison to US tech, and that's far and away the #1 reason the brain drain exists and will persist.

I'm a proud Canadian, and all else being equal I'd rather live in Canada than the US, but one of the persistently annoying things about Canada's tech industry narrative is the continuous denial of just how far behind they are compared to the US.
Is this true? if so, how can sites like angel.co exist? I believe I can invest in most of the startups right now on there..
Your experience definitely doesn't match mine.

while it's true that media in general is in decline and has a poor wage situation, that's mostly felt on the editorial side. Programmers still seem to be paid quite well, at least in New York. I've never received an offer to work at a media company for less than $100k and have had a few at double that.
> In the 1980s the boom was experts systems and logic inference supercomputers.

Would you consider any current system or approaches are a continuation of that or did that end up a dead branch in the AI evolution so to speak.

I can perhaps think of IBM's Watson as sort of continuing in that legacy.
Very, very well said.

>> I'm a jack of all trades master of none.
>> I've always taken that as an insult rather than a compliment.

"Specialization is for insects", Heinlein.
> “We are losing our top talent, the talent at every level,” says Ajay Agrawal, a professor at the University of Toronto’s Rotman School of Management. “While we had that advantage, it is slipping through our fingers.”

well yeah, people want to go to the states and be paid more while working on interesting things.
Looking at the salary numbers from H1b applications (http://visadoor.com/h1b/index?company=netflix&job=&case_no=&...), I wouldn't find that too far fetched. To add to that, I know someone who went there as "senior" with 5 years of work experience
Yes, "she cost them their jobs". That's a "valid interpretation" of the story.
The greatest shock to my idea of fairness in the world was when I learned that banks could deposit money in the federal reserve and get a guaranteed by law interest rate of 6 percent. Heads, market's good and banks lend money and make money. Tails, market's bad, banks put money in the fed and make money.

Not surprised that it is a similar heads-i-win-tails-you-lose situation with IPOs. The House always wins.
last I checked, nannys don't let the kids they're taking care of democratically elect their behaviors.
But are goods and services in Canada correspondingly cheaper. In other words converted to US dollars, devs make less there, but is food, housing and healthcare also costing less?
Don't forget that there are other options. I work for a small consulting company. Our size allows us to have the agility of a start-up, but without the long hours and the stress of your product failing.
It's the "actually listen to women" part that a lot of people here have problems with.
Thats the trick to guarantee a job
People bring this up in every single thread about sexism in HN and almost every single time somebody gives them a cite to any of the several of efforts dedicated to getting dudes in those fields.
Yes, my sister did this -- she was a bright college grad and went through an associate program. Gave her a ton of exposure and helped her then find her niche and accelerate quickly. Let's be honest, know one in college knows what the ins and outs of "marketing" or "customer success" or "operations" looks like; my sister was surprised to find herself really interested in the niche field of fraud for a big travel booking company, and now she's able to parlay that expertise to get a higher salary and better job title elsewhere.
Cancer is tens (perhaps thousands) of substantially different diseases. And yet, we group them under a common name "cancer" because they do have commonalities, and while so far treatments focus on very specific cancers, it is not unthinkable that we WILL actually find a common treatment.

The naked mole rat has apparently solved the cancer problem[0] - and while it is not perfectly understood, it is definitely NOT by mitigating hundreds of different cancer factors - the prevailing theory is that it detects and destroys "overcrowding", regardless of cause. We might be able to do something like that for humans, although right now it is still in the realm of science fiction.

The most promising venue to the best of my knowledge is the Warburg Effect[1]; unfortunately, it has been promising and not really delivering for 80 years now, although DCA[2], which showed promise and is undergoing clinical tests as a cancer treatment, is at least conceptually related - malfunctioning mitochondria and fermentation-in-lieu-of-glycolysis seem to be two sides of a similar coin to my (untrained, ignorant) eyes.

[0] https://en.wikipedia.org/wiki/Naked_mole-rat#Resistance_to_c...

[1] https://en.wikipedia.org/wiki/Warburg_effect

[2] https://en.wikipedia.org/wiki/Dichloroacetic_acid#Cancer
> It is absolutely insane that there is so much wealth being generated by these companies, yet they seemingly have no political will to influence the very localities they are based in

Wealth != municipal revenue. Menlo Park was particularly upset that Sun Microsystems (selling hardware and generating sales tax) was replaced by Facebook (no sales tax revenues). A pizza parlor would generate more revenue for the city, seems like, than an Internet company.

The only other venue is for company employees to buy up residential real estate, start paying property taxes and show up for city council meetings, as the city is likely deriving significant revenue from that. But if that is not happening, we can assume that company employees chose to deploy their residential spending elsewhere, and if so, why should the city care?
In other news, rental prices near Facebook just went up $10k / year. Odd.
Well if you use aws s3 sync, then know that this in fact relies only on timestamp and file size to compare files. If there's a difference it'll send the whole thing.

rsync is smarter it actually can compare and send parts of modified files. This article talks about new functionality which utilizes zfs snapshots. Now zfs knows better what has changed (for example whether file was renamed or moved) so it can be even faster when replicating the changes.
That explains why the companies are located in these places. It doesn't explain why the companies don't use their clout to improve them, or even apparently make the attempt.
Author missed option 3:

Do contract work at $250 an hour or equivalent compensation in shares at >= series B funded startups. Choose the level of risk you're willing to accept in cash vs equity. (Nearly) completely avoid politics and other office related BS. Take vacation between gigs if you like. Get a very broad variety of experiences at different companies and get a good feeling for what companies are willing to pay for should you decide to start your own.
> FB should be offering to pay to modernise it and build stations

I'm sure Facebook pays taxes, why should they be building train stations on top of that?
Right, that's how it should work.

Roads have a finite capacity (you could increase vehicle speeds in order to increase capacity, but you'll run into hard limits); you properly price that capacity based on time of day. If you can't reduce demand with dynamic pricing, you will exhaust supply (in this case, congestion occurs) in short order.
Does Menlo Park not have property tax for corporate headquarters?
The only problem with LiSP is the price! I recommend PLAI (https://cs.brown.edu/~sk/Publications/Books/ProgLangs/) if you dont have the money to spend.
In the bay area, "asking price" is just the start of the communication on the low end.

I have a friend that was in the market for a house, most houses went for 150K avg over the asking price.
Yes, it does pass thru our servers. That's how we can create shared conversations between members of the same team.

Our email client consumes data from our API.
> Software engineers are paid relatively poorly in Canada

Do you have any sources to back up that statement? I only ask as I know many devs, myself included, who receive pretty competitive pay when compared to SF (taking local living costs into account).
Embedded Systems Weekly Newsletter #31 – A selection of embedded systems posts
The Lower Mainland is a pretty big area, the farther away from Downtown Vancouver the lower the rent is. I rent a small 3 bedroom house in North Delta (about a 45 minute drive to Downtown, no traffic. An hour if I park and take the train in) and pay $1550/m plus utilities. The house we're in sold for $510,000 in November 2014. It's very difficult for any single family to purchase even a small house. The vast majority of the houses being sold where I live are being bought by Indian/East Asian families who will buy the property, tear down the house, build a massive multi-tenant home, and have 2-3 families living under the same roof. A ton of property is also being purchased by people who will get their Canadian residency, buy a bunch of property, but still live in China. The property is bought as investments and left empty. There are area's downtown that are full of 20+ story residential buildings but yet the streets are deserted since nobody is actually living there. Super strange. Everyone who I know who's purchased recently is either buying townhouses or condo's (which are both still going for a minimum of $350K for 1-2 bedrooms).
Great article.

Odd though that so many commenter choose to interpret this as "look! clear proof that there is no sexism! everyone has been overreacting about it!"

If you don't believe that sexism is a real issue, look at source [0]. It says so right there:

"While women have gained many more rights and freedoms in most of the developed world, especially since the beginning of the 20th century, women still face discrimination and harassment worldwide. Until then, women in most of the world did not have the right to vote, and were treated with even greater disrespect than today."

https://simple.wikipedia.org/wiki/Woman
Why Blockchain Is the New Website