skysight-inc/HackerNews huggingface dataset:
I love Spark, it has great documentations and Scala! But how is Storm dead?! The documentation is not good enough yet, but there is a strong userbase and it is being actively used in a lot of companies.
If your undergrad was a disaster, you are not going to get into any grad school worth your time. And it's going to hurt you in trying to get a startup off the ground too, since investors are looking for an accomplished team.

Sounds to me like you need to build some credibility. You need something you can point to that you have done well.

To be honest, I think your best bet is to take an ordinary job, and do good work. Try to find an employer that people know and respect. About five years of this, including a promotion or two, is going to go a long way to making you a credible practitioner, ready for whatever you have in mind after.
Storm is anything but dead. Spark streaming is definitely not all there yet.
Hey Ditty (can I call you Ditty?), great work. Truly impressed. I've been a social entrepreneur myself for many a year (since I was 18, so 2 years ago), so it's always great to see fellow entrepreneurs tackling the problems that define our time.

Two questions, one technical, one not. Do you guys use a microservices architecture on the backend? And if not, why not? Also, what is your MBTI (Meyers-Brigg personality type)?

Best,
J
"Customs figures showed exports fell to $126.1bn (£88.5bn) last month. That was down 25.4% from a year earlier and worse than an expected fall of about 15%. "

But if you are measuring this in USD, and the deprecated yuan means more volume for less dollars.
> an unnamed mayor asked the Marine Corps to use a drone to find potholes in the mayor's city

Let's play a guessing game! San Diego? We've got Miramar and Camp Pendleton here, along with crumbling infrastructure and terrible potholes. Although the city certainly doesn't need help finding potholes around here...

Using drones for this kind of thing actually makes a lot of sense, although not a $20 million militarized Predator.
But how does homework affect whether students are roaming the halls during class time? That makes little sense.

I am in my late 20's. I remember homework. I was super excited about school when I started High School. I was in the GT program, I was doing my homework like a good boy. But when I started HS and the homework was piled on, I burnt out. I was spending 3-4 hours a DAY working on homework. I hated it.

By sophomore year, I had enough. I stopped doing HW. I went from an A+ student to a B/C student, but I had fun. I aced every test. I participated in class. I talked to the teachers about things after class/school. I even stuck around some classes after school and helped other students with their homework. I refused to do my own hw.

I went home and got into electronics. Picked up programming. Studied physics on my own. It taught me something, it taught me that I can teach myself. That I can learn on my own.

I understand that not everyone has the motivation to do so, but that is part of the fundamental problem. There are so many students in schools today that don't want to be there. I remember some of the worst trouble makers would disappear the day after they turned 16 and could legally drop out.

I was in a tech based magnet program within my HS, and everyone in the program WANTED to be there. That made the world of difference. We rarely had outbreaks in the tech hall, rarely had troublesome students in the tech-only classes (usually math, upper level comp/lit, sciences, etc). These people wanted to be there and wouldn't interrupt others. But the amount of homework assigned isn't going to make a difference to those who don't give a rat's ass about being there in the first place.
wow really good point, never thought about the financial motivation especially the motivation NOT to be broke
It is possible to provide exactly-once guarantee. Trident does this over Storm.

http://storm.apache.org/documentation/Trident-tutorial.html
http://tryr.codeschool.com/
AltaVista was excellent because of those booleans. Particularly, "NEAR".
What does "flip against globalization" actually mean? Unless people are suddenly preferring domestically produced goods over imports in statistically significant numbers, I don't see globalization slowing down any time soon.
Please also note that AMD's Vulkan beta driver is not packaged with DirectX, so you should give it a pass unless you are a dev or you have a game that supports it.
This has been demonstrated for a long time with Storm's Trident.
> no one does this

> I didn't have that much money when I was a child

> it was hard to invest in the S&P 500 until recently

A lot of you are missing the point. toado85 clearly made this to illustrate the behavior of the stock market in the long term; it's not a suggestion that you literally do what the hypothetical investment is doing.
Remember that "solve computer vision" was considered a summer project.

And they're pretty much there. Have you seen some of the latest results in that field?
This is a serious issue in the imbalance of information available to large companies and individuals. Consider the ability to pressure jurors or individuals, such as someone suing a large company, or someone running for office (or in office).

The info available via Google is nothing compared to the much more sophisticated databases available to businesses. Consider this story I recently read:[1]

You're just starting work on a major home improvement project when your insurance agent calls. "You need more coverage," he says. But the real question is: How did he even know you were building an addition? Did he smell the sawdust or hear the hammer?

Neither. Thanks to a supercomputer owned by LexisNexis, the data analytics subsidiary of London-based RELX Group (RELX), your insurance company knows so much more than that.

"Very little in your life isn't known," said Victor Bayus, who runs the new Active Insights program at LexisNexis. It enables other companies to "predict, assess and manage risk."

Bayus' program allows insurers to find out as much as possible about you to market new products to you, get you to increase your coverage or, if you've done something wrong, like driving while intoxicated, either raise your premium or drop your coverage. Newly divorced? New driver in the family? Newborn baby? New business venture? You could say it knows just about everything.

[1] I just posted it to HN here: https://news.ycombinator.com/item?id=11254842
Pricing is usually fixed for a 2-3 day period. Generally, market fluctuations take place outside of this.

For the crops, our team ensures that the quality requirements for buyers are met. As for the buyers themselves, ensuring they meet our requirements is taken care of during the on boarding process itself.
Same boat here too... I found they saved nicely to Evernote. I keep really useful threads in a separate notebook.
> Is there a similar benchmarking linux tool that can use many cores?

There is kcbench:

http://linux.die.net/man/1/kcbench

It compiles a kernel.
Learn New Ways to Monetize Email List
Like we all agreed to the metric system already?
When you inexplicably decide that health care is a "marketplace" of rational and informed actors, patients become customers that need to be pleased, and lost patients become lost revenue. We are in a world of hurt over here, please send help.
Heterogenous computing is already used in AlphaGo (and your smartphone). 3d chips will come to mainstream devices in a few years, but will give "only" a modest performance boost, say 2x or so.

The rest of the technologies you mention have great potential but will they be available in a smartphone in one decade? I don't think so.
I'm definitely no expert, but I'm almost certain I saw low flying drones around Dulles Airport in VA (about an hour from DC) near where I lived in 2005-2009.
I think there's a lot of thought that went into these. The "Teresias" one has the character's bald head and beard morphing into longer hair, I think suggesting that the gender changes as in the myth of Tiresias [1].

I think he (Marcus Blättermann) presented at a meetup in Berlin [2] in a talk called "Resolution-Independent Illustrations in Pure JavaScript". Does anyone have more information on how this was created?

[1] https://en.wikipedia.org/wiki/Tiresias

[2] http://up.front.ug/2016/03/08/meetup/
> It does not make sense to me why anyone still believes that using the criminal justice system as the mechanism for getting to that goal is the right path.

http://www.opensecrets.org/news/2014/08/money-not-morals-dri...

> Alcohol and Beer Companies.

> Pharmaceutical Corporations

> Police Unions

> Private Prison Corporations

> Prison Guard Unions

http://www.businessinsider.com/police-unions-and-pharmaceuti...

> Pharmaceutical companies that make billions off painkillers and police unions are two big heavy hitters in the fight against marijuana legalization. They throw their monetary support behind groups that fight legislation that would legalize pot — even medical marijuana — and lobby Congress.

http://www.msnbc.com/msnbc/presumed-guilty-how-prisons-profi...

> Yet in documents the company is required to file under securities law, Corrections Corporation of America has told investors that its business may be hurt if new policies advance “leniency in conviction or parole standards and sentencing practices.” And in a 2010 report, CCA declared that “any changes” to harsh drug sentences could stem the flow of new prisoners in the U.S., reducing “demand for correctional facilities to house them.”

https://www.washingtonpost.com/posteverything/wp/2015/04/28/...

> The demand for our facilities and services could be adversely affected by the relaxation of enforcement efforts, leniency in conviction or parole standards and sentencing practices or through the decriminalization of certain activities that are currently proscribed by our criminal laws. For instance, any changes with respect to drugs and controlled substances or illegal immigration could affect the number of persons arrested, convicted, and sentenced, thereby potentially reducing demand for correctional facilities to house them. … Legislation has been proposed in numerous jurisdictions that could lower minimum sentences for some non-violent crimes and make more inmates eligible for early release based on good behavior.
>I just flipped a coin and got heads. I'll probably get heads again on the next flip

Which is corrrect, if you don't know the true probability of flipping heads. You might find, for example, that it's a trick coin with two heads and no tails.

You absolutely can predict future progress from past progress. E.g. Moore's law held true for decades after the observation was made. If you see a technology advancing rapidly, then there is no reason to say it will stop in the near future!

>I don't really see the value in speculating.

Because everything depends on this prediction. The invention of AI will be the most significant event in the history of humanity. It will totally change the world. Or likely, destroy it. Being prepared for it is absolutely necessary.
The Limits of the Lean Startup Method
Thanks for putting that up :)
I just lost a ton of respect for Danny Sullivan.

Every system can be gamed. Every system where money can be made WILL be gamed. It's a predator-prey relationship.

The way this article was written made it sound like Google Search was a bane when it arrived. And sure, it was the worst Search Engine at the time, except for all the others that had been invented up until then.
Thank you, I will.

Is it easy to connect these to local data sources or do I have to upload csv's or something similar?
Being a bank we store data locally in both PostgreSQL and MS SQL, although we are considering moving some stuff to Azure anyway. Just have to clear it with the legal guys!

I guess I can make a quick export of non personified data for testing though.
While I'm somewhat ambivalent about Windows-only tools, it's nice to see R getting love from all the big players. The more market share and developers using it, the more the tools and implementation improves, and the better for all of us. Just finished an assignment using R Studio, Knitr and Plotly, so much less pain than Excel+macros or Stata.
Kratom is a great and currently legal alternative. It works on opioid receptors and cannot be fatally overdosed. Unfortunately, many sates are already moving on banning it. Big pharma lobby for the win.
What if we could vote from our phones?
I disagree with this due to the rate of AlphaGo's progress. Consider CrazyStone which was the previous state of the art in Go computers. That program reached 5dan after many years of development and has not shown any signs of being able to reach Lee Sedol level (9dan).

In October of this year AlphaGo beat a 5dan player, bringing it into the range of CrazyStone. Only ~6 months later it beats a 9dan player which means it is now ~400 Elo higher. This means the new version would be predicted to beat the old version ~99% of the time.

Such incredible consistent progress of a problem considered somewhat intractable is notable and exciting. Imagine where this machine will be in 6 more months.
Microsoft will release a custom Debian Linux
I don't remember Yahoo being a wrestling site. But I was over 20 in '95 and I can remember the internet before Google. It was a bit of a mess. Fun and amazing and kooky. But tantalizingly frustrating if you were trying to do any focused research.

I can also remember the moment when I discovered Google. It was reading this article back in 2000 (I could have sworn it was 1998):

http://www.newyorker.com/magazine/2000/05/29/search-and-depl...

If you want to travel back in time to the internet as it was when Google appeared, give it a read.

For any gripes I may have about Google's search engine (like the fact I can never seem to easily relocate this article when I want to refer to it), it definitely solved more problems than it created.
Not too bad. My last 34-bedroom house was at least 10x that. ;-)
Thank you so much. Really appreciate it.
Some pretty awesome stuff!
Looks like he did include that; did you scroll horizontally? HN does that to some types of text and I can't remember why but it's quite annoying.
Installing Windows 10 on a Raspberry Pi 2
Would you hire a person who's LinkedIn summary reads like a dating profile?
We still do use faxes and pay phones, but now they are less popular than email, mobile phones, etc.
You can reach us at founders@kisannetwork.in!
> I think considering the Standard Model a moving target is still reasonable

IMO no. The standard model isn't just a table full of particles, it's much more. One core part is is the description of how these particles behave, and the lagrangian. These could change much more drastically if a new particle turned up. This is because the particles in the standard model are intimately tied with underlying representation groups, which can't accomodate another particle. It's possible folks would still call it the "Standard Model", but I suspect such a drastic change would get a new name.
This may be genetically variable; OPRM1 A118G seems to predict some amount of decreased effectiveness for a lot of exogenous opioids.
What do you see as advantages/disadvantages of each tool?
I guess I misread you as supporting andrewstuart2 and I'm sorry for that.

I have however not downvoted you, so if anyone did it was somebody else.

(btw: seems I've crossed some magical threshold and people seems to be upvoting almost anything I write now. Might be time to create a new account, again :-P)
if you upvote something it'll show up in the list at https://news.ycombinator.com/saved?id=pitt1980. So just upvote things that catch your eye.
Ack. That doesn't look very good. And it runs unplayably slow and glitchy / flashy.

"Your first assumption might be that geod has hard-coded specific algorithms for each supported game, training the emulator in how to detect specific objects and create good-looking 3D models for them."

I don't know why anyone would assume that, given how poorly it works. My current assumption would be that game-specific algorithms would be the only way to make this work given how ambiguous NES graphics are. I suppose a top-tier neural network expert could make a game-agnostic algorithm... but it would probably handle a frame per minute on a multi-thousand-dollar machine.

I wish someone would come up with better filters for emulating CRT glow so the game would look like a series of photos of the game being played on a top-of-the-line CRT (PVM / BVM). But that would probably be way too slow, too. Actually I have an idea of how to do it...

If I could get an array of pixels per frame into Unity or some other game engine and make each pixel a light... or even just make each pixel a partially transparent shaded sphere bitmap and multiply them together where they over lap... it would probably run too slow but I once made something like that and looked pretty good and ran plenty fast albeit at a sub-NES resolution.
But unlike SpaceX, Blue Origin are nearly as far from the existing market of putting stuff into orbit as Copenhagen Suborbitals.

They are much closer to the hypothetical market of suborbital joyrides than CopSub, but so far, that hypothetical market does not sustain anything.
> which doesn't happen.

My point is that it does, just not as often.
While the sentiment that is needs more verification is accurate, there are not thousands of teams in this context. ATLAS and CMS are the 2 general purpose detectors at the Large Hadron Collider - they are the only teams/detectors in the world that can detect this signal, significant or not.
You can upvote a story an it will appear under "saved stories" when you click on your profile. You commenting to save stories for you is spamming everyone else. So yes, please stop.
That's what I never understood about Microsoft. They're a software company. And some of it is absolutely horrible (Sharepoint), and some of it is the best in the business (Visual Studio).

There's a significant mindshare in Linux and Open Source. That being said, I don't understand why MS didn't provide Visual Studio, Office, and similar for Linux at a premium. For example, if Office was $499 for Windows, charge $999 for Linux. That way, they get the best of both worlds (use their software, pay them money). And their mindshare is significant as well, and this would increase it.

Maybe finally they are coming to their senses, doing just this. It's about time.
> plenty of machines learn from their mistakes and adapt to new settings

Curious what you see as examples of this.

> Intuition is so poorly defined that depending on what you mean machines easily have it (heuristics, Bayesian inference, etc)

As a working scientist and a bayesian practitioner, I'm sceptical algorithms have intuition. From my perspective, almost all models that one codifies are extremely brittle and will produce catastrophic failures (or just nonsense) unless the user possesses enough expert knowledge or intuition to a-priori know not to use the model in this regime.

However, I agree with the spirit of the text... go is a well-defined game and adaptability and intuition will be highly limited. For instance, the human can't just turn the board over, or unplug the game!
The Republican race: Five degrees of climate denial
> In short: I'm the most vanilla, square, anti-drug person you can find. I don't want to use them, and I think other people would be better off if they reduced their usage as well.

You say you don't understand why drugs are illegal. I think this is your core misunderstanding.

You are not the most anti-drug person I can find. I've never used alcohol or cigarettes (I didn't even use painkillers when my four wisdom teeth were taken out), and spent the majority of my life admonishing the use of caffeine.

I am not even anti-drug compared to most Americans. A substantial portion of America believes that using drugs (illegal drugs only, of course) is _morally wrong_. That is why they have favored sending people to prison instead of rehab. Because it is a violation of the social contract they favor to be under the influence of such substances, and that by using them you are no longer able to execute your duties as a citizen. And you aren't. I don't want you high on meth when you vote. I don't want you high on pot when you drive. I don't want you coming down from heroin when you serve on a jury. Those actions have consequences, all actions as a citizen do, because we cannot isolate from each other. Breaking those commitments _could be_ considered morally wrong, and not just from puritans or fundamentalists.
thanks, I hadn't noticed that feature before
Ahh Berkeley. The city cares about making a stand about nonexistent space based nuclear weapons, but when there's a war criminal among their midsts...
I am fairly certain it is on the Spinnaker roadmap. There was a recent talk by Sangeeta Narayanan on "Containers so Far" [1]. At 37:10~ you can see how they will essentially be allowing for containers to replace AMIs in the "bake" process. I'm looking forward to seeing how Netflix start to roll out more container support, and seeing how Spinnaker progresses.

[1] http://www.infoq.com/presentations/netflix-containers
> There is a problem. (job interview are selecting incompetent people)

Of the developers you hired, how many nailed the interview process, then went on to being classified as a bad developer?

From my experience hiring candidates, the typical software interviews that I have been a part of, tends to produce very few false positives, and instead do produce false negatives.
No, I mean Visual Composition Framework (it's a Gartner name). It is drag and drop components just like Rapid Miner, Alteryx, KNIME or Azure ML. However the tools that perform those things now are standalone and I have to switch between 5 or so different tools to get my job done.

Kind of like SQL Server Integration Services but instead of SQL Server, target Azure ML.
Better title: "How SEO Asshattery Turned The Web To Shit"
Nothing like that as we don't need one!

As for MBTI, mine is ENTJ.
7 things I've learned about startups and maybe life
It's not hypothetical; it's Cell. IMO it was a nightmare, but you can probably find an old PS3 with Linux and try it out.
It is pretty ridiculous having such an arbitrary cut-off without an explanation. Is no data available for <1950?
This is definitely what is happening. I work in SEO and follow the industry closely, but the SEO industry itself is a giant echo-chamber. But essentially what it boils down to is:

- make something your audience wants

- make content your audience wants to share

- "earn" links by creating useful resources & content

Essentially, the way to get great rankings in Google is by actually having a website that people want to go to and is relevant to their interests. Trying to game the system is much harder these days, and honestly for the most part isn't worth the effort.
It seems there are infinite biometric identifiers. Is there any way to protect yourself? Walk around with a sheet over your head? But then your gait (to an extent), height, etc. are still visible.
What kind of source do you want? It's a saying in the go community, people believed (including me) that a bot couldn't beat a human in our lifetime, some people had more extreme view and thought that it would never be possible.
The discoveries in the 20's that were "'just' a further understanding of the world around us" are what give us computers now. Not something someone could have predicted back then. Give it time.

Most of these particles are short lived and pretty useless in themselves. However, their discovery led to a theory around them, and that theory might be useful for things like quantum computation. Or not. Hard to predict.
Sorry for the super late response, I forgot about my comment. I wonder if another option would just to have things communicated a little more clearly to the commenter. Maybe some way to view all the comments you've sent, even allow you to edit them. Also, if they person receiving the comments had the option of responding, might be cool too?