skysight-inc/HackerNews huggingface dataset:
As somebody who has some insight into the inner thoughts of the revenue departments of newspapers, the suits running newspapers would rather die than accept Spotify for newspaper.

We were offering something like $0.20 per article. We ran a small scale test. The users loved it, it allowed the newspapers to monetize users that would otherwise not pay, it let you read the article without a bunch of ads loading slowing down the page. We thought this is great, we're making the digital newspaper experience better and making them more money, this is a wonderful success. They noticed that our product was loved too much by the user that they were cancelling their subscriptions in favor of it.

They would rather have that guaranteed $1/month from a subset of their users than rely the unpredictability of hoping the user reads 5 articles a month. And it wasn't just one newspaper, half the top newspapers 15 by circulation said the same thing. Throw in an aggregator service like Spotify on top so the newspapers can't even control the look and feel on top? The idea's dead in the water.
Graph API and Graph Search were different. The latter was never exposed via a public API.

Neither exposed data that wasn’t available from using the product normally. For example you could visit someone’s profile, see who their friends were, and then look at those friends’ photos.
Ditto. There’s no way this is projecting almost a year into the future and maintaining accuracy. It’s being trained on the test somehow or it’s doing something different from what I’m interpreting.
And driving your kids around in a car raises the risk factor of getting killed with a bumper in their face, but that seems fine. We're completely blind to the relative risks we face and focus on the one in a million when one in a hundred risks are everywhere.
> dejavu is the missing web UI for Elasticsearch. Existing web UIs leave much to be desired or are built with server side page rendering techniques (I am looking at you, Kibana).

When did server-side rendering become a bad thing? It tends to be much faster. Kibana feels slow to me, and that's because of the JavaScript it does have.
I think useful in this case is pretty clear with the WD-40/duct tape example; hardly the best-in-class solution, but when you just need a simple, short-term solution, then Yahoo! should be the place to go.

In the same fashion that excel is the default go-to tool for any kind of basic data management (and now to a certain degree superceded by google spreadsheets), Yahoo! would have been the default place to go basic image hosting, basic blogging, basic chatting, basic news; A good enough solution to meet the 80% of common problems
Google tried this model some years back (I forget the name). The problem ends up (as always) being around the money.

You need to sign up ~all the newspapers for it to be valuable for users (otherwise they're paying $20/mo for access to just a random subset of the news), but the more newspapers you sign up, the more you need to split the user's subscription fee between an increasingly large pool of newspapers.

In the post he writes that the papers should get their "fair share", but how do you compute that? If you do it based on pageviews you create an incentive for participants in the program to juice their pageviews, either through low-quality clickbait or technical means like splitting a single article into a multipart series. And so on.
What's the tl;dr: on Beacon?
Average US citizens have no comprehension of 1930s America, FDR, etc. but the same people will instinctually glorify the 1950s as a time when traditional values led to economic prosperity.
Yep, Amazon is going to be the next evil. They are getting into supermarkets and healthcare now.

I make a conscious decision to spread my business. No ecosystem for me.
Jury selection does absolutely everything possible to weed out jurors who wouldn't be impartial. Also the jury doesn't decide the punishment, the jury only determines if the prosecution has proved their case beyond a reasonable doubt.
I think the main problem is less that users can't control their data; it's that for most people, your data is already out of the box. So many developers downloaded all of this data using the Facebook Graph API prior to 2015 when it was locked down. And given that 8 million developers used the API, it's almost a guarantee that someone you don't trust has access to all your data.

When you allow apps to access all the information about people's friends as well, informed consent becomes impossible.
> That means a pause in privatization, which Morawiecki says contributed up to 14 billion zlotys a year to the budget, a preference for domestic over foreign borrowing (the share of Poland's debt owned by foreigners is down to 50 percent from about 60 percent three years ago) and a reliance on state enterprises to increase investment because private companies are too small and not boldly expansionist enough to provide the desired boost.

Sad to read this. Most LatAm leftist governments tried the same formula over the past 2 decades, with disastrous consequences. Focusing public borrowing on the domestic market means that the government will compete with households and businesses for capital, which have a much harder time raising capital internationally.

This will make it much harder (and raise interests) for households and businesses to secure capital for new investments (especially when the domestic savings rate is so low), restricting supply growth and possibly leading either to inflation or to an increase in imports.

That, coupled with a low or nill savings rate, an over-reliance on government for retirements and a low retirement age, means an economic disaster, exactly like the one in Argentina and Brazil.
Two years ago, David Patterson interviewed John Hennessy for Communications of the ACM. They discuss the changing job landscape, MOOCs, and the future of education.

https://doi.org/10.1145/2880222
Circa 2009 I was hired to build a Facebook graph app that did just this, only for dating profiles. Thankfully it was acquired and buried by the shady sociopaths who hired me to build it, before it ever saw the light of day.

However, there were many, many apps that also did the same. A number of dating apps, companies like Zynga, business networks like BranchOut etc. They were just inhaling data wholesale, especially Likes which were fully exposed to all friends in your graph.

I could totally see how you could use that data circa 2014 to build psych profiles and resell it for sophisticated targeting years later.

There is an enormous risk of companies who rose and fell during the Zynga era to have resold or improperly disposed of FB profile data during their final liquidation. This is just the tip of the iceberg.
The model could be trained in such a way that it will only work with historical data and pass only back tests accurately. This is because you are training against the “answer” which is already known.
The stability implications of the US nukes' burst-height compensating super-fuze
That's the way it should be seen, but it's often not.

I was at a conference not too long ago and chatting with a fellow faculty member at another university, pretty well-known in his field (in a medical school department), who told me a story about how his chair berided him for doing peer reviews at all. The colleague was like "but this is part of our job as a scientist" and the chair's response was "but what account number is that coming out of", as in, "who is paying for that?" The chair proceeded to explain that unless the department was being paid for his peer reviewing time, he shouldn't be doing it.

He subsequently explained that he feels like he's checking out of academics per se and trying to shift to public outreach activities because he's tired of trying to make a case for research integrity for its own sake, as opposed to being a vehicle for bringing funds into the department.

Things in higher education are quickly moving toward a state (or have already moved toward a state) where it is implicitly assumed that your job as a researcher is to bring in money, not to do research. That is, if you are paid by the state, you are not being paid to do a job (research) you are being paid to bring in even more money. You're a salesperson or adsperson not a laborer. Grad students are the laborers. I strongly disagree with this model, but it's where we are.

I used to think that conversations like the one with my colleague were kind of fictional dystopian kinds of conversations until I actually had one. And he was dead serious.

Universities are quickly becoming places to rent space for research, basically.
I think it's the very fact that they cannot truly verify, which is why Facebook is so willing to go through the motions. In reality, they know many developers will not comply, but they can claim they did everything humanly possible before a grand jury.

It costs Facebook nothing to ask developers to sign a contract written on virtual paper, yet can be used as a defense to cover their butt further down the line.
I'm going to have request a source here, because this doesn't make much sense. We've spent very nearly all of our evolutionary time pillaging, raping, and murdering each other - not exactly singing kumbaya. There's tribal instinctual stuff that would include 'in-group' trust, but that's something far and away from trusting a person because they're a person as you're implying.

'Fake news' takes advantage of something much more simple. People believe what they want to believe. In other words the people led on by fake news tend to already want to believe what the news is about. When we see something that confirms our biases, many of us don't question it. And this is made even worse since people tend to work as apologists for fake news from sources they like, so instead of being able to discuss the issue of fake news - it ends up dividing people into splits on the 'fake' topic at hand, which in contemporary times is most often political.
Can you explain the backend? When the spreadsheet is updated, is the generated website automatically updated?
His most recent was posted to Retraction Watch Monday: https://retractionwatch.com/2018/03/19/caught-our-notice-ret...
> Isn't it because majority of Germans rent and majority of Poles buy?

No. Economically, it doesn't make a difference. Although renting is better to society as a whole.
The internet has been a "wild west" for its entire existence. While this allowed it to grow and improve freely, it also brought about bigger issues. Government intervention could work, but the government getting involved in tech usually sucks.
That doesn't really offer a solution for those of us that need to get paid. The choice he may have made to quit his job and write free software is anecdotal and simply won't generalise to everyone.

Stallman judges those that write proprietary software, calling this type of software immoral, and yet doesn't offer guidance to get from the current situation to a better situation. Without realistic and generalisable guidance, it is simply self righteousness on his part,
the same as any extreme idealist.
Which they can't sell, there are laws against that for very good reasons.
Focusing on Facebook exclusively (for now) will give the public a real, indisputable, concrete example on why data mining is terrifying. If you start babbling on how "everyone's doing it" then you take away much of the importance and seriousness of the topic. People start going "you didn't know that? Of course they do" and "yeah, what can you do about it, right?" and just shrug the issue away.
But with the specifics of Facebook and CA, you know that something can be done, and that not everyone has been doing it the same way and at the same magnitude.

Even if it's just Facebook, it's a step forward. You can't expect to take down all internet giants at once.
What good would that do if you wanted to know what someone was doing with a profile they downloaded of you prior to 2015? FB says that any developer giving that data to another organization would violate its TOS, but given the sheer scale of apps that were on Facebook back then, it almost certainly happened many thousands of time.
> most of the polish judiciary has roots in the communist prosecution apparatus and is actively shielding all of the assholes that had a soft landing after the "toppling" of the communist government

I was under the impression that most of the people that were working as judges during the Soviet occupation are now dead or retired..?
My estimate is that the founders took money off the table during those rounds. It's doubtful they'll see anything from the sale. I wouldn't worry too much about them I'm sure they're sitting fine.
Research metrics measure quantity, not quality :(
Being in a similar situation (before degree), I totally agree that I need a solid CS education.

BUT, given that resources like https://teachyourselfcs.com/ are available for free why should I waste money and time and energy on courses of a probable lesser quality, at least at my local university.

The way I see it the problem is not the education itself but your credentials or reputation in front of a possible employer.

So I noted down 3 ideas for myself:

- build an Open Source reputation, by own projects and contributions - a stellar github account

- get good at competitive programming - win kaggle competitions, hackerrank, top coder etc.

- get a CS degree

To me either one of the first two seem better than a degree (given that I learn CS on my own).
> but Y! Games is one of the most glaring examples where they had a massive, loyal audience and just destroyed the community bit by bit.

I'm sorry, but at least we tried when I was there, and if it hadn't been one of Filo's babies, it would have been killed long before we got to take a stab at it.
Hashbrowns. Mashed potatoes. Fried in butter or oil in the former, butter added to make them taste good for the latter.

Who actually adds a mind-boggling amount of sugar to their food when they cook from basic ingredients? Everyone I know overdoes fats, but sugar?
> Democracy only works when everyone gets an equal vote. What are the consequences when special interest groups, including from abroad, can pay to use the official Facebook APIs and craft targeted messages to shape the public opinion?

Democracy only works with an educated population. Regulating data might act as a short to medium term buffer against this issue; however, as we learn more about how our psychology works, the more often we'll be manipulated. Combined with the interesting argument that being politically uninformed could be rational:

> If the odds that your vote will be decisive are minuscule—Brennan writes that “you are more likely to win Powerball a few times in a row”—then learning about politics isn’t worth even a few minutes of your time. [1]

... we have an interesting problem on our hands. I personally believe that the long term solution is within education, but instead of teaching people "what to think," we ought to be teaching people "how to think". People typically learn naively about how to think: both how to emotionally cope with struggling and with parsing and understanding information. At the minimum I think schools ought to be teaching kids strategies for both arenas.

I personally really enjoy two approaches around "how to think.":

1. The now out of print "How to Develop Your Thinking Ability," is a super old, easy read loosely based on Korzybski's controversial "Science and Sanity." It taught me how to approach my perception as gambles (i.e. to avoid universal judgment). The principles, all often obvious, as I recall, are roughly:

a. Up to a point e.g. that person is annoying, up to a point.

b. To me. That movie is awesome to me.

c. As far as I know. Warren Buffet is 92 as far as I know.

d. Indexing by time: I like John at this point in time.

e. Indexing by place: I like John when we're at the club, but not when we're at the office.

f. Indexing by subindex: Instead of: Guy_1, Guy_2, Guy_3 are all scum, therefore all men are scum, we use indices to avoid generalization.

2. The Happiness Trap: enumerates Acceptance and committance therapy. ACT roughly uses a variety of defusing techniques, mindfulness, and values oriented behavior to help a person handle their thoughts in constructive manners.

[1] https://www.newyorker.com/magazine/2016/11/07/the-case-again...
By the way:

confounded's comment https://news.ycombinator.com/item?id=16641777

over in https://news.ycombinator.com/item?id=16640437 ("Big Other: Surveillance Capitalism and Prospects of an Information Civilization") is well worth reading and keeping in mind in this context.
I think Zuckerberg just doesn't get it (or is playing dumb).

The point is this - I don't and will never trust facebook as a company. There is no way to salvage that. Once you've established yourself as untrustworthy you can't talk your way out of it, because there in no reason to believe your excuses and trust there aren't omissions.

Consider the microphone accusation (and the legalese they used in their oddly specific denials), Zuckerberg's wish to run for president, the incredibly extensive profiles they construct on their users ("Is the kind of person to look at their phone in akward situations") without justifying it to the users, and now this.

It's way too late for people like me. I've deleted my facebook.
Drop Dropbox (2014)
They still haven't demonstrated that they can make significant money on anything other than advertising. They do a lot of stuff but nothing really turns into a profitable business. Compare that to Microsoft who have shown over decades many times an ability to get into new lines of business profitably.
It's almost certain that they do, and almost certain they'll never be able to validate that this data won't go to any actors that you would not like to have access to your information. For anything on your Facebook prior to 2015, the cat has already jumped out of the bag.
to me lisp is its own problem, its value is that it gives you too much it becomes anti social. Society likes ignorance and delegation, lisps gives you the ability to have everything into one atom and mold it as you need it. But that's only useful for 1) people with that kind of mindset 2) hard problems that fall off mainstream/commercial support
Because they are all awful, no one uses them, and they are ui clones with no features built by people that think the word decentralised is actually a selling point to the general public rather than having a single innovative thought about what social means and then using decentralisation as a tech solution.
Thanks for sharing your experience. I myself on a new quest to self-teach CS and change my career. I have been in the Technology field for the past 13 years or so but am pivoting to a software engineering career. CS50x is my first stop. I am intrigued by your experience with HarvardX. THe CS50x path now offers 3 more courses beyond the CS50x which i hope to take over the year or so to build my portfolio. Very inspiring to see someone achieve the impossible.
Sure, outsourcing is tricky, but apparently so are passwords? One failure mode it doesn't have is "a bunch of passwords got pwned and my company is at fault".

I do agree that the current schemes such as OAuth2 have odious implications. I don't think that the design space is completely explored, however. By relying solely on emailed and browser-stored tokens with judicious lifetimes, a site could outsource to email providers in a pretty secure way.
for one, the author scaled their mean-OLHC values _prior_ to making their train-test split, meaning data from the test set has leaked into the training set. Time series prediction is a bit easier if you understand how the future values are distributed!
I never understood that. I keep hearing about landlords ultimately sucking all the earnings of the society that lives on the land they own (see the Bay Area for an example, where a mattress in a wardrobe costs you $1k or whatever).
That's great. I suggest keep going and finish it.
Not sure if you already have a family but free time evaporates once you decide to have one.
There are two points that I wished were addressed more often.

1. New researchers. The examples he mentions include researchers who were already important in the field, and whose prestige guarantees review. But if you're a new researcher, good luck getting noticed. Blind review doesn't have this problem.

2. The cost of journals. People say "journal" and think of Elsevier, but there are several journals and conferences that publish all papers for free. The ACL, the largest conference on computational linguistics, finances itself with the entry fee to their conference, and you can read all of their papers right now (disclaimer: I'm currently doing work for them). There is a middle ground between Elsevier and Arxiv.
Ask HN: Are you using or considering alternative container runtimes?
Those of you who are using containerization, are you using or considering container runtimes that aren't Docker?

I'm particularly curious their usage with Kubernetes.
That's because it's a one-step behind prediction. (If you go to the linked notebook and look carefully at the graph its evident.) If you could shift the prediction one step forward, you'd be rich!
One is fairly trivial to prove compared to the other.
Puerto #Rico Electric Power Authority (#PREPA) Hacked Over the Weekend
Facebook's Zuckerberg admits mistakes over Cambridge Analytica
Did you mean to reply to someone else? You didn't address what I said.

WaPo bundles authorship and curation, which is exactly the problem I'm describing. The problem isn't cost, it's incompleteness.
Actual way this experiment should work: feed the recurrent NN with stock markets data from the latest 10 years but the latest year. Then display the prediction for the latest year and the actual data. I want to see if it will match like that...
>Beacon formed part of Facebook's advertisement system that sent data from external websites to Facebook, for the purpose of allowing targeted advertisements and allowing users to share their activities with their friends. Beacon would report to Facebook on its members' activities on third-party sites that also participate with Beacon. These activities would be published to users' News Feed. This would occur even when users were not connected to Facebook and would happen without the knowledge of the Facebook user. One of the main concerns was that Beacon did not give the user the option to block the information from being sent to Facebook.

https://en.wikipedia.org/wiki/Facebook_Beacon
This model is showing predictions one day into the future. The "test set" plot is all predictions made with data from 1 day ago. The input sequences have size 1, so no recurrence is happening (see to_1dimension in https://github.com/miguelgfierro/sciblog_support/blob/master...). If you predict that tomorrow will have the same price as today you'll get better plots under the same operating conditions.

In[2]: TIME_AHEAD = 1

Train set has ~1e-6 MSE, Test set has ~0.8 (0.94^2).

EDIT: I should say this person is probably learning, and a lot of this is honest mistake.
"I'm sorry, it's all in the past. I promise I wont do it again."

Is Zuck still at school? "I'm sorry for running a business model that made me squillions" just doesn't cut it with me.
This is probably decently efficient if you use recursive CTE's to traverse it, and use keyset pagination rather than limit/offset.

with recursive cte (udo_id, prv, nxt, label) as (
select *
from udo
where udo_id = :first_item_id
union all
select u.*
from udo u
join cte
on u.prv = cte.udo_id
) select * from cte limit 100
Yes, absolutely. However, regardless of the reasons, it when I run into an issue I feel annoyed and it makes me want to not bother.