skysight-inc/HackerNews huggingface dataset:
Tangentially related, the author of this timeline has developed an Earley parsing framework called Marpa. http://savage.net.au/Marpa.html .

It's used in other projects (eg, https://github.com/jddurand/MarpaX-Languages-C-AST ) but the only ones I found which look production ready, in a cursory search, also involved the author.
They aren't. With some luck their errors do not correlate with the ones of the machine, that gives us the best of both worlds: cheap diagnosis for healthy people and precise diagnostics for unhealty ones.
I was just thinking about this this week. I've been trying to keep better track of where I spend money for budgeting purposes, so I've been downloading transactions and putting them into a spreadsheet. Currently I export the transactions from Mint, but I'd really like to stop using it if at all possible (for security, privacy, and UX reasons).

I've thought about creating an open source project with scrapers for the major banking institutions so you can export your transaction data into a common format.

Does anything like this exist?
The diagram at the bottom of this link, 'How Blockstack Works', has proven helpful to me for discussing and understanding Blockstack and dApps built upon it: https://blockstack.org/intro
They would still be blocking the IPv6 netblocks assigned to Amazon and Google, only it would be easier because the blocks would be more contiguous.
It may not be philosophically compatible with GNUCash, but adding all of your accounts to Mint would bring it all into one site that you can then script against. Mint used to use Yodlee’s APIs to access data from financial institutions, do you could try getting developer access to that if you wanted something more direct.
It's actually dated-source. The source code they occasionally publish is always months beyond the recent release.
One of the reasons I don't like working on GCP or Azure is because I prefer ELB.
Can you name a single type of job that MapReduce can do better(faster/using less resources) then Spark?
In my experience even for most simplest tasks like when you need to just read the data, change it slightly without shuffling and write it back Spark is faster then MapReduce with the same limitations on resources, and it's much more efficient in case of heavy jobs with joins etc.
Well of course, there are other things like API which in MapReduce is just a nightmare to deal with in comparison to Spark.
2018: it describes what they do in a much clearer way.
I wonder if there are biochemical pathways in, let's say, Neisseria gonorrhoeae that are actually handy to have in a night on the prowl...
To me, 50% vs 40% isn't "far more culturally diverse". Especially when you consider that Los Angeles has more than 2x the number of people. And I can tell you that the experience of living in Los Angeles is insanely multicultural. It's like somebody took the globe and shrunk it down to fit inside of a single city. In the course of a 30 minute drive, you can pass through neighborhoods where the store front signage is alternately in Korean, Armenian, Chinese, Spanish, Russian, etc. I mean, there basically are no white people in the city core, outside of extremely affluent neighborhoods.
To go further back into the 80s where we were hard locked at 64k for commodore or 640k for DOS Assembly became the norm and optimizing for everything was the common goal for the whole community. It ended up creating a hack centric environment but it sure wasn't A) pretty nor B) beginner friendly. I'm old and have fond memories of assembly on the C64 as a kid, but I think we are in a better place where we have higher level languages and where Racket (Lisp of your choice here) and Python can run on a micro controller.
If more people start using GCP, then in the near future, GCP's prices will go up. In contrast, AWS prices may come down to compete with GCP. And when they reach close parity, things will begin to commoditize and get even cheaper across the board. I see this being a good thing overall as an industry.
Tell HN: Today's the day that YC invites applicants to interviews
Goodluck everybody!

What are you building / what idea did you apply with?
Wouldn't there be bigger concerns, terrorist attacks really don't happen that often.

It'd be like constantly worrying about protecting yourself from lightning.
Facebook involved in new privacy saga
Doesn't the president's salary define the statutory maximum, though?
Doesn't do much good if you have to fail out of an entire data center.
> Honestly, it’s not as bad as it seems. For example if I grab some milk, I just drop the $1.99 in under the Food account shortly after I get home.

Who just buys milk? I usually buy 10 to 40 things at the grocery store. This means I have to keep my receipt, enter each line item and figure out the per item sales tax. And if I forget once, it's all screwed up.

Do most people track each item or do you make one entry for the whole grocery run? What do you do if you fail to enter something? How about failing to enter two or more things during a time period? When and how do you reconcile?
^^This.

Agreed. Google is certainly advanced, but it certainly isn't fair, despite what their guidelines tell content writers and webmasters.

Google wants people to write high-quality, relevant content, so they altered their guidelines to simply tell everyone to write high-quality, relevant content. Yet, just as the YouTube lottery exists -- where two creators can produce videos of similar quality and one sees enormous success and the other doesn't -- there's probably a ranking lottery.

And at the end of the day, if a content moderator or employee at Google likes your content, you'll have a better chance at ranking regardless of quality.
Lord I hope there are more parties involved in the conversation than "tech companies and law enforcement".
I’ve found that good freezer pizza is usually better than any delivery.
AFAIK telegram has channels and groups which were used in russia for purposes the govt didn't want to encourage. To my understanding, both groups and channels cannot be encrypted, so this ban has less to do with encryption but with the fact that Telegram wasn't willing to handle over the plain text chats they have on their servers.
Reminds me of this https://www.theverge.com/2016/8/3/12325104/airbnb-aesthetic-... article on how airbnb has changed the aesthetics of certain places. I feel like fears of algorithmic based fashion is overgrown but articles like this and that one show that something did happen that resulted in taste in certain places converging onto a similar style.
> These buildings aren't unsafe because there's no choice, they're unsafe because the builders wanted to save money and the building code was too loose to stop them

Side note from a New Yorker, it always shocks me how careful San Francisco pretends to be with building codes and environmental and safety reviews and this and that, only to go on and systematically approve a series of terrible structures. (Not before showering them with ecological awards, of course [1].)

[1] https://en.wikipedia.org/wiki/Millennium_Tower_(San_Francisc...
I'm largely referring to RPC calls, not DB queries. Many of those calls won't even be to services you control and may well be HTTP calls to other companies.
It might be interesting to analyze how it is you serendipitously find new films and whether that could be applied to a site like Netflix. Is it a cover that catches your eye? A recommendation from a passerby? A random pick off the shelf? Etc. Any of these approaches could be replicated in a web interface.

I think Stumbleupon was quite clever at what it did and I'm disappointed more services haven't picked up on the "Give us a broad category and pull the lever to make the slot machine spit out something you've never seen before" approach to content. But it does give me hope that algorithms can provide the experience of serendipity if the people designing the application make that choice.
I've worked in SEO since 2006 and the game has changed. However, it's still a game and not a "losing" one by any means.

I've seen many businesses including my own boom with good SEO. Back in the old days I got to #1 for "movers", but the tricks back then don't work anymore (which is a good thing).

Today, it's much more legitimate and I find the most success with keyword research. It's about finding what your target market is searching for and where your competition is or isn't.

Giving up on SEO is a losing proposition for any business that doesn't have a dominate brand or social media presence, which is most businesses.
Meaning of Success and Figuring Out What Your Really Want
Wake up at 9am, go to sleep at 3am or 4 am.

Work from 10:50 to 2am then move around the city.

Work only if I feel like working, otherwise read articles, chit chat, networking and some promotion/marketing.

Can't complain.
The Marpa FAQ at http://savage.net.au/Perl-modules/html/marpa.faq/faq.html#q1... asks "Are there C/Lua/Python/etc bindings for libmarpa?" and answers that there are "Various language bindings for libmarpa" at https://github.com/rns/libmarpa-bindings .
Read a section of it. put it down. and then think about it. would you do it that way? what would you do different? how can you benefit from this? where could this be useful?

You really want to know it. Do a project with it.
And yet, living under that is preferable to living under a Facebook-governed polity.
I agree with your criticism, however this is slightly different. The difference here is that one is like a promoted company culture, the other one is just like online fanboy hagiography.
Do you think people actually like—or are claiming to like—a movie just because Netflix recommends it? To me, it seems more likely that this just reflects increase availability: more people suddenly have access to a movie, so more watch it and some of those will like it.

I can see how people, especially on a dating site, would feel pressured to mention something highbrow, but the social pressure itself isn’t coming from Netflix.
Deep character flaws that lead to Toxicity!

Negative people that are always saying "it can't be done", "refusal to experiment and try new things", "blaming", "refusing ownership", "whiners", "people that seem to be happy when a failure happens", "folks that reject collaboration and wish to be left alone, you know, the lone superstar programmer"
I'm not sure if it's in the article or not, but the professor requires her students to ask people out in person. In my experience, both from dating and from talking to male and female friends, this is significantly less common now than in the past. And I've noticed that on planes and while waiting in lines people talk with strangers less than when I was a kid.
Generally, the FDA (or the government body responsible for certifying medical devices) does not conduct code reviews in the sense of looking at the code and trying to find bugs.

The way it works is: the manufacturer of a medical device assesses the harm that can be caused by a software malfunction, and assigns it a safety classification (class A, B or C). Class A is used when no injury is possible, and class C is used when death or serious injury is possible (e.g. a surgical robot). The manufacturer also provides a "failure modes and effect analysis" document that looks at everything that could go wrong, what is the likelihood of the failure happening and what is the effect on the patient.

Based on the safety classification, IEC 62304 requires different levels of rigour. For example, the standard only requires blackbox testing for class B software, whereas for class C software it requires whitebox tests as well.

The manufacturer also needs to come up with a software development plan that ensures that all of the requirements of the standard are met, and an "argument" (supported by test reports, process documentation, source control history, etc) that the software was developed according to the plan.

And that is what the FDA audits: they look at the development process of a given feature and they check that the plan was followed. I think they rarely delve into the details of the implementation and are generally just checking that the safety arguments are sound and supported by evidence.
I work for a company people use to build CDNs. Just another turtle. :D
That depends on what you mean by "truth". Newtonian mechanics says that gravity is pulling you down towards the surface of the earth. Is that "true"? It has tremendous explanatory power, but I would argue that it is not actually true. The truth is (as far as we can tell at the moment) that the surface of the earth is pushing you up and accelerating you through curved space-time.
The IRS really needs to be shutdown. It is a toxic cancer.
>I don’t own a credit card (by choice)

If you have the organizational skills and self-discipline to use a credit card the same way you'd use debit or cash, you're way better off using a credit card. If your debit card gets skimmed at a gas station, your bank account will be debited and you have a significant problem until it gets resolved. If your credit card gets skimmed, the issuer has a problem and you need merely to inform them and wait for a new card in the mail.

Plus, 2% cash back on all purchases is pretty nice.
Check out Tiller! https://www.tillerhq.com/

I tried going down the route of dealing with OFX in GNUCash, and it's just a huge never-ending hassle. Tiller dumps the raw data from Yodlee (the backend that does the gnarly interfacing and cleaning for most PFM sites, besides Mint) into Google Sheets. From there you can use Apps Script or the Sheets API to push the data wherever you want. Sure, it's $5/mo, but well worth it for not ever dealing with bank websites or APIs or OFX formats again.
Because sometimes to reach the truth, you must risk being offensive.
How do you know democratizing decisions results in minimax optimal decisions?

I would expect the result to be strongly biased due to societal norms, much less direct manipulation.

Suppose a majority wants strong social programmes and basic income. The tiny problem is the economy is nowhere near big enough to afford it. Satisficing (!) executive branch puts some of the policies starving innovation and education budgets. Causing long term harm and stagnation.

Where is the minimax decision in here? Over what timeframe?

(P.s. I could've as easily picked liberal, fascist, military or conservative example. This one is relatively easy to understand.)
Magic Bitboards: Finding all valid bishop moves in a 64-bit multiply (2008)
Is it? I always name my personal belongings (umbrellas et al) so if I forget them somewhere public and whoever finds it is a kind soul, they can return it to me.

Of course nobody _else_ should be forced on sharing details just for this kind of occasional utility, I'm not claiming that.
I'm still working on it. I fear the only viable solution is going to be to drastically change how I interact with computers and the internet.

There was a period of about a week where my home cable internet was down and I had to pair my phone with my computer in order to work. I don't have an unlimited plan and I was constantly afraid of running out of data, so I didn't go to any website I didn't absolutely have to. The fear of not being able to work when I needed to and getting fired was a good motivator. I immediately reverted to old habits when my internet came back for good.
Making a fork also lets you keep a copy of a repository if the original public GitHub repo is deleted or made private. So in that sense it's more useful than just starring a repo.
Half a year ago, I saw a scientific study that people are trolling more when they are not anonymous. The opposite of what you say.

Is there any new data?
A well functioning government, does, ideally, what you describe. But most governments in the world (maybe except a few western ones) are, as I was saying, incredibly disfunctional.

And when governments misbehave, they kill: wars, corruption, suppression, etc.

Forgive me if I’ll prefer businesses over governments every day.
I think you misunderstood something. Websites can play audio in the background on iOS. It works great for podcasts — but only as long as you don’t want to control playback. The API is there, Apple didn’t omit it on purpose. But it is broken.
Shameless plug: we have an open source tool you can build stuff like this on. It'll run any logic you can implement in JavaScript, we have people doing things like "send traffic to backend with lowest latency" already, it'd be pretty easy to pull in some API data to pick based on cost.

https://github.com/superfly/fly
Definitely do not check out wickedfire.com
I agree with your post-college assessment, but I think the skill that's lacking practice is the ability to approach and meet new people. Phones, texting as the dominant form of communication, and swipe apps seem to have made that interaction more socially unacceptable / reduced the urgency for it.
Dawn of the Robot Coach: software is influencing the way managers are trained
Why isn't it the role of the government to prevent loneliness if it's a serious issue? How is it any different from preventing disease?
They honestly made it worse. The crust is like bad bread. I didn't used to mind eating Domino's if someone ordered it, but now I won't touch it. It's the only type of pizza my son actually won't eat.
How about not making the grammar non deterministic in the first place? I think that 'attractive new syntax' -comment means that there is no usable ports for Marpa. I guess I could try to help with that .. :)
> > at least one result in 20 will be due to chance

> That's wildly overly pessimistic

Why? You yourself said:

> The null hypothesis is correct but they got "unlucky" data (5% chance or p% chance)

How is that different from what I said? 5% is just another way of writing 1 in 20.
Do things like meta description tags and site map submissions still matter? Just curious.
> There's just a very big gap between how science should be done and what capital owners want from science

It was "a team from Bayer Healthcare" who "tried to replicate the results of basic cancer studies," failed, "and kicked off a media storm questioning the legitimacy of cancer science—and science in general" [1]. The "capital owners" looking out for their own buck are performing more effectively, narrowly speaking, than academia.

[1] https://www.wired.com/2017/01/fighting-cancers-crisis-confid...
I'm skeptical of the idea of the IRS moving to a contemporary platform of any kind. They have 50 years into the current configuration, with no signs it will be replaced soon. On the time scale of decades, what platforms have proven to be stable and backwards compatible over that time frame? I mention the decades time scale, because I'm not at all confident that the next revision (after the one that hasn't yet happened) of the IRS platform will take anything less than another 50 years, and in that time, almost everything current today will look like a flash in the pan.

I think they'd be better off moving up one step in the abstraction layer with something written in COBOL for the backend, and some kind of service layer whose clients can be updated over time as need allows. If they can de-couple and modularize as as possible, it will make future upgrades more manageable.

In many respects their data workload pales in comparison to what used to be called "big data". Their system is more analogous to airline scheduling in the need for availability, correctness, and longevity. They have to take a very conservative approach. Even if they were spending tens of millions a year on maintenance, that's a better option than the risk of a major downtime during tax season.
We might have bigger problems if AWS goes down
Of course there are exceptions and what I said doesn't capture all cases (like with massive fixed costs or unique kinds of studies), you're right. I find it's a pretty good rule of thumb, though.
Demo is the new Resume
This seems like a good time to mention the open-source Quake map editor TrenchBroom[0] which is actively developed and supports Quake, Quake 2 and Hexen 2 (with Quake 3 support on the way). It's very easy to work with and heavily used in the Quake mapping scene today. Yes, there is a "Quake mapping scene" still![1] :)

[0] http://kristianduske.com/trenchbroom/

[1] https://www.quaddicted.com/ & http://www.celephais.net/board/
In a sense social media feeds on our pack animal hindbrain...
I can't speak for the IRS specifically, but I can speak for a few other agencies. The problem is most certainly not incompetence at the individual level-- I've met some of the brightest, most creative people in government IT.

The problem is an incentive structure that rewards constantly adding scope to projects. There are a lot of ways to think about why, but I tend to break it down to two things: Economics and culture.

First, economics. Money is allocated through the federal budget. This budget does not obey the normal laws of physics. There are myriad reasons why (down to the fact that the government can just go ahead and print new money sometimes), but the important thing to understand is that it's harder to remove lines from the budget than it is to add them.

Private industry has a wonderful garbage collection mechanism called "going out of business". In the public sector, projects have a tendency to keep existing. It's not because people in management want to sit around and collect an easy paycheck-- It's because they often have zero control over where the money goes. That ability belongs to congress.

Second, culture. And here, I actually am going to do some finger-pointing. Moving up in the hierarchy almost always means controlling more personnel, and vice-versa, having more people under you means you're higher in the pecking order. If you suddenly find yourself in charge of a 500-person department, well, you might be in line for a promotion to SES. This leads to a strange territorial game where high-level management has no incentive to shrink the size of projects.

The hierarchy tends to self-enforce, notably through the way it communicates[1] (Always Outlook, rarely any type of tool that allows easy communication between management and staff). This is made exponentially worse by the fact that written correspondence can and often does become public record, making it even harder for people to talk openly and honestly with one another.

I think the budget problem is unsolvable, at least by us Silicon Valley types. But one area where we can contribute is project management. Thinking about projects in terms of actual deliverables (SLAs, APIs, usage levels, etc.) and flattening communications channels would really solve a lot of problems.

[1] http://www.melconway.com/Home/Conways_Law.html
Skyscrapers have a tremendous amount of mass and are engineered to resist the force of gravity. That's hard, so they only bother to engineer it so that it resists that force in one direction relative to the building.

As soon as you might start to turn the building onto its side it falls apart like a sand castle. Were this not to happen the building would have to be engineered such that it could withstand being turned on its side like that without collapsing. But they don't design them as such.
Besides ad-blockers, turn off location tracking in apps. I forgot how it is for Android, but in iOS you can disable location tracking on an app-by-app basis. And you can also partially disable it -- only allow it when the app is active, as opposed to background tracking.
That would be a very aggressive response from ICANN, though it might work from an arms race perspective.

I don't think cold war era thinking alone is the solution to these issues; there are likely other, less destructive, paths.