jkeisling/hacker-news-corpus-2007-2022 huggingface dataset:
That's really an amazing system. Super redundant.

A relatively easy boost, which he briefly mentioned, would be to also store the data in S3. That should be easy enough to be automated, which could provide a a somewhat-reliable off-site backup.

However, Instapaper has the benefit of a (relatively) small DB. 22GB isn't too bad.I don't know how well this would scale to a 222GB DB with proportionally higher usage rates. It'd be possible, but it would have to be simplified, no?
translation: user privacy is a barrier for him as a developer, just like english.
Nice compilation. It is good that Google has taken this seriously and are working to fix it quickly. We will probably see a few more like this as things like Google, Facebook Connect, Twitter become federated Identity Providers to many sites on the net.

I must say though personally if it is only harvesting my email address I don't really have a major issue with it, I use my email address everywhere and signup for lots of services, Gmail is very good at spam filtering and with unsubscribe.com and prioritized inbox I don't have a problem maintaining a zero inbox. Doesn't mean it is not a bug that they shouldn't fix, I'm just saying that perhaps the impact is not as large as the votes that got this to the frontpage of Hacker news implies.
Its also an excellent way to think about your app.

What are the core things your app should be doing from a data perspective? Expose those things in an API.

Making the API available over REST or as a Web service is extremely simple, and its amazing how useful it becomes over time in your own development.

It also makes you think twice about changing how these core methods change, which is often a good thing (especially when you are working in a small team and its tempting to make "little" changes to solve your current problem without thinking about its implications).

Cheers
The authors tone is reminiscent of the narrator from Fight Club.

Excellent write up btw.
Is Git really suitable for deployment? I thought that Git have full history of the past versions which moves a lot extra bytes when you are firing up a new instance. It may be interesting if one could use git's pull/push to have some distributed deployment system (still far from BT protocol based one, but interesting topic though).
> So many companies are making big bucks off Ruby, yet so little are willing to fork out a bit of money and time to make Ruby better. <

And why would/should they when there are quite literally dozens (or possibly hundreds or even thousands) of developers who will happily work on "making Ruby better" for no cost to said companies?

A large percentage of software developers will quite happily hack away at projects for nothing in return simply because they enjoy it (and would, quite incorrectly, claim that as compensation itself), in order to gain notoriety, boost their own ego, or any of a number of related reasons.
People have to be inside hospitals for hospitals to help them. If you don't have insurance you're less likely to go in the first place.
I would classify this as a "great to know but not in any way essential" for someone, so I am curious why you actually take a chart with you? How do you use it?

I can understand using a chart to plan things out ahead of time, though to me it seems that it is easy to figure out workable gears when starting out just by riding and eventually you know how to shift in a given situation. The more serious riders will refine that by trying out different combinations in more controlled experiments (power meters when you get to Serious Training). The best gearing always depends on the rider.
You can see this line from the log.
Using Device : Intel GPU 0.0 Apple M1 OpenCL 1.2 Memory : 10.67 GB (11453251584 B)
Hmm, the book description makes it sound more like Yet Another Process Management book (e.g. "Lean ", "Waterfall ", "Six Sigma *", etc.) rather than a collection of nuts-and-bolts war stories. Is that not accurate?

I leave the process management stuff up to other folks, they're better salespeople than I am. They get paid to beat other people into submission; I get paid to beat servers into submission. :-) (Though not in Jacques' or Rachel's league.)
I hope you're right, and that's what I'm getting at with "something on the table." Right now, the pace of storage is increasing so much faster than the algorithms to infer meaning.
There's no irony in advocating using a richer array of types in a dynamically-typed language. In fact, static vs dynamic typing doesn't seem apropos here since it's also common in statically typed languages to use strings for everything, leading to the same problems.
Can someone explain why the EC is so into internet companies like Google these days? Is it just the smell of money and succes they are after?

Google is a company..! Why is it wrong for them to promote their own products in the search results. Maybe I am too liberal for this, but imo the EC has nothing to do with the Google search algoritm. If customers don't like it they can use Yahoo or Bing.
Wow! That's cheap for a "Notebook".
Also, those "incremental" improvements often lead the way for more advanced applications of the device. To carry your example, at some point GPS is not feasible because, off the top of my head:

* Screens are not good enough.

* Processors are not fast enough.

* Radios are not sensitive enough.

* Data storage isn't small enough.

* Batteries aren't dense enough.

It took these things all converging with "incremental" improvements to allow the major advancement of consumer GPS.
Well, I'm not getting one for three reasons:

1. The laptop sometimes sits on my lap. The surface keyboard doesn't work as a laptop.

2. The resolution is a joke.

3. There is no sane pen storage. For a pen device, that's dumb. Thinkpads add a few mm, and have a hole you put it in which stores it securely. There's a move to move everything out of the device to make it small, but carrying around 50 gizmos is worse than one slightly bigger gizmo.
I use the complete works of shakespeare as my passphrase. The rhyming makes it easy to remember. You just need to type deliberately as not to make a typo.
There's no option called 'WhatsApp Web". I'm on 2.11.491
Don't forget what the "D" stands for. If it's not maladaptive, I don't think you can call it a disorder.
Given the ingredients, one would assume that it's at least safe to ingest. Whether it's actually effective or not is an open question given the lack of data in the article.
This discussion is happening quite often in the VR world. Essentially the accepted opinion is that 1) AR is harder than VR and 2) solving the problems that VR has will get us closer to usable AR
That's absolutely ridiculous. I assume the same didn't happen for Citizen Four (which was actually a real movie as opposed to a thinly disguised hit piece).

You should name and shame the company, even if you do so anonymously.
If, as many articles seem to be suggesting, we decrease the number of grad students, then that just means that the ones left will teach more, which distracts them from the research and (presumably) lengthens the PhDs. It's not a completely linear tradeoff, but certainly something to bear in mind.
Whoever Jack Dorsey hired to do his PR should win some sort of award. In under a year this guy went from almost zero media presence to:

* having a glowing profile written about him in Vanity Fair

* appearing on Charlie Rose

* being anointed as the second coming of Steve Jobs by TechCrunch

* having the media at large make Evan Williams look like a jerk and return to Twitter as Executive Chairman

* getting The Wall Street Fucking Journal to title an article "Visa Backs Jack Dorsey's Square"
Reminds me of autoblogs. Spammy as hell. Lucrative as hell.
Given the birther-related news today, I was curious about another uncouth term. Sad results:

http://ngrams.googlelabs.com/graph?content=nigger&year_s...
Anyone else feel that the reliance on a credit card on hand is just a stepping stone in Dorsey's eventual vision?
Disclaimer:I work at Amazon as a dev manager.

Working at Amazon does mean that you need to work hard, long and smart. There is a lot of technical debt to deal with too. But the technical debt did not come from bad design, but from the way business grows and changes. There is a 20% growth YoY. Inventories run into millions of products across multiple warehouses. We ship through multiple means and we ensure the product shipped reaches the customer on the promised date at over 95% of the time.

In real life, this means that you are going to have trade-offs and some of the trade-offs do turn into technical debt. What we do with the debt is more important and amongst my groups, we are decreasing the debt by leaps and bounds.

If you want to see how it is, give me a shout. We are hiring, as usual :) I can take resumes in any format too :)
What are your thoughts about this? I'll tell you mine.

I just watched Google slowly, painfully, realize that Google Glass isn't commercially viable (in it's current form and to the general public). I can't help but feel that this is a larger, albeit more immersive, version of Google Glass.

I only make this point in regards to any plans for a sci-fi, everyday wearable HUD. There is obviously a great demand for this kind of immersion within the gaming community (although I would argue that Oculus will have market control for the forseeable future).

My opinion is that the kind of augmented reality that we all dream of, that sort of matrix-like constant data download, won't become a reality until someone figures out how to take it (visibly) out of human interaction, i.e. with smart contacts, etc. The current tech is just too intrusive in normal human interaction. My understanding is that this kind of tech is still a long way off.

I'd love to be wrong though!
Yeah, I looked at openstack for a few days - including a small test deployment, and came away with "not for a few more years"
I use Iridium a lot, and you need a clear view of the sky. Would it work indoors? Otherwise it'd be a very serious limitation.
Faraday's Cage
Well, my point was more that "of course we think the 80s were significant because that's when so many of us were born", and less a discussion on the meaning of "opinion".

If some of the older posters (40-60 rather than 20-30) were to post a similar sentiment about the 80s then it would say more.

Edit: Alternatively, I'm very likely just projecting my age range on some posters who are in that age range, but them chiming up to confirm that fact would be helpful.
It's not, but just for the conjecture of it, let's assume that list contains Canada, since we have to protect our borders. And Mexico. And of course the UK, because they speak English and it's much easier for drug dealers to collude with other English speakers. And so on...

So don't think Iran is the only country on the list, they just trumpet that to dig up thoughts of terrorism oh my.

I'm jaded. I'm pretty sure pre-Snowden I was salty, but now I assume the worst of the government and assume they're always lying. Always.
I enjoy debugging, and don't believe anything you claim. Anyone I know that enjoys it doesn't believe it either. What you write is pretty offensive actually. Its like me saying you liking programming means you run around deleting everyone's software because it would let you program more.
Longer keys could also make some compromises less obvious; finding identical keys -> bad entropy, weak keys (Debian/OpenSSL, lots of devices).
I don't know if anyone found backdoored key generators that aren't based on weak entropy.
It's not about the specific answers - it's about being able to reasonably construct a model about how a system might work, based on the knowledge you do have, and clearly communicate that model (including its limitations!) to another engineer.

Sure, if you are a dedicated embedded device programmer who has never used a web browser or engaged in networking of any kind, then maybe you like unaccountably not be able to construct a compelling description of the process. But I find that unlikely; all I can suggest is that if you are hiring for such a position, then a similar question more tilted towards a particular field would be equally useful.

The overall idea of an open-ended question like this is sound.
^ This. I ended up majoring in pure mathematics as an undergraduate after finding out that applied mathematics courses had too much material to memorize after finding out that physics courses had too much material to memorize. Pure math was so much easier.
The comments in the article show a lack of thought and understanding; just listing fears someone may have about a new driver and applying them to automated cars instead.

Some genuine concerns would be those below. In my opinion the benefit still outweighs these arguments (as most of these could also be applicable to a regular car driven by a person), but if someone wants to have a go at self-drive cars, here's some ammo instead of blanks:

- Malicious Hacking - People with malicious intent can hack the cars by using devices to confuse/misinform their sensors, or by finding ways to amend the car's code (perhaps amending at source, perhaps by patching the car with the malicious code). This isn't something a layman could do - so the risk of an idiot loner is small; however if all of our infrastructure moves to AI cars the payoff could attract some organised and skilled attacks.

- Poor Maintenance - cars would self diagnose and ensure issues are dealt with promptly; however if people are still doing the repair work they may make mistakes which the car cannot see (at some point the car has to assume it can trust its sensors) - so those mistakes may cause unpredictable issues.

- Geek Play - If you had an AI car and knew a bit about coding, how tempted would you be to put some of your own code in there - maybe just to give it KIT's accent. Most of the car's controls would be locked down, but people would look to jailbreak their cars so they could do such customisations, which may have unforeseen side effects. This would be illegal, but some would still try.

- EMP - there's a concern that EMPs can be caused naturally by solar flares, which could have significant impact on our infrastructure. If not properly shielded, cars could be affected by such issues: http://www.forbes.com/sites/tombarlow/2011/06/23/huge-solar-...

- Refusal to drive unsafely - in an emergency it's OK to break the rules (this person will die if we don't get them to hospital in 10 minutes). An AI car will be designed to put safety first, so likely won't allow you to break the rules even in such a situation. If the rules can be broken in such a scenario, people could just declare emergencies when running late. Perhaps a compromise is to allow overrides such as "get to nearest hospital asap" rather than just a generic override, and to penalise anyone misusing this facility - however there will always be unforeseen edge cases (though these will be rapidly diminishing & the cars will still be far preferable to humans given they'll at least prioritise public safety).

- Unforeseen special cases - Y2K, Y2K38, Patriot missile clock, north pole sub divide zero coordinates bug, etc are examples of issues caused by oversight: more here http://listverse.com/2012/12/24/10-seriously-epic-computer-s.... None are likely to be global catastrophes, but we can never rule out possibilities of issues lurking for years unnoticed.
Firefox has a feedback feature (in the Help menu). Mozilla watches the flood of feedback for keywords and correlations to identify bug regressions. And, in Mozilla fashion, the anonymous feedback and ugly truth is open for all to see:

https://input.mozilla.org/
That is original authors github, the guy that made this thread, not the guy's that posted to elance...
I think the attitude of a lot of companies, especially the ones hiring fresh grads, is that the ability to think is more important than the ability to code (the latter of which can be taught far more easily than the former).

I don't mean to imply that you are unable to think, of course - the puzzles are surely an imperfect heuristic - but that's my understanding of their aim.
In all honestly, the conclusions drawn by the "socialist" authors don't appear to be that different from those drawn by Carnegie, who robustly defended the idea of meritocracy whilst being practically the embodiment of the self-made man.

We start, then, with a condition of affairs under which the best interests of the race are promoted, but which inevitably gives wealth to the few.... The question then arises...What is the proper mode of administering wealth after the laws upon which civilization is founded have thrown it into the hands of the few?

Men who continue hoarding great sums all their lives, the proper use of which for public ends would work good to the community, should be made to feel that the community, in the form of the state, cannot thus be deprived of its proper share. By taxing estates heavily at death, the state marks its condemnation of the selfish millionaire's unworthy life.

The growing disposition to tax more and more heavily large estates left at death is a cheering indication of the growth of a salutary change in public opinion...This policy would work powerfully to induce the rich man to attend to the administration of wealth during his life, which is the end that society should always have in view, as being that by far most fruitful for the people....

Really, you don't have to be harder or smarter working if you have the fortune to be born into a situation where you're in the top 1% of the population that are worth more than the bottom 90% (the article would benefit from some reference to social mobility though). That's not just a problem if you labour under the delusion that wealth is a zero-sum game; it's also a problem if you're one of us that believe that properly functioning and free markets ought to have a real, tangible link to what the mass of the population demands.
These type of comments are what makes me really wary of what comes after the current mainstream media implodes. Instead of becoming more skeptic of what they read, people just replace blind faith in one source with blind faith in another.
Related ideas:

1. I wish that the dentist had a keyboard I could type on. I know that most people couldn't use it very effectively, but as a decent touch-typist, I could communicate with him while he's working on me.

2. A number of years ago, a friend told me about his mother who'd had surgery for throat (?) cancer, and can no longer speak normally. He rigged up for her a small (musical) keyboard, with each key corresponding to a phoneme, so she could speak with the synth. At the time he talked about wishing he had audio recordings of her own voice to use. He proposed a "voice bank" that folks could store such recordings for just such a purpose, at a nominal charge.
Penny Arcade talked about it several times since one of the charities was Child's Play. That targeted traffic is worth it's weight in gold.
Time will tell either way. I suspect the end result of this will be different then either of you have envisioned. All that can be said today is that the experiment is by any measure reasonably successful and there is potential there to go bigger in some capacity.
Social Security is a pension system very much like any other pension system. It is currently actuarially sound. Like all pension system it assumes a certain percentage growth per year and part of the pension payout a person receives will come from such growth. It is not a redistribution scheme. It's a pension system. It is well funded in an actuary sense. It is not properly a government expenditure and therefore is not counted in the discretionary fund.

You may count it as a government expenditure and count payouts from this pension system as a government expenditure but this is contrary to how this is normally considered.
Sorry, I suspect I'm missing something obvious. You specifically said PGP, which is an encryption program that provides cryptographic privacy and authentication for data communication.

And above you're saying it's about meta data problems in messaging systems. What is PGP's bad meta data story you were referring to?
Oh, yeah. It definitely isn't meant to add value.
"I think the technology used to implement the Bitcoin payment system is fascinating - public ledgers and crypto and block chains will all be game changers. Bitcoins themselves? More of a necessary component to creating a new financial system."

Another article that seems to suggest that the blockchain has value with Bitcoin. I've heard others (pmarca in particular) promote this view, and I think it's far from validated. At the moment, BTC is the most important incentive to mine, and mining is the most important factor in establishing the blockchain's security.

It's true that, in the future, we might be able to come up with other incentive structures to encourage mining (the Bitmessage protocol is one such example). But if we want one blockchain, and we want it to be as secure as possible, how could we ever come up with an incentive that is as universally desirable and infinite as money?
Are you sure about that? I was there a year and a half ago and had no trouble with the tunnels. And the similar pyramids at the 103rd st. and Ancient Playgrounds have tunnels.
TradeHill (shut down twice due to regulatory issues, now dead) was the first US exchange, but I think that Coinbase will be the first to be properly licensed in the states it operates in, as opposed to just FinCEN.
Just saw it promote to bishop :)
Previous discussion: https://news.ycombinator.com/item?id=8933218
Same, my clients always want me to travel to SF (entirely paid for and everything) but now I rarely do unless it is really important.

The biggest reason is the frequent harassment I have went through going there on numerous occasions, not just by US but also coming back into Canada. But this is very much a quiet protest, same with you I presume, I'm not an activist. The true cost of their security theater is largely unreported IMO. I'd expect there are countless people like us not contributing to the US business world or tourism thx to overly-aggressive security.
I know this isn't the best answer but it really depends on what your product does. If your product is the kind of groundbreaking technology that the potential customers will understand right away how it will impact their company (high efficiencies/lower costs/increased customers), then I would say demo the product...ONLY if the core functionality is built. If the main purpose of your product isn't working properly yet then you may want to hold off.

If you anticipate that it might take the potential customer some time to fully comprehend how it will benefit their company, I would wait until you can polish the UI some more. A better designed and thought out UI will make it much easier for a potential client to understand the true benefit of your product.

I know it's a little vague because I don't know exactly what it is you are building but I hope that helps
Isn't the annihilation supposed to cause an explosion? How much energy is generated?
High Stakes, No Prisoners : A Winner's Tale of Greed and Glory in the Internet Wars

The story about making and selling Frontpage to Microsoft for ~$130 million.

Skip the last 3 chapters or so, where he rants boringly.
Depends on how they have agreed to price the vwap. Presumably someone trying to hit vwap is trading on the normal markets and wouldn't interact with the block trades (which are happening elsewhere and only reported to the exchanges)
Wait until you need to scale. Then, analyse your actual system under load. Address the biggest performance problem. Repeat.
Tidal is close. They offer Flac lossless streaming.
You're good. That sounds like an amazing childhood.
I don't understand why he wouldn't move to somewhere that doesn't have an extradition policy with the US. If you go down that path, it seems like you should probably be willing to abandon your life. It's the same with Ross Ulbricht, seems like it would be terrifying living with that sword of damocles hanging over your head absolutely constantly.