skysight-inc/HackerNews huggingface dataset:
> I purchased these units through a vendor we like to use and they hooked us up, so I won’t be able to share my specific pricing. (...) If you build the systems out on there you’ll find that they come in around $35,000 (USD) each.

That devided by 52 x 8 = 416TB is 0.084$/GB. For comparison, the Backblaze Storage Pod 6.0 [1] claims 0.06$/GB for the version with the same hard drives. Although this version has a bunch of extra features like 2 x 800GB SSD's for ZFS SLOG, 8x more RAM for a total of 256GB, etc.

[1]: https://www.backblaze.com/blog/open-source-data-storage-serv...
To be honest (and speaking from experience), the only thing that would actually make life hard for a scraper is the last suggestion. I've never personally dealt with that, which is the only reason why I concede it.

Machine generated HTML is a pain, but I wouldn't call that "very difficult" - it's more like "annoying" in the same way that having to parse HTML instead of finding a neat JSON endpoint is.

And I'm not sure how randomly inserted HTML elements would help - if you're already parsing the HTML, you can extract the relevant data. Unless you're trying to parse the HTML with regex, in which case: https://stackoverflow.com/questions/1732348/regex-match-open...
I'm sure Greece would at least agree that they should have the right to
sell the Elgin marbles. The British Museum, on the other hand, probably wouldn't agree.
Because it doesn't really mean anything, and people act like it does.

Maybe there's some description somewhere with meaning, but it doesn't matter because the meaninglessness has prevailed.
But then the anonymous LLC can create a new company somewhere else. The anon LLC will own it and will only need a representative for the Bank.
> real Agile

Heh, classic response. Whenever your project fails, your coach tells you it's your fault because you didn't do real Agile. Same with OOP, whenever your code inevitably becomes a tangled mess of classes, you will have all sorts of gurus making metric shit tons of money from books and consulting telling you you didn't do real OOP.

Guys, please, can you just admit there is no recipe for success (rhetorical question, of course you can't, that's where you money comes from, maybe you even believe your own bullshit)? There is no real Agile and OOP and other crap that I forget, they're just buzzwords that, when applied long or hard enough, produce shit. If you had kept you project to an absolute minimal level of Agile and OOP, it would probably still be alive and kicking. But you didn't, because you jumped on the bandwagon, you used religiously whatever was popular.

> Agile, done right ...

Yeah, heard that a thousand times before. Sadly, younger developers fall for this all the time, so shit grows exponentially. I'm aware my opinion has always been in minority but whatever.
I was an early adopter (1999-2000), and for years was excited. I was burnt out on programming and considering quitting the industry, but adopting XP made things so much saner that it turned things around for me. But circa 2007 I heard more and more horror stories about companies that were "doing Agile", by which they meant top-down imposition of some fraction of things, plus managers slapping shiny new labels on their same old bullshit.

It was heartbreaking to see something that helped me and my teams a great deal get so throughly misused. It became just another stick to beat developers with. I spent a lot of time apologizing for all the pain people endured.

It's hardly the first time, though. The original paper on Waterfall basically said, "This is a thing that is bad and does not work." But people went and did waterfall anyhow, because a) it conforms to a number of human biases, b) it reinforces the typical top-down corporate power structure, and c) provides endless opportunities for people to blame other people for problems. So in retrospect I'm not shocked at all that we've mostly turned the various Agile methods into meaningless pablum.
Tor would introduce pretty intolerable latency into a professional data crawling setup.
I work for a tribal community college and they do random drug testing about 4 times a year and have done all staff ones in the past two years. Part of it was a safety issues (teaching how to drive a semi is not a drug helpful experience), and some government & organization grants require a drug free workplace.

Its a straight up escort you out of the building firing offense with your appeal being a blood test at the local clinic. Showing up to work drunk is also a firing offense for comparison.

It just depends on where you work, and people need to understand what situation they are in.
tristate bussing invites the possibility of contention (one driver trying to drive the bus high while the other drives it low). You can burn up your chip doing this, an will certainly degrade it in any case.
Writing a WordPress REST endpoint in 2 minutes
Is your product compatible with medical privacy law? Could it be made to be compatible with such law?
I have been checking out CBD oil but I haven't found a great source for it. From what I've gathered, you can't buy it from recreational shops, even if they carry it for medical patients, because it doesn't have THC, but you can buy high ratios of CBD to THC strains/extracts. It's the same predicament for the testing, though it may clear out of my system faster. It's something I'm definitely planning on trying.
He got $30k in bail, the equivalent of a $3k bond if he doesn't just pay it directly himself. The $30k is returned whether or not he's found guilty: it ensures only his appearance in court.
> Static typing provides a false sense of safety, since it can only prove the absence of certain errors statically.

That is as blatant a straw man as I have seen recently. I have never met someone who mistook static types for a guarantee of correctness, though I have met several people who did not understand why testing to 100% statement coverage does not do that.

The authors would be well-advised to remove this sort of thing if they want to be taken seriously, and in general, striving to "do our best to make it provocative" is not an effective way to influence people, no matter how smart it makes you feel.
I went through an MD cursus with no lectures. It was horribly inefficient and boring. This experiment has been tried multiple times in various universities already. To my knowledge, it has always failed spectacularly, except in the mind of the cursus policy makers. Also to my knowledge, this kind of cursus has been reversed to a lecture-based system in all cases after some time.
My personal take is that the "collaborative" methods are so much in contradiction with the ultra competitive nature of medical school that it simply cannot work. In other words, it is a stupid thing to implement if you want to keep a selective school.
I have been using spaced repetition for the last 11 years to remember things, and I totally love it. I don't really like reading books, I prefer to listen to them. My solution for not being able to make flashcards while I'm reading a book is to listen to the audio book, when I hear a passage that I want to recall or think about, I write it down in a note taking app on my phone (I just use the default Notes app on my iphone), and then review my notes every couple of days and make flashcards of the stuff contained in notes.
Yes, whenever I'm looking for a source to crawl I prefer mobile applications for precisely this reason. Request signing and certificate pinning are an upfront annoyance, but the maintainability is far higher.
I dislike it because it makes me a worker at a conveyor belt rather than a craftsman or artist. The person paying the bill might argue they need something built so can't pay a craftsman to improvise - which is why this friction occurs. It's between software development as engineering vs. as an art/craft. It will always be both.
Legit laughed when I saw this.
The animation is a redraw of this picture.[1] It's one of the most famous demos in history.

[1] https://en.wikipedia.org/wiki/File:Elisha_OTIS_1854.jpg
Trac? TaskJuggler?
Breaking tasks down is the hard part. Usually much harder than completing them once broken down properly.
As noted by the other reply to GP, even if your links worked and were to actual, peer-reviewed scientific papers, they do little to support the argument that women's underrepresentation in STEM is not due to systemic discrimination. I think it would be an uphill battle for you to argue that they count towards the 16 in my challenge.
For someone not very up to date with all the various ZFS flavors, can you please explain this a bit?
Top Books on Web Scraping
As someone who's professionally developed mostly in Erlang and Clojure in the last 6 years, it's not even close. I love Erlang, but the REPL is severely underpowered and used mostly for debugging and inspection.
"Women are less qualified than men" way of thinking is very common in IT.

Obviously people that think this way don't understand that companies hire individuals that can be man or woman. Or that's the way it should be.
That makes it a lot harder to have a dramatic lobby, which is an important component of most skyscrapers.
Top 5 Books on Reinforcement Learning
Quite many registries forbid this and explicitly forbids the registrar to hold domains for their customers. Those that disregard this can lose their registrar status.

Right, which is why they say "we're not actually a domain name registration service, we're a customer to these. We sit in between the domain name registration service and you".
I have an idea for a solution. Legalize hacking, let everyone hack each other and spy on each other and what not, make every company out there explicitly aware that the internet is a jungle. This will create a demand for security and force software and hardware manufacturers to actually care about security and so on.
> They aren't real problems because nobody smart is trying to directly hook up a road sign classifier to a steering wheel. They are trying to build complex systems where this is just one signal.

What are the guarantees that those higher-level "complex systems" aren't going to have some weird behaviors as well?

The problem isn't just that ANNs misclassify adversarial examples. The problem is that it's counter-intuitive to an average observer and that no one clearly knows why those examples generalize so well. It's a remarkable property that a lot of AI "enthusiasts" try to downplay.

It's one thing to wire up unreliable but simple and fully understood components into a more reliable system. It's an entirely different level of challenge if the "unreliable components" are complex and poorly understood.

> Humans also act much worse than you imply. Look at the number of people who accelerate into crashes instead of braking, etc.

Except we know very well how and how often people make mistakes. For most of those mistakes we have a pretty good idea why they happen (at the high level, I'm not talking about neuroscience). Our roads, our cars and our laws are designed to handle these failures. Also, we have a pretty good model of how other people behave on the road, so we cal react accordingly.

All of this goes out of the window with self-driving cars.

Hell, most people naively assume that if a single self-driving gets into 50% less accidents than an average person than replacing all drivers with self-driving cars will reduce the global accident rate by at least 50%. This assumption doesn't take into account the fact that many accidents are caused by complex interactions between several vehicles and the environment. So introducing many self-driving cars can lead to some nasty emergent behaviors and some mass accidents that just aren't possible with human drivers.
Or http://www.reddit.com/r/AskElectronics/

(Disclaimer: I am a moderator there)
> The evolution will converge towards content creators being funded through decentralized crypto currency platforms so that the money cannot be prevented from getting to creators if someone wants to pay them.

http://steemit.com is an example of precisely this. Will check out lbry.io.
In which case, why not just provide a paid API? The content provider will then make extra revenue that would otherwise go to the endless arms race.

As others have mentioned, there is nothing (that I know of) that can thwart a motivated and resourceful scraper.
Publii – Open Source CMS for Static Websites
How to handle Differences of Opinion
I have done it right. It worked well for me. I've been on happy teams that produced good code: high quality, high test coverage, good for users. We did technical work that I'm still proud of. And we believe that was true because we paid careful attention to how we were working and improved it continuously, using a lot of techniques from the Agile movement.

I grant that there's no one right way. There are many, and they depend on circumstances. I certainly grant that there are an ocean of idiots selling bullshit. But you're throwing the baby out with the bathwater.

There are better and worse ways to make software. Teams can reflect on how they work and get better over time. Those teams can recognize patterns, and other teams can benefit from learning about those patterns and trying them out in their environment. And that's how things like Extreme Programming came to be: teams experimenting and sharing what they'd learned with other people who wanted to get better. That was exactly what the early Agile movement was.

Piss all over that if you like. But you'll be missing out.
And yet, irssi still lives :)
I tend to distinguish between two uses of the word "generic": code can be "generic" by providing hooks/parameters to override every decision, which leads to complexity and bloat, as you mention.

On the other hand, code can also be "generic" by avoiding decisions, parameters and special-cases. An example of this is Lisp's use of cons cells to represent data: regardless of the contents, and what it's meant to represent, we can always use `car` and `cdr`; they're "generic".

Compare this to a typical OO approach, like a `Customer` object with a `name` and `dateOfBirth`: we can't access those fields without either writing those particular strings (`name` and `dateOfBirth`) in our code; or use some complicated reflection approach to look up the names then use those to look up the data.

Of course, it depends completely on the context whether to use special-purpose datastructures (e.g. custom classes to model a domain) or generic ones (pairs, lists, maps, etc.), but generic doesn't always imply bloat and complexity.
Why custom allocators/pools are hard (2012)
And marijuana use is expected to jump significantly over the next few years in North America.

They don't tell who exactly expects that, nor what the chances are such expectation will hold true (nor whether it will in the long run, over the course of decades). At first sight it makes sense, but does it really? I couldn't find any large scale studies, but searching the internet seems to indicate the outcome can go both ways. There's enough articles to be found saying there's actually a decline in use after legalization (e.g. in Portugal and California). Likewise for the opposite. Conclusion to me: you can expect what you want, but without a proper scientific approach to evaluating it you just don't know for sure.
cool, thanks for clearing that up for me.
Haha, wow, you really missed the crux of my reply.
Why don't you just use an app that displays the barcode? It's been a while since I've boarded a flight using a paper ticket.
Why work for a company that has a +95% chance of failure, a fraction of the cash you would make at a FANG, after 3 years at FB think the "average" hire is now worth like $3M.

Why work at a startup? Makes zero sense.

Source: Work at a startup. Have not been paid in 2 years. But I do get to go to the beach when I want. And learned how to live on nothing. :-)
Yes, it will do nothing against sophisticated botters.

It has been a standard tactic to run browsers in purpose built VMs. The last bastion were smarter, more disruptive captchas and rendering performance profiling, but even that got grinded by now.

The situation is even more grave with mobile ads as you have zero opportunity to shove captchas, or rely on single unique per-system ID or cookie that was vetted outside of embedded webkit environment.
This is going to sound odd but I'd recommend journaling. You need to spend some time free writing to access your subconscious and gain insight into how you really feel and especially what you value. You'll be amazed at how effective it is. I'm of the opinion that a substantial share of ennui arises from a failure to commit to routine and honest introspection.

With respect to software, your feelings may stem from a perceived deficit in value creation. No matter what we do, we all want to feel like we're contributing in some way and we all try to find ways to achieve that. Could be blogging, OSS dev, teaching classes, turning an app into a business (or just putting it out there for people to use freely!), etc. If you're just hacking on things to learn, that's great and necessary. But you might be better served taking it a step further.
It depends on which "Agile" you mean, but for me it's just the opposite. It's no accident that a lot of the people behind the Software Craftsmanship movement were part of the early Agile movement:

http://manifesto.softwarecraftsmanship.org/
The way it works right now is that you would upload one of those old speeches or radio shows to the API, and then you'd get back a transcript that includes all the "terms of art" you customized the API to be able to recognize. Right now there's no feedback loop for you to tell the API where it was wrong, but that's something we have in mind to build! We do run QA across our entire API usage though, and from that are able to improve recognition accuracy over time. We also release updates to the models that power the API every few weeks which improves recognition accuracy too.

And then we do provide confidence scores, so we can at least give you some indication when we're not confident in the automatic transcript we're returning to you.

If you want to try out the API, you can email beta@assemblyai.com and I will look for your mail!
This sounds like a WIP implementation of channels[1]. Am I wrong?

[1] https://en.wikipedia.org/wiki/Channel_(programming)
Facebook now makes roughly $9 billion in revenue (and $4 billion in profit) per quarter.
you forgot to say what's bullshit about it
30% is a statistically significant portion. It seems to me very likely that just as many hold the same views in the population.
Thats a clever but not very mathematical answer. The general problem here is the conflation of universe i.e. "all of spacetime and everything we will ever discover" with the idea of a universal set, which doesn't have to include all elements and is rather arbitrary/relative.
This is something we are looking into!
In addition to dsacco's reply it should be mention that using images instead of text hurts accessibility and, depending on your industry and country, it may also run afoul of equal access laws.
Seems like it wasn't a quote from the mentioned document, just a comment from a Google employee.

And considering that recently Dawkins was deplatformed in Berkeley for 'abusive speech' I will hold with comments until - if ever - this doc will be available.
maybe not going to happen, seems like most googlers disagree with the doc but more so with the leaks
Statutory music rights database proposed in US Congress
Software developers are human beings. This seems like a "duh" moment until you realize that we routinely ignore this basic fact. As human beings, we operate best when we feel like we're doing something important or valuable. If we are tasked with something that is neither, then it is up to the person that is assigning the task to acknowledge the situation and make it be known that "taking one for the company" won't go unnoticed. There are also additional compensation options that could be used to make the whole situation more tolerable. Something along the lines of "Bill spent two weeks documenting that entire area of the product that everyone is so wary of altering, so he's earned that extra 3 days of vacation".

Edit: In case it wasn't clear, I agree with everything you're saying. However, I do think that good managers that understand their developers can make things work and keep everyone happy.
The first realization should be that Agile is not a silver bullet and is not needed to build great software. Great software was built before Agile existed.

People who care passionately about technology and software build great software.

On recent Agile projects I have been involved in, a lot of Agile 'artifacts' were produced (mostly walls covered in Post-it notes). Software seemed to by a by-product and didn't really feature much.

I think this is a result of the 'busywork' Agile created.
I managed to go about 15 years without using the ternary operator. Pretty much the only time it's really good at what it does is for assignments, and I've started using it a bit myself.

However, the old discomforts come up pretty frequently. I find people slipping functions into both the right hand and left hand side. And once you do that, you really should push it into a new function. Especially if you have any plans for testing.

Most compilers are pretty good at inlining things like that, and at any rate there are almost always bigger performance problems than function call overhead. In fact, one of my big tricks is that a function that consists of a weird but fast algorithm is generally tolerated by your coworkers better than just dropping it into the middle of a block of code. And knowing they could easily revert the change (because it's only one commit and one function body!) if it starts to annoy them also helps.

tl;dr: Just like comments in the middle of a function reveal a missing function, a ternary operator probably means the same.
Absolutely, and that somehow makes me sad. I hope that the designers who don't yet, understand the grandiosity of their mission and give a goal to their pieces, beyond the instant gratification of fast rotting eye candy.
I run napp-it on omni-os at home and work with good results. It's not too hard to adapt your linux knowledge if you're not used to the solaris-ish userspace.
agree, though i think its tempting to view this cynically rather than as an almost inevitable product of the circumstances. i think it was david foster wallace who made a similar point about tv, namely that it caters to the lowest common denominator because thats what we all share- you cannot have the "mass" part of mass media without doing that. we all have more deep interests, but they are disparate- so the venn diagram essentially dictates the subject matter.
If only there existed a way to "print" web pages to PDF files...
I'm not sure that's the only option, but at the very least, a mix of contexts, spaces, and communities seems likely.
while i absolutely agree on your general premises, i also think that they should've specified that on the product page.

its absolutely fine to take money to properly maintain and port a software for money. it does feel kind of scummy though if they're portraying themselves as if they're actually the sole developer of said software. and that is the vibe i got from skimming their product page.
Reddit 10 years ago

> BUSH BAD BUSH BAD BUSH BAD

Reddit today

> TRUMP BAD TRUMP BAD TRUMP BAD