skysight-inc/HackerNews huggingface dataset:
I genuinely don't have the answers to your questions. I'm just against shooting off the whole idea that there might be an answer worth considering because of the dogma held by some people that "regulations == bad". Let's wait until we actually see what these people propose (which at this point might very well be nothing at all), then we can scream bloody outrage that our freedom is in danger.

If something needs to be done let's at least give one chance to the people who seem to be trying to do something.
I read the series as a twelve or thirteen year old and loved it, but when I tried rereading it a few years ago I came to the same conclusion.

As mentioned in another comment, it began as a serialized work, and it never really escapes Asimov's "make it up as you go along" style, resulting in quite a meandering series. I think it would have to be a very loose adaptation to make it interesting.
> This sounds like AV1 is actually worse than H.265, at least at low-ish resolutions. Am I misreading these results?

Yes, VP9 is basically on par with H.265 at standard resolutions, so if AV1 is 34% better, then it is a lot better than H.265. H.265 also doesn't tend to scale as well down to smaller resolutions, a lot of AV1's benefits scale well across the resolution spectrum (it seems).

I'm sure a lot of the confusion about this comparison comes from the fact that a) we're not talking about UHD content, which is where H.265 was intended to shine, and b) Facebook probably has never had, and will likely never have, any interest in H.265 because it is simply too legally and practically cumbersome.
Intolerance and any other anthology, Koyaanisqatsi, Last Year at Marienbad, Magnolia and other ensemble pieces, and many more.
So it took only a decade to bring Python 3 to levels of Python 2? Victory!
That's a good question, and I don't have a good answer, but I don't believe the answer is advertising. Not because of any anti-capitalist aversion to it on my part, but because the web wasn't designed to allow for it, and I believe the model is doomed to fail in the long run.

Every other media paradigm is centrally controlled and has its equivalent of Arbitron/Nielsen to extrapolate audience size and attention through polling without directly interfering with privacy or taking control away from the viewer or listener. Unless I'm wrong, advertising on the web requires ever increasingly intrusive and fine-grained analytics to accomplish the same thing, in a medium which is designed to give the end user the ability to arbitrarily filter responses.

In my opinion, the only reason advertising ever worked on the web to begin with was that neither browser makers nor the browsing public were savvy enough in the beginning to do much about it, but now ad blocking is becoming more and more common, and the browsing public is less and less willing to tolerate ads.

Sites can be paid for by charging directly for access, or funding through alternate means like Patreon. Content on the web doesn't have to be funded through the web, after all, plenty of people run sites on shared servers that don't make money. A lot of Youtubers are running sponsored ads directly in their videos because of Youtube's demonetization attempts. There are bound to be numerous alternatives to direct advertising that might be more acceptable to the end user, but we might also have to accept that most content on the web doesn't bring the end user value worth paying for.
Clojure has several libraries (such as https://github.com/jkk/honeysql) which basically let you build a representation of an SQL query as a Clojure data structure, and then programatically transform it. It is great when you need to do things like add joins and subselects programatically to a query based on selections from a UI, and is extensible enough to support many advanced SQL features.
No, but the evolution of Galatea, from an almost comical robot to one that assists the death of Portia (in a beautiful scene) out of mercy is deeply moving.

It's a very good movie, even if not faithful to the original.
Trantor was friggin crowded.
this is probably the most infuriating thing about academic CS, is condescension from people in every other field about this fact.
A photographer present at the hearings was able to get a picture of the notes Zuckerberg brought: https://twitter.com/becket/status/983846618263891968.
We got separate JSON API's instead of machine-readable web pages.
Well, I only get blank stares when I mention octopus merges around here.
All websites where the webmaster wants to leverage Facebook's ads and retargeting. So probably half the websites out there.
Yet it is not new and how is it different than when Obama did it?

https://www.investors.com/politics/editorials/facebook-data-...
Isn't same true for encoding.

I don't see hardware support hardware support coming in next 2-3 years. Then also everyone is not going to change their hardware immediately. Good Software performance is quite important.
1. For static SQL, write views or procedures (i.e. raw SQL).

2. For dynamic SQL, use jOOQ or something similar in your language.

3. For the rare case of really needing object graph persistence (loading a graph of entities, manipulating it, and storing the changes back to the database), or the less rare case of doing boring single-record CRUD, use an ORM. You don't want to do that with SQL.
I just subscribe to the weekly newsletters of news websites/blogs I'm interested in. Does RSS have any advantages over this?
It all boils down to personal responsibility which, admittedly, doesn't seem to be a particularly valued trait these days.

Both you and the manufacturer know if your customization was the likely cause of a failure or not. Life would be much simpler if everyone just admitted that and moved on.
The remark about PHP was the move from version four to five. It was a big move.
Analyzing a billion files in S3
Start with an ORM, for 99% of projects that is the good first choice.

Once you start growing and you can't solve your problems with the ORM or performance on the database starts to suck, start handcrafting where it hurts and gradually move to Raw SQL.
“Dumb, unambiguous code” does not rely on magic conventions that change with the whim of the framework developer.
Banks' "Consider Phlebas"

It's criminal that Banks never got to see his books as movies/series. Banks is, hands down, my favorite scifi author, so I hope the adaptation is well done.
Wayback run progets of portal protocol
new running undoesesa of wayback machines of hydrophonicals of runn material//aka angela dawn winkler 358684699 of English
You misunderstand. Women use their sexuality to manipulate men all the time without actually having sex or violating social rules. In fact a lot of them play this game for sport. Here's one woman's take on this:

https://en.wikipedia.org/wiki/The_Manipulated_Man
what display and how do you control your display from your PC?
One of the best parts is the ability to add any FB, Instagram, Twitter users as a feed. BazQux automatically converts the user's feed into RSS and serves it up.

No more having to go to FB for updates from various organizations that don't have any other mechanism for publishing announcements! :)
Not very consistently, but Voyager revolved around it taking a lifetime just coming back home, hurtling full speed.
That’s a pretty big if
I have no reason to believe a computer cannot write a novel.
As expected, just bloody hate towards Microsoft and Google advocacy without Android development experience.

Have you forgotten to write Microsoft as M$?
I spent a long time with C++ and my learning was primarily through books. However, I also think that not everyone learns best by reading. Some learn better by listening, some by doing and some by observing others do something. For someone of such disposition, it might be more beneficial to follow a MOOC than to solely study the subject from a book.
>And while it's hard to be, "oh no think of the poor hate speech!" that tech is actually very scary when you start thinking about how much it can be abused.

Of course it will be abused, and it will be abused from the outset. The powers that be already define hate speech vs dissent, propaganda vs news, terrorists vs. freedom fighters, scientism vs science, et cetera.

Big Tech and Western governments together control of the flow of information. Previously, the blue-flavored regime held that control and abused it terribly. Now, the red-flavored regime has it, and people are finally noticing. God help us if people far, far worse gain that control in the future and start defining what is unacceptable speech.
Building a VPN kill switch on Ubuntu using Node.js
Is this a suggestion or light sarcasm?

Perhaps was my comment too hypothetical? :]
FullContact (https://fullcontact.com) | Denver | Full-Time | On-site

FullContact’s mission is to help the world stay fully connected, master its contacts, and be awesome with people. (& yes - all roles include $7,500 Paid PAID Vacation: https://www.fullcontact.com/blog/paid-paid-vacation/)

We are currently hiring:

* Senior Software Engineer - Data Platform

* DevOps Engineer

* Foundation Engineer

* Senior Product Manager

More details about the open positions: https://www.fullcontact.com/about/careers/denver
I can't speak for Sam, but I can give perpective as someone who can't relate to any of those really.

I'm not goal oriented. I don't plan a lot for how what I do impacts my future. I'm just driven to solve or fix things. I get external rewards from doing so, but I would do it in some form regardless because I have to.

It's like chasing a high for me. Money and status are nice, but honestly, much of what gets me going isn't to strive for any of those, but rather to prove that people who do have those things aren't necessarily correct. Witnessing incompetence or blatant inefficiency makes me angry. Injustice makes me angry too. When I know I can do something much better than how it's being done, and I have time and means of doing so, I just do it and it feels great. To steal a quote from American Gods, "Angry gets shit done".
If you're new to tech or you've got a different mental model of how version control works, getting across the gap to git is a challenge.

My current team are mostly controls engineers, working on PLCs. But the software we're now working with has its configurations tracked in git. These aren't dumb people, they're quite talented, but their education wasn't in CS, and "directed acyclic graph" is not a thing they have a mental model for.
For your average user I think this is confusing and not good UX.

Since a lot of people using this tool will be developers with MacBooks and not hardcore *nix users, it’s probably a good choice to ignore that convention.
I spent 2 years using a semantic reasoner to develop an ontology for reasoning about smartgrid vulnerabilities. Ignoring the web aspect, ontologies are very hard. In addition, one needs to use multiple languages like one to express the ontology, and another to express a query. Change the ontology a little bit and the query will break when you run it. There was no integrated IDE that was complete.
5 million lines CSV hand-edited by users? I can only see everything going wrong with it.
Out of interest what do you regard as a valid phone number?
I'm probably a minority here, but I think lack of huge characters could actually be a good thing. Too many sci-fi shows use science and technology as a glorified backdrop to showcase the characters, which quite often happen to be a recollection of same old tropes again and again.

"She had a rough childhood (20 minutes of expose, plus mandatory flashbacks in every episode), her mom died when she was 9 and dad was a cheating alcoholic, but now she's a badass who will kick ass for the next 4 seasons. And oh btw look: she has a cool hoverboard and here's white platicky computers which are REALLY powerful. Also, some omnipresent AI will play God."

If you are not identifying with the protagonist, everything else is simply meh. OTOH, interesting ideas are interesting on their own.
Agree, but I’d expand that to all humans.
Perhaps the problem is with the client relationship.

Why not explain to the client that you will need to put in manual or custom work to clean up the CSV or batch of CSVs and charge for the extra time writing a script or cleanup?

Literally the only time this may not apply is if you are writing a general purpose program.
I did this a couple months ago. You can share playlists from your original account with your new account and copy them over. You can even make a playlist of your saved songs and and save them all at once to your new library (select all > Save to your Library)
Can we get a 2016 tag please? This is from May 2016 interview on CNBC:

https://www.cnbc.com/video/2016/05/02/munger-gates-on-future...
JDBCTemplate would probably also qualify, it can be useful especially if you use Spring already. JDBI can be an alternative if you don't use Spring.
So, instead of fixing your messed up data model, you wrote a service (sorry, microservice) which tries to keep your main DB in sync with a columnar cache, so you can keep using that awful query with multiple UNIONs. Throw in some "Go" and boy, you have your Medium post going!
I don't know about the Foundation, but I'd watch a movie based on Lem's The Invincible in a heartbeat.
European air-traffic-control agency: beware of possible airstrikes
But how would you do exclusions with your approach?
Generally speaking though, the areas where the sorts of issues that the article talks about come up is from user-specified CSV mostly loaded from Excel. When you're dealing with enormous amounts of data coming from another (automated) system, you can often make assumptions that wouldn't be practical with user-supplied CSV, like assuming a particular encoding, delimiter, etc.
I dearly hope they focus on dark web use that is associated with actual harm, but in all likelihood they will focus on attention grabbing drug busts.
OneChronos, a proposed trading venue, wants to use AI to match orders
But that only runs Windows. If i switch, I'll switch to something that runs Linux properly.
> Since the books span many centuries, characters come and go and are mostly not very fleshed out or interesting.

Depending on how they manage it, this might not be all that much of an obstacle. Cloud Atlas faced the same problem, but I thought that their use of an ensemble cast to tell a story that spanned the several centuries worked out just fine.
The CSV parser in Python actually makes least one assumption, that should hold true, but doesn't. The delimiter isn't always a single character.

I've had to deal with CSV files containing financial transactions, they used "," as a decimal separator. Fine that perfectly normal, and the same standard used here in Denmark. But what to do with the delimiter then.... that can't be a comma, so rather than making it a ; or something similar, the made the delimiter ", " that's a comma followed by a space.

That doesn't actually work for most CSV parsers, they just assume that the space is part of the data, and the value is split in kroner/øre (dollar/cents). The result is that you gain an additional field and need to trim all data.... Oh and headers doesn't match.
That's just half the problem. You then have to put the data in a database and you (usually) don't want to declare varchar(4000) for all your fields.

It's irritating to go through 50 million records and three of them have letters where there should be numbers. Or weird stuff like "$nul".
I don't know anyone who has found Watson even a tiny bit useful. I've seen demo projects done but results are always very underwhelming and the whole thing is just an IBM meat grinder marketing funnel.
The idea of "accepting arbitrary input" is nonsense. Arbitrary input would imply that I can feed the CSV parser a JPEG and expect some non-error result.

A CSV parser will obviously only accept CSV. That list includes a few (5?) things that might end up being common bugs in hand-rolled CSV parsers. However, most of is is just bogus.

The only possible way to handle "garbage" input is sensible errors. Of course, is someone is presenting a valid CSV variant that you do not support, then it's not garbage, but just a variant that you may wish to implement support for.

A parser that tries to continue on error would be absolutely outrageous for a business to implement. How do you think the finance department would feel about their accounting being rendered invalid because of a parser trying to be smart?
It is impossible to be immune to filter bubble effects. The only way to be immune is to not filter at all (can't be in a filter bubble if you don't have a filter), but you can't do that. Even keeping up entirely with lil' ol' HN would tax you, and I don't know how many zeros to put in the 0.0000001% but HN is not very much of "the internet".

If you think you've got yourself into a situation where you're immune to the filter bubble, that just means you've created one so comfortable that you never get prodded by anything.
A colleague got stuck trying to parse a 1-million-lines CSV for a while, then he found out that the last line was a PHPMyAdmin timeout error.
Maybe they should add "All CSV contain no error messages" to the list :)
OK, but then can the python community stop saying "Pretty much all of the packages are converted anyways!" if the answer is really "we don't care anymore if your aren't" ?
I made python version:
https://github.com/akme/lsofgraph-python
Never heard of them (well, probably in passing); will look into is. Thanks!
Ask HN: Hub for links to educational documents?
So many pdfs and lectures series get posted here, but is there a central repository where you could see a full range of available online resources for learning about a wide range of topics?
The software decoder is not considerably slower than the VP9 decoder, which is pretty fast. If you want to try it out, Firefox Nightly ships a pre-release AV1 decoder behind a runtime preference, so you can try it out. There's still a chance that it can't keep up, of course.

Also, it's likely that you've been using the hardware decoder on your machine for H.264, which would further take a load off. H.265 decoders also vary considerably in terms of speed, I've noticed recently that ffmpeg decodes H.265 faster than it used to.

https://hacks.mozilla.org/2017/11/dash-playback-of-av1-video...
Pretty funny that in the preceding years they gave for free the same data to the Obama administration. Then they sell it for the Trump campaign and all hell breaks loose. Maybe facebook should have given that away for free too?

It's pretty obvious there's a huge double standard going on here that's totally being ignored. I find it funny at how willing the left is to self destruct without thinking.
Yes, upgrading is an engineering expenditure like any other. If you devote manpower to maintaining your codebase you're not devoting it to user-facing features. As such, upgrading your codebase can hurt your ability to deliver some priority feature on-time.

But that kind of zero-sum thinking is myopic. My whole point is that if you only ever prioritize feature work, eventually you lose the ability to deliver features. Nobody in their right mind thinks you can have a company with zero technical debt, there's always a balancing act in play, but if your managers are just playing the risk card without, you know, doing an actual risk analysis which includes the risk of not being able to deliver future features, then your company isn't making smart decisions.

Now, there do exist codebases where you can make the logical conclusion that there really will not be any future feature work, but it's still running in production and so it will need support, and it's a fairly large codebase, and so there would be an enormous cost to re-certifying for the upgrade with very little apparent benefit. That happens, but it only (really, truly, only) happens in large enterprises with many, large codebases and only so many engineers. Those enterprises do have the resources to hire new employees and/or outside contractors to pay down the technical debt on these half-alive projects - they just aren't prioritizing those resources on the technical debt, even long after it became clear that the clock couldn't be stretched out any longer. Through painful personal experiences, I have zero sympathy for companies in that position who think that they can solve their problems with more firewalls.
Absolutely, xkcd tends to reflect popular sentiment very well. On a different front, you made my day! One reply, and from the creator of SQLite, no less!
> For your average user I think this is confusing and not good UX.

I disagree, as the average vault user is likely someone familiar with Unix (though there is a Windows binary). Here is an example that I just ran on my machine.. very silent.

$ mkdir source
$ cd source
$ touch file
$ rm file
$
Better take a compilers course to learn the differences between .NET and .NET Native.

Interesting that you mention PWA, which happen to be pushed by Google's Chrome team, which has some Google IO talks bashing native apps as if Android wasn't made by the same company.

At the same time they are pushing Flutter and Dart as replacement for those stacks.

What a cohesive company, go figure.
Kids don’t like the apps. Shocker.
I wonder if the free tier that appeals largely to enthusiasts and nerds also helps as a lead generation process. People use it and like it, they get jobs where they have a say in procurement decisions, and they advocate for platforms they like when they do.

It’s also a good “eat your own dogfood” way to make sure your platform is up to commercial standards for UI/UX and feature sets. A lot of enterprise software is garbage specifically because the people doing the procurement aren’t the people using the tools.
> All CSVs contains a single consistent encoding

> All records contain a single consistent encoding

> All fields contain a single consistent encoding

What? How are you expected to handle these cases?

Generally you have to guess the encoding of a plain text file like a CSV. I’m fairly sure the common case is the entire file will be a consistent encoding. If you were to guess per-record or per-field I suspect it’s more likely you’d guess some records/fields wrong than encountering a file with varying encoding.

I’d be interested to see some real world examples of CSVs with varying encoding and how existing software handles that.
Actually, the posthumous books edited by Christopher Tolkien are not based off his father's extensive notes and manuscripts -- they ARE, quite literally, his father's extensive notes and manuscripts, organised and annotated by Christopher into a coherent series of publications.

Whether you should try them or not depends on what is your personal favourite form of reading material. Tolkien himself once quoted G.W. Dasent: "We must be satisfied with the soup that is set before us, and not desire to see the bones of the ox out of which it has been boiled." If you enjoy a good soup, I recommend you to read The Silmarillion and The Unfinished Tales, even though they might not be as delicious as The Lord of the Rings. But if you are a connoisseur of raw bones, enjoying reading the different versions, drafts and scraps of those stories before they were published (and many others never actually published, like the beginning of a LoTR sequel, or a time-travel novel connecting Numenor with 20th century England) -- in other words, if you enjoyed the Appendices as much as LoTR itself -- you will definitely find the right reading material in the HoMR books.

More details: https://en.wikipedia.org/wiki/The_History_of_Middle-earth
It's entirely possible. Much about friendship is not about smarts but how fun the person is to be around, their interests...

Source: My dad was in MENSA and maintained such friendships.
Cool Projects on the Blockchain: DFINITY Envisions a Decentralized Cloud
That’s not really comparible to a cloud service that provides 1TB of storage and allows me to access my files from anywhere, or delegate access to others.