skysight-inc/HackerNews huggingface dataset:
We looked at Parquet early on and it wasn’t competitive even with what we were using at the time.

And yeah, this really depends not just on the dataset, but also on how selective your queries are, what predicates and aggregations they employ, etc. A significant percentage of queries gets orders of magnitude faster. I can’t disclose how much faster things got on average, but it was a significant gain, way more than would be sufficient to offset the increased cost of encoding (which is another aspect people typically don’t consider), even considering that much of the data people encode is hardly ever touched.
The beauty of RSS is no one has or ever had a monopoly on it. The comings and goings of particular readers is of absolutely no consequence. The only issue is the reduction of sites offering feeds, but I don't think Google is one of those offenders. They offer RSS feeds for things including Google News and most YouTube channels, they're just not always visible on the page.
RSS is as important as E-mail.

Sure today people are mostly focused on corporate run social media like Twitter or Facebook but nobody really likes them. Everyone is constantly bitching about their practices. And you can't really make money on Social Media, which means corporate run social media is going to die some day, when they all realize there's no cash in that expensive cluster of cows.

RSS is free, and everyone can use it, no matter what blogging software you use. Operating your own blog gives you more control over content and presentation, as well as smaller details such as how your commenting system works. It's the superior choice.

It's free. That's important. Nobody controls RSS. Anyone can write an RSS reader. Anyone can write a blog app that publishes RSS. This ensures it will be around to survive the rise and fall of social software trends. When the smoke clears and people emerge from the rubble of the corporate landscape, RSS will be there, welcoming them home.

footnote: I saw this article in my "Hacker News" RSS feed.
I think this is a separate philosophical debate: operating under current legal frameworks in the United States of America, you do not have the right to prevent me from publishing my photo (with no demonstrable harm being done.)
For better or worse, Star Trek TNG and DS9 have played an important role in my development. I would like to think that is was a benefit.

The major message of Star Trek in general and DS9 in particular is that despite of - no! because of! - our petty differences, we can all live together harmoniously. That harmony may require to people to avoid contact, but that is a - relatively - rare exception.

A minor message, but an important one, I think, is that violence and force are rarely, if ever, the best way to solve a problem. With a little bit - or a lot - of cleverness you can find a solution that will be satisfactory to all the parties involved. Even if you have all the right cards, simply relying on strength is not a good foundation for a long-term arrangement. Diplomacy and Compromise is.

It is a lesson - Star Trek or not - that I think could help many young people these days, Star Trek or not.
> And as there is no way to immediately see where some interface is declared and if/which interface is implemented

you can use go-oracle (https://camo.githubusercontent.com/3fb1d62bbc7b1306da783f395... that!
Andy Glew had a post: http://blog.andy.glew.ca/2017/05/intel-iamt-bug-strncmptrust...
It's a program rendered as an equation. That's still kinda cool IMHO.
n-gate is going to have a field day with this discussion
This is true although nobody likes to admit this. Intelligence, including specific subfields of intelligence, is highly heritable, explaining about 70% of variance.
I've noticed you've made a few of these APIs lately, nice work!

Can I ask how the business side of that is going for you? Also, what do you think of the token-based billing rather than monthly plans?
If you find this stuff interesting, as I do, I would check out http://www.welcometothescene.com/ (Dead link). It was a web-series about the scene that was pretty much completely a screen recording of the "main character" which I don't think we ever see. The entire thing is watching chat logs and this person rip/upload movies and the like. I'm sure you can find a torrent kicking around out there of it (if you can't email me). Here is the wiki page on it https://en.wikipedia.org/wiki/The_Scene_(miniseries)
They are functions (in the programming sense) that can be called by other code, but Apple reserves them for their own use. They don't necessarily have anything to do with privacy, though some of them do. The "private" refers to them not being publicly documented and not provided for developer use. Internal developers at Apple are allowed to use them, but only as appropriate. Consider a function (API) that allows one to wipe the phone. Apple doesn't want just anyone to be able to write an app that provides that feature. Same with a lot of other functionality. Other private APIs are things that Apple might someday offer to developers, but hasn't yet. For example, Apple can change the icon of its own apps (note the calendar app, which shows the current numeric month day, and the clock app, which shows the time including moving second hand) but it does not offer this functionality to developers. [Edit: I was wrong about this; see firloop's comment below.] If they did, the results could be off the rails, visually, and make the platform look bad, so I expect when they do allow this, they'll do it with a heavy review process in place... but that's just one small example. A lot of private APIs are more under the hood housekeeping stuff that you just don't want the average programmer to mess with.
Reading these comments makes me wonder if there is something wrong with US cursive or the way it was taught. I learned cursive in first grade GDR and continued school in Austria where we had to (and enjoyed) writing copious essays weekly over and over again. It's actually amazing to watch the penmanship shift over those years and develop into a idiosyncratic style or to see the speed and form impacted by topic, time and material. The ability to use basic materials to communicate and express knowledge and civilization should include a wide array of skills from cursive all the way to tool classes. When you finish high school the goal should have been to hand over the foundations of civilization and let you go from there. Rhetoric, grammar, broad knowledge of history and science, firm skills in math and your ability communicate seem to me the basics of an enlightened age. A touch typing course is really not that hard or difficult to add on. But there is something refined and cultivated in training your brain's neural net to become skillful as far as mastering the basics of self-education (reading with clear and deep understanding) and self-expression (communicating clear discursive thoughts) goes.
Would you rather have them use C++? In this regard, Go is a lesser evil.
> That's a support nightmare; it would be nearly trivial to start submitting false reports from a ton of accounts without establishing a pattern so those accounts could easily be ignored.

What's stopping me from flooding false reports now? Arguably, only reviewing the image they already have once a hash matches is less work, since they wouldn't have to review all incoming reports, only matched ones.
I feel like score voting is much better in that regard. It lets people express their whole range of opinions.
RCV has some weaknesses compared to Condorcet methods (which use the same voting mechanism of ranking candidates but different ways of determining the winner). RCV can punish people for voting according to their true preferences.

For example, say a country is 49% Republicans and 51% Democrats. In addition, a Socialist candidate is running. 30% of the Democrats actually prefer the Socialist candidate, but under a plurality system they would vote for the Democrat candidate because the Democrat has broader appeal.

If those 30% chose to rank the Socialist as their #1 choice, then the Republican will win the election, because the Democrat will be eliminated in the first round. So the Democrats are incentivized to not vote their actual preference.

Look at the various Condorcet methods [1], and also check out Approval Voting [2] for a system that produces fairer outcomes without the complexity of RCV/Condorcet.

[1] https://en.wikipedia.org/wiki/Condorcet_method

[2] https://en.wikipedia.org/wiki/Approval_voting
> Most of them will never model anything again in their lives. But we've removed the idea that when they see an amazingly detailed 3d-printed prosthetic limb, that the designer was doing some kind of magic.

I don't believe in "magic", but I believe there is magic everywhere.

TIL I won a math award in grade 6 and almost failed grade 8. I remembered that the first time I took calculus I scored 39% and the second time I scored 93%.

I learnt a lot from school, but more on my own.

I'm terrible at math and programming, but better at it than most everyone I know. The only people I know who do it better do it professionally, but do it so narrowly they barely know anything at all.

I understand very little in detail, but quite a bit in principle.

I'm uneducated and probably unemployable, but make more than most people I know who are employed, in a field that's been made obsolete (while working less than they do).

I believe strongly in the dignity and simplicty of living that comes from reflection and self-awareness. And that empathy and understanding are the cornerstones of a just society.

I believe we should all know more and do less. That our experiments and play should be confined to safe spaces and have as few repercussions as possible. That the public acts we willingly make should be considered and measured.

I am hungry now, I will eat.
Are those lectures in the public domain? If so, could you pls link to them? Thx.
I'm surprised that I didn't see hand fatigue mentioned, which is probably the number one reason cursive is actually useful, not that it is fast or "aided in cognitive development". Business scripts (like Spencerian in the early 20th c) were developed if you were Clerk or someone who had to scribe stuff out for hours on end, and it had to be legible and consistent. The mechanics of it are quite simple. If you hold a pen, pinch it, and write each letter by moving the your fingers in and out, you will tire quickly or get hand cramps. Cursive scripts on the other keep your fingers fixed, and you write by moving your whole arm, and bending your wrist back and forth, that's why letters come naturally at a fixed angle, because your wrist is going up and down as your arm moves across the page. It also makes writing legibly easier when you write large, your arm system is like one of those old line plotters doing big sweeping motions that you can easily control. Try writing large letters with finger movements while keeping your wrist and elbow mostly still and it's like chiselling them out. It's hard to maintain the right movements over large sweeps and make consistent letters. So this I feel is the number one reason to learn cursive, if you go to college and want to take notes for three hours a day while keeping your hand comfortable, it's natural to write through your whole arm, and the way to write naturally with your whole arm is to basically flick up and down while smoothly pushing your arm across the page: cursive scripts.
There are a few good templating (gengen, genny, etc) solutions for generics in Go, but yeah, it would be nice if it was baked into the language.
The Gross Inequality of Organ Transplants in America
If Ada had curlies and ran on the web, people would flock to it. But it has Begin/End which looks antiquated to people.

/slightly tongue-in-cheek
Or Rust, if you really really want to avoid C++.
Construct some building in the middle of nowhere, in the middle of the Sahara desert or something, and see if it increases or decreases in value.

The structure itself will depreciate somewhat, and that's all.

...It's the location for a structure that is responsible for increases and decreases in real estate.
> We use obscurity every day and its a completely valid layer of security.

Not sure I agree with that, most of the time when we do that is because we don't want to spend the time to have better security. And then we get burned. To your example of the 100$ bill: at my parents home with the car parked in the garage? No problem to do that at all. Out on the street in SF? No. I don't trust my glass enough as a security measure. But I don't leave money at all, is not security through obscurity.

But we are going OT. The problem that is raised is that they need necessarily security through obscurity. And we have two problems:

- How really robust are these algorithms? How long before we will see people abusing them?

- Have you thought hard enough about how this system could work? E.g: have a partial hashing made client-side and the final one on the server? Or a situation where the server code is open-sourced without the model to calculate the hash? That would allow for external review without disclosing the hash. Yes, you still need warranties that Facebook is using that code, but you could have a trusted third party certifying the program.

My point is, the person who designed this program didn't really understand the problem. The problem is not revenge porn. The problem is Facebook reputation. And this solution is totally deaf.
In my opinion, that's actually better. In the United States the Republicans are actively trying to dismantle all the legislation that was passed by the previous Democratic congress, and there seems to be little rhyme or reason to their platform other than that if the Democrats support it, they're against it. This is especially noticeable with healthcare, and the volatility around the government's stance on healthcare has lead to real uncertainty for insurance companies that has led to higher premiums and spottier coverage.

Approval voting actually allows candidates that break the mould of existing parties, because voters can support a candidate with unorthodox views without compromising the campaign of their party's primary candidate.
2019 because it looks to me like some groups like Ogma, Open AI, Deep Mind, as well as probably several others that aren't widely popularized, are starting to put various aspects of it together but it seems too speculative to assume anyone will both have all of the capabilities and in a strong enough level next year. I think someone may put it together more or less in 2018 but it will be nailed in a way that most can't deny in 2019.
It's like saying every time you open twitter there will be 1,000,000,000,000 tweets waiting for you.
I always see people praise Vue for it's easy to get started with it, but in the end it seems like a strange mix of jQuery and React.
Not sites that are solely driven by ad revenue. Most sites that aren't, still offer an RSS feed, it's just not always visible on the page. Some sites I've subscribed to and contacted for minor RSS related issues, didn't even realize they had it, it was just part of the publishing platform they used and the feed was exposed through a link tag in the markup. I don't think the protocol has anything to do with the choice to provide a feed, in fact, yet-another-protocol would just make it a harder for everyone involved.
Object-Oriented vs. Functional Modelling of Musical Arithmetic in Python
The API to change an app's icon is not private (as of iOS 10.3)

https://developer.apple.com/documentation/uikit/uiapplicatio...
I for one built my own RSS reader which I serve locally with NodeJS. I update the sources every minute and keep them in a MongoDB collection. I even added a Mercury API integration so if I like a summary, I can click a link and read the whole article in-line (formatted consistently, and just how I want it -- no ads)

https://mercury.postlight.com/web-parser/
Oooh, nice! Thanks.
That motorcycle video near the end of the article is simply amazing.
I'm not sure who you're quoting or why.

> Issues are representative as a sampling, not absolute numbers.

My point was that issues are not a reliable sample of the Go community as a whole. They're a self-selected population of Go developers who cared enough about generics to click on a Github proposal on the subject and react to it. I'll say it again:

>> The majority may not spend their time reading or reacting to proposals they don't care about.

Maybe the majority do want generics, but the Github issue is poor evidence. A random sample of Go developers would be much better, and then we wouldn't have to make up things like "And many more want Generics without having responded to the issue."
Even if he is, the AMT is a pretty spectacularly unfair tax that hits a lot of people it wasn’t meant to.
When we did the math (over 20 years ago), the difference between cubes and private offices was about $500 a year per person (At roughly $20 per square foot). Our average developer cost was close to $100K a year, so a 1% increase in productivity would have paid for it.

The cost difference between one person and two person offices is so trivial to never be worth considering. The real problem is when you are getting an allowance from your landlord for build-out as part of your lease. In that case the landlord is going to fight very hard for you to build two person offices (or open space) because they'll perceive it as far easier to re-let if you leave.
Code like parent comment is why I use Intercooler.js [1].

[1] http://intercoolerjs.org
The purpose of a discussion is to determine whether or not those legal frameworks are appropriate to the situation.

The law is a tool, not an ends.
> - Stdlib just loosely wraps posix features with many C flags copied verbatim. These APIs are old and could use a refresh but Go never bothered.
> - Similarly, Go doesnt bother to hide the differences of different OSes.

I disagree with these. Go runtime/stdlib is architected to work around many many POSIX headaches and design bugs, hiding them completely from programmers, and to be fully portable. For instance:

* Concurrency is completely redesigned (goroutines).
* Signal handling is redesigned and doesn't cause bugs when interacting with concurrency.
* Forking/Exec'ing is redesigned not to cause fd leaks in subprocesses (all file descriptors are marked as O_CLOEXEC, in a race-free way), nor have races while interacting with concurrency
* Sockets are exposed through a higher-level API (Dialer/Listener).
* epoll is not exposed but transparently used by a single thread to handle all supported file descriptors without wasting OS threads, to improve performance

In fact, I think the only thing that is pretty much low-level is os.File and filesystem access in general, which tends to expose lower-level details.
I have a different objection to Open Source, that companies can profit from its use without paying its developers a penny, and usually do. My preferred licence is Shared Source: you get the source, and it's free
(as in beer) for non-commercial use, and can be bought for commercial use.
I built my own reader, in which I have a Mercury API integration. This allows me to click a link and scrape the source article, so I can read the rest of it inline (and with no ads)

https://mercury.postlight.com/web-parser/
These “progs” are main reason I learned Visual Basic and then C/C++
When I started using Macs (about 7 years ago? was it that long?) it provided a nice balance between good GUI (not excellent, Finder is woefully bad for any power user scenario and there are other problems, but reasonable) and full-power (even if slightly weird) Unix underneath. I could use - especially when homebrew got good - practically any tool I want as a command-line power-user without giving up on reasonable UI.

However, lately it looks like Apple got this disease where they just break random stuff and change things around just because they want to do something new. I am afraid Macbooks are not the best home for developer/power user that they used to be. And the fact each new model comes with completely different ports and power connections borders on trolling. And their closed-garden "no upgrades for you" hardware approach is getting very old very fast.

Looks like Apple has their product design canon firmly aimed at their foot and is yelling "fire!".
> The lawyers would disagree with you. If the email address contains anything that identifies you personally, it's PII and thus falls under GDPR.

You are simply missing the point. It's not required to "contain" anything. If it is the email address of a person, then that makes it PII.

> Therefore, if you collect email addresses you have to go through great pains to protect them.

Well, yes, of course you do? If you want to profit from using other people's addresses, you better make sure they don't get harmed by it.

> We live in a data driven world that requires.... well... collecting data.

Erm ... no? We don't live in a data driven world, we live in a world where some people are completely unwilling to respect the boundaries of other people and consider it their right to do whatever it takes to manipulate them in their interest. There is no such right, there is nothing that requires that you violate other people.

> Saying "just dont collect email" isn't helpful

Well, whether it is helpful depends on what you expect to be helped with. But it is a perfectly viable thing to do. If people voluntarily hand you their email address so you can send them invoices, say, there is absolutely no problem with you doing so, because that obviously means that there is consent. Anything beyond that, and you are just selfishly trying to ignore the interests of other people, and it is perfectly viable to just not do that.

> collecting IP address info without associating it with use data is pretty pointless.

... so don't do it, then?

> It is a huge, expensive undertaking to make any kind of "legacy" pre-GDPR infrastructure GDPR compliant.

Erm, well, it's an expensive undertaking to stop being an asshole ... so what?

> If you are doing anything useful on the internet, you are collecting data.

So, if I publish a free software project on my own web server that doesn't write any log files ... that's not useful? Could you explain how exactly that reasoning goes?
> Once we receive this notification, a specially trained representative from our Community Operations team reviews and hashes the image

At first I wondered "Why?!" Why does a "specially trained" person have to look at the very same intimate images that their users wish to prevent being shared.

Then it struck me that without review, any image could be blocked, simply by submitting it through this process. This would also explain why the offline hashing approaches being suggested aren't practical - they're just too prone to abuse by flagging images that are not of a sexual nature, but that you would like to see blocked for whatever reason.

An ML approach to masking the most sensitive portions of the submitted images would both protect the user, and reduce the burden on those tasked with reviewing the submitted images.

If this could be handled on the client, and sent with a verifiable hash of the original image, that would solve the majority of concerns raised in the discussions here.
This is very good. The parent comment is very reasonable, but your switchblade admits the possibility of aonethig very concerning which is not easily dismissed.

They did post a bug fix though.
>Large "super store" like WalMart/Target/others don't really exist. I can't go buy a couch at Albert Heijn. I don't go buy a TV at Aldi. In the US however going to Walmart for electronics is as normal as going to get grocerie

You don’t get a TV at Aldi in the US either, and many (most?) Walmart stores don’t sell groceries
I'd try just a little windex. Had this awful whiteboard for a while that just would not clean normally. Window cleaner though? did the trick perfectly.
>I admit I'm not even sure how bittorrent make sures the other "bits" are valid...
Each peer has a sha1 hash of each peice.

>p2p-storage.js...
Maybe webtorrent.min.js is what you're looking for.