skysight-inc/HackerNews huggingface dataset:
Most users on HN might not be too interested in a Library such as this (and I must admit the demo page I'm linking to above probably doesn't do the best job of explaining the background or utility of such a package), but hopefully a few of you will find it interesting.

As I mention in the page, I was drawn to the issue when I noticed how much memory was being used when I pulled a large data set from one of our Oracle databases here at work and I thought to myself, "Self, is there any better options?".

My main goal with the application I'm still working on, is to create a database proxy API (so I can submit a JSON request to this PHP application with an actual SQL query, that could then prepared/sent to the Oracle database and the results returned as JSON back to the user). Lots of security-related stuff I'm working on as well to make it happen in a way that won't cause any issues for the database, but this particular subproblem related to memory usage took up a few weeks of my time as I looked into and experimented with using JSON strings directly, and then into GZIP strings (particularly because GZIP was going to be the final output in most cases with Content Negotiation).

All in all it was pretty fun to build the package and just run various performance tests so if you have any questions feel free to ask and I hope someone might be able to use this in their own projects too :-).

Enjoy!
Have you used Allegro?
If you had you would notice their gui is single threaded. Segfaults often, and has no color syntax highlighting of any sort. Perhaps Lispworks would have been a better example.
Decentralization is not the only way to save the open web – democracy can, too
It's common practice, but that doesn't make it ok. In fact, afaik, those network-based hiring practices are a major obstacle to social mobility and to ending racial and gender inequality.

Think of it this way: In the U.S. in 1950, white men[0] controlled access to resources like education and jobs, and shared them only with other white men, intentionally discriminating against non-white and non-male applicants. In the past 66 years, network-based hiring practices have extended that systematic discrimination well past its expiration date. White men still dominate those resources, in large part because they network with and therefore hire each other. Who has good schools in their neighborhood? Who got into the good college? Who are their college buddies? Who do their professors and other mentors know? etc.

Isn't time we broke that cycle? Only 33% of Americans are white males, yet look at photos of SV leaders, Fortune 500 CEOs, the US Senate, etc.: If we step back from our expectations, conditioned over our lifetimes, those photos are absurd - and represent an enormous waste of talent, self-determination, and achievement.

----

[0] Really it was Protestant, heterosexual white men, and maybe some other parameters applied too, but let's keep this simple.
I dunno, it just feels that the crypto community is shooting itself in the foot by largely catering to those with smart phones. A huge chunk of population, (poor, elderly, etc) are in a similar boat as I am and it doesn't make much sense. Many of the civics/activist/crypto folk seem to only want to make flashy toys to prove their worth rather than tackling problems in solid ways :\.
Just installed redshift, and once I had hit "locate" and applied it, wow. I was very skeptical, but my eyes already appreciate the color change.
Why Rating Rocks (but wordier)
> However, the lawsuit specifically alleges that, in one example case, the qualified application pool was 73% Asian. In that case, it's extremely abnormal to hire 17 non-Asians and only 4 Asians.

It's abnormal, sure, but that doesn't imply that the abnormality is Palantir's "fault." It might be that, say, one department of one major University, which happens to have an outsized Asian student population, heavily encourages its grads to apply to Palantir.

As a result, Palantir would see one "general" applicant stream, from all walks of life, but with a self-selection effect filtering for people who are (in their own opinion) good matches for working at Palantir; and then one applicant stream of people who happened to go be in the Maths program at University X and didn't want to say no to some advisor's strong recommendations.

The self-selected stream would be better hires than the "coerced into applying" stream for obvious reasons; and the "coerced into applying" stream would also likely be much larger than the self-selected stream. If the people in the "coerced into applying" stream, then, fit a certain profile, it would appear in the resulting data that people who fit that profile are worse candidates than you'd expect.

Doing a causal factor analysis to the applicant graph, though, would immediately show that the contributing factor of being Asian (or whatever else) is "screened off" by the contributing factor of being an alumni of University X.

Given that Palantir is full of the very people who can do this sort of analysis, though, I fully expect that if this is the case, they'll end up attempting this argument on a judge. Probably with amusing results.
Yes I know, but call/cc without any context generally refers to undelimited continuations. Delimited continuations use differently named primitives.
Really? Did they do any kind of blood tests with and without wheat germ in his diet? It would be interesting to know what exactly was causing that response. That doesn't really sound like a normal allergic reaction.
Maybe you need PNG thumbnails for user-uploaded SVGs.
Trying to reply to a few parts of this nested thread at once, starting with OP:

>shawkinaw

>Goddammit. I really liked StartCom for free S/MIME certificates

Same. It came up over the last year in previous discussions when the covert acquisition began to come to light and I was forced to reluctantly dumb StartCom, but it really was a shame because StartCom's core business model was extremely sensible and doesn't seem to exist elsewhere. They essentially only charged for where there was a human time cost. So you could do automated verification (level 1) for free with decent time outs, and then upgrade to greater levels of identity verification (level 2 individual, level organization etc) building on the previous ones but in each case only the identity verification cost money, once verified you could request unlimited certs with that identity (since address ownership can be confirmed automatically). For email in particular it was quite nice.

As far as S/MIME vs PGP/GPG, it boils down to practicality in many situations.

>Why are you using S/MIME?

>It has less users than PGP/MIME, which is an impressive feat.

S/MIME has native transparent support on a number of major OS/email platforms, importantly including iOS (since iOS 5 IIRC). That helps solve the perennial general adoption problem encryption faces, ie., what happens when people using it interact with people who do not. With S/MIME there is some potential value just from signing and it doesn't require most recipients to install anything else at all.

I at least do use GPG in addition, and if Apple/Google/Microsoft/other clients all built PGP support natively into their platforms and email offerings then I'd stop bothering with S/MIME period. But as far as "how can I get many of my parents/family/friends to gain at least a little end-to-end email auth/security that they can use with minimal to zero additional effort on their part" goes S/MIME has remained valuable. Unfortunately. The entire state of email authentication in general is insanely frustrating (or even depressing), there are no great solutions right now despite the tech all being there. Use of S/MIME certainly has plenty of flaws. Right now though I've found it to still be a useful part of my toolkit and at one point I'd hoped that other places might adopt some of StartCom's innovations and ideas without the many warts. No such luck.
For sake of perspective I am a VP of my IT department (smaller company, about 300 employees, about 40 reporting to me)

1) Me, personally: I wouldn't ask for a raise (and this might be me just being pedantic) but I'd ask IF the role change has a scheduled raise and what is to be expected. I'd use this answer to help me make a decision. I'd (me, personally) would assume the role would have a minor raise and future raises based on my performance in that new job. I'd try to secure a 15-20 percent increase in pay for moving to a manager role - which, btw, is hard. Moving into a manager role means learning a new job - this isn't (or shouldn't be) your other job with a couple new responsibilities. This is an entirely new job that isn't your old job... sure, you can help people when they ask but that is entirely different than hiring/firing, writing people up, or trying to determine what sort of a raise somebody deserves.

2) Be humble. Find a mentor. Read a lot. Be humble. Be humble, be humble. I believe that power exposes more than it corrupts but it can also corrupt. Work from goals. Give clear expectations. Also, you may not like this role. I've hired a lot of developers leaving their company because they were great developers that were put into management roles and learned to hate it. Good luck! Me, I love it. (to each their own)

3) Learn. Read. Read. Learn. Read... and remember: In theory practice always works, in practice theory doesn't - You are now dealing with PEOPLE not COMPUTERS. People are emotional beings and often unknowingly irrational. HOW you say something is much more important than WHAT you say.

Lastly - learn to manage UP as much as you learn to manage DOWN.

Best of luck!
Revealed: the criminals making millions from illegal wildlife trafficking
How to Create a Blog
I wrote this article some days ago which runs through all the major group decision making methods I've come across and hopefully conveys why zero-sum methods (like plurality) suck, why methods based on conversation or veto are vertically/horizontally challanged and why rated voting systems with consent orientation (assessing resistance first) may be the thread out of the labyrinth. Interested to hear any feedback. Cheers, D
Funny story (I think): I happened to have brought a C.H.I.P. when I went back to europe for vacation. My father proudly showed me his new solar array and the log he had collected manually. After a bit of googling, sourcing a USB-serial adapter locally, and a few long nights I had the CHIP collecting this from the Growatt 3000's serial port and uploading it to pvoutput.org. It's still running 24/7.

EDIT: I have too many of the little SBC, but in my mind the CHIP is outstanding value for these little projects where in yesteryears one would have used a microcontroller.

For things that need more power, I like the ODROID C2.

Soo many to choose from.
> The problem is that obesity is truly the primary cause of many medical problems.

Obesity makes lots of medical conditions worse (or more likely), but it's the primary cause of almost none of them. It's rare that it's even the biggest risk factor.
Great post. I like how he didn't go into too much detail on the math of backprop etc. I find the conceptual understanding of ML is more interesting as a lay person.
There's also a rumor going around that he plans to start a media company if he looses because he has some very strong supporters and he think his campaign should have been covered differently.
Parent poster is probably talking about the fact that I willfully use a dumb phone. Though, I'm honestly not sure how a perception of being 'weird' is really relevant.
I posted an Ask HN related to this, would love to get some feedback on it:

https://news.ycombinator.com/item?id=12561580

Short version:

Does anyone do this in software for certain specialties (like application security, DevOps, etc.) either for people with no experience (or more likely) generalist dev experience? What Dan Luu termed "trainingball" and what Matasano (sort of?) used to do with its proverbial .NET programmers:

https://danluu.com/programmer-moneyball/

https://news.ycombinator.com/item?id=7260087
Does this support iPad and Android tablets?

How about Windows tablet support?
DC is just catching up from the huge losses it experienced in the previous years. In such a case, it's easy to re-increase the population.

SF is different, population had been growing for 20 years already before the boom happened. Before that, the days of losses were much older than for DC, and the losses were not as big, so the available 'free' population growth margin was much smaller.
One other thing to add...in creating the demo I wanted to use the Shakespeare JSON data set that someone had shared at some point on here (they had shared the link).

I ended up having a bit of difficulty using it at first because it had some extra tab characters throughout the file and PHP's json_decode() function didn't quite tell me exactly where the problem was.

Other tools didn't seem to be useful either (online validators are only for small files typically and don't allow file uploads) and even Notepad++'s JSON related plugins didn't seem very helpful.

I finally ended up using the JSON Streaming package available for PHP which allowed me to run through the file and identify some of the offending lines.

Then I noticed a pattern of the tab character not being escaped in the line strings and just did a mass replace/removal of the tab characters in the file which then allowed me to create the sqlite shakespeare.db file included in the repository.

This by itself might be useful for others to use as well in their own projects :-).
Ask HN: How to build custom camera as prototype?
I have a software background and near zero background in hardware.

Could anyone kindly provide tips on how to hack together a camera for prototyping purposes?

Camera spec:

* Stream images to smartphone via WiFi

* Use multiple sensors to provide 270 degree depth of field (similar to VR camera rigs)

Also any gotchas to be aware of?

Thanks so much!
7 Secrets Killers Strategies to Flood Traffic to Your Website
Tax dollar ROI for whom?

Part of the benefit of ensuring a diversity in government roles is aiding governments to better provide services for all aspects of society, not just the minority who hold those roles.
Sure, they'll figure out any excuse to kill some of their animals for profit. Let's say I give you that, and I wouldn't be surprised if that's what's going on there.

Still, wouldn't it be in their best interest to maintain a sustainable population of their animals least they kill the golden goose?

Because if that's the case their aims perfectly align with conservationists.
I went to Georgia Tech, and a small subset of Indians there matched the "bachelors in India + work in consultancy" description. I didn't feel anyone there was clueless though. Definitely no fake resume shit.

It is possible that I'm clueless, and cannot identify clueless people.

Thanks to you, TIL that Tech is a state university. Never knew.
Have you ever made a contribution that conflicted with Google's goals? If so, how was it handled?
Save as "optimized svg" helps a lot as a first step.
How is that solution better than effectively putting them out of business?
HN is not pointing out anything to me. There's a couple of members here who seem to be involved in the "fat acceptance movement" who are defending the article.
I've been watching a lot of Scott Adam's periscope videos about Trump as a "Master Persuader" and although Im not sold on the premise, it has made me reconsider the real role of a president. A job beyond detail work and one instead of setting direction and tone. It has definitly got me watching the campaign in a different way and I'll be watching the debate tonight with his periscope feed on my phone.

Adams, creator of Dilbert, has a track record for predicting Trump's moves. He has a theory worth looking into about Trump's church pastor as a youth being Norman Vincent Peale, the author of The Power of Positive Thinking. Adams is a trained hypnotist and detects in Trump the influence of Peale's techniques.

That said, I'm not American and enjoy my political theater with a pinch of conspiracy theory, so... grain of salt.
3d of a 2d fractal is one of the things the group that made the video from the original post are trying to achieve:

http://www.hpdz.net/TechInfo/CameraTilt.htm

you can imagine the compelxity of introducing perspective into the already computationally heavy fractal calculations
Members of Congress, or MC [1]. The UK (and other parliamentary governmental) analogue is MP -- Member of Parliament. The term fell out of favor in the US, but nonetheless exists.

[1] https://en.oxforddictionaries.com/definition/mc
From the video's description:

"The deepest and first ever HD deep-zoom animation into the Burning Ship fractal. This is one of the creepiest and yet stunningly gorgeous fractals ever."

I agree about the creepy factor. I've seen many a fractal video, but this one... is different. Maybe it's the music, but it really did feel mysterious and... creepy.

Thanks for posting the link.
>Repealing Prop 13...

Would put houses that the owner can't afford on the market thereby increasing supply. Adequate social security would mean they don't then get dumped on the streets.

>Eliminating the mortgage interest deduction...

Waiting changes the tax burden? No. But a capital gains tax would deincentivize flipping houses, a practice that serves little purpose other than inflating prices.

All the benefits of mortgage deduction are immediately swallowed by a commensurate increase in house price. People will always budget the same monthly payment, the only difference is whether the non-home owners (or future generation due to budget deficits) are unfairly burdened by having to make up for the missing tax revenue. The mortgage deduction is simply a funneling of money from the treasury to lending institution and provides zero long term benefit to the home owner. And Canada does not have it and their country has not fallen apart.

>Limiting realtors to hourly compensation?...

Hourly is good enough for lawyers, but salaried would also work. Seriously though, anything that does not incentive maximizing the sale price (such as pegging compensation to sale price) would reduce housing prices. Better would be tech simply replacing realtors entirely but unfortunately they have such clout in the assembly, their privileges are sacrosanct.

>I'm tempted to think you're trolling...

That is because you have never hear these ideas before exactly because they are not disseminated exactly because they would reduce housing prices which is political suicide and will cause TV views to turn the channel. I assure you not one of these ideas is my own and indeed they are well understood and discussed by very serious people eg[0], [1] and [2]

[0]http://fivethirtyeight.com/features/the-tax-deductions-econo...

[1]http://www.nytimes.com/roomfordebate/2015/04/14/the-worst-ta...

[2]http://www.forbes.com/sites/realspin/2014/04/15/heres-a-way-...
This has really been a great series to read. Does anybody know where this will live when they are done restoring it?
You may be talking about two different situations. "r-w" might be thinking about a build style where compilation just uses the versions of libraries available on the system, rather than going to the package manager on a per-build basis and re-fetching dependencies (so, something more like a C build than a Rust, Haskell, or Node build).

As an aside, and echoed by a few other comments in the thread, what you're calling "dynamic analysis" is what I know as "static analysis", like what I want Coverity to do (watch the build process, and monitor the source that actually goes into each of my build artifacts). "Dynamic analysis" brings to mind something more like Valgrind, or some other tool that monitors and profiles a program during execution.
Who needs an Apple watch? Timex digital watches have been dinging every 60 minutes for decades.
Realistically, you are. There's a bit of lock-in that occurs here: you've spent X% of your career learning the ____ stack, and there's a huge opportunity cost to switching stacks... so ____'s incentives are aligned to make sure that that X% stays X% over time, that you're learning new ____ stuff, rather than their tech stagnating and you being able to use your now-free learning time to learn a competitor's stack.

I don't mean to be cynical - ____ legitimately want to improve their APIs and the experience of working with their software. But that's what makes the "build an ecosystem" business model so amazing if you can swing it: the crazier your innovations, the more you capture mindshare as people try to keep up, and so you're able to make a great profit while attracting the craziest talent.

Insert Microsoft in the ____'s.

Now, for all the Angular 2 programmers out there, insert Google.
https://news.ycombinator.com/from?site=inside.com shows that this is actually the 11th time that awwstn has submitted inside.com as a "Show HN".
Its proving that we arent necessarily two decades off.
Not for the positions I was interviewing for.
He's an okay programmer, but he's got a frankly wacko political agenda (Ayn Rand, Libertarian, racism, paranoia etc.), he's mismanaged The Jargon File by putting in some of his own phrases which nobody else uses, and he's just an all-around unpleasant person.

Honestly, he's kind of worse than RMS, who is merely unpleasant to be around...
> In that case, all the 'poor' consumers that were paying P1 must now pay P* or not transact at all, so they are all now worse off.

Except that P1 and P2 cannot be different unless what you get for them is different, or else the rich customers would also choose P1. So the poor who pay P1 pay less money but in exchange for an inferior product, which is not guaranteed to yield a net positive outcome.
It tells us something might be broken. Could be their applicant pool, and/or could be the way implicit biases creep in.

The way you word it, however, says the problem is that they are "attracting 73% of Asians".

If you want to work in the 21st century, get used to working with people who don't have your same exact background.
Quality-checking the contractors a consulting agency is feeding you feels like the perfect case for a Starfighter-alike "bar exam"—much moreso than the actual Employee-Employer matchmaking that Starfighter tried.
Flexport customer here; compared to working with other freight forwarders abd customs brokers the experience is night and day a better and simpler experience.
Would you be open to possibly having to restrain the patient and force them to take the medicine? Would you be open to shaming then into taking it? Would it be wrong to say that unless they want to be cured, no one can help them?
Because it would be interesting to solve a wider class of problems. And having a deeper insight helps define which data to look at.

Having said that - I'm always bemused that AI is supposed to compete with a hypothetical single human brain, and that the Turing Test is supposed to prove we have AI when we can build a brain that appears human.

Learning is a social activity, not an individual one. Individual brains are useless without social training and access to culture.

And some humans are actually quite stupid.

A machine that passes the Turning Test for a hypothetical middle-of-the-bell curve human isn't so interesting a thing.
Ask HN: What's the current state of remote work/telecommuting?
What's the current state of remote work? I know different parts of the world react differently to this trend.

Do you see this trend going up or down? Strongly or weakly?

If you're a decision maker, have you considered remote worker? If yes, why? If you considered and rejected this concept, then why?
We don't support Windows Phone - just iOS and Android.

Android tablets should work. We don't have native iPad support but we're planning on adding it.
I pinged google.com from the linux3 machine after enabling networking and it worked fine.
Keep asking, and get bigger:)
Um..why is it one or the other rather than both?