skysight-inc/HackerNews huggingface dataset:
> KDB is a single box timeseries

It’s not limited to a single box. “single box” is the easiest setup, but by no means the common use case. Kdb+ can be, and is, used across multiple servers and multiple storage devices.

> the closest open source analogue would probably be using Pandas + a big folder of CSV files

I’m not familiar with Pandas, but I know what “a big folder of CSV files” looks like and that’s pretty far from kdb+. Historical/disk data is typically organized as “splayed/parted” tables, which means it’s column oriented, sorted, grouped/hashed by key columns, can be distributed across multiple devices[1], and has built-in compression. So yes, operating over binary data, with a well-organized physical layout, and some optimized data structures is going to be much faster, not to mention the implied storage/server cost savings.

> Also KDB pricing starts at $100k or something like that.

I wish Kx were more open about this, but this is not very accurate. You pay per CPU core, or for query throughput. The size of your data, or number of users doesn’t matter, so you can start-out for 1/10th this cost. Of course your need for query throughput will correlate with things like number of users/clients and size of your data. But the licensing model is pretty simple, and seems to fit well with how user access scales.

I know Kx makes the argument that the licensing costs are more than offset by the reduced server footprint. Personally, I’d love to see an actual case study that shows costs for a open-source database solution (with some performance metrics/benchmarks), while a kdb+ performance-equivalent solution costs less (and projected to scale for less). I know that’s a complicated comparison, where you’d really need to account for things like developer/admin time/salaries, not just equipment/bandwidth/storage/licensing costs. But it would be great to at least see a cost comparison on the latter dimensions.

[1] - http://code.kx.com/wiki/JB:KdbplusForMortals/kdbplus_databas...
I know Atom is the more popular Electron based editor and it seems to have more plugins, however Code's JS debugging is really painless to set up and use.

I'm sure someone else is going to point out a good Atom plugin but VS Code's JS debugging "just works".
>Islam is not just a religion. It is a very deliberately structured guide for the entirety of society. "Full-stack" social control as we on HN might call it. The Quran is a complete manual that details everything expected and required of a good Muslim, from the food that can be eaten to the appearance of your body.

You are sort of right that Islam was more full stack than Christianity is in western civ now, but this is an over simplification. There were points in Western civilization were the Catholic Church had strong control over western laws.

And while Islam started off with a pretty much unified religious and state body, that hasn't always been the case. The Ottoman Empire didn't use real Islamic law. In the far flung corners of the Ottoman Empire (like what is now Saudi Arabia) they pretty much practiced a more pure Islamic law, but the Ottoman Empire didn't. And it's successor states really didn't either.

Most of the middle east is on a legal system that quite different from Islamic law. Only really the Saudis are following anything that closely, and even they don't do it 100%. The rest of the Islamic world really just uses it as a family court.

The push to bring back Islamic law into full legal force is somewhat new. It's a fundamentalist movement that pushing that idea.

Plus the idea that Islamic law is the only law isn't just a bad idea it's essentially unislamic too. Tazir crimes are laws that rulers make for their people and that has been part of Islam since the start.
PyEntrezId: Easily convert between various gene or proteins IDs
There may be a bias due to the fact that the leaks are only from one law firm, which may have targeted regional markets. Business ties to Asia don't have to mean you were more likely to have offshore companies, but it may mean you were more likely to be a customer of Mossack-Fonseca.
Putting a lot of weight on the "like" part of that statement, I agree - but likely for very different reasons. I look forward to the continued trend of balkanization in political and moral thought, because the lauding of compromise has brought us to the point where we've got two parties bickering over distinctions without a difference. One is statist and the other is corporatist, both equally self protecting and resistant to social change. Looking at the GOP blessed candidates over the past several years it is easy to see why republicans have basically strapped on a dynamite vest this election cycle. I look forward to seeing the democrat equivalent who, being similarly extreme, would either be Mussolini or Jefferson.
Same in the UK, we have kids learning about the sea and rescue at 7 years old. By 16 they are fit, strong and qualified.

But 99% of the job is prevention.
This is a pretty serious changelist for a monthly release cadence. I was a big fan of Sublime Text for a while but began looking elsewhere when we went such a long time with no updates. Atom and VSC both seem to release much faster; they're already very good and I can't wait to see where they are in a year or two.
Show HN: Object.freeze() for Go
Which is IMO preferable to MySQL servers randomly losing sync for no reason every few weeks. I don't care how many tuning knobs MySQL has if none of them makes it work as smoothly as Postgres.
If you click one of the names, it displays an important message:

Please read the statement below before searching

There are legitimate uses for offshore companies and trusts. We do not intend to suggest or imply that any persons, companies or other entities included in the ICIJ Offshore Leaks Database have broken the law or otherwise acted improperly. Many people and entities have the same or similar names. We suggest you confirm the identities of any individuals or entities located in the database based on addresses or other identifiable information. If you find an error in the database please get in touch with us.
> every single product out there got major overhaul/complete rewrite every few years/versions

That's just wishful thinking. Most products do not go through a complete rewrite. They may change dramatically over time, but that's typically due to incremental changes, not a from-scratch rewrite.

For context, I'm working on a project right now that has a reasonable amount of technical debt incurred at least 4 years ago. We're eventually going to have to rewrite big chunks of the app specifically because those parts aren't very maintainable. If they had been written correctly the first time we wouldn't have this issue. And in this case, it shouldn't have been hard to write it correctly; doing things right does not necessarily mean doing them slower.
Funny, I was thinking the opposite... I was wondering if people would actually use this system, and how Amazon would distinguish the naming... part of why "YouTube" is successful, is it stayed "YouTube" instead of "Google Video".

A separate brand for a separate product is important, as anything else dilutes the brand, which is already doing that to itself pretty well. Google has been better than many companies with this imo. Apple, better still.

It will be interesting in how this works out and ties into Twitch, as I think that will be the more natural conduit for integration. As it stands, it's just another place for clickbait sites to embed video from.
Electric cars still use a lot of copper... http://jalopnik.com/ever-wondered-how-much-copper-goes-into-...
Their big expense is buying market share by running at a loss in new cities. One source says only SF is actually profitable.
"I'm a scrotum model, mama. A ball jockey. We think differently than the face and body boys... we're a different breed."
We're in agreement, because I said that the documents sent to her were classified by other agencies and that she had no authority on those documents.

Classified items were sent to her to her private email address. Her server, which she had setup for herself, contained those classified items. That is against the law. It is also against the law to handle classified items in a way that puts them at risk.

She is responsible for the content of her server, and therefore broke the law. That she somehow didn't recognize classified material isn't a defense. The people who sent her the classified materials also broke the law (especially since they may have removed any classified markings from the documents).
Treehouse Introduces Techdegrees: The Next Step in Our Evolution
Does anyone blame these people for hiding their wealth when they know how wasteful government is? Shouldn't we be looking deep underground in government waste and political misconduct?
What if get_bit happens to be deterministic on a particular machine? Then get_fair_bit would be stuck in an infinite loop. This can potentially happen when CPU is so overloaded that executing the bit-flipping instruction takes longer than a millisecond.
It wasn't mentioned that it will cost 25 billion - which btw is a ridicilous high number in comparison to other tunnel projects.
Also for example the Gotthard base tunnel or the Brenner base tunnel are longer and therefor 'larger' then those described in the article.
There are few real-world analogies for the vertical that is Amazon. We don't have brick and mortar construction companies that also are a retailer (as far as I know). Amazon is like a company that builds houses, and will only allow Amazon appliances inside the house, even though other appliances generally work fine. Your buddy across the street has a house made by Google, and their house can have any appliance, which kinda irks you.
Creating a user engagement score for your product
care to shoot me an invite?
http://splasho.com/upgoer6/
I don't agree that eyeballing a list of one law firm's clients says something about all Canadians of Chinese descent. If the data matches your eyeball estimate, it says something about only that law firm's clients.
I'd be down. I'm at Pinterest (Brannan St in San Francisco).
How does checking `get_fair_bit(0)' that the next bit isn't the same as the current help fairness?
I've left Ubuntu quite a while ago so here's my biased version: I'd expect my usb wifi key not to work, to suffer to get my 9 series geforce card to run full speed, to have to fight each program independently to set up my preferred i18n configuration (English language but Italian keyboard with Italian number format and iso date format), to have to mess with dependencies to get a recent official java version running.

plus weird specific things, like at some point I had some issue with 15.04 having different security defaults requiring docker to run with some additional weird flag to let 32bit app run in the 64bit host, something which worked on 14.04 out of the box.
All the more reason to find an alternative to SMS based authentication.

It is somewhat comforting to know that message history cannot be retrieved from WhatsApp or other E2E apps like Threema.
Ha! Yes, it is disgusting. Can you imagine applying for a job and the employer finds out that you are being investigated by the FBI. I would imagine that there would be some questions/concerns about hiring you. You can't just brush it off and say "Oh that, don't worry about that."
You've been downvoted, not sure why. But this is true. Lifeguards mainly tell people not to go in where it is dangerous.

Like I said in my previous comment, if you get into trouble it is very hard to see you let alone get out to you and save the day. You are responsible for your own safety.

We used to red flag the beach (no one in the water apart from local surfers) then at the end of the day take the flags down and get ready to go home. Every time some idiot would go in for a swim... as if the flag was the thing that made the sea dangerous.

If you go in the sea, be prepared.
Reflections: The ecosystem is moving
Each history file contains it's internal name, much like a file system has an inode # that is the internal name for that file. We call the names "keys" and you can dig out the inode key like so (every delta has a key, the first delta is called the rootkey):

$ bk log -nd:ROOTKEY: -r+ slib.c
lm@bitmover.com|src/slib.c|19970518232928|52808|f3733b2c327712e5

The key is user@host|relative path|UTC|checksum|64 bits of /dev/random
and they are guaranteed to be unique if your DNS config is correct (we don't create duplicate keys, look for the uniq db in the code).

The way we version the entire tree is simple, it's logically (implemented differently for performance):

<rootkey> <delta key>
<rootkey> <delta key>
...

where each rootkey uniquely identifies a file and each delta key identifies the tip as of that commit.

Not sure if that is clear enough or not, ask away if not.
Wikipedians are often wrong, but have learned to be more vigilant regarding claims about public officials.

Selective sourcing and misdirection are even easier when you own the "media" outlet. Brock's takeover of Blue Nation Review is a shameless reshaping of liberal media to fit the Clinton agenda - a super PAC aligned with a candidate owning a "news" source.

It's probably a smart political move this election, but along with the $1M Correct the Record push for online messaging, shows how Clinton can't gather the kind of young grassroots support that Obama and Sanders could.
I reloaded and it worked.
Life as a Female Developer
Uber Recognizes New York Drivers’ Group, Short of Union
I think there's a fine line there. From what I understand from whatever corporate training I went through in the past - if there's a job-related activity like team dinner and then some ppl go to the bar for a few drinks - this is still 'job related'. Same goes for business-related travel and so on.

In this particular case though - a weekend conversation after an explicit request to take it private - not sure if this qualifies as "job related".

And even if it somehow does qualify as being 'job related' I guess my point is that I can see how by agreeing to switch to whatsapp the signal that she sent was 'yes, let's talk in private' and if he's the kind of dude who calls someone he barely knows a 'milf' I can totally see how in his mind this was 'yea let's hook up' :)
Rumors of Scala's dominance at Twitter are slightly exaggerated. While it's true that the non-revenue-related backend is almost all Scala, on the ads eng side, it's almost 100% Java. Which language a new project is written in has more to do with who's writing it than anything else.
semi offtopic because my anectdote is more about the compactness of the genitals than their size:

i used to live in firenze and there is a statue of neptune(o) in the palazzo vecchio

once i was walking past it with a friend and i told her it was one of my favourite statues in the city

and she surprisingly responded, 'of course it is'

i asked why it was so obvious and she said, 'well, look at his balls'

"what about his balls?"

'that's an old man with the balls of a prepubescent boy'

now, you could make an argument about the models used or some social aspect of the times or artist but i loved where she went from there

"interesting, go on"

'it's a clear fetishising of immortality, to think you can be old with such a tight young body is the pure representation of a god, the immortal'

wisdom of experience, strength of youth

(o) https://en.wikipedia.org/wiki/Fountain_of_Neptune,_Florence
Almost nobody actually used Swift prior to mid-2014. Did any 1978 C compilers offer both K&R and prior as options?

IMO the example of Java is a great illustration of why Swift shouldn't be tied to source compatibility too soon. You don't want to be stuck supporting your 1.0 syntax until the end of time, or you'll end up like Java!
>...encrypted apps use SMS authentication to identify and authenticate users participating in encrypted conversations

Is this true? Because it's common knowledge that SMS is insecure. So I don't understand how why anyone would want to use it for secure authentication - especially in the case of Whatsapp.
Have you tried hiding the Hillary/Trump posts and interacting with the friends whose updates you want to see?

Or you could just install Social Fixer, and control your feed that way. However, in my experience, it's quite hard to produce a better feed than Facebook's AI...

http://socialfixer.com/
Is that your site? You have a spam problem in your comments.
"Big" name? Ehh... maybe 15-20 years ago.
In short, RCS maintains a clean copy of the head revision, and a set of reverse patches to be applied to recreate older revisions. SCCS maintains a sequence of blocks of lines that were added or deleted at the same time, and any revision can be extracted in the same amount of time by scanning the blocks and retaining those that are pertinent.

Really old school revision control systems, like CDC's MODIFY and Cray's clone UPDATE, were kind of like SCCS. Each line (actually card image!) was tagged with the ids of the mods that created and (if no longer active) deleted it.
…in Number Theory.

Also: license is GPLv2+, so they seem to think this is software. That makes some sense.

(And moderators, please fix that typo; mathmatical is spelled with an 'e')
I'm interested to know what German, Dutch or Norse-descendant speakers think of that.

I'm learning Danish, and reading that is similar, but easier, to deciphering letters from the electricity company.
It's FBLearner Flow, not Flow
"If everyone did that", yes, but everyone isn't. That's where marketing is important. I wish Elementary.io were a fully-assumed for-profit able to trigger a snowball effect of customers around a Mac-level quality. Especially as Mac OS X quality is decreasing.
I took OPs comment of "sound Chinese/Korean" to mean that OP was unable to distinguish Chinese and Korean names.

I interpreted OP as something like "East-Asian appearing names, but not Japanese since those are more distinctive to me."
I think you sort of have to look at how SNAP evolved. It was the result of what was deemed to be an iterative series of improvements. Way too low-res, the sequence was "commodities" to food stamps to SNAP, with generics and store brands also evolving out of the same ferment.

SFAIK, the principal ... principle driving this was administrative cost reduction on the government side - reuse
existing buildings and people.

And then it ties into the crop subsidy system, which is generally awesome in that it prices risk from shortage almost to zero at a cost in mild to "OMG!" overproduction.
I don't think that's what he's saying, and if any attempt to talk about the behavior of China's nouveau-riche -- a small, but comparatively very wealthy subset of Chinese investors in Canada -- is reduced to race-baiting about something which nobody seriously believes is characteristic of all Chinese immigrants (and which is the product of China's government's policies, not the investors' disposition) or for that matter even most of the recent ones -- after all, the vast majority of people are not wealthy -- then how can we ever reasonably discuss it?
Thank you for the clarification. I suspected the "by" portion might be key, mainly because it felt like it was missing (and thus a requirement). That it helps distinguish the meaning makes sense.

I really should spend some time to research the mechanics of my native tongue, rather than rely on what sounds right and the simplistic rules I can remember from primary school. This has been on my mental to-do list at different times over the years, but I always seem to have it de-prioritized and then I forget about it. :/
Note that this is a 1997 paper, seemingly written before Kasparov's rematch and overall loss to Deep Blue. I imagine there have been more ideas that have become standard in the 20 years since, though machine learning still seems to not be used much.

Blatant self promotion for anyone interested in this subject, I wrote up a series of blog posts about the evolution of Chess and Go AIs with some more detail and pretty pictures: http://www.andreykurenkov.com/writing/a-brief-history-of-gam...
Yes. Why should I, and everyone else, pay more taxes to cover their fair share?

I definitely want government to be less corrupt and wasteful (though I think the situation is greatly exaggerated, and the U.S. government is among the least corrupt), but somehow we need to pay for those services.

If they want more or less services from government, they have a chance to convince their fellow citizens to vote for what they want. But an essential part of the deal is that, once the law is written, like it or not we're all covered by it. Majority rules.
It's expensive; it spins for a millisecond to obtain one bit.

Suppose this is running on a quiescent system with no interrupts or other tasks running. I can see it degenerating into deterministic behavior. Suppose the RTC counter and the CPU clock are from the same master clock, and the code is executing cleanly to the clock from on-chip caches.

Ultimately, the question is: is there really one bit of entropy from each call to get_bit(), and under what conditions?
> This would be one way to ensure most videos are high quality.

I'm not so sure of that - Amazon can't possibly police every single video to ensure correct closed-captioning. There are likely tools that can take a video, rip the audio stream and machine generate a subtitle file for you. If you have a person uploading a family video this will pass the "good enough" bar for you. You'd get something close to Youtube's automatic closed-captions.
Little kids with chromebooks.
You are confusing "accept a limit order" with "purchasing a call option".

Once you've accepted the order you are legally obligated to deliver in T+3 days. If you fail to deliver you pay big penalties, your broker shuts you down, all sorts of bad things.
As I was entering various first names, the number of chinese surnames stood out to me as well.
Interesting, just reading about it, or seeing the videos, make me fell uncomfortable. Guess that must be some research about this "empathy" somewhere.
If you think of each slide as a separate page, as some do, it makes sense.
I'm similarly ambivalent. Though Elm and it's flavour of FRP were more of a hobby (I never turned into an academically valuable thing :) ), I was still very interested in the roots of the system and how to use and improve it. I know the change was happening already, that signals were not used much in the Elm Architecture; I also understand and applaud the simplification. But I'm still a little sad to see FRP go, it's an interesting idea and does have potential IMHO.
> Does anyone blame these people for hiding their wealth when they know how wasteful government is?

Yes.

> Shouldn't we be looking deep underground in government waste and political misconduct?

We can do both.
dupe, please check before submitting!

https://news.ycombinator.com/item?id=11668069
I'd rather they waste everyone's money equally. Not just the people who play fair.

Taking care of waste is a separate problem.
How many transactions per second? Is all this really necessary?
If the conductor sits around twiddling his thumbs all day long, what is the point of him existing in the first place? For a fully automated train system, what useful function does the conductor serve?
r3bl: Any chance Wikipedia links could be associated with the records?
MIT's press release: http://news.mit.edu/2016/international-team-launches-atlas-m...
Because the broker isn't doing the front running. That's why it isn't the currently illegal kind of frontrunning. They sell the data to other participants who have faster internet connections than you.

Basically any time you send a "smart" routing order, it is actually the least smart thing to do (unless you REALLY need the liquidity). Your trade order gets sent to all the exchanges, and ah I don't really feel like explaining it.

tl;dr Someone intercepts your data packet to one exchange, and alters the liquidity on the other exchanges, so you get a partial fill and then adjust your order at the slightly worse price.