skysight-inc/HackerNews huggingface dataset:
So the question is compression ratio...

So lets assume that amazons cia/nsa op datacenter is receiving these 1PB a day messages.

Lets assume they use a tool to remove certain very common words and an algorithm whic can replace the hidden words later if they want to restore the messages.

Text compresses really well.

And if you have a replacement dictionary, even better.

The most commonly used words:

https://en.m.wikipedia.org/wiki/Most_common_words_in_English

So you have a simple key-value store....

And compress that text even further.

So what can we get a PB down to if we use that thinking...

—-

Hey has anyone noticed that palantir Has stopped their employees from wearing their swag on bart and disappeared from reddit and HN?

Oh and all the nlp competitors went silent??

Yeah, deep state data processing market is booming.
Pirate Bay doesn’t have lots of stuff and if it does, the quality varies, sometimes they have baked in subtitles in foreign languages, etc.
> You cherry-pick a one-off example (# of clients) and ignore the rest. Feel free to remove that one if you don't think it is pertinent, and address the remainder of my comment.

> You also cherry-picked the letter. Yes, 5 years after a history and pattern of security negligence, they are now able to repeat that pattern on H1. Hurray, positive delta.

Those were the only two arguments you made to support your claim that Valve's bug bounty program is not as good as it should be. You're accusing me of "cherry picking" because I responded the only two arguments you made. This is just laughable, and it eliminated the rest of my doubt as to whether or not you're participating in this conversation in good faith.

Let's recap your previous comment: Your first paragraph didn't make an argument, it was sharing your opinion that you think Valve's management of their bug bounty isn't up to par and that highlighting the fact that they have paid out hundreds of bounties amounts to "bragging". Your second paragraph is where you make the first actual argument, the claim that we should be able to hold them to a higher standard because of the ratio of their client install count and employees. And you added the link to the letter in an edit below that.

I respond to both of the claims you made (the client vs. employee count, and the letter) and now you're saying that I'm "cherry picking" because I'm responding to the two arguments that you brought up.
International Pressure Shapes Political Decisions – The HK Be-Water Movement
>It seems like you would have to prove it is gross negligence though.

Storing PAN's in clear text is a violation of many, if not all, payment networks, be it done by a Merchant or any intermediary. The citation I will show below is MasterCard specific, but should not be considered restricted to that network.

> It's not their fault if they lost a database to a 0day or if they were otherwise doing everything reasonably correctly.

Actually, it very well can be. And, in this case, it almost certainly is the Merchant's liability (fault) due to not adhering to security standards. For reference regarding same, see the MasterCard "Security Rules and Procedures" document's "Chapter 10 Account Data Protection Standards and Programs"[0].

0 - https://www.mastercard.us/content/dam/mccom/en-us/documents/...
>The manager is already being paid to manage people and, as you point out, usually at a higher rate. In my opinion this is simply part of the job.

Just like an engineer is paid to write code and review code of their teammates. However, a teammate that pushes unreadable mess for reviews and requires tons of code review comments and iterations to get it to anything even resembling something functional is a drag and overhead for the rest of the engineers.
Oh I totally believe it. An ounce of prevention is worth a pound of cure.
Guns, Pills, & Marketing
Non-Sales Founder and Need to Sell? Sales Loathing to Loving in 5 Minutes
This is why I enjoy HN community
Anti-Eczema Diet of Lamb and Cheerios Leads to Boy's Vision Loss (2017)
Why All Eyes Are on Billie Eilish, the New Model for Streaming Era Success
There is no compulsory license for on demand music like Spotify - only music where you don’t get to choose your songs. Do you really want a Pandora like service for video?

So if we want to make their content compulsory, are you okay with making software licensing compulsory?
Rent, healthcare, etc. Some have 401k accounts, if they are lucky, otherwise you have IRAs which have an annual contribution limit of $6000, IIRC (am not an expert and am likely wrong on that point). Pensions are unavailable and housing is out of reach for most.
Mongoose Cricket: Shutting down after investing $130K in glitzy marketing
Choosing to include nothing by default is easier than having the argument about which modules meet the "highly desirable" standard.
It's well past time for there to be a mechanical license for streaming copyrighted video content. This lock down garbage is just that. Copyright is a joke that provides zero benefit to the public, little benefit to the starving artist, and almost all the benefit to the mega corporations. Sonny Bono is a plague on creativity and his law was even worse.
Interestingly we did a survey such as this on our massive danish government and it turns out that since the 1950s there has been a 0% productivity increase, the wages have however followed increases in the private sector.
Or if you’re at ARCO in Oregon, you can avoid 35 cent undisclosed debit fees.
>It's unrealistic to expect cigarette smokers to quit over night and start using patches and lozenges.

>It's a little more realistic to expect that people who vape to do so.

From personal observations, what would actually happen is that those people will just switch to smoking cigarettes.
Why feel nostalgic? You still can.
What We Know We Don't Know (2019)
Why did you remind me of iGoogle, I miss it so much :(
Its possible to write bad code with or without any framework.
Are you sure what ICE is doing is really all that much different and what’s instead dramatically different is your awareness of every even borderline thing ICE is doing now?

Just how familiar were you, or are you for that matter, with the full scope of ICE’s activities circa 2015?
or just run your debit card as credit and don’t play with snakes?
Learning document embeddings along with their uncertainties
Due to divorce, not unprofitable shovels.
Your whole first paragraph is about the web, which the OP specifically said they weren't talking about.
A hardcoded trie for string matching, perhaps?
Seconded. I often just close the browser tab when I encounter a site built like this.
Who uses the Pivotal distribution of Kubernetes? Why?
You mean software companies owning their own aggregator storefronts? Yes. I'd for banning Steam or Epic from both making games and owning the storefront if it meant Apple and Google had to give them up too. No one says music companies or even movie companies can't sell their own stuff on their own site. What they are saying is that just like the antitrust laws made it illegal for movie companies to also own the theaters, no one in thIe digital age should be able to vertically or horizontally monopolize either. I.E. The law that already exists should apply today too.
A little too technical. This link may help a little to understand the previous work:
https://en.wikipedia.org/wiki/Carbon-12#Hoyle_state
Many people download binaries from the internet.
https://github.com/Zip-o-mat/Slic3r/tree/nonplanar/lib/Slic3...

arcfitting, motion planning, pressure regulation

https://github.com/Zip-o-mat/Slic3r/commit/9fcd7f38de44ecaa0...

edge detection

then some random other random geometric stuff.

I'm sure its way more complicated than that. Not something you pick up in 10 minutes.
We should be having official 4 hour workdays. State mandated.

We can only do about four hours of solid work. There’s really no tricks to productivity. Just trying to mask fatigue, I suppose.

But me? I don’t do any real work until after lunch. Maybe a meeting, to manage my managers, of course.

I learned this just in recent years tho. Before that, I was as neurotic as anyone.
This post was such a ride.

At one point they found a fucking legitimate reason to compile a javascript interpreter to javascript(wasm) to run javascript!
It's slightly worse for white men in the West who had a historically unique period of prosperity immediately following WWII. It's still nominally better for them, it's just not relatively better compared to everyone else. It's better for women, it's better for minorities, it's better for immigrants, it's better for the billion people who escaped poverty since just 1990. What are the big complaints compared to 50 years ago? If you happen to live in some of the best places to live in all of human history it's harder to buy a house?
What about a daily, and monthly option?
So you reckon EO's calling him "Peeping Tom Bertrand Russell" because in one of his essays he calls a particular view of God a "Peeping Tom"? That would be ... strange, but I suppose you might well be right.

(I'm familiar with that essay, but didn't make the connection because, well, the fact that someone uses a particular phrase once isn't any reason to apply it at random to them in turn.)

Incidentally, I'm not sure it's exactly right to say that Russell started out doing good technical work in philosophy and then turned later on to anti-theism. E.g., A Free Man's Worship (not exactly anti-theism, but in the same ballpark) is two years before On Denoting (the paper introducing his account of definite descriptions).
Sure, but when it's a binary you only do it once, at which point seconds (or even a couple minutes) become mostly a non-issue.
Depending on the RDBMS and the target text (ideally, you’re looking to compare an entire column to the search text, and in a known character set, and known casing, etc.), I’d take one of two approaches:

1) write a UDF—in C, or for SQL Server, in pretty much any managed language—that returned the Levenshtein distance between a passed param and a column name, with a “max distance” param to aid in optimizing (e.g., maybe it doesn’t bother calculating the distance if the length difference exceeds the max Levenshtein distance)

Then you could write a query that looks something like:

SELECT product, description WHERE levenshtein(`fobar`, product, 2) <= 2

-or-

2) if you only care about a distance of 1 or 2, create a set of secondary tables where you’d pre-calculate the permutations of every word, with a FK pointing back to the PK of the actual row.

Alternately, a combination of a Levenshtein distance function and an RDBMS that already supports fuzzy text matching seems (to me) to be ideal.
I'm fascinated by this problem: How would consumers navigate a third-party aggregation application? It seems to me there needs to be a free "Kayak"-like service for film & tv discovery. Show me only what I can watch for free (because I already subscribe to my favorite channels). Develop the application on every OS that I watch content (TV, Mobile and Web).

Would consumers like navigating a UI similar to Pinterest (boards) or Spotify (playlists) on your TV? It works well for images and music...
Its true, addiction is a troubling disease
That's right: you should bark out "K9" instead.
You go to any Starbucks and ask the person operating the register to cash you out. They push the button designed to facilitate this.
The wikipedia article says he was a millionaire.
Maybe Carbonblack can compete with Crowdstrike a bit more now with vmware backing them?
There's not going to be everything unfortunately. What was your site on archive.org?
justwatch and reelgood do this well but need more applications.
Facebook is hiring journalists to curate the news again
I used mediatomb ages ago, and now Kodi (formerly XBMC). Works great.
Do not take your security team for granted. They're already doing more than most, sadly.
The planet needs a new internet
Clojure is by far the best programming language I've ever used. Rich Hickey's Sermons On The Mount changed the game of programming once and for all. With Clojure you could finally have your Lisp cake and eat it. Witness the sheer chutzpah of the guy when he basically told Ruby devs they were doing it wrong at Rails Conf in 2012 (https://www.youtube.com/watch?v=rI8tNMsozo0).
I was wondering how NR1 worked out. Seems not great to me...
Would you classify this as a new version of a reverse merger?
L. Strauss and W. Fargo did okay and they were in the same category.
I don't know if this was financial engineering because Dell bought EMC/VMWare but it was the smaller company, so this is a way to just increase the ownership they have rather than take cash out of the company which they use to make purchases. I'm not a FA expert, only TA, but that's my thought here.
yeah pgtrgm works really well for detecting typos or almost-matches.
I"m having trouble really understanding what is going on in the linked conversation, I hate to admit it.

The most simplistic interpretation I have is China and the US are playing a game of financial chicken. US raises tariffs and China lowers its currency. At some point, based on China's slowing economy and debt load this could trigger a major global recession since China will no longer be able to prop up economies that have been relying on its cash to purchase imports (e.g. Australian resources). In fact, China probably has to do this anyway at some point in time to offload the accumulating bad debt.

If anyone can ELI5 for me I would appreciate it. My impression is that Trump is betting China may just be desperate enough to seem stable (from an economy and currency standpoint) and may actually be willing to concede to his trade war. The guy in video seems to be saying that China may just accept some currency devaluation (other rich countries have done it and survived) and use the opportunity to fix some bad debt in their economy. If they do so, and they may just do so, then they can choose a policy that minimizes impact to their internal economy. That would likely cause major problems for everyone else.

I'm having a hard time seeing a good conclusion to this mess if I'm understanding correctly.
Most Americans don't have student debt to pay down (44million), nor a 401k (55million). Most young Americans are just trying to get by, I'd imagine "wealth" isn't a reality for most, outside of maybe emotional wealth.
Yeah, but content producers still haven't realized that our time is more valuable than their usually garbage product, their product is overvalued, and no one feels bad about pirating because copyright is so fundamentally broken by the same content providers that the contract between the public and producers has been totally violated.
I wish Javascript, etc. had hexadecimal floats. It’s annoying to worry about whether different implementations might parse your numbers differently, worrying about whether you need to write down 15 or 17 decimal digits, ...

Often the numbers (e.g. coefficients of some degree 10 polynomial approximation of a special function) are not intended to be human-readable anyway. Such values were typically computed in binary in the first place, and the only place they ever need to be decimal is when written into the code, where they will be immediately reconverted to binary numbers for use.
been jumping into clojure lately myself. after years of js fatigue I've been dying for a functional pairing to elixir on the backend. clojure is growing on me with its nice hot code reloading and macros. (babel is basicly an overgrown macro)
The Dizzying Capabilities of Mathematica's Import Function
I've spoken at a few conferences over several years. I feel (and the feedback seems to reflect) that I've had some good talks and some that maybe weren't so good.

IMHO, perhaps the most important thing is to know your subject inside and out, upside and down. Given that, you can speak freely and ad-lib colorful comments to fill time if needed. You are also a much better Q&A responder.

The soft skills count for a lot, too. But I think super-deep knowledge is a must-have.
I've always been extremely impressed with Wolfram Mathematica's import function. This one call can handle importing images, text, file I/O, optimization files, geographical file formats, genetic encoding files...etc etc. The consistency is what is truly impressive here as even though Python can probably do much of the same things, each type that isn't built-in uses an entirely different library with different conventions.
My Roku TV does this - you type in a title, and it will show you what apps provides the movie, the prices for each, etc.
I came to say this. rlwrap is so good. I honestly have never bothered using readline since I found rlwrap. I just wrap my command with it and move on.
Ask HN: What languages / frameworks to learn now to become more employable
I've worked with a handful of technologies in my short career. My current position is mostly legacy ASP.NET (framework MVC and a bit of WebForms). Prior to that, I was using PHP and before that I did some really insignificant freelancing using Node.js and a few other JS technologies.

The problem is, it's a pain having such fragmented experience. I don't have a more then a couple years professional (i.e. on the job experience) with any of that tech. The only one I fell comfortable with at the moment, is ASP.NET and C# and hell, I don't even have a PC running Windows at home anymore.

When I stopped paying attention to the trends, I think Node.js and React was the popular stack, angular was (sort of) maturing and Vue was up and coming. I also remember Elixir and Phoenix being touted as a rails killer ans something to watch, but am not sure what became of it. But I'm wanting to learn tech that will get me a job I will enjoy more, but I have no idea what's best to invest in. My jobs have typically been full stack, but I'm more comfortable on the backend. I've looked at learning Python (Flask, Django), Elixir (And Erlang, but when I tried to last, I gave up after having issues mentally parsing the list comprehension syntax) and even Go, but I'm not sure how well the job market is for any of these, especially for someone with no experience. I also have very little experience with frontend JS frameworks, embarrassingly, but those seem to have slowed down form a while back.

What new(ish) tech would you recommend to learn, that will be valuable to employment at least in the short term?
What’s the marginal value of this kind of list though? Call me cynical but I would assume data of a similar type and quality is already readily available
When Martha Stewart went to Jail over $45,673.
Ah yes, the subtle distinctions between escheatment and breakage, my two old friends.

A nice Google search proves why this can be so complicated: it's actually very important and the best blog post about it is this one https://blog.agilenceinc.com/making-sense-of-unused-gift-car... (it's not very good)
I actually believe that the present and the future are bright. Pinker's last book does a great job at showing how we're all simply victims of recency/availability/selection/confirmation bias when consuming the news. The world is getting dramatically better, it's our perception of it that is getting constantly worse.
On my machine I have ~1500 packages. I don't really care if a few are very large, but on the whole, they have to be pretty small. My SSD has limited space and I'd like to use it for things where IO performance is important for the tasks I'm doing. That random package I don't use that's pulled in as a dependency for a feature I don't even have enabled takes up space.

E.g. if you use protobufs for C++, you probably don't want to pull in all of ghc so protoc can support haskell. You would rather use that space for ccache or something.
This is feature that is/was present in other applications, such as ICQ and talkd.
Interlink. Like cellphones allow you to choose the UI you want to call the person you want on any network, I think the future should be all services cross licensing content.
You are seeing the effects of this "manipulated" exchange rate in American real-estate in every metro-area.

One thing you have to understand is, the exchange controls are for plebs, but the connected including the members of Politburo and State Owned firms (directly or indirectly), can happily get dollar in exchange of the funny money and buy REAL assets across the world. It can viewed benignly or nefariously based on what you think their end game.

But its effecting every one especially if you are in real-estate but also other things.
Yeah and you can drive dangerously with or without traffic lights. That doesn't mean traffic lights turning green in both directions at once isn't a disaster.
Who's going to set things right other than the children of the talented and capable?
Or just don't be a prick and write your own readline if the terms of the GNU version are not to your liking.

HN is a strange place where people will bemoan piracy but salivate at ways to workaround the GPL.
This reminds me of You Suck at Photoshop
Let’s take that to the next level.

Microsoft couldn’t sell third party software that integrates with Office. GCP and AWS couldn’t run marketplaces that sold services from third party companies like ElasticSearch and Mongo labs. Who would be hurt worse if AWS stop selling ElasticCo and Mongolabs hosted services and just sold their own ElasticSearch service and Mongo compatible DocumentDB?

Walmart couldn’t sell Walmart branded goods. CVS couldn’t sell cheaper versions of name brand drugs, restaurants couldn’t sell name brand sodas and their own food.

How far do you want to take it?

Seeing that if Netflix couldn’t create their own content and had to buy content from third parties do you think that would help Netflix more or give other studios even more leverage to raise their prices?

What if Apple said fine - we can’t offer Apple Music and Spotify so we will just kick Spotify off the platform and not allow third party games and only allow games through Apple Arcade.

They could also kick off Office and force everyone to use iWork.

But why stop there? Let’s also make a law that says Apple can’t sell third party accessories and Apple products in their physical Apple store and Google can’t sell Pixel devices along with third party phones on their website.
Google does too. I'm talking about discovery - most people don't know what they want to watch when they sit down in front of the TV.

I've found myself scrolling for 20-30min sometimes just looking through Netflix, then Prime, then Hulu, then HBO... just to end up watching Friends again..
According to the US Census data, the percentage of households that are low income is smaller than ever.

https://fee.org/articles/why-our-shrinking-middle-class-is-a...
This looks similar to node-red
~/.inputrc

set show-mode-in-prompt on
set vi-cmd-mode-string "cmd:"
set vi-ins-mode-string "ins:"
Spoken like someone who doesn't know/remember using a slow connection...
> One thing those foods have in common? None are a good source of vitamin A.

Indeed, when the doctors measured the levels of vitamin A in the boy's blood, they found that he had a vitamin A deficiency. The boy's blood levels of vitamin A were 14.3 micrograms per deciliter (ug/dL); the normal range for this vitamin is 25.8 to 48.7 ug/dL, according to the report. Cohen said the boy's deficiency was severe.

I didn't understand if the diet was home-developed or was prescribed by some doctor. If it was the former, why simple supplements weren't added ?