skysight-inc/HackerNews huggingface dataset:
I sent a reasonable amount of data to Cloud Storage. It varies a lot. Usually ~10GB/day, but it can be up to 1TB/day regularly.

xz can be amazing. It can also bite you.

I've had payloads that compress to 0.16 with gzip then compress to 0.016 with xz. Hurray! Then I've had payloads where xz compression is par, or worse. However, with "best or extreme" compression, xz can peg your CPU for much longer. gzip and bzip2 will take minutes and xz -9 is taking hours at 100% CPU.

As annoying as that is, getting an order of magnitude better in many circumstances is hard to give up.

My compromise is "xz -1". It usually delivers pretty good results, in reasonable time, with manageable CPU/Memory usage.

FYI. The datasets are largely text-ish. Usually in 250MB-1GB chunks. So talking JSON data, webpages, and the like.
Love these thoughts. I think the code craftsmanship movement really speaks to your 3rd point, but the whole industry is incentivized against it. Especially in SV, if you don't get into a company, make a major contribution, and get out in 3 years then hiring managers start to see it as a red flag. I really love the cross-pollination of ideas this brings, but it also wreaks havoc on stability and institutional knowledge.
I am not supporting a side here. But what exactly is the practical or moral issue with this? Is it that Amazon is squeezing money out of people who want the movie but probably won't use the Prime service otherwise? Is it false advertising where Amazon claims to cater to everyone, but you really only benefit if you use their Prime service?
Global warming transforms coral reef assemblages
In my experience, the person adding the technical debt usually had every intention of going back to fix it, but they were never given the time to actually do it. :)
Thoughts on the generative AI creative economy: there will be blood
People certainly made a fuss about the face recognition trial in the train station.

But we Germans seem to be irrationally against data collection by companies compared to government data collection. Google street view was another case that made this apparent.
I'm counting on TMO to kick Comcast's ass in my town

Is Comcast really that bad? In my admittedly European experience all the service providers are (dis)functional and greedy pretty much to the same degree, none of them are good guys.
By "not a good" you mean an open protocol not controlled by Google?
When I use xz for archival purposes I always use par2[1] to provide redundancy and recoverability in case of errors.

When I burn data (including xz archives) on to DVD for archival storage, I use dvdisaster[2] for the same purpose.

I've tested both by damaging archives and scratching DVDs, and these tools work great for recovery. The amount of redundancy (with a tradeoff
for space) is also tuneable for both.

[1] - https://github.com/Parchive/par2cmdline

[2] - http://dvdisaster.net/
It's a little more complicated in this case than for a typical gardener. The developer works for their manager, their team, but also ultimately for the firm. The developer may well be pursuing explicit goals of the firm, while annoying their peers or manager. And the developer may be right!

Teams reach a kind of stable state. New hires may well represent a desire of the firm to change that stable state. The team may not be on board. Sandbagging is not so uncommon.

In this particular story, the review situation is what particularly raised flags for me. Obviously the author did not situate himself well, but I'm not sure he'd have been happy if he had been more adaptable, and that may be on the team and not him.
Only AT&T shut down 2G. T-Mobile reiterated recently that their 2G network will probably be shut down after their 3G one, since it hardly uses any spectrum.
Or if you're a Beatles fan.
If you win a huge jackpot, the casino withholds taxes on your winnings. However, you may be able to deduct gambling losses from your gambling winnings up to the amount of gambling winnings for that year, assuming you itemize your deductions.
This happened to me, and caused me to rethink my approach file management.

Unfortunately, mainstream tooling is largely fire-and-forget and never includes verification (e.g. copying succeeds even if the written data is getting garbled), so one is forced to use multi-step workflows to get around this. It's pretty discouraging that no strong abstractions exist in this space.
Milestone for next-gen solid-state batteries to power future long-range EVs
Are Americans Giving Up Their Fourth Amendment Rights?
When developing and documenting systems, I find it's really important to document Why you are doing things a certain way. What is done, and how its done can often be discerned from looking at the current implementation, but why needs to be explicitly documented.
> The difference is that one is expected to consent and be beholden to something they could not reasonably understand without paying a large amount of money to a specialist.

I've found that this is generally less true than I imagine it to be. A lot of law is not actually so difficult to understand. Legalese is still English, and Google is great for figuring out the odd meanings of certain terms of art.

Most of the exceptions I've come across (e.g., buying a house) are IMO actually intrinsically complex transactions. I could undestand, but it'd take so long. And the time taken would happen even if we only had the laws we needed and all those laws were written in plain english. In software terms, lots of essential complexity.

Going back to the article, the problem with Facebook's terms and conditions is definitely not understandability -- see https://www.facebook.com/policy.php. The average high schooler could understand. The problem is people caring enough to 1) find, 2) read, and 3) inconviencance themselves if they don't like the policies.
It's even worse.
I've participated in a lot of interviews on both sides of the process.

In my experience, the whole process goes a lot smoother when there's a take-home exercise. It turns the in-person interview portion into a technical discussion about a recent mini-project unencumbered by NDAs and trade secrets.

If you can't quickly determine if an applicant "cheated" on the take-home exercise through a simple discussion, then you may want to recuse yourself from performing interviews.

If an applicant can't make enough time for an appropriately scoped exercise, I think it's likely they're unqualified or they don't value the opportunity enough to make time. Those are undesirable qualities the recruiting/interview process is intended to filter out.
Avicii Dies at 28
Networking effects matter, but only when after you abandon a common protocol in favor of walled gardens.
Something has happened to big banks along the way, where they no longer actually provide banking services to their customers. When I walk into a Wells Fargo branch now and sit down with a "banker" to take care of my accounts, it consists of sitting next to them while they call 1-800-WELLSFARGO for me and talk to a call center. There simply is no service anymore. I walked into my local branch to open up an IRA last week before the tax deadline, and they literally couldn't even do it for me in time because the person on the phone said "we'll do our best effort, no guarantee." I walked up to the teller, asked for a cashier check for the full amount in my accounts, and opened up an account next door at a small local bank (First Republic). They were able to sit down with me and immediately pull up all the paperwork to create and fund an IRA account with no hassle at all right there, no phone call involved. It was like night and day.

These huge banks have simply become way too big, and it serves no one's interest but their own. They have zero incentive to provide actual customer service anymore. There needs to be a massive restructuring of our system to allow smaller banks to thrive and provide actual competition.
> but once everyone in 4G moves to 5G, we’re back to how it is today.

Would there be a benefit to split 50:50 between 4G and 5G?
As a fellow emigrant of `Scala is the best island` forced off for pragmatic reasons.

I've been around scala long enough to see the rise and fall of multiple expeditions into the bowels of the OSGI eclipse cave of horrors (Sean McDirmid / Miles Sabin etc). Before switching horses and settling in Intellij for several years. So I understand where you are coming from.

I've since jumped ship again to vscode (along with typescript), and in my humble experience / opinion, vscode & it's language server protocol (LSP), alleviates quite a bit of this. It abstracts away a lot of common operations from a language to the languages compiler, while providing a consistent front-end. I think if scala eagerly adopts supporting this it would be a good thing. Having a language server protocol applies back-pressure in a certain sense on language features, if you are going to add them, then the tooling (and LSP) needs to support them.
Where does the fine go? Does it get divvied up amongst the people affected by WF's wrongdoing?
We use Scala as the primary backend language at Elastic for the Elastic Cloud SAAS & enterprise products (along with Java, Python and Go).
I wonder how often they get internal suggestions to kill google+ which get vetoed out of brand pride.
> Do not fix problems you do not have by throwing Rust at them

Thank you. I write mostly Node & wanted to try Go for a long time because of performance & then I heard that Rust is even faster. So I thought I would learn that.

But you are right, I don't have any problem with Node. Its working great for me. :)
Care Revolutions (S16) in hiring a full-stack marketeer
Hi

I'm a 2x Founder, serial entrepreneur and growth strategist. I founded and exited online tuxedo rental company SimpleTux before starting my second venture, Renly, an Airbnb for commercial business space, where I am currently CEO. Additionally, I've led growth at a number of startups, including alumni from such prestigious programs as Y Combinator and Techstars. My speciality is growth hacking. I'm sure I can help and would love to set aside a time for us to discuss your goals and how we can accomplish them together. See my startup resume at www.chrissheng.com

Chris Sheng
www.chrissheng.com
Understanding PIVOT, UNPIVOT, and Reverse PIVOT Statements
This doesn't seem to contradict the point. There is a fixed capacity that the network can handle. For 5G, this appears to be a higher capacity than for 4G.

So, yes, more devices will mean less speed for everyone. However, there is more speed to go around, so the same number of devices in a 4G setting will get less speed than the same number in a 5G.

Or is that not the GP's point?
Google Is Indonesia's New Weapon in War on Illegal Fishing
Was the fine expected to be much worse? They're trading up at the moment
Nothing wrong with the analogy; the Prime membership is like a little Costco nested within Amazon.

Costco could run a parallel retail outfit (also visibly Costco branded, like "Costco Open" or something) where anyone can walk in and buy anything, but not some things that are available only in regular Costco.
The purpose of a compression format is not to provide error recovery or integrity verification.

The author seems to think the xz container file format should do that.

When you remove this requirement, nearly all his arguments become moot.
I think these are the relevant parts:

> When assessing whether consent is freely given, utmost account shall be taken of whether, inter alia, the performance of a contract, including the provision of a service, is conditional on consent to the processing of personal data that is not necessary for the performance of that contract.

From https://gdpr-info.eu/art-7-gdpr/ paragraph 4

And the definition of consent is here:

> ‘consent’ of the data subject means any freely given, specific, informed and unambiguous indication of the data subject’s wishes by which he or she, by a statement or by a clear affirmative action, signifies agreement to the processing of personal data relating to him or her;

From https://gdpr-info.eu/art-4-gdpr/ paragraph 11

---

'specific' and 'unambiguous' in combination seem to disallow the "bury it in the TOS" cop-out.

'informed' and 'specific' in combination seem to disallow the opt-out cop-out (since a opt-out permission is never specific, and basically never informed).

Article 7 paragraph 4 (the first quote) seems to disallow the usage of data unless it is necessary for the service.

Of course this is still all pretty untested in the courts, and IANAL but to me it seems pretty clear. If your primary service is not building a machine learning model based on your own users data you will need to get your users to opt-in for that specific use-case.
This isn't about law. It's about what people consider acceptable.

Also precedence is really only a thing in common law countries (mostly the english speaking world) and not most countries in the world.
This is why I refuse to remain a Prime subscriber. I do use the monthly plan once or twice a year (particularly the Christmas shopping season), when I know I can advantageously receive a massive amount of value out of it.

(If you have Prime and buy a new $60 video game, you get like $14 off, so buying Prime for a month if you're going to buy a game is pretty much free.)

Not being a Prime subscriber has afforded me often finding cheaper prices elsewhere. I buy from Target, Wal-Mart, Best Buy, Newegg, etc.

As for when I do shop Amazon: I wait until I have an order big enough for free shipping, which often means I am more hesitant to buy things rapidly and have more time to consider my purchases, it keeps my spending down overall.
> Does Siri understand you well, or do you have any cases where you have to scribble, send typos, etc?

Siri works pretty well in most situations. It doesn't work great when I'm in locations with spotty WiFi and LTE. Siri also doesn't work well when I'm in meetings or on the bus, so I scribble in those situations. I really wish I could use Palm's "Graffiti" instead of writing out the letters, it would be so much faster! I also do send typos sometimes.

> What do you do for taking notes? Do you have a system for processing later on a phone or a computer?

I do not have a system for taking notes on my phone or watch. I use org-mode for my notes so I carry my computer around with me at work as a portable org-mode system.

> Any apps like whatsapp where you can't initiate a message? How do you get around it?

I don't use Whatsapp, but I do use Signal and not being able to initiate a message is very frustrating. I end up using iMessage in those situations, which isn't ideal. I hope that Signal makes an Apple Watch app.

> Do you carry a phone? If not, do you carry a camera?

I don't carry a phone for 5-6 days out of the week. At this point, I only take my phone with me if I want to have a "GPS" or a camera. I do miss having a camera, but it's a small price to pay for being free from the constant distraction of a phone.
What a joke.

Imagine the (UK) government fining every person who wrote something "offensive" online.
FYI - Check your credit card benefits! Most offer free price protection for items you buy with the card, its saved me hundreds of dollars over the years. In fact, I just got a $40 check in the mail the other day for a price protection claim on a TV. And the price protection works on other retailers too - so if you bought the product on Amazon and it goes on sale at Walmart next week, you can make a claim for the difference in price.
Most Costcos will actually sell alcohol to nonmembers, as a probably unintended result of some states' old blue laws.
You are twisting my words. I'm saying there's a significant amount of intelligent people who can think for themselves in other situations that refuse to seriously look at cryptocurrency and have a knee-jerk reaction instead.
Yes.... lack of vision is what seems to define an ISP. Creating content, while 'sexy', is fleeting and incredibly expensive. Delivering the content reliably and quickly is a predictable busy model. ISPs should be clamoring to advertise how they deliver Netflix the fastest, or offer equivalent to Cloudflare's service but for their customers. Instead, we get an XFINITY VOICE REMOTE O.M.G. and a platform thats update once every 5 years.
Again, it'd definitely be possible to write a document more narrowly describing what they need a license to do. But that doesn't solve the problem. The updated version would be more readable for network engineers, less readable for lawyers, and still incomprehensible to the average person who just wants to upload a meme.
A bit more detail here including the lyrics.
https://www.liverpoolecho.co.uk/news/liverpool-news/woman-wh...
Correct, but collectively, between now and 2020 it's almost certain in aggregate, Typescript will have significantly more `features` than Scala 3.0, and they will have the benefit of being used and iterated upon for 2+ years.
FYI, Munro does these taredowns and sells complete plans on every aspect required to manufacture each part.

So expect a clone from China at some point.
> E.g. The poor are usually uneducated. Meaning they can't help with homework.

> Even in poor black American communities, house work is often more important than school work.

You pretty much nailed what I wanted to described earlier. My mother works from home and although she has a bachelor's degree, since the education system (esp. in her times) was poor, she is not even at the level of a high school grad in terms of knowledge regarding math, humanities and science. This is not to mention that she (nor my more educated, late father, who was a doctor) wouldn't be able to help her/his children with their homework due to lack of knowledge/education or time.

One thing I remember though is that after finishing homework, my mom would expect us to help out with house chores like sweeping the floor, collecting clothes from clotheslines, buying small grocery items, etc.
But of course the IRS probably isn't the only entity to which you owe taxes (states and the federal government are separate entities), so the IRS's forms only get you part of the way. What services like Credit Karma do is let you input your W-2 forms or similar (which indicate taxes paid), ask you questions to determine any adjustments you might need/want to make, generate the correct forms to send to the IRS and your state tax agency, and transfer the money you owe from your bank account.

Doing all that by hand is quite a bit more work.
>The lower speed on 4G is mostly due to the number of devices on it.

Is that the sole reason 5G is faster, or will being able to allocate less in idle situations and utilize spatial multiplexing support faster speeds even with a comparable number of devices?
No single person can maintain an entire ecosystem around a language. And programming languages have strong network effects. If I think a language is dying then I won’t want to use it because I’ll worry about future support. It becomes a self fulfilling prophecy and a negative feedback loop.
Reading that instantly reminded me of the Great Seal bug the Soviets gifted to US Ambassador W. Averell Harriman in 1945 [0]

I'm not an engineer, but as I understand it the principles at work here are very similar?

[0] https://en.wikipedia.org/wiki/The_Thing_(listening_device)
U.S. tech giants hiring more foreign workers on H-1B visas
"You haven't?"

No I don't, because it's a waste of space and money. Using par2 and/or dvdisaster I can archive a lot more files on to the same archival media and still get enough redundancy to feel secure.

"Storage is cheap."

Cheap is relative. Are you really buying an extra 2 TB's of storage to archive 1 TB of data, because that's what you'd need to do to archive 2 copies of each file. That's a huge waste of space and money that adds up when you're archiving a lot of data.

If your needs are small or your pockets deep, you can afford to do what you're proposing, but for the rest of us who aren't made out of money it's just not practical.

On the other hand, when I have worked at places which could afford to have multiple archives at various locations, I've made sure each of those archives were protected with par2 or dvdisaster, so I could recover from both rather than have one of the archives fail because of a bit flip error.
From another comment: https://en.wikipedia.org/wiki/300-page_iPhone_bill
I don't have an iPhone, but my understanding was that users had strongly adopted Apple Maps after the initial stumbles.

http://www.betaboston.com/news/2015/12/07/apple-maps-once-a-...
They use similar deceptive practices with Audible. You can't cancel your account without losing the credits you have already paid for. I believe this works so well because people wishing to cancel probably have unused credits but when they go to actually cancel they will have to think twice before giving up their credits or searching for some books they want and then cancelling.
Imagine just putting the spheres in one at a time until you can't put in any more. Why can't you put in any more? It must be that every point of [0.495,0.505]^1000000 is within 0.99 of the centre of one of the spheres. Otherwise you could put in a new sphere with that point as its centre. This means that if we imagine spheres of radius 0.99 around each of our original spheres (which only have radius 0.495) those big spheres must cover all of [0.495,0.505]^1000000. Hence their combined volume must be as large as the volume of that box. Note that I defined V to be the volume of a sphere with radius 0.99, not diameter 0.99 as in the statement of the problem.
Wouldn't your explanation ("if sun absorbed radiation in this way, you would not be able to see it") work exactly the same to explain how the classical arrow of time emerges from the time-reversible laws of classical physics?

(Edit: fusion/fission are atomic processes not properly accounted for in classical mechanics but I hope you understand what I mean. If there is a classical arrow of time there is no need to explain it again from a quantum point of view.)
If you get compression ratios that good, you should consider if your application might be doing something stupid like storing the same data thousands of times inside it's data file.

If you store enough of the same type of data, invest in redesigning the application. There's a reason we all use jpegs over zipped bitmaps...
Huawei working on an emotional AI
NASA Researches Ethereum Blockchain Tech for Deep Space Exploration
You should also write out ECC information.
The argument generalises to Abrams tanks, Minuteman missiles and nuclear bombs.
It's just a terrible way to treat your customers, that's all.

I get having exclusive discounts/pricing. But when you say "subscribe or go elsewhere, we won't sell this to you"... I go elsewhere.

It feels like Amazon has moved very far away from the "focus on the customer" approach they used to have. They should never be giving me a reason to buy from a different store.
Telecoms have the ability today to add more capacity by increasing tower density.
No, by "not a good" he probably means that it's not well suited for low battery consumption expected from a mobile device.

Don't push your words on other people :(
Intel Stratix chip performs over 10 trillion calculations per second
In some Costco locations non-members can get into the food court area to buy Costco fast food. This is outside of the cash registers and the food vendors don't check memberships.
Chase seems to have moved their "hands on" banking to their "Private Bankers" (who you qualify for if you have some minimum amount of money or debt across your accounts).
Why do people use xz anyway? As for me I just use tar.gz when I need to backup a piece of a Linux file system into an universally-compatible archive, zip when I need to send some files to a non-geek and 7z to backup a directory of plain data files for myself. And I dream of the world to just switch to 7z altogether but it is hardly possible as nobody seems interested in adding tar-like unix-specific metadata support to it.
Quantum Radar Could Detect Stealth Planes