skysight-inc/HackerNews huggingface dataset:
I worked on a system that generated around 500GB-1TB of log data monthly. An estimation done way before it was put in production said that it would generate less than 100GB/month, so the DB storage was sized accordingly (~6TB, half of which were used for other data). A change that came later in the project (on a different system) was disregarded, but it increased the application traffic by a factor of 5, and the space estimation was not updated. So it was an interesting surprise when the space started filling up way faster after the go live.

To make the issue even more interesting, the system was mission-critical at five nines and the log data was sensitive + had a legal requirement to be kept online for at least one year, for queries. So deletion was not an option and the migration had to be done online.

Fortunately the system used Oracle DB and the log table was partitioned by date. Unfortunately, a partition kept three months of data, so it could reach the full amount of free space on the DB. There was no easy way to add storage to that server, but we did have some space on another one, with lower speed (the prod DB was RAID10, the other one was RAID1)

In the end we had to create a new partition scheme, with monthly partitions stored in different tablespaces, create another table with the same structure and switch it with the online one (a couple of seconds of downtime), backup the database and restore it on the slow storage, then delete the old table structure and tablespaces/datafiles to free the space on production.

A procedure was created to detach the oldest partition from the production database and reattach it to the slower database (where we also implemented compression at a later stage). This meant that the query system needed changes to work with both databases, but at least the system was up.

The good thing was that in Oracle you can detach partitions and tablespaces and transport them to a different database without downtime. I don't know MS SQL enough, but I understand from the migration procedure that this is not possible there. I guess they did that manual daily partitioning by table, but they did not store each table in its own datafile, so it can be moved as a whole (maybe with downtime, but at least it would free the space faster).
Thanks for the link, video is very informative.
Beside,That option has gone now, which means It was by mistake accidentally shown to us. Most probably they are experimenting some new feature on quick experiment tool!!!!!
Ask HN: Is it safe to analyse your DNA?
Yesterday I saw this video https://www.youtube.com/watch?v=f0QJvZlEDNo where one of these doctors recommend to test your DNA to know your weakness and anticipate future problems and prevent deseases. Although, recently I read about a data breach from one of the major genetic analysis companies. I'm concerned about privacy and future threats that can appear with your DNA in the wild. I feel like I'm giving away my private key, which obviously is impossible to replace. What are your thoughts on these matters?
Indeed Prime
Indeed Prime tries to encourage employers to think about such candidates by using coding tests on its platform, aimed toward showing employers than “non-traditional candidates” are even as skilled as children beginning of the halls of academia.

Seen helps employers more easily connect with not just some of the toughest to fill tech roles Indeed data shows that the toughest to fill tech role within the US is programmer , where the bulk of job postings lie open for over sixty days.

In addition to serving a broader range of job titles, Seen has many other benefits for those trying to find their perfect match. Such benefits to job seekers include free, personalized career guidance that gives everything from webinars and work style assessments to one-on-one career coaching sessions. Additionally, personalized resume reviews are going to be provided to all or any tech candidates, providing videos unique to every individual with recommendations on the way to boost their resume.
So you're paying roughly 72,000 per year? Or are you using SSDs?
Just in case you're not aware, there is a new and much improved free Kasa library in the works: https://github.com/python-kasa/python-kasa

It's already been working perfectly with my HS103 and HS110 plugs for months. The only thing still missing for me is the per-plug energy meter of my HS300 strip, which I hope will be coming very soon.
http://archive.is/PcEku
What is bitcoin if not a distributed ledger?
Why would oil companies not benefit from economies of scale? These aren't Bain-style leveraged buyouts.

It's true that once a company gets a lot of market power, either as a buyer or a seller, it causes problems. But by this logic, why not breakup Walmart first? There's lots of documentation on how they push supplier cost so low that suppliers are practically going out of business selling to WalMart. Google seems less problematic than lots of companies.
> In 2018 YouTube went on a deletion/censorship spree in the name of racism, deleting 50mil videos in the process. But it was clear that they only scapegoated racism as the reason, because only 1% of the video they deleted was racist. [0]

Huh? "In the name of racism", but the source in that story is Youtube itself, and they're the ones giving the breakdown of why videos were deleted:

> YouTube says that most of the videos it removed — 79.6 percent — violated its policies on spam, misleading content or scams, while 12.6 percent were removed for nudity or sexual content. Only about 1 percent of channels were removed for promotion of violence, violent extremism, harassment or hateful or abusive content, although videos of that nature have attracted the most scrutiny in the past year.

The source seems to be https://transparencyreport.google.com/youtube-policy/removal...
Another neat command added to the arsenal. Thanks for linking this here.
I’m very proud to work on these products, those close to me are aware and fascinated by it. It’s always an amazing source of conversation, jokes and is genuinely interesting.

I wouldn't say porn sites are the most regressive (or otherwise evil) thing in the world, by any stretch. There's much, much worse stuff going on out there.

But the complete absence of any introspection as to the obvious negative side effects of the product he helps push -- not to mention the notoriously exploitive aspects of the industry that creates that product -- all wrapped up in an almost sheepish "What's not to like?" attitude --

is, sadly, quite typical for Big Tech.
Exactly. Why not break up Berkshire?
Blender isn't competing with those programs, because those are a different type of software. Those are renderers, not 3D production suites. And two of the renderers you listed can be natively used in Blender in place of its own renderer.

Blender is competing against Maya, not Renderman.
I must confess that the Hockey I played was much less cool than Ice Hockey :-)
The thing to blame is the enhancement filter. It is meta-stablity in this filter that is causing the flickering. It is doing the same as what happens when a visual cortex processes an optical illusion. It can not resolve it to one steady state.

Look in the monitor menu for the setting that turns the following off:

Picture enhancement: SmartImage game
> Because protecting our customers’ data is our top priority, we paid the cybercriminal’s demand with confirmation that the copy they removed had been destroyed. Based on the nature of the incident, our research, and third party (including law enforcement) investigation, we have no reason to believe that any data went beyond the cybercriminal, was or will be misused; or will be disseminated or otherwise made available publicly.

"Thanks for the ransom money. Oh, sure, yeah, I deleted everything. I hit the big "Delete" button and everything. Don't worry about it."
Nice. I did a test project and just let screenflow record for hours - I think I have around 26 hours of stuff, but ... it's definitely not fit for consumption or learning from. I look back and think I could edit it down some and make it useful, but then think I may just start the next project with a more focused eye on the recording in the first place.
Oh I see, my apologies for an incorrect suggestion in that case.
I think it's mostly Ada anyway.
It’s common in Europe (I think it’s even mandatory now, though not necessarily for each transaction).
At that point, they enjoy green uplifting lines more than anything else. I know my grandpa loves some pointless things as a habit. Maybe they have forgotten how to enjoy life through other means.
> How do you propose to adjust capitalism's core reliance on scarcity and supply and demand (supply of a digital good is infinite!)

There is nothing wrong with capitalism when it comes to scarcity or supply and demand. It just doesn't apply to the supply of digital goods, or any other good which is superabundant (i.e. not inherently scarce).

Labor is scarce: the labor of writing new works, and the labor of distributing them. To the extent that there is demand for new works we will find some way to pay for the labor of creating them which doesn't involve undermining capitalism—along with people's natural property rights—in order to impose artificial scarcity. There are various existing, proven models to choose from which have resulted in quality productions in the past, including patronage, crowdfunding, sponsorship, donations, and open source. Each of these has its own strengths and weaknesses and the eventual solution will probably include all of them to some degree along with others we haven't thought of yet.
Cool tool!

A couple of questions:
-can you set this to automatically trigger for high risk transactions?
-how do you flag the user as "ok" for charges in stripe?
-do you need to disclose random charges to the customer?
-are these actual charges that are refunded or just authorizations?
The issue with homework is that the top percentage of engineers really won't have any time to complete a multi-hour homework assessment that might not even be graded by a human. For spammy applications or bad colleges sure. But that's not the target demographic.
Can we link to the actual research instead of this people-doxing clown's article?

Source: https://geminiadvisory.io/cybercriminals-deploy-emv-bypass-c...
First Tech Federal Credit Union offers Chip and Pin Mastercard.

https://www.firsttechfed.com/

https://www.firsttechfed.com/help/support/frequently-asked-q...

What is the difference between Chip and PIN versus Chip and Signature?
Chip and PIN is the most secure type of credit card technology. Instead of a signature being used for identity verification, it requires you to enter a four-digit Personal Identification Number (PIN) that must correspond to information contained in a computer chip embedded within the card. The Chip and PIN authentication method has been a global standard across Europe and Asia for many years which means using your card while traveling overseas will be even more convenient. Authorizing your transactions with a PIN is not new to debit card transactions, but is a new way to authorize payments with a credit card.

You may occasionally still be asked to sign for transactions while using your chip card. Please be assured that while these transactions are still secure, many merchants do not yet support chip and PIN so you may encounter this from time to time. First Tech is committed to ensuring chip and PIN technology is available wherever merchants accept it. Learn more at firsttechfed.com/mastercard.
That's what structural typing is enforcing well. (used in TS, although IMO nominal is useful too)
I really can't see a resemblance here with the kind of nefarious machinations with an agenda that are being referenced.

Copyright doesn't really control or distort the flow of media or ideas in a way that favors any particular politics.
> Does Apple treat other video streamers differently than Amazon?

Apple changed it's rules for everyone in this category to get Amazon onboard with their video service.

Why should it take another Amazon in another industry to change rules for that industry? Why did Apple change it's rules in an entire category so that they can get Amazon onboard? Because Amazon is too big and has leverage over Apple? Isn't it?

Well this is precisely why good democracies and competitive countries have anti trust laws.

This also shows that for some arbitrary categories to please companies that have leverage over Apple, Apple will change rules at whim. This also indirectly indicates that Apple does not treat all developers equally - if you look at this in good faith.
I disagree with the premise of your statement. It's typical that a log will be accessed zero times. Collecting, aggregating, and indexing logs is usually a mistake made by people who aren't clear on the use case for the logs.
It is being applied, in fact many non-violent offenders are getting out.
Good luck finding unbiased news outlets.

My main criticism of Fox, CNN, and frankly the vast vast majority of all news outlets (including smaller news outlets and your so-called "independent" analysts) do not present the "other side's" arguments fairly. NPR is one of the least "unfair" major US news outlets (i.e. in reports about controversial issues, you're at least exposed to adequate and coherent arguments from both sides of these issues) despite the creeping bias you allege, so I was taken aback when you lumped them in with the other blatant rage-pornography outlets on the Internet, television, and radio.

Also, in my RSS feeds, Russia Today has hard-hitting unbiased journalism such as "Alyssa Milano roasted after complaining that Joe Rogan's podcast has more listeners than hers does" and "Liberals leap to politicize Herman Cain’s Covid-19 death because he ‘didn’t wear a mask'". Go on NPR's website right now and try to find something similar from today.
Except on steam, you can install your purchases locally. So you can probably play them directly (Hmm..I should try and see)
Talking about mobile devices, you can't simply "go to Android". What you are purchasing when you pay Apple's fees are access to a userbase (among other things like the ecosystem). If you switch to Android, you are no longer buying the same product.

Talking about things like bricks, it would be more like if Home Depot was the only brick seller, and if you didn't like their brick terms, you could leave and buy instead 2x4s elsewhere.
That's an interesting story. Another component why the Versailles treaty was so harsh was that Germany had made a similarly harsh treaty with Russia before that, so the western powers gave Germany the same treatment that Germany gave Russia.

https://en.wikipedia.org/wiki/Treaty_of_Brest-Litovsk

Ultimately, the Ottoman empire received probably the most harsh treatment of all, although they were the only country out of the group of Germany, Austria-Hungary and them which managed to reclaim some of the lost territory and keep it up until today. https://en.wikipedia.org/wiki/Treaty_of_S%C3%A8vres
I'm not saying Congress has passed a law explicitly making personal copies legal, but it does appear courts (in the US) do consider market effect when determining fair use.

This isn't exactly the same as personal use but it's pretty relevant: https://arstechnica.com/tech-policy/2015/10/appeals-court-ru...

> "While Google makes an unauthorized digital copy of the entire book, it does not reveal that digital copy to the public," the opinion states.

Also, Pamela Samuelson, a professor at University of California at Berkeley has stated: "Personal-use copying should be deemed to be fair, unless there is a demonstrable showing of harm to the market for the copyright at work"
Ask HN: Co-founder title, when an early employee asks for it, what do you do?
I am an early employee at a startup who joined at the idea stage. Now we are hiring a key executive and making them co-founder too. I asked for the title for myself and I was told no, while acknowledging that I am absolutely essential to the company's success. I have read before that co-founder titles are usually currency you should give to the earliest employees to keep them motivated but instead I am being told no because the incoming exec might not see me as their "peer". Is this a good reason to say no to your most essential employee who is building out the product as the product leader of the company? It has also been acknowledged I would have the most equity in the company except for the current single founder.
Emotional intelligence and EQ/EIQ [1] are commonly ignored, but are just as necessary for functioning in society and achieving success.

Some people seem to be really fixated on IQ over EQ, for what I suspect are, ironically, emotional reasons.

[1] https://en.wikipedia.org/wiki/Emotional_intelligence
The City Is a Lie
UX in the Age of Abusability
Yeah I only scanned through but there seem to be better tools for the job in the environment. SSIS is scriptable/has APIs so you can shred the data into n packages and run it. Also, columnstore_archive gives amazing compression if you're low on the read side and immutable data means you can load into partitions. Column diffs are a bit annoying but not unmanageable. Then again, arm chair architecting isn't ever as accurate as you assume. I do know you can move billions of rows daily using SSIS across thousands of tables.
Why Usability and Accessibility Matter in Product Development
I've been on the "right" since my earliest political memories (going back to about 2006). I just don't see that much having changed. It sounds like this myth of Republicans/right being super evil crazy people was foundational to his politics. Now that it's being challenged in his mind for whatever reason, he wants everything to go back to this blissful state. Note how he doesn't really say much nice about the Right. To call the Left Right is the greatest insult to him.
That might happen with elective stuff like LASIK, but nowadays, I doubt any healthcare providers that are part of larger groups would play ball.

As far as I can see, all the hospital systems are combining, doctor groups are combining, and you never negotiate with a doctor directly at these places. The doctor sells their labor to the company, the company sells healthcare to the public, and you deal with the billing department about any money issues.

I know the doctors are monitored for how much revenue they are generating which corresponds to the CPT codes and whatnot they use, so everything is billed based on that.
To be fair, many of those counterarguments would be seen as valid if we were discussing, say, private messengers instead of cryptocurrency:

* It's not Signal Messenger's fault that it's used for shady stuff.

* There are so many warnings against unbreakable strong encryption, it's getting boring.

* Many people are biased against strong encryption

In the end, like private messaging, cryptocurrency is just a tool that can be used for good or evil. I don't think that the general concept needs to be "defended as not being shady" any more than any other technology that enables scams, e.g. phones, youtube[1], the internet.

[1] https://www.theverge.com/2020/7/23/21335554/steve-wozniak-yo...
Disinformed to Death
A “Design Problem” Is Everyone’s Problem
Go do some research and report back to us please. I would be happy to hear what you find.
“Once the rockets are up, who cares where they come down? That’s not my department”, says Wernher Von Braun.
https://youtu.be/TjDEsGZLbio
Ask HN: Restricted Stock Awards/Units for startup employees
Does anyone have experience with RSAs or RSUs instead of stock options for startup employees?
Don't forget that Google stores probably at least 3 copies of each for redundancy and multiple sizes.

Wouldn't want your only ice cube to melt
Thisoght be one of my favorite hacker news comments I've ever read.
Apply a similar comparison to the past and it's humbling to realize just how little we know about history, and how quickly we collectively forget the farther back you go.
Enhanced Android Security: Build Integrity Verification
Do IBANs allow debit without reliable authorization? In the US having a bank account number (and I suppose maybe a name/street address for more plausibility) is enough to print a check and then withdraw money from it. Do IBANs let a random person do that, or do they need verification from the account?
It's not that easy tbh. Languages are also important.

Like I guess Brazil and Argentina would work, but you'll essentially just cause wages to equalise over time.

This will happen to some extent, but it's much more likely that US software engineers pay will normalise first.
This is not what I meant.
With content moderation at scale.. having leeway can allow you to prioritize on trending videos, which removes a large subset of things required to moderate
Text to Speech Software Will Change the Way You Edit Audio
Great idea!

Do you have plans to support other processors and/or integrate natively with ecommerce platforms like Shopify, BigCommerce and 3dCart?

A button to click in the Ecommerce Platform Admin page for an order that triggers this extra verification would be game changing for many ecommerce companies.
Also, he gets more of a cut if you buy from him and no DRM! win-win
> For the company, people that work remote start drifting away from the company vision and spirit

The company I work for produces some really cool products that I really enjoy making. Is that good enough?

> I have some friend who have been working at a company who went remote-first and after 5 years they do not feel identified with the company anymore. It's just a job. You could work for someone else and you wouldn't even notice.

I worked on satellites, and then rockets, and now I'm back to satellites. From an embedded software point of view, they can be made remarkably similar. I'm guessing most kinds of embedded software development feel similar lol. Of course, company culture matters - and by that, I mean how the team behaves, how the management behaves, and how the CEO runs the company. I worked for an idiot CEO once and the managers would yell at each other in meetings. I left quickly because it was a very toxic company.

> Also, working from home is only as convenient as your life situation allows it.

Almost every single company talking about going mostly remote is still having offices as an option for those who need it.

> You are a people's person and feel more energetic and productive when working with others face to face? Well, sorry, your team is mostly remote.

You lost me here. That sounds like an extrovert demanding that everyone bend to their will.
US fares better on this point, AFAICS.