skysight-inc/HackerNews huggingface dataset:
Sia, the system described above, comfortably handles files of 100-200 gb, and with the recent Skynet link also enables filesharing for files up to 400 GB.
I wouldn't word it like this if it wouldn't be a very noticable pattern of behaviour comming pretty much only from US customers. Negotiations with customers from other cultures have been significantly more honest - it doesn't mean they weren't seeking an advantage, but this agreesive backstabing from legal departments right after signing up the customer was something that was very very US American.

After seeing it first-hand, I'm noticing this attitude even in fields like global politics, where burning goodwill to gain very minor advantages seems to be the policy these days.
It is terrible, but it will not die off.

There has been incredible lobbying for this. This is the ultimate capitalist's wet dream: making a profit on every transaction. The privacy angle is tangential, just collateral in the land-grab, just one more way to squeeze the last drop of profit out of everything you do.

Besides, the sharing of the data with 'authorities' was the lube that pushed these systems in. Gotta catch them terrorists, right. No no no, it might seem like a grandparent giving $50 dollar to her grandson on his birthday, but I'm telling ya'll, terrorism.
To down voters: tag me in your Instagram or Twitter post about how rude I am about your hyperconnected walled gardens!
According to your link, backblaze hardware costs are around 10x cheaper than OP's estimate. $2.56 per TB (based on .05 per GB) vs $25 per TB.
What are the drawbacks? Nobody seems to talk about drawbacks.
“The 200mg enhanced problem solving significantly, but had no effect on creative thinking,” said Zabelina. “It also didn’t make it worse, so keep drinking your coffee; it won’t interfere with these abilities.”

So not really I guess
Brian Williams, NYT's Gay criticized over math flub:'Saddest clip in TV history'
I’m a previous founder, I’ll come back with my second act someday. After I quit my startup I decided to stay around in this startup world.

I attend these demo days on behalf of investors who trust my judgement in specific verticals.

I’m fine sharing my notes.
How much is a terabyte of dropbox storage?
I am not the op nor an expert on this, but I think https://ceph.io/ targets clusters of this scale.
Is this region comparatively unspoilt because of the Chernobyl disaster? If so, that's a strange kind of irony.
Definitely not a healthy habit, but I used to take an energy drink to bed at night because without the caffeine it would take forever to fall asleep. I'd believed it was an addiction, except now I have been 'clean' of caffeine for so long (without any urges to consume it) and still suffer the same difficulty of falling asleep.
Every single company I've ever worked for that advertised online had a "cost of doing business" ad budget just for buying their own keyword on Google (and Apple iOS Store/Google Play Store if they had consumer apps). Bigger international companies often have someone from an ad consulting firm tracking the major search engines and buying keywords for all of the big ones like Google, Bing, Yandex, etc.

It's one of those "the sky is blue" type of things in advertising. You NEVER want a competitor to have a shot at advertising to your potential customers, especially when they've gone to the point where they're typing in your name into Google so their conversion rate is likely significantly larger than your average site visitor.
"It doesn't matter how we behave as long as they're still forced to do business with us." attitude is exactly what I was talking about :)
> Use an alias.

Yes, this is what I was calling out in my original comment. We need to remember to treat physical establishments as attackers.
Probably meant cross-fire in the colloquial sense more than the literal one. The ocean is indeed pretty big and it would be hard to get accidentally caught in crossfire.
Backblaze has not only purchase costs but also considerable ongoing operational costs for salaries, network, datacenter.
Also try using the Wavelet-Transform instead of short time FFT (with overlapping windows).

It is easier to configure (less parameters, there is no need for a window function), offers more flexibility (exponential frequency band; e.g. for music scales) and can reach the Gabor-Heisenberg uncertainty limit without artifacts.

The only downside is that you need to know the entire signal in advance, so it can only be used for recordings.

Shameless self-promo of my implementation: https://github.com/Lichtso/CCWT
Zurich person here. Tell me about it.
I think the complaint is about the number of screen <-> brain cycles required. "kubectl exec -it something-" <TAB> <read a list of deployment hashes, pick the first letter/number of the one you want, type it> <TAB> <read a list of pod hashes, pick the first letter/number of one, type it> <TAB> " sh".
Anecdotal Analysis of Creative Intelligence and Wealth, from Da Vinci to Tesla
I'm not aware of any dietary fat requirement to enter or maintain ketosis. I've talked to others that mention a protein/fat ratio but I've not see any literature about it. Citation appreciated.

A low carb and low fat diet is unhealthy for lean people because fat/fatty acids/etc is required for a whole lot of synthesis.
To back your claim:
"The disease caused by infection with SARS-CoV-2 is now called COVID-19."

Source:https://www.worldaware.com/resources/intelligence-alerts/sar...
I though the same, yup.
Perhaps in Japan it's easier to let someone go if they're not pulling their weight. Here in the US companies are absolutely frightened of making a bad hire, because it's so hard to fire someone (and if you lay them off you need to pay unemployment), that companies would rather hold out and not fill a role rather than hire someone who they aren't 99% confident will be a rockstar.
Signal also doesn't retain the content, I believe, which... well, if it's more or less auto-killed, there's no argument, no?

Note that I don't support doing away with Section 230, but I find this train of thought interesting.
Is the olive thing a so-called "cabotage" issue?
How much of programming/IT is tiptoeing through a minefield of broken shit hoping you can remember enough edge cases from your experience that you can avoid snagging on an issue which arrests your progress for large stretches of time?

And how much of vaunted 10x productivity is being able to have a clear path to get up to speed and stay at speed, without such snags anywhere nearby?

And how much of company problems are related to many employees being stuck in tarpits like these (and similar businessy ones)?
What if they are acting in the interests of the company? Is that "others" or "themselves"?
SAML is more common in enterprise, it's a tad older and it does dual way authentication that OIDC can't do (the enterprise and the auth provider both sign messages and whitelist one another).

However OIDC is catching up quickly. It's supported by ADFS 2016, Azure, Google and all major IAM products now. It's also a lot easier to integrate, to use and to debug.

So both will be supported by all companies over the coming decade. Even dinosaur companies like banks that are very backward, because they follow Microsoft lifecycle.
For many of the things affected by the coronavirus (events, going to restaurants, going on holiday etc), you basically don't aggregate any pent-up demand. People won't take twice as much holidays next year. It's tricky to argue for the recovery on that.
LinkedIn suggested a post from you a couple weeks ago and I remember thinking “what’s Ivan up to?” and I saw Datasaur. Congrats on YC! I know that our time at Yahoo was a brief overlap but I remember the swirl of ML, Knowledge Graph and labelling our org was at 5 years ago.

Good luck with Datasaur!

-
Julio Nobrega
Part of the reason we're stuck in that nightmare is that there are so many workaholics out there that for many people, braving the obvious risks and downsides of doing relationship stuff "on company time" is their only path to not dying alone. It would be so much easier if we could all agree to divide the sterile from the personal right down the 5pm line, but there are too many people that have nothing on the other side of 5pm.
How close is this to Mint? I'd be interested in paying for a Mint alternative. They've really gone downhill plus they sell my information.

But then again I don't trust Plaid and avoid them at all costs.
I'd like it if someone actually thought of the adults, for a change.
I think it very much depends on the desk. I mean, power alone at my home just barely reaches three nines. Internet connectivity glitches out occasionally. I'll fat finger configurations and reinstall stuff for some more hours a year. It all adds up.

You're right that you can take the same hardware, add a $70 UPS and some thought and care, and do much, much better. But my point was only that "95%" is a trivially achievable goal even in the most naive setups, which makes me treat their analysis with a little more credence than most folks here.
Why do you think I brought him up? AMD needs someone like Jim Keller but for software.
> That said, the economy was an extremely fragile condition before all this began so this might be an exception.

It was? This bear case hasn’t had much data supporting it. Can you elaborate what made it “extremely fragile”?
What the hell did I just read.

Intermittent fasting works. Talk to people that can show you results. Enough with the "theory".

I've heard many theories from obese people and it's always bullshit. Everyone can find far fetched theories for anything on this planet. That's why results talk. You know how they say "money talks"? Same here: results talk.

I, on the other hand, can tell you what works 100%, based on results (like 8% bodyfat, in very good shape):

Eat clean food, exercise daily, eat in 6-8 hours per day. Don't eat too many calories in total.

Do this for some time and I guarantee you will see effects. It only takes will and it's not rocket science.

Most bodybuilders that I see are people that are just, you know, dumb. And they can do it. So I promise you it's not complicated or anything. So I don't know what's stopping people from doing it.
We have done this calculation and even if you put your gear into Equinix/Digital Realty in the most expensive places and use Backblaze-type setup ( which is not optimized and buying retail) bringing 10Gbit to every 4U the price for double-writes at 5TB disks are $10/year per TB.
I got the scots one once when I searched for the Hoover dam.

https://sco.m.wikipedia.org/wiki/Hoover_Dam

At first I thought either I was going crazy or the article had been vandalized. But then I figured out that DDG hadn't taken me to the English result.
In 2018, I spent about six weeks running a series of tests to measure Sia's real world costs. At that time, storage cost ~$4.50/TB on Sia to back up large real world files (backups of DVDs and Blu-Rays).[0] Community members have re-run my tests every few months, most recently in October 2019, when the cost was measured at $1.31/TB, though it's worth noting that recent tests use synthetic data optimized to minimize Sia's cost.[1] It's also unclear how much the market value of Sia's utility token affects these costs, as the price of Siacoin has fallen by ~80% since I conducted my original set of tests.

The calculations in today's blog post account for the labor cost of assembling hardware, but leave out major other labor costs:

1. You need an SRE to keep the servers online. Sia pushes out updates every few months, and the network penalizes you if you don't upgrade to the latest version. In addition, to optimize costs, you need to adjust your node's pricing in response to changes in the market.

2. You need a compliance officer to handle takedown requests. Since Sia allows anyone to upload data to your server without proving their identity, there's nothing stopping anyone from uploading illegal data to the network. If Sia reached the point where people are building $4k hosting rigs, then it's safe to assume clients would also be using Sia to store illegal data. When law enforcement identifies illegal data, they would send takedown notices to all hosts who are storing copies of it, and those hosts would need someone available to process those takedowns quickly.

[0] https://blog.spaceduck.io/load-test-wrapup/

[1] https://siastats.info/benchmarking
When TWD was still new on TV and everyone loved to chat about their end-of-the-world survival strategies I would joke that in the Apocalypse I'd be a tinker and head of HR.

Both of these sound like menial jobs in the 1st world but if you can repair broken shit OR you can decide who has useful skills (and ultimately, who stays or goes), you are one of the five most important people in the group (and I could be two of them). They'd look at me funny and go back to talking about what machete or door design was best.

Being able to find things that people can excel at (or at the very least meet expectations) comes in pretty handy at work. You have the people you have, what's the best outcome you can get out of them? Not a conversation everyone wants to have, but pretty damned useful when it does happen.
You just re-defined asshole in a way that suits your argument.

The article doesn't define it that way.
Any chance you could support HTML files? We've been using https://www.tagtog.net/ for some of our data labeling / annotations needs but their tool for these file types is still "experimental".
> 9 out of 10 managers will give you more money

Perhaps in the tech industry where there is a lower supply of workers, but not everywhere. Plenty of managers will say no because they know you can be quickly replaced.
Microsoft Teams really is horrendous.

I've used a lot of chat apps over decades. Teams might be the first one that manages to be _confusing_ - a feat I'd never seen in a chat app - because of the way it rearranges new threads, yet hides the recent part of the thread. Plus various other half-implemented features. The wiki and sharepoint/file integration doesn't work very well. There's no wiki search. It's super easy to delete an entire wiki. I've lost notifications on entire channels for > 1 month without realizing it. Just a ton of little stuff like that; my team will never go back.

Slack is "fine" - it mostly works, and has a lot of app integrations.
The third sentence of your Medium article says; "Despite this, the Sia network is able to achieve 99.9999% uptime for files." How do you achieve this in a "not a highly reliable facility"?
I suggest you look up game theory. Not being an asshole is actually the winning strategy over the long term.
You can do basically anything in Excel. My favorite video on this topic is from Joel Spolsky.

You Suck at Excel with Joel Spolsky: https://www.youtube.com/watch?v=0nbkaYsR94c
With the same logic you could say that nuclear warheads are not worse than cars.
A great portion of people have very little self control when it comes to spending and will spend the money that would have been on a vacation on something else (weekend travel, a new phone, extra eating out, etc) so the money does indeed usually flow back.
I might be playing Captain Obvious here, but anyway, this worldwide coronavirus pandemic state of panic is the best possible scenario in which corrupt politicians in any country could enact restrictive laws or do nasty things while their citizens look elsewhere.
If they were waiting for a good mass distraction weapon, well, this is it.
I will be bringing it to macOS desktop at least!
Companies are sharing very private information - disclosing economics, stats, etc - to which only prospective investors would/should have access.
Are you saying you can share experiments that show optimal levels of glucose in the body are not directly proportional to optimal decision endurance? I'd love to see something that refutes this, I can't imagine what it would look like when I have found it so easy to evidence the relationship in myself and others.
I'll risk being downvoted for nitpicking in an attempt to be helpful about "affect" vs "effect":

Did it affect you?
Yes, it had an effect.

The psych study showed the meds were effective in improving patents' affect (mood).

I want to effect (bring about) change by doing X.

HTH!
Can the general public tune in too?? That would be really cool!

If founders had an ability to tick a box that said make public. Not sure if it’s a thing with regular Demo Days. Would love to tune in.
> You have to be a part of the ecosystem. If you need any connectivity (internet or phone), you really have no choice.

Which is why we need really tough legislation to put a stop to this abuse. The GDPR and CCPA are good starts, but both of those are much too weak. Here's hoping that such legislation will get better, and more pervasive, over time.
Is there any real evidence that restricting distribution of CSAM creates better outcomes for victims? More to the point is there evidence that increased aggression in enforcement of CSAM possession laws produces proportionately better outcomes? I would expect the ROI curve to go flat pretty quickly.
Sure can! Would love to hear more - what do you want to extract from the HTML files?
Okay - I have to say this is really cool.
I have a ritual of watching through my queue of Youtube videos (on many topics) when I am preparing and eating breakfast each morning. It works well. I've been able to churn through so much useful content over the years that I wouldn't have normally watched.
>
I didn't read all their math but I expect their final result to be off by a factor of 2-5x.

Can't be more than 2.5 because Backblaze B2 already gives you $5/TB/Mo.
Redundancy, I assume. Lots of unreliable facilities and nodes can be very durable in aggregate.
So, its sit at a table shared with strangers.
Probably also adjusts delivery priority and improves battery life.

Apple’s APIs are really good about exposing specific use-cases as separate functions and enums.
It's fine from the perspective of a single request but it seems like it reduces the overall throughput of the network. If Sia has, say, 1M hard disks and can do 100M raw IOPS then 10-of-30 gives 10M net IOPS but 64-of-96 gives only 1.5M net IOPS.
What a trooper. Well written, very interesting journey and very forgivable mistakes for a startup. Hope this takes off big time
If it's indirect reports, that means there's an org tree 'beneath' you... How are you not already a manager in that case?
http://steve-yegge.blogspot.com/2017/05/why-kotlin-is-better...
I suspect it has to do also with the culture of places that use it well.
Credit where credit is due:

"Markets can remain irrational a lot longer than you and I can remain solvent."

-A. Gary Shilling
Don't need to write CSS, built the website with Webflow :)
And before Slack, HipChat was quite good.
Imagine how much more efficiently you could absorb new information if you did not put arbitrary barriers on the "engagement" level of the source?

The reality is that you are just being mentally lazy for not accepting new information because it isn't in the most palatable format.

It is juvenile.
>If we assume that the 30 hosts go offline independently

I wonder how reasonable this assumption really is. For regular CPU-bound crypto-mining we see that it tends to centralize geographically in zones where electricity, workforce and real-estate space to build a datacenter are cheap.

Assuming that Sia ends up following a similar distribution, it wouldn't be surprising if several of these hosts ended up sharing a single point of failure.

Beyond that, if only copying stuff around three times to provide tolerance is enough to lower the costs to $2/TB/Mo, why aren't centralized commercial offerings already offering something like that? Just pool three datacenters with 95+% uptime around the world and you should get the same numbers without the overhead of the decentralized solution, no? Surely the overhead of accounting for hosts going offline and redistributing the chunks alone must be very non-trivial. With a centralized, trusted solution it would be much simpler to deal with.

Or is the real catch that Sia has very high latency?
This is very cool! I especially love the logo. Congrats on the launch and best of luck.
Very strange timing on what is unfortunately a horribly inaccurate title based on my personal experience.

I tried swapping to DuckDuckGo yesterday on my iPhone as the primary search tool and reverted unfortunately back to Google after only two hours.

It’s hard to define all of the reasons the ‘mobile’ experience is so unbearable, but I’ll try:

1) No video or image results at the top of the page when that is most relevant.

2) No IMDB/overviews for movies, music, books, etc.

3) I am used to one of the first results in my search consistently being Wikipedia. This was the case about 1/3rd of the time vs. Google.

4) Results often appeared extremely out of order in terms of relevancy vs. Google, with the actual relevant like often being on the second(!) page.

5) Personal taste, but super relevant - In terms of UI/UX, the interface feels dated, actually harkening back to the days of AltaVista - I’m unfortunately honest when I say I feel like I’m using something designed 10-15 years ago.

6) Autocomplete seemed to have significant issues, and, for some reason, sometimes even taking several seconds to appear.

I couldn’t express my disappointment enough. I really wanted to give up the ghost, and just move on from Google - but I am so used to so many of the apparently fantastic nuances of Google, I believe it will unfortunately take 4-5 years before I can even get past enough of these significant issues to make it worth using.

On Desktop - the experience seems to be significantly better. I can’t even point out enough reasons why it’s so poor on mobile, it could unfortunately fill several blog posts and I don’t have time to point out the myriad of issues and inconsistencies here at this time.

If there’s jobs available at DDG - I’d love to help, in all seriousness.
CPU TDP is accounted for, the CPU linked in the blog post draws 65w and that is used in the electricity calculations.

I did realize that I completely forgot about RAM, when I get back to a computer I'll have to make some updates, but it won't materially move the numbers, there's 33% margin of error between the number in the spreadsheet and $2 / TB / Mo.

The $80 PSU is what I could link to from Newegg, I do have experience in industrial electronics, and I know from firsthand experience that you can buy a 10+year PSU at 93% efficiency for well under $80 at 300 watts. At that level, you're going to be able to request all the required cabling as well, which means you're getting a much better price than the $7 per cable linked in the post.

95% uptime means 18 days of downtime per year. Consumer grade PSUs and mobos do much better than that.
We from croit.io operate Ceph based storage including everything from datacenter, power, switches, labor, licenses, all to a price point of 3€/TB.

No consumer ware
Awesome! Congrats, excited for this!
Post-Mortem Python Plotting