skysight-inc/HackerNews huggingface dataset:
Yes. In fact I spent months working on a system to workaround all the problems it caused for Hadoop: https://hadoop.apache.org/docs/current/hadoop-aws/tools/hado.... We had a lot of automated tests that would fail because of missing (or more recently, out of date) files a significant portion (maybe 20-30%) of the time. We believed that S3 inconsistency was to blame but I always felt like that was the typical "blame flaky infra" cop-out. As soon as S3Guard was in place all those tests were constantly green. It really was S3 inconsistency, routinely.

To be fair to S3, Hadoop pretending S3 is a hierarchical filesystem is a bit of a hack. But I had cases where new objects wouldn't be listed for hours. There's only so much you can do to design an application around that, especially when Azure and Google Storage don't have that problem.
I assume this means room for another indie in that space now that Slack has been eaten?
www->root should be handled on DNS, therefore Route53.
http->https can be done using CloudFront and Lambda@Edge
But I have a beefy server with capacity for many extra VMs for a fraction of the price, so I can still spin them up on a whim. The power use is proportional to system load so I'm not paying much continuous overhead, just the up-front cost of having a larger server.
Their existence is not at all dependent on such things. (Note that I didn’t use the word “always”.)

If the answer to a question of “Why [...]_1?” would be “Because there is a [...]_2 such that [...]_3 .”, then there is such a [...]_2 such that [...]_3 . (Possible exception : if “because you asked that question” would be part of the answer.)
I read an SFGate article about Parler yesterday, they had to use https://www.burnerapp.com/ to generate a working non-personal phone number as Parler wouldn’t accept a google voice number. For $2, it’s worth a shot! I hope this one works or someone else is able to offer a solution.
I mean, there are summer camps for kids who are old enough, grandparents if you have them and they are willing to take the kids for a week or two, but the thing is even the "vacation" is not the same as your life before kids. You're always still thinking about them, always ultimately responsible for them. Having kids is a fork in the road. There is no going back to the old path, even temporarily. The closest you will get is when your kids are adults themselves, but even then it's not the same.
Absolutely, absolute love pgloader! So painless and quite straightforward. Saved me lots of time migrating my production db. Highly, highly recommend if anyone wants to migrate from MySQL to PG!
I've bought and implemented the strategies in that course. I mean, it does work, at least for those who put the effort in.
What conversations give you energy? Track your tone with an always-on voice band
The majority of a game's data usage comes from assets. The binary is a tiny fraction of the size of the application.
Creating the back end for a sustainable weekly newsletter
Dropbox hasn't been involved with Zulip since 2016. Previous discussion here: https://news.ycombinator.com/item?id=23864140

They acquired the original Zulip startup in 2014. Then they open-sourced the code, and Zulip since 2016 is backed by a new company which is the one tabbott is describing above.
As a security architect, I hate you. I get the freedom but I don't want our corporate data floating on a insecure elastic search cluster. Thanks
Devo was a bunch of brilliant, genre-defying creatives. In my point of view they have been as influential as Kraftwerk, but don't get as much love and respect.
Side question -- why is s3fs so slow? I get only about 1 put per 10 seconds with s3fs. One would hope that you could use something like s3fs as a makeshift S3 API, but its performance is really horrible.
yes speedometer is a bad visualization, it confused me and I'm a full time dev advocate
A quick google search about Spokane turned up this[1] and this[2]. Maybe the only difference between SF and Spokane is that the real estate prices means it is easier to hide the problems from public view.

Pretty much every city and state, liberal or conservative, has a fair share of population that is struggling with drug addiction, mental health issues, and poverty. The difference between SF and other areas, is we have higher real estate prices and better weather, so these issues are much more visible than else where.

[1] https://www.safewise.com/blog/most-dangerous-cities/
[2] https://www.reddit.com/r/Spokane/comments/bchlna/how_ghetto_...
thanks! i'll try it :)
You're getting the responses you're getting because you called them creepy. Other people would be happy to save selectively if apps supported it. No one is going to switch to Gmail just for that.
Could you not already do that by specifying ETag?
Okay, yeah, I agree with that. Thanks.
So long as everybody knows what the "real" Bitcoin is, it doesn't present a problem, anymore so than existence of the Liberian dollar renders USD unusable.
This might be useful to simplify that model for you :)

https://aws.amazon.com/about-aws/whats-new/2020/11/aws-lambd...
I think it depends on how you give it to the person.

Think about giving someone a generic gift card without any other information vs. "Hey, I know you're looking to get into art but honestly I have no idea what type of supplies you want, so here's a gift card to buy what you want from xyz art store".

I know when I was a kid getting a $50 gift card for some toy store that sold video games was the best thing ever. Your Aunt may have good intentions but she probably doesn't know what games you like but you sure as heck appreciated the gift because it translates to something you really like that was enabled by the gift giver.

I think the card being specific to 1 store also really helps personalize the gift. You can be sure the person will enjoy it instead of maybe feeling guilty about how they should really use it for every day living expenses.
For an easy life hack, feed the kids left overs from the night before and enjoy your dinner after they go to bed. They end up eating the same food (albeit a day later) and you get to enjoy both the cooking and eating.

Plus it’s easy to combine it with intermittent fasting as you don’t even get a chance to eat till after they’re in bed!
I have a similar take, but I framed my thought around failure. I realized there are hundreds of ways that my life will get worse by taking some kind of choice, and also hundreds of ways that my life will get worse if I take the opposite choice. So by embracing the fact that is quite likely that I will fail, I got rid of the fear and the paralysis.
Sorry for the tangent but isn't litecoin and dogecoin one and the same now? Why separate clients?
Tangential question, is the new Google Pay a completely separate product from the old Google wallet? Because a lot of the functionality seems to be the same but I get the impression it was probably re-implemented since a lot of that functionally was removed from Google wallet years ago.
Last year I somehow ended up using the iOS imessage thing where I chat directly with a company and it was excellent. Never saw or heard of it again, but I would love to have a similar ability on slack.

I have to chat with like ~10 vendors on a weekly basis for short-burst communication and end up having a bunch of weird shared slack-room things. Salesforce could clean that up and it'd be a great b2b messaging system.
what about version management when conflict happens in dependencies that are installed vs needed. Admit Python is a big mess. That is why people recommend installing within another weird software called conda environment vs directly.
Unripit, platform for gaming clips with cool features
Hey I just finished my latest update with a lot of cool, unique features for my gaming clips platform. I hope you guys like it and any feedback is gladly welcome!
Apple uses tons of linked lists, I'm not sure why you got the impression that they don't?
> netsurf instead of chromium or firefox

Great for the default but can we have a Firefox/Chromium/derivative as an alternative, for the sites which don't work in NetSurf?
The distinguishing term here is not GAAP, it's gross vs. net profit. Both of which can be calculated under GAAP.
I keep thinking this is a distilled piece of Americana, a cultural artifact, of a time, & place. But I'm not sure it's really distinctly American. The term feels insufficent.
You'll have more free time than you do now, possibly, but there will be school events, extracurricular activities, meetings with teachers, help with homework. etc.
ESP32-C3
Excel doesn't scale, isn't reproducible, and has behaviors that silently destroy data

https://genomebiology.biomedcentral.com/articles/10.1186/s13...

https://www.theverge.com/2020/8/6/21355674/human-genes-renam...
Yeah, linked lists are bad for the data cache since each element is in some totally random area of memory and thus less likely to be in a cache. Whereas for a linear array the data is next to each other and can be cached effectively and accesses can be easily predicted.
Lots of the stuff they release I imagine is to comply with license obligations.
>Because Eno ain't no elevator music.

In keeping with the pedantic nitpicking, I think Eno might actually disagree and say that his music could be elevator music. In the liner notes[0] for 'Ambient 1: Music for Airports', he writes that "Ambient Music must be able to accomodate many levels of listening attention without enforcing one in particular; it must be as ignorable as it is interesting."

But, speaking for myself, I wouldn't relegate Eno's music to the elevator. :)

[0]https://audioweb.sitehost.iu.edu/T369/eno-ambient.pdf
What's up with all the new AWS features in the past few days? Coincidence or not?
If you're bringing something new, people will misinterpret and take it in worst possible meaning.

If you are doing something new, how do you even express it effectively?

Let's say you invent a new form of housing and all the words that currently exist for various forms of housing don't really describe what you do? You basically have to make up new language entirely for a scenario like that.
Millions of people?
I also want the answer to this, but to the best of my knowledge it does not.
Yes, a ton. The big issue for me was Does key exist? -> No -> Upload object with key. Followed by Get key -> Not found. Less rarely, I'd see Upload object followed by an overwrite object, followed by a download download some combination of the two if the download was segmented (like AWS's cli will do).

The first one happened often enough to cause problems, the second one was a fairly rare event, but still had to be handled.

It might have been more of an issue with "large" buckets. The bucket in particular where I had to dance around the missing object issue had ~100 million fairly small objects. I ended up having to create a database to track if objects exist so no consumer would ever try to see if a non-existent object existed.

Time to revisit all that mess, I suppose.
At some point I feel like society deserves a vote. Sorry, you have claimed copyright & intellectual property, but we are just going to go to duckduckgo.com and google for whatever we're looking for. Your insistence that this (google, noun) is your word has failed; we all know it, why deny it.

Whatever the owners of "Muzak" wanted, whatever they thought of it: the dog is out of the yard. It's free. Your claim may be legal, but it is, by all accounts, incorrect and false. This word has a meaning now, this passive easy listening background vibe, humming nothings, it embodies something more real than what the owner intended. It's falsity & a lie that we let law & property dictate to us the terms by which we think. It's said that a rose would smell just as sweet by any other name. Well, society knows these roses, far better than whomever came up with the name. Let us not let the first-comers shape & dictate to us our usages.

(Velcro, I am coming for you. Your hegemony over this idea is coming to an end! We will not fall back to "hook and loop" forever, like animals! We all know we need a word. That you own it? Bah! Poppycock! The resistance of your lawyers does not cow me, does not frighten us!)
Yeah that's fair sorry I was under the "KDE/Neon" pretense, I did briefly check that out seems like it is related to Debian or at least able to use .deb... I'm hoping. At least there is the Mobian as you mentioned.
Likely the documentation that does exist internal would take a relatively large amount of cost to extract without pulling other stuff with it.
Personally, I do like the concealed nature of threads within the main conversation, but I do not like how they are presented when opened. The whole "displayed on a narrow pane on the side" seems too cluttered to me. I'd much rather have it expand in the main conversation pane, maybe even create nested threads inside (kind of like reddit/HN).

Thread notifications are another pain point, as others have also noted. For some reason, all thread updates/notifications are clustered together in a separate tab called "Threads", regardless of what channels these threads belong to. If a thread (that I am following) belonging to a channel has an update, shouldn't that channel be highlighted? Now that I think about it, if that channel is highlighted and the user clicks on it, how is the user going to know which thread to check... all I can say is, threading in chat rooms is a non-trivial problem and while Slack gets some part of it right, there's still a ways to go.
If you load all the dependencies outside of the actual event loop, then these will only be loaded in a function's cold start before it is suspended between requests.

With this, you're only effectively paying this cold-start costs on first load of a new function (or whilst adding extra concurrency) and they're often kept around for 4-8 hours, even if they don't receive any requests.
Uber Engineering, SF and Sunnyvale, remote until July but on-site After. We’re hiring mobile, backend, and data eng for the Product Intelligence and Experimentation Teams. Want to build services in the 100k*n QPS, near real-time systems processing petabytes of data, powering human and machine decision in our marketplaces? Apply here or email me at lduncan at Uber

https://www.uber.com/global/en/careers/list/63377/

https://www.uber.com/global/en/careers/list/64019/
Brené Brown on Empathy [2013, video]
Yes, it caused us some pain with multipart uploads that we sort of proxied, them being multipart from the client to us as well.
AWS Re:Invent is going on. It's virtual this year, but they're still using it to unveil a bunch of new stuff.
It _works_ for everyone, but not everyone needs to understand it.
Yeah, both projects have their challenges. It's been good to see them, as well as the Librem developers, working with each other to advance their respective projects where it makes sense.

Just curious, what corporate backing are you referring to? I hadn't heard that before.
I really wish it was possible to have flagship class phones that supported open systems well. The closest any phone is that I can find is the Pro1 X, which hardware wise is a Pixel 2, but it isn't open hardware, it's just documented so that you can more easily run what you want.

I'd love to see a current Snapdragon, Mediatek, Exynos, etc. chipset in one of these open phones. I'd even be willing to pay flagship prices for one.
So how can you comment on, or have a critical thought about an article, if you're just reading a bunch of other comments likely left by others who also likely didn't read the article?

I find that genuinely baffling, and somewhat worrying, especially on more serious topics.
i already had enough "catching-up-with-latest-aws-tech" problem with amazon, though this is a welcome addition, with daily announcements like this, makes life tougher for a AWS architect who likes to be up to date!

just today proton was announced and now this! this is going to be a hectic month :|
> Honestly, I'm team dynamic linking. I prefer to have things clearly separated in functionality and easily upgradeable.

This is awesome as long as no app you need requires an otherwise-useless yet big thing (with its own requirements) or insists on an obsolete version of a library you prefer to have a newer version of.
No coincidence. It’s reinvent season. https://reinvent.awsevents.com/
I'd pay good money if I had Chinese hardware with secure, privacy-guaranteeing software. I'd buy the smart watch right now if it was either open-source, it came with a strong privacy policy.

As is, I see no reason to upload my health information to a random corporation.

Indeed, I can see plenty of business models where I could give away smartwatches and cameras for the wealth of data I'd collect. Selling still makes more sense; you want people to have a vested interest in them.
In a few cases perhaps—they definitely still use some GPLv2 stuff—but it's mostly under a license that doesn't require them to release anything.
Touché. Eno could be elevator music then.
Thanks, I was totally out of the loop there.
Yup me too! Checkout this state_doc Interface I wrote in Python for building a state machine where the state is stored in S3. I never bothered to solve for the edge case of inconsistent reads because my little state machine only ever measured in hours when it slept waiting for work and then minutes in-between waking up and doing work to verify restores.

With the news of S3's strong consistency my program is immediately safer to use for some set of defects, since the underlying datastore properties, S3 has made my codes naive/invalid assumptions, true.

https://github.com/remind101/dbsnap/blob/master/dbsnap_verif...

I should likely pull out the StateDoc class into it's own module.
I think we're on the same page. Once someone gets good enough at heap shenanigans, they likely have a good enough skill baseline to go after real targets. In terms of skill development though, I found ctf'ing gave me a decent sense of what may be exploitable, that it would be hard to get otherwise.
If you want more technically accurate terms, you might call raytracers and polygon-pushers "image space" and "geometric space" renderers, respectively.

Worth noting that neither method is particularly physically based, and really just boils down to whether you approach the rasterization task "forwards" or "backwards". Which method ends up faster is essentially a function of how much geometry and how many pixels you have.
+1 I have been doing this for years. Makes life so much easier. My father in law is getting new grill tongs because he was complaining about the short ones he has this summer.
Pinterest Visual Search / Applied Computer Vision | SF / REMOTE | Applied ML Internships / full stack ML infrastructure engineering contracting roles

The Visual Search team works on all aspects of applied computer vision at Pinterest and is offering summer 2021 internship opportunities, along with contracting roles for more experienced developers who are looking for a flexible arrangement. This is a full stack team, ultimately driven to ship user-facing products, like Pinterest Lens, Visual Shopping, and Pinterest AR. We do this by building state of the art computer vision signals, such as large scale multi-task embeddings, high-throughput detection models, generative adversarial models for image composition, and many others. These models and computer vision features power product experiences on Pinterest for hundreds of millions of users.

Pinterest Visual Search team runs on PyTorch, C++, and lots of Python, among with many other technologies. We encourage publication of all of our work (CVPR, KDD, etc.), and have a highly collaborative and flexible work environment. We’re looking for roles right now: interns with an interest in shipping computer vision products, and contractor roles for more experienced engineers to help us build better ML data tooling and visualizations.

Interns: If you’re passionate about product or computer vision infrastructure, such as building label-to-deployed-model toolchains via active learning, or if you’ve had experience with interesting CV challenges, or you are just looking for a highly applied ML work, reach out to our team! You can contact me directly by pinging dkislyuk@pinterest.com with the tag [VISUAL SEARCH HN] in the title. Please highlight a CV project or an interesting product you've worked on to help our team figure out what role to consider you for. Any ML infra or tools that you are interested in are a big plus.

Contractors: If you have experience with data workflows for ML projects, or building dataset visualization front-ends, or have some other expertise that you think is relevant to the problems above, send me a message (same deal, please add the tag [VISUAL SEARCH HN]). The position would be fully remote.
I don't think I could buy that. It's not about efficiency or productiveness, it's about being. At this level, I don't even care about accomplishing stuff, just existing is fine. It's more like a fear of the darkness and the lack of consciousness when I'm asleep, that's why I framed it as a FOMO.
> I know corps and teams where they need approvals for each cloud resource they instantiate. That is a culture problem.

I'm on the software side so I want my compute resources in the next 30 seconds like anyone, but.. at a larger company there needs to be controls in place or things can go bad quick. At one company I'm aware of, finance really started banging on doors when the cloud bill went over $1M/month and nobody really knew very clearly what any of it was being spent on or what products or customers each expense was associated with.
We have a fraud decline set for protonmail too, not a gigantic company - but we've had too much fraud from the domain.

It sucks, but it's a very small loss in potential revenue overall.
Twitter is just a bunch of businesses, celebrities, and bots.

I don't know a single normal person that uses it on a daily basis. The fact that is has this many people is amazing to me.
It’s free this year, too. Might as well register if you’re interested.
That siacoin post is great! I definitely will hire an editor if I start blogging.
Fly.io is more like a simplified Fargate.

This is more like Lambda with Docker instead of ZIP. More code storage but same 15min runtime limit.
I mostly agree with you. I'd like to point out this seems to be the first project zero post on HN that hasn't had a handful of posts suggesting project zero is a hit squad going after Apple.
Aurora’s Software Engineering Tenets
As far as messengers go, IRC is about as far from Slack as you can get. Two main differences:

1. You can't send IRC messages to people who are offline (yes you can work around this with bouncers etc. but that's beside the point). You can send Slack messages to people who are offline.

2. Slack is a proprietary, centralized system. Slack, the company, decides who is allowed to participate, and at what cost. IRC is a federated protocol, where different servers can be part of the same network, or part of a different network. You can set up a server or client by yourself if you want.
RAII can be decoupled from ctor/dtor mechanism, see Python's 'with' statement. Javaish pseudocode, similar to a 'for' loop:

// on exit the finally fn will be called with 'x' as an argument.
with (Type x: create(args); finally (Type x) -> cleanup(x)) {
// safely use x, throw at will.
}

Re C++ and exceptions, there is an additional layer of wrinkles: throwing exceptions from ctors or, worse, dtors. Herb Sutter used to have a loooong list of what can go wrong in such situations back in the day. Explicit error codes happen to make it impossible to write ctors / dtors that can enter an error state by virtue of the fact that there is no way to return the error. My suspicion is that this is 50% of the reason of banning C++ exceptions in solid C++ style guides.