skysight-inc/HackerNews huggingface dataset:
My experience with Athena was that cost was negligible compared to alternative options, but YMMV. As in all things cloud pricing related, you should experiment and measure once price becomes worth thinking about.

Partitioning by date gets you really far because the vast majority of queries are interested in a specific timeframe. If your data is growing, but the ingestion rate is not, v0 might work forever.

v0.5 is simply to add another level of partitioning. This can get you an order of magnitude performance gain in many situations. I've often not needed to go past this.

v1 is a different beast. The nice thing about the simplicity of v0 is that it gives you time to learn the requirements for v1 (including whether you even need a v1) and the data is JSON on S3 so it's never hard to migrate it somewhere else. v1 is usually driven by very specific, known requirements, so there's no generic answer. For many requirements, it's useful to put a queue like Kafka (powerful) or Kinesis (convenient/cheap) in front of S3 and have a Spark job performing actions on that queue.

If speed of a single query is the issue, too many small files could be the root problem. Then, a good option is to read batches from the queue and write them to s3 as a single Parquet or ORC file. This could also be a good option if the issue is the cost of s3 API calls (when you're looking at 10k JSONs per second, PUT calls get very pricy), but at large enough scale, you might be better off using Redshift.

With Postgres or Redshift, you can run into contested resource problems when the number of users querying the data scales. I haven't found that to be a problem with Athena due to separated compute and storage, but if it is, you could maybe replicate data to another AWS account. Or, depending on the query patterns, you can build a higher-level table (e.g. given a series of events, tell me the most current state for every entity) from the raw data, either using ETL or by writing a new Spark job that reads from the Kafka queue, figures out the current state and writes the higher-level data a new s3+Athena table.

If the issue is time-to-answer (e.g. if there is a problem, how quickly will that be apparent in your analytics since batched writing introduces delay), streaming analytics could be the solution. You can also use the lambda architecture, but that's always looked too hard to implement and maintain to me.

If the issue is auth/data visibility in an enterprise context, I would lean towards using a fully featured enterprise solution, preferably one that uses a well-documented format on s3 as the underlying datastore with separated compute and storage. Alternatively, you could build or buy a query layer that sits on top of Athena that handles the permissions (e.g. Looker).

At a certain point, you should consider just adopting Snowflake as they have solved many of these problems already and is building an analytics solution really your core competency?
Why auto-scaling is essential for digital news and content publishers
Thanks again. Very helpful. It sounds like you understand this space. If you’d be up for a chat I’d love hear from you (gavin@zebrium.com).
I was talking about this with friends the other day - and here in NSW, Australia when you first get your license you get your L (learner) plates then your P (provisional) and you have to put these letters next to your numberplate so that everyone knows you are a beginner. I think we need to bring in a X plate (havent determined the letter yet) to help raise awareness to other drivers. Generally people are more patient and give more space when they see L and P plates and I think a plate for pensioners would help too.
The nice thing is that, if left alone, one doesn’t need to be concerned with or frustrated by the inefficiency of others.

Markets work this way, and when individuals are left, for the most part, to operate in the same fashion the intrinsic efficiency of supply satisfying demand is better than anything we might, as a group, think up.
imessage: not even once
Thanks for responding. I think you need to back up your claims that iOS lacks testing (really?) and has a poor user experience (a very subjective claim) a bit further. The only point I really agree with is the incoming call unavoidably taking up the whole screen.

With respect to the shutter sound, in the title you said, "no way to disable shutter sound", and then you contradicted that statement in the paragraph below with ways to do it. You also claimed that you have to completely mute the device or use a workaround, which is misleading at best. Shutter sound is togglable via the Ring/Silent Switch (which does not affect music playback), the alert volume and the system volume, so you have at least 3 options.

The inability to delete multiple contacts is also untrue, you can do this at iCloud.com. A simple web search will show you how to do this. If you don't have iCloud, some apps also do this.

The reason for my criticism is due to how you approached the topic, prepending it with "This is not an Android fanboy post where I criticize Apple recklessly." - when it comes across to me as doing exactly that.
There is a difference between advice for a lifestyle business and critique of a fortune 50 company.
To be honest, I'd be quite happy if Scoot stopped doing kick scooters and just focused on mopeds, and ran the kick scooters under the Bird name instead. I don't actually like the kick scooters, so they just clutter up the Scoot app and make it harder to see at a glance where the mopeds are.
Leelavati Prize Lecture: The Adventure of the Mathematics Village
You can switch SSH to port 80 or 443, right?
You know post-Keynesianism is just a flavour of dynamic stochastic general equilibrium models, right?

Those “strange assumptions” are what distinguishes economics from disciplines whose models are so under specified that they can’t be proven wrong. Economic theory can at least say that if certain assumptions are met some set up is optimal.
That is essentially what most SD-WAN devices do- treat the Internet as an 'underlay' network- most of them are using proprietary code to create their own network infrastructure that isn't standards based.
To go further, in your example it continues to pay out even if the $100 crowd outnumbers by 8 to 1. So it seems they could forego nearly 90% of the population and still profit more at a $1000 price, unless I’m missing something.
UBI is often a libertarian push to strip away what social safety nets we have, presuming everyone is a rational actor: https://www.libertarianism.org/columns/libertarian-case-basi...

Sadly, we live in highly distorted markets with imperfect information, where often individuals have little leverage as compared to large groups.
It seems like part of the world is going in the direction of verify don't assume, and the other half has decided that their gut always has the right answer. It's a strange time to be alive.
You continually deflect my questions with each comment, it is clear you are not trying to actually debate the problem and want to just rant about whatever comes to mind.
> This is a pretty standard data structure in most languages.

Yes, vectors are common, but they don't typically require compiler modifications to avoid mis-using them. In this case I'd make it super clear whether the method mutates the existing value or returns a new one, and "possibly both" seems like the worst of both worlds. If this behavior is preferred, it seems like `append` should take a handle to a slice pointer, possibly to a slice rooted in the stack, and write to it if replacing the underlying slice.
One reason is simply that most of these cities exist today by virtue of top-down fiat, planning and investment. That is, they owe their present prosperity to the govt.'s policies.
You don’t really know what that means, do you?
Correct, as WSL 2 requires Hyper-V.
Build a Twitter Clone Server with Apollo, GraphQL, Node.js, and Crowdbotics
I should've also linked the video https://www.youtube.com/watch?v=AkoML0_FiV4
> Other people will get the money.

Well, it goes to fund the system overall, but doesn't really increase the amount other people get (other than to offset future inability to pay from instability of the institution). It is a socialistic institution, and there are other financial products that don't pay out after you die (annuities), so it's not entirely unique in that respect.

Also, having items only go to your spouse isn't entirely without precedent. How your assets are distributed when you die is handled differently in different states, but if all your children are from your spouse at the time of death, I think generally the assets all go to the spouse.[1]

> In that way Social Security seems like other insurance in that payouts are not earned and you're getting other people's money.

Consider savings accounts or money market at banks. They don't put your money in a vault and keep it there while it magically grows, they invest it, and the money of yours they invested may be completely wiped out at any time, but they offset that by other people's deposits and profits on other investments. Whose money you ultimately get out is irrelevant, as it is with every financial product. What you get in all cases is governed by an algorithm of some sort (even if it includes as a variable how a specific item performed as one or more of many variables, such as fees).

> Similarly, if an insured house burns down, we'd say the policy holder is entitled to a payout, not that they earned it.

Yes, but we wouldn't say that is handled through "entitlements", which colloquially means something entirely different when used to refer to items related to the government. Specifically, it refers not to the "the amount to which a person has a right" but to the other possible meaning, which is "the belief that one is inherently deserving of privileges or special treatment". In that respect, I don't think it's all that accurate to refer to Social Security as an entitlement, since the connotation is somewhat inaccurate in my eyes.

1: https://estate.findlaw.com/wills/what-happens-if-i-die-witho...
IPv6 already succeeded. So far the many corporations already work very hard to perform even internal networks transition. And with new hardware upgrades IPv6 comes for free almost. For example, China recently did a huge leap, where many networks switched at once, along with mobile and web applications. And more is planned in the near future [1].

[1] https://blog.apnic.net/2019/06/06/100-by-2025-china-getting-...
dunno what he's talking about... horses... horses are the future.
And why is no one talking about the fact they never bathed? No amount of being high would cover that up.
Disentangling ethical value judgments from economics is difficult, to put it mildly. It’s also front and centre in any introductory economics course, where the first lecture will introduce the distinction between normative (what should be) and positive (what is). I’m not sure I’ve ever read an intro textbook that doesn’t introduce that distinction.
define 'well-mixed Bitcoin' please?

Is there a threshold that you'd use? How do you judge whether a BTC tx is well-mixed?
Excellent effort, my business runs completely open source since 2000s and it’s always constantly improving. Closed source has so many downsides that it only means that companies that adopt are nothing more than lazy.
And you can do the same on quite a few AMD boards with "Precision Boost Overdrive", which gives you a 300W TDP on 1950x if your cooling can handle it.
Or you can ignore turbo and flat overclock the thing, which depending on workload will produce better results.

Source: I have one of these.
they have the scoots
Razer SoftMiner and Razer Silver
“Lectins and phytates” are the black box doom and gloom ingredients of the paleo world. Let’s straighten up a couple misconceptions:

1. Lectins. Lectins are substances found in many raw foods, like tomatoes, lentils, beans, and whole grains. Some lectins are toxic (like those in kidney beans) and some are completely harmless (like those in tomatoes). Toxic lectins are completely destroyed by proper cooking. Some high lectin foods (like lentils and beans) are strongly correlated with longer lifespans, so diets suggesting they be avoided are probably worth scrutiny.

2. Phytates. Phytates can bind to vitamins and minerals and make them biologically unavailable in digestion. In practice, this is only problematic in already nutrient deficient diets. And like most dietary concerns, the picture is more complex. Phytates also have remarkable positive effects, such as decreased rates of cancer, kidney stones, diabetes, and heart disease.

The paleo diet (basically rebranded Atkins) runs contrary to every developed nation’s dietary guides. To believe it’s healthy is to believe in conspiratorial thinking as silly as flat earth or faked moon landings.
Exactly correct! Overblown overdesign by people who don't even know the founding principle of the internet - the end to end argument in system design.
I run Visual Studio without admin rights every day. But, if you're doing driver development, working with older IIS, certain parts of the registry or developing installers then yeah you're going to have a bad time.
Even if you need admin rights only once a week, if it takes a day to get them you waste 20% of your time.
Being able to ignore return values is something that C had before they had function prototypes. The compiler didn't know if something returned a value, so it couldn't check. There's no good reason for that misfeature in a newer language.

Go apparently does it that way to make "defer" work.[1]

[1] https://github.com/golang/go/issues/20803
> I think the world would be better off with climate vigilantes doing what they can to fix the climate.

I don't think I agree on that point. A small group of people with good intentions can do a lot of damage. See, for instance, all the attempts to introduce X alien species to a new environment to help with problem Y, and it turns out X likes its home a little too much.

I absolutely agree with your first paragraph though, and the crux of your point.
In the FAQ section under "Is Razer Silver a cryptocurrency?" it says it is not. It claims to be a royalty rewards program.

So, it's not a cryptocurrency if for no other reason that you can't exchange it with anyone but Razer. But then why is it called a "miner". And what are they doing with your CPU cycles?
Denial of guilt is not considered lying. Otherwise, every contested guilty verdict would have a perjury charge attached. Just say no. Or say nothing. Or one word: lawyer.
I imagine drawing eyes on your eyelids would be enough.
> Something changed. We understood...

Like having an annoying wife (erm, spouse) constantly tell you you've wrong all the time. In the end, some if not all will understand and adapt their behavior as complaining is of no further use.
You're right about poverty, and it's a shame, but I can live with the rest of it.

As a human, when I consider all of the ways that governments could be inept, killing humans tops the list of my favorites.

I only worry because I doubt that feature creep is handicapping other governments as well as it's handicapping mine.

Laws about keeping your dog on a leash only work if both dogs are leashed.
And an impractical security mess to tunnel into your home network. There are a hundred arguments against IPv6 and 3 or 4 - at most - in favor of it.
SPSS and it’s native format .sav are the industry standard for survey data. If anyone is in that field and hasn’t used Q (q research software) I highly recommend it. I used to do a lot of crosstabs and banner reports in SPSS and wincross and Q saved my probably 15 hours of work in that process per survey.
The classic failure for me is the damping harmonics you get from the delay in a corrective response to a change input. It's control theory 101.

Loans take time to approve and issue, therefore interest rate changes, even if all the other assumptions stack up, suffer from such control harmonics. They end up being just as badly targeted as the discretionary fiscal policy decisions they are supposed to replace.

That problem is hand waved away using 'expectations', which when you dig down requires the entities in the calculation to have perfect foresight over infinite time. ie they can see the future.

And such expectations would 'correct' the discretionary fiscal policy approach too.
Cost+ needs to die. Contractors should be forced to either meet their original bid or go bankrupt trying.
One of the reasons the Spectrum was so common was the low price. And of course using taps for games meant that most weren't paid for, but copied and shared around at school.

I grew up with the ZX Spectrum, like so many others, and it is what started me programming/developing/being interested in computers.
IBM coasted on the mainframe customers it kept for some 20 years from then... So yes it did make sense. Except just a short to mid term sense.
See the companion blog from PingCAP:
https://pingcap.com/blog/tidb-passes-jepsen-test-for-snapsho...
Presumably the commission would consider those factors, yes.

As to your first point, Coates gives Chicago as an example of a "less significant reparations program." This includes a permanent change to how they teach history, which he regarded as being crucial.

Another example is a change in criminal-justice policy.

Both of these (I have good reason to believe) would improve the community and be sustainable, yes.

I don't see anything in the essay which can be considered a "continual welfare program", so I don't know what you refer to. The proposed compensations are all "for specific acts" of legalized discrimination.

Your second comment appears needlessly binary. Coates gives an example of Jewish reparations in Israel after the WWII. Those reparations did not solve anti-Semitism. Then again, the narratives did not "continue unabated."

Since neither of your two outcomes happened, if I interpret your argument to mean that those are the only two acceptable outcomes, then are you suggesting that those Jews should not have received reparations? If not, then I don't know how to interpret your question in the context of reparations for slavery and legalized discrimination.
> enough ICBM's to end global civilization

There are enough conventional munitions stockpiled by major power to do this 10 times more than with ICBMs alone. A nuclear confrontation will not be the end of any global scale conflict today.
> Successful bars don’t have slim margins

This just another way of saying that successful bars are successful.
You are extremely generous in assuming Big Corp is using whole 90 days for fix and validation. In might have being sitting in a backlog for 90% of that time.
I work with a guy, that can't code, is a DBA but I have to fix his queries but when it comes to new projects, he has all the answers on how to implement everything and has not written a single line of code in an application.

Recently, I even told him just to tell me what he wants to achieve because his implementations do not make sense and its my job.

At least my boss also let's me do it my way, still annoying.
I am not lost on the irony. The military industrial complex has irony with layers of richness, second to none.
The idea that private enterprise leads to greater efficiency can be thoroughly discredited by anyone who has stepped foot into an industry that manages rent-seeking.
There's a reason apple doesn't have as much of the browser market share, and this is part of it. The lack of good ad blocking is literally the thing that drove me off of safari.
Using nightly features is as simple as inserting +nightly as the first argument to rustc or cargo (assuming rust was installed with rustup, which is the default way to install it).

So in this case, it's just `rustc +nightly green_threads.rs`
That's a problem that would have been solved with requiring 2fa.
> I love the A-10C. It’s a wonderful plane. I’ve flown it for years

Ah great some first-hand military combat experience here for once!

> in sims as part of a realism-based squadron

Ah, ok then... a computer game...
Cars aren't typically strewn about, except where there are tornadoes and such.
The opposite scenario also happens. When security management's job is to never prevent work getting done, their inability to say no to even the most abusive practices can become an issue.

Cloning a production database full of private customer data for testing? Well, we can't interfere with a practice that gets features shipped and the team doesn't have space on their roadmap to build out synthetic data...
Haha - Right to #1 on HN... I can't believe you so-called engineers think we've ever been to the moon. Get out a piece of paper can calculate the fuel and weight of said fuel to get there. If you did it right, then it should take about a week. Wow...
But do they wash with water there?
Poop downtown, like from humans? I've literally never seen that tmk in 25 years. Which is to say it's not very annoying. Oblivious doofs are magnitudes worse.
Chetty's own inequality/mobility data gets interpreted differently by the left and the right. There is no free lunch here, when it comes to dealing with people's vested interests (biases).

Policy/decision makers know anytime things get political the issue is never about the data. If someone somewhere has to give up something, try doing it just showing them your data and analysis.

You can run the experiment on HN. Try getting something in the architecture to change based on data, and pitch it to the HN community. See what happens...
TL;DR: Analysis of a neanderthal hyoid bone indicated that neanderthals did not posses a series of air sacs, common to apes, that preclude complex vocal speech, and thus were mechanically capable of producing sounds comparable in complexity to human language.
Not sure what are you trying to say here? Do you mean that India should scrap such projects in favour of public health services?
> All this is to say that, while data is useful for validation, it is not useful for prediction. The last thing we need is a black-box machine learning model to make major economic decisions off of. What we do need is proper models that are then validated, which don't necessarily need 'big data.'

Hand-wavy theory - predicated upon physical-world models of equillibrium which are themselves classical and incomplete - without validation is preferable to empirical models? Please.

Estimating the predictive power of some LaTeX equations is a different task than measuring error of a trained model.

If the model does not fit all of the big data, the error term is higher; regardless of whether the model was pulled out of a hat in front of a captive audience or deduced though inference from actual data fed through an unbiased analysis pipeline.

If the 'black-box predictive model' has lower error for all available data, the task is then to reverse the model! Not to argue for unvalidated theory.

Here are a few discussions regarding validating economic models, some excellent open econometric lectures (as notebooks that are unfortunately not in an easily-testable programmatic form), the lack of responsible validation, and some tools and datasets that may be useful for validating hand-wavy classical economic theories:

"When does the concept of equilibrium work in economics?"
https://news.ycombinator.com/item?id=19214650

> "Lectures in Quantitative Economics as Python and Julia Notebooks" https://news.ycombinator.com/item?id=19083479 (data sources (pandas-datareader, pandaSDMX), tools, latex2sympy)

That's just an equation in a PDF.

(edit) Here's another useful thread:
"Ask HN: Data analysis workflow?" https://news.ycombinator.com/item?id=18798244
Andrew Yang on the Rubin Report
"Unenforceable" under what principle or flaw?
I like a lot the idea of using .onion URLs to encrypt plain text protocols that at the very least support proxy and DNS.
The proof of coverage looks pretty cool although there are probably more ways the overall system could go wrong than it could succeed.
Looks like another PR move by the Modi government.
One Billion Files on Linux [2010]
iPod Touch?