skysight-inc/HackerNews huggingface dataset:
> ...BigQuery's per-query pricing charges you JUST for the resources you use (well, data scaned), so it SHOULD be far less expensive than a model that charges you for the luxury of having a cluster sit idle (and often at only 30% utilization), correct?

> For example, if Netflix charged you a penny per minute of watchtime, you'd have no idea if it's more expensive or less expensive, but you'd be assured it's more efficient.

The Netflix analogy is actually quite good. Using that, let's say that I have a family of six, I'm billed $0.01 per minute of viewership, but I'm getting the best/quality speed. Each person watches 40 minutes a day, for all 30 days, for a grand total of $72. Far greater than the fixed cost of $10.99 (with, say, significantly less quality, speed, and minutes per month of viewership).

In the real world, the family of six is my team of data analysts, scientists, and BI folks who are querying my database from 9-5 every weekday.

A customer of mine, a large NYC publisher, who you have heard of and probably read, evaluated BigQuery in 2017. They loaded BQ with the exact same data as their Redshift cluster, pointed their Looker instance at it, and in just one day blew through 1/4 their typical Redshift budget. All the queries were faster. Way faster than they needed to be, actually.

Going back to my original post above, the issue here is that just because Google CAN throw these massive amounts of resources at my problem, doesn't mean I can afford to use that level computation for each query, or would even want to. In the Netflix example, I'm happy if Sally and Billy get less quality or limited time watching Netflix, as long as my bill stays at $10.99.

For most companies, their Redshift cluster is optimized to be able to handle their peak workload WELL ENOUGH. That means that queries won't be as fast as BigQuery - and that's totally fine. And it means that the cluster will be underutilized for large portions of the night and weekends - again, totally fine. They just need their usage capped at a predetermined cost, and have their queries finishing in a reasonable amount of time.

I've posed this Google employees before and I'm hit with "well, you can limit how much each person can query a day." Except that isn't a acceptable solution. I can't have analysts sitting around unable to query their database because they've exceeded their daily limit. They'd rather just fire off their Redshift query and if it takes a little bit longer, so be it.
Want your business to use ML? Fill a 1 min form for a 30 min free consultation
Voting is certainly the biggest problem in America at least. The two party system means nothing, people don't vote for parties they vote for individuals. The last election demonstrates that it's certainly possible for even fringe elements to capture a party. But none of that matters because of all the problems with voting. The solutions to the voting problem are obvious and well known: independent districting commissions, ballot voting, election holidays and finally mandatory voting (that is a small $20 - $50 fine of anybody with a permanent address who doesn't vote).

But it will never happen and this is by design. The history of America is not the history of empowering people through democracy. It the history of the powerful working very carefully to ensure that only their votes count and only their voices are heard. Even today it is extremely rare to hear important politicians talk about how to make it easier for people to vote, instead all you hear about are the need for voter IDs as the solution to the completely non existent problem of voter fraud. All of these major initiatives to disenfranchise the citizens going back to the very beginning of the republic are now paying big dividends. Academic analysis of the American system has shown time and again the government works only for the wealthy.
The mechanism is they send you an email, you verify it as you wish (have them post a comment using their credentials), you overwrite all comments from that uid in the db with a simple query?

If you're using a CMS then it's going to be type the username and hit "delete all comments"; maybe WordPress et al. do this already.

With a small blog the administration of that is going to be facile, surely.
Just anecdotally, reading is the most powerfully positive shared experience I have with my kids, and we do everything together. We paint pictures, play outside, eat dinner, watch movies, play video games together, etc. But reading is different; when I read to them, they're quiet, they're well-behaved. They are really paying attention.

It's not the activity they enjoy the most, and it's not proactively educational (at least not in the sense that I'm forcing numbers and letters down their throat), but it just seems to turn them into a different sort of kid for a few moments.
Hey HN!

We’re offering free 30 minute sessions to help you identify, understand, and apply the right ml techniques and tools to successfully solve your business problems. We have more than 5 years of experience in AI and applied ML, both in an academic and industry setting. Don’t worry, there’s no upselling involved, and we’ll try to respond to every request! As part of our mission to democratize AI at ModelDepot, we’re trying to help teams struggling to solve a business problem, and learn from their experiences and obstacles along the way.
Can happen. I once worked for a large engineering company and a startup competitor emerged with a cool new innovation.

We very explicitly discussed that we would either aquire them or use the patents portfolio to shut them down.
99% of people give FB their location.

Perhaps as just if (EU IP | EU LANGUAGE | EU PHONE NUMBER | EU LOCATION SET) == EU.

Just to be safe for a massive 4% of global REVENUE fine.
> my personal data is an extension of me, and if you want to store or process it, you need a legal basis for doing so, and need to be able to demonstrate this legal basis to me.

In the U.S., freedom of speech usually trumps privacy rights. It will be very damageable if the supreme court ruled that any EU citizen can limit US speeches based on their laws.
I can't wait that EU citizen will hit them hard after May 25th.
Maybe put you on a naughty list and inhibit internet access - as the UK does for TPB, et al.?
Doctors who prescribe homeopathy ignore other medical guidelines
Magic Leap Creator Portal Open
Why does the media seem to be publishing so many "well duh" tier articles about various companies at the moment? "Big data company collects big data", "company known for monetising private data collects private data", "political consulting company profiles voters and tries to affect vote".

No shit?
> Anonymous comments

Wordpress asks for your name and e-mail to post a comment, doesn't it?

I guess the tuple (ip,name,email,comment_text) is PII?
> Furthermore, individuals are fully entitled to sue in the event of a data breach, and there is legal precedent in the EU for compensation of between 10-15k euro per person.

This means that I can bankrupt small, careless companies that hold a few hundred users data?
I heard lots of good things about Deep nutrition (a book).
Never, ever, recline your airplane seat.

Sit up straight, with your weight on your spine like a human being. Even when sleeping.

When you lean back and try to get "comfortable", you force all of your weight sideways onto your butt, which now has to act as a scootch-guard to keep you on the seat at all. That works for a couple hours max, after which you're in agony for the rest of your 12 hour flight.

Learning to sit on chairs is a good skill in general. Getting an office chair that doesn't recline will do wonders for your health as well.
Lately most of the companies I had an interview with wanted me to be a contractor (most of the time with all the benefits of being a contractor removed, from a law standpoint this is possible), this is a common practice around here, not just out of caution, but for tax evasion as well.

There's not much I can do, it's so common a practice nowadays (literally all of my team members are in a similar construction and we are working on fixed projects from nine to six) that with my next workplace I will do the same.
There's a huge number of people involved in the design of the rpi. The antenna is a great example of a subsystem designed by a separate team; another is the new PMIC for the 3B+[1].

[1]: https://www.raspberrypi.org/blog/pi-power-supply-chip/
Book for kids (death and bullying)
Put a stop to all bullying! Check out "Butterfly Me"....by, Evon Latrail
Now available @ amazon
Also, talk to your kids about death "When Mommy Went to Heaven" by Evon Latrail
The messiness of our elections is excessive, and your points are generally good. But to our credit, it's hard to imagine a large, long-lived republic that would get a pat on the head from Jefferson. He had very strict principles that even he found difficult to maintain in practice.

That being said, we need a healthy dose of principles that safeguard liberty, and the determination to hold elected officials to them.
Ask HN: What tools do you use to automate your business?
I imagine the HN readership loves to automate things.

I'm curious to know what tools you use to automate your business operations (if any).

For example, https://zapier.com is one such automation tool.

If you don't use any tools, do you use any frameworks or systems you've made yourself?

If you don't automate any parts of your business, why not? (I'm interested in the reasons why, not disputing the choice)
How do you charge the phone and use ethernet at the same time?
Top b Schools in Bangalore
I'd really, strongly, very much like this for the Org file format.
Even the Miracle on the Hudson was a pilot completely aware of what could and should be done even though the exact scenario had never been practiced. Experienced pilots have been through enormous training sessions these days and even tossing them something no one has ever faced is still based on them understanding the limitations and potentials of a plane in distress. It doesn't always come out perfectly (planes do still crash based on pilot error) but I'd trust a well trained experience airline pilot without question in life or death in an airplane.
> If your startup is at odds with this, well then perhaps you're not the kind of company the EU wants to be doing business with.

The EU is not a single entity. It’s dozen of nations, more than 300M individuals.
Top BBA Colleges in Bangalore
Oracle Owns “JavaScript”, so Apple is taking down my app: JavaScript
5 guiding principles you should know before you design a microservice
I mostly agree with you, but to the extent that your software competes with other, similar software built by companies with similar cost structures and addressable market, the cost of that sweat factors into their costs as well, so does have a (loose) connection to the viable costs for that software in the market.
duplicate, please check before submitting: https://news.ycombinator.com/item?id=16862949
There are obviously people out there for whom this is new information.
How to Estimate Software Development Cost?
> Compulsory voting, (...) abolishing the electoral college are all fundamentally terrible ideas that pose direct threats to the integrity of a democracy

Why? The electoral college is a pretty uniquely American institution, and Australia seem to manage OK with compulsory voting?

> Not to mention that the United States _is not_ a democracy

Well then how can they be a threat to the integrity of it?
I know this might be a surprise to you, but not everyone knows everything that you do.
Visual AWS monitoring with topology
In France, I have noticed that journalists often say they were very weak in mathematics. Probably there is some kind of education effect that drives smart people weak in mathematics toward journalism. People opinion is very much influenced by journalists and I wonder if this selection bias is the cause of the bad image of mathematics (difficult, disconnected from the real world, ...).
+1 for examine.com, they collate and simplify studies to the point where you don't need any related scientific knowledge to grok them, and provide dimensions that help you to understand the trustworthiness of the result, and the strength of the effect.
I think it’s clear what he meant and you’re being purposefully obtuse. If I said I was going to put a problem “on the internet” you would know I didn’t mean the netowrking infrastructure was going to produce a solution.
https://www.naturopathy-uk.com/ has some links however the actual sylubus pretty comprehensive course, and tends to look at aspects of curriculum not covered by traditional (and reductionalistically broken) alopathic medicine.

Patrick Holford is considered by many as a goto know all for holistic nutrition https://www.patrickholford.com/
Why You've Never Heard of the Titanic's Chinese Survivors
Software as a service (SaaS) in plain English
Whilst the article may not have any surprising information for the regular hacker news reader, it may come as a surprise that a non-insurance, non-government business holds more private data about an individual than Facebook does, especially since most individuals will not recall ever interacting with said company. I think it is beneficial if more people become aware of this.
An uninformed electorate would likely not be an improvement.
> be prepared to delete a user's comments on request.

Or, just block users from EU from commenting. I can see the win for the Internet here.
Sure it is facile. But it is a burden and a exposure to risk, which wont be worthwhile for the most non profit blogs.

And by the way, most blog comment systems don't require you to create an account before commenting. So this "have them post a comment using their credentials" wont work anyway.
I think palantir is CIA related... They probably are not going to worry about pesky international regulations
Yes there are two separate bases for processing of data, but the point is that consent cannot be bundled and made a precondition to another form of processing i.e. to provide a service.

Put another way, Facebook should not make the provision of a service (which technically should not require usage of data for other purposes i.e. marketing/advertising, ignoring any business model points) conditional upon providing consent for that other form of processing.

Bundling of consent means the consent is not freely given here because the user wants the service and so is less likely to refuse than if the consent decision was isolated from the provision of service.
Hey, an AMP link in the wild.
Not a bad idea to yell at someone asleep at the wheel.
media will do this about every subject, think of it as the original analytics, if the story drew a lot of attention then another story similar to the first story will also draw attention because people will associate it with the original really interesting story that drew all the attention. Sooner or later the quality and interest of the stories on subject X will decline and people will not react so much to them so the writing of these articles drops off.

Currently, because of facebook, there is a spike of Company Y knows everything about you type stories, as well as a spike of Facebook is evil stories. These things permeate out and loose interest over time.
7 Books to Grasp Mathematical Foundations of Data Science and Machine Learning
According to a meta study on personal greenhouse impact the biggest "less" thing a person can do is to not have too many children. To their data a single child represent yearly the cost in CO2e as is saved by 20 people not driving, 40 less air trips, or about 100 people eating a purely vegetarian diet for the same time period. (http://iopscience.iop.org/article/10.1088/1748-9326/aa7541)

If we want less we need to understand the order of magnitude that the different forms of less have.
> The last election demonstrates that it's certainly possible for even fringe elements to capture a party.

Trump isn't a "fringe element" - he's pure GOP, just saying the bad parts out loud.
I’ve always thought - I don’t care if the NSA is spying on US citizens because their job is national security. The problem is when those tools trickle down. All of a sudden you have a local cop with too much time on their hands spying on you. But if you’re not doing anything wrong, you shouldn’t have anything to hide, right? Isn’t that how the saying goes?
> mathematically detect corruption, injustice, prejudice, racism, hatred.

The problem in short is that the people in power and quite a lot of those supporters don't want those problems detected.
For Firefox, set media.autoplay.enabled = false in about:config.
Native apps have the same problem. There are "SDKs" for analytics, social sharing, and "monetization" that are native equivalents of putting <script> in your app.
A thread about computers
> Although an objected-oriented language I really enjoy the fact that one doesn’t have to create instances to invoke class methods. This was a big turn off, not to mention cumbersome, on my previous C# jobs.

Am I missing something here? Fairly certain C# has static methods.
Really? Because others have frequently claimed the opposite -- that it is a visualization company with the insight to focus on lucrative government contracts.

https://news.ycombinator.com/item?id=14674460
Counterpoint: http://magarshak.com/blog/?p=169
This skips from idea to idea kind of abruptly without clear linkage but the core idea definitely rings true: freedom cannot exist if all economic transactions are controlled and monitored by a centralized entity. People have to be able to privately enter into exchanges of value. It greases the wheels of the entire economy and prevents things like the State Dept. saying, "No, you can't donate to this journalist."

As cash becomes more and more marginalized and moves from the majority of transaction to something seen as inherently shady and criminal some alternate is going to be needed. Cryptocurrencies that are (mostly) private like Monero can fill part of the void but none of them really scale like cash does nor are they as convenient. They have a role to play in preventing an East Germany like situation but they aren't sufficient.

We still need cash. But go ahead, try buying, say ... a multi-hundred dollar bike with cash. Or even paying for groceries with it, they'll swipe every bill over $5 with the test marker and look at you quite suspiciously. And countries like India and Sweden are moving aggressively to eliminate it. Even in the USA having large amounts of cash is considered intrinsically illegal by both the police (who will seize the cash claiming it's mere existence is proof that it is to be used for or is from, crimes) and the IRS which makes transfering large amounts of cash something you have to report and be scrutinized for. And if you don't they'll throw you in jail for violating either the Bank Secrecy Act or for "structuring", ie, not triggering the automatic reporting provisions.

And people, on a whole, love it. They love the convenience of never actually paying with or holding their own money. A giant multi-national corporation will promise to pay for them and it's reputation is so pristine no business will balk.

It's a brave new world. Just like the old (east german) world.
Freedom to contract isn't a basic human right, it also wouldn't affect companies acquiring my PII from third parties - as Facebook and the like did when harvesting address books.

In most (?) countries we deny the right to contract on many things, contracts that avoid taxation, contracts that involve selling human organs, contracts that make slaves.

It avoids power imbalances from causing desperate people to do things that dehumanise, disenfranchise, and devalue them.
Because what is clear to you, isn't clear to Joe public. Oh - and "company known for monetising private data collects private data" isn't the story. People kind of understand that. What they didn't understand is that "company known for monetising private data" actually sold the raw data, rather than using it for its own targeted advertising.
well if that is what they're doing it's not very useful, if I as a EU citizen do business with their US office they better follow the GDPR in relation to me or I'm going to mess with them.
I'm a little surprised it is as high as it is. I am used to thinking "64 bits is enough for anyone."
It'd be interesting to know the length of a sequence that will never be sent over the Internet. In B. Schneier's "Applied Cryptography" there is a discussion of 256-bit numbers, the minimal amount of energy and mass required to guess them and conclusion that "brute-force attacks against 256-bit keys will be infeasible until computers are built from something other than matter and occupy something other than space."

The length of a never-transmitted-on-the-internet sequence is probably much shorter than 256 bits, even 128 bits (as the article mentions).

More details here:

https://security.stackexchange.com/a/25392
Could someone explain what's the difference between both approaches and what are the advantages of Clangd?
I'm not exactly tapping my own research here. Palantir is a big data/spying company, what do you expect from them? Facebook asks you for lots of private data and it's clearly obvious that when you post data on Facebook, Facebook gets that data. So what's the shock that they hold this private data? The only surprising aspect of the current Facebook drama is that they apparently mine your phone for additional data but that's not the main focus of the outcry. Why are people surprised that Cambridge Analytica, a political consultancy, did political research and affected a voter outreach strategy? None of this requires any real background knowledge, and yet the outcry seems extremely disproportionate to the revelations at hand. It seems like the Snowden reports all over again, where the world was up in arms that an intelligence agency was collecting intelligence.
Please tell me where I can find these jobs that will pay six figures a year for two hours a week of basic IT work. This is more than an order of magnitude higher than anyone I know makes.
> As shown in the privacy breaches at Facebook and Cambridge Analytica, the pressure to monetize data at tech companies is ceaseless

Says Bloomberg, and includes Facebook code on their pages
It's not a near term practical possibility, it would require a Constitutional amendment.

For states, they each get to decide how to structure their own government. Many do have 2 houses. Here the upper house is elected from larger districts than the lower house, but each member represents 1 district.
High standards? For what? I look at amazon and I see a sleazy money-making machine. Nothing about it screams high standards.
Here’s the problem with the journalism industry:

They love to write about scandals and problems. But if you have an actual solution to the problem, they aren’t going to publish it.

You can also see articles on court cases about some scandalous things, but can hardly find out how the case eventually turned out. And so on.

Journalism highlights problems not solutions because that’s what gets the most “outrage reshares”. The exception is some “cool new technology” that can have a story about it, but not as a SOLUTION associated to a lot of PROBLEM stories.
This comment in no-way degraded the conversation. It added important context in a humorous manner.