skysight-inc/HackerNews huggingface dataset:
Possibly not, as alluded to by other comments.

Don't jump on the SQL-on-Hadoop bandwagon without understanding the trade-offs. Here are some:

- If you use Parquet as your storage format, you lose indexes (ORC does support indexes though). If you use JSON, you lose a bunch more stuff including predicate pushdown, which are critical for WHERE clauses.

- With schema-on-read, you lose a bunch of potential performance optimizations that come with schema-on-write.

- Joins on a distributed database are much more difficult and usually much less performant than on a single node.

- Depending on the SQL-on-Hadoop system you choose, you stand to lose a ton of ability to perform complex analytic queries with pivots, windowing functions, etc. which are commonplace in most traditional SQL databases.

- You also lose the ability to rewrite data easily -- UPDATES and upserts are much more difficult (HDFS is an append-only file system, and is best suited for storing completely immutable data; its optimal mode is write-once read-many).

- HDFS also doesn't like small files, so you either have to buffer your writes before writing nice and large 128MB blocks, or have a nightly job to do small file compaction. For enterprise data, small rewrites are often needed to incorporate corrections, backfills etc. due to data arriving late, or due to errors that need to be fixed, and Hadoop does not handle this case well at all.

So as you can see, traditional SQL databases, if your data fits in them, present you with a tightly-coupled optimized environment that distributed databases are often not able to. They support also easy replication (real-time replication can be achieved via CDC).

However, if the scale of your data is beyond what traditional SQL databases are able to handle (and this differs from database to database; some MPP SQL databases can handle large datasets just fine), and if you need redundancy, SQL-on-Hadoop solutions may make sense.

One advantage of SQL-on-Hadoop (via Spark) offers is the ability to resume jobs in a long data transformation pipeline. If large SQL queries fail, they typically return nothing. With Spark, if you cache the intermediate results, you can carry on where you left off.
Technically, nothing.

"Using Visual COBOL in Modern Application Development" https://www.microfocus.com/documentation/visual-cobol/visual...
> At a meeting over the issue he said Zuckerberg also told him: “This is probably the last time you’ll ever talk to me.”

I realize this was probably said in fruatration, but I think it paints a pretty clear picture of Zuckerberg's arrogance and entitlement.
Show HN: Tag oriented bookmark site
Ask HN: My SaaS startup is getting a partner, how much I should charge them?
I started an SaaS startup that is aimed at very specific hosting for civil engineers. I do have a basic product but to have something ready to general public I need additional 6 months and input from the engineers. The current costs of running the software are very low (~$100 a month). I developed the project in my evenings so there is not fixed cost there either.

I am talking to one engineering company as a partner and we are currently discussing how much I should be charging them.
It is crucial for me to be able to have at least one company to partner with. I need them to provide me feedback on the features, suggest new ones and use their name on my website as a partner.

My question is how much I should be charging them such that they move from the legacy vendor to me. I could go as low as $0 given my very low running costs but my worry is that in a 6 months time when my services becomes popular I have to continue to service them while I will have multiple other clients that actually pay. Any ideas how I can structure the pricing ?
Apple Watch Series 4 review: A bigger, better watchOS experience
Because I'm the only one using it, it occassionally has backwards incompatible API changes, most browsers ship with their own engines, it has a compilation step anyways for the wrapper, it is self-contained, etc. How do these packages ship Chrome or FF? They don't make them ship Blink or Gecko as shared system-wide libs IIRC. My browser is no different. (now, Qt on the other hand, is a different story, like Gtk or whatever)
Ask IH: How you guys perform cross browser testing of your websites or web apps?
It takes approximately a year to learn to walk after you are born. But almost everybody figures it out. And once they know, they practically never forget. So I don't know, is it not trivial?

I have never had to support all of the mobile environments of DropBox nor the scale, so I cannot claim that my 99% solution would ever meet their 99.999% requirements. But I have been able to package Python apps for Mac OSX, WinVista, Win7, Ubuntu, and CentOS at the same time using that strategy.
While unlikely, I could see more wide-spread adoption of this concept if a large online company began using the approach. If Twitter for example decided to cut out all their bloat, simplify served graphics and assets, and invest in sustainable energy, I could see other high-profile internet companies following their lead.

Just my 2¢
Isn't there a meaningful difference in this case between the consequences of false positives from routine mammograms, or, say PSA testing, compared to detecting Atrial Fibrillation?

False positives will always cause undue distress, and that's a factor worth considering, but the consequences of a false positive from a mammogram or PSA test could be an invasive biopsy, as you point out, or even unnecessary treatment. Wouldn't the consequences of a false positive AF detection typically be much less serious though, such as some additional non-invasive tests? There's a financial and psychological cost to that, but is it really comparable to a false positive indication for cancer, which would be much more difficult to follow up, especially weighed against the benefits of detecting undiagnosed conditions?

When I saw the product launch I shared your concerns about emergency services being inundated with calls from watches detecting falls, but apparently the chief executive of the US National Emergency Number Association isn't concerned. He said this about it:

“These are the real beginnings of exciting innovation. I don’t see, at least initially, an overwhelming number of false positives coming in. But only time will tell.”

https://www.bbc.com/news/technology-45518040
Consider that turning down the very very large offer would also have meant turning down the money for his hard working employees. Not such a simple choice.

But, as he openly acknowledges, he did sell out to a terrible company.
This article is a bit out of date at this point (2017), but it gets the history correct. To see an updated Tweetmap demo (the demo shown in the carousel), check out:

https://www.mapd.com/demos/tweetmap/
Yeah unfortunately that's an attitude that still exists in some places. Fortunately I'm going into a specialty (EM) that has much less of that, and my first priority is to find a group of people I like and that I want to go to work with every day.
A lot of newsletters use click tracking. These scripts are blocked with a full block list, making everything unusable. It's often affiliate stuff and the newsletters that do this stuff
What if he uses prerecorded footage of his hands, created by using some kind of TAS programmed to perform a 4:55 run in human style and then outputs those button presses to a screen. So instead of playing the game, he just presses what he sees on the screen. It would take a lot of work but would arguably be a lot easier than actually accomplishing the real run. Then, the footage is just TAS footage and the camera on his hands is also prerecorded. Then he just has to read out the comments on stream as this charade is going on and make sly responses to it

I guess my point is that, although I trust the veracity of this record, one should not underestimate the potential for cheating.
Sure, but fight the battles you can win. The database I use wasn't written in C. That doesn't mean I have to write applications in C.
Yes. It varies from car to car, but as someone with a new GM vehicle I can say it's definitely feasible to disable OnStar. And contrary to what someone else up-thread suggested, it throws no codes if you do.
Cryptocurrency Giant Bitmain Chooses Hong Kong for IPO
To be fair it had gone up by an irrational amount just prior to that...
*IPO
There goes any level of free speech...
According to this table: https://en.wikipedia.org/wiki/Benefit_corporation#History I'd say around 2010.
This[0] is also a 43kB 800x533 image, saved at 30% JPEG quality from the GIMP. The whole dithering thing seems to be the wrong approach.

[0]: https://bitsquirrel.co.uk/800x533.jpg
Seconded. I only wish it was easier to convince management that the cost of switching from Oracle products is worth it.

Vendor lock in is a real bitch.
Getting error for the content part of the page... AccessDeniedAccess DeniedB0E46C75A8861AB9BwG1ruvHy+Eu1LweUgZ2ydwVUOXxwRrOMT5gsdZqPlbSqFFmjbuAm0gFG3V2iT+1DV5UHcHleBg=
"IBM Cloud Private" - it's a fascinating product that can be summed up as "We package kubernetes for you, and you pay us 2 million dollars. If you are a huge customer, we'll discount that to 1.6 million dollars."

Trying to keep from maniacal laughing during their sales pitches is always a fun game.
How to create beautiful pipelines on Elixir with Opus
Tab management is as bad as ever, I need to turn of spy configs all the time to still use it, it broke most of the plugins I used etc. etc.
As you stated, blockchains can be quite useful in a low trust environment. Thus currently most of its use cases are by criminals or transactions that can't be easily adjudicated, like international money transfers. I hope that the cryptocurrency craze is more just a standard get-rich-quick ponzi scheme in action than a sign that the West's hard won high trust culture is changing to a low trust one.
Cool experiment!

My suggestion is to get a larger solar panel. Solar is cheap now, less than US$1 per watt. Why not get a 100W or a 200W panel? It will put out enough power to supply the server and router on a rainy day. The battery will only be necessary overnight.

The price of 18650's is low enough that building your own pack to handle 30W continuous overnight is not costly. To help with the environmental impact and cost you can get used batteries that are being recycled or thrown away.
How much is a 10 gigabit peer connection? I know you can buy 1 Gb connections for $500/m at some datacenters.
If you read the history how Iverson notation became APL programming language, you might agree that APL is more natural as it grows from mathematical notation which accumulated over centuries. Actually, APL was initially used to teach basics of programming, it was considered to be easier for many, especially non-programmers. Funny that now Python takes a lot of that role.
Someone really needs to publish a nicer font in an easy-to-integrate way for these projects.

This MDA/EGA/VGA thing hurts my eyes.
As a big fan of ergonomics, it's really hard for me to understand how anyone likes these types of keyboards....

Maybe its just my physical size, but to me, one of the biggest problems with traditional keyboards is how close the right and left key 'wells' are to each other.

I started using a kinesis advantage some years ago and find them simply amazing for a multitude of reasons.

- First off, the separation between right and left key 'wells' decreases pressure at my wrists significantly.

- Secondly, the small, natural curve in the wells seems to greatly reduce the effort required to reach the most used keys.

- And thirdly, thumb keys are bomb!!

All of that said, it is a pretty expensive piece of gear... but it's also where the rubber meets the road -- where my fingers do the talking.. so why shouldn't it be nice?
> The concept is truly revolutionary

In what way? Publishing a DB dump with a checksum has been around for decades, and doesn't require a new user to download an entire history of deltas from day 1.
Mosaic on an SGI or VAX/Tektronix not sure which one arrived first, we had both in our Unix pool at university.
sorry, but that is very naive of you 2018 / 2010 / 1990, no business can be trusted to tell the truth if it is not written down in a legally binding way.

They will always do what is in their best interest when it is in their interest to do so
> Yes and the only way you can “require” anything when doing business is through a written contract with clauses that specify what happens when the contract is breached and the jurisdiction where the breaches will be adjudicated.

I expect/require that people not steal from me even though I don't have a contract or prior agreement with them, and I also predict that some people won't respect my property.
Well I was never trying to defend against hypocrisy and no hypocrisy is present in the actions of the US considering these international norms were developed by the US more than a century after the supposed IP theft by the US took place.

Using the argument that some country did the same thing 100 or 200 years before is a child's argument and holds no weight. The Chinese government by taking advantage of the international order developed by the US has sown the seeds for the trade retaliation that is taking place today (to the detriment of everyone).
Vivaldi browser launches 2.0
People don't need to know what OAuth is to use it. I've built and provided support for a site used by thousands of adults and even children! They rarely had problems understanding OAuth. So, maybe make a better argument than "you just don't have experience with support".
Well, I am going by the DO-178C/ED-12C (Software) and DO-254/ED-80 (Hardware) from the RTCA and EUROCAE which I have conveniently next to me since I am currently planning a Software Assurance Level D system for use in the A320.

Also I am going by the 2 Portable IFE systems from our hardware partners that I have in my Lab to play around with. Portable IFE systems are completely battery powered and have no connection to the Aircraft. The only "certification" that you need is that you would need to demonstrate that this device does not need certification. Which in the case of the 2 devices I have right here is fairly simple thing.
Lack of evidence can't really ever prove anything.
That might be but I'm using dotnet core and vscode on Linux now and except autocomplete being weaker than I'm used to in Java and config files being a mess, -both of which are true on Windows as well, I haven't found a single thing to complain about.

And while I have stopped trusting MS (again) after their recent browser failure it seems they are very much trying to sell software and services on all platforms.
Snapchat is my favorite for messages and calls to others with snapchat.

(I work there)
Back in the day (also before ext4) we solved this by mounting the root filesystem read-only. Depending on any other application for the machine, you may not need filesystem writes at all once it is set up. Bonus: it’s even friendlier to the flash.
"At some point" is not the same as "eventually". Think of it as "eventually consistent" to the extreme.
https://solar.lowtechmagazine.com/feeds/all.atom.xml

^ seems to have full articles.
For what it's worth, United Healthcare's Motion program supports Fitbit, Garmin, Samsung, Apple Watch, and more:
https://www.mobihealthnews.com/content/unitedhealthcare-adds...

UHC is the U.S.'s largest insurer, and they claim to have validation data that shows this program saves money.
Border family separation and how computer software can make policy
> The size of the average web page (defined as the average page size of the 500,000 most popular domains) increased from 0.45 megabytes (MB) in 2010 to 1.7 megabytes in June 2018.

It's the second place I see such low average size values (I'd say, somewhat reasonable), but I'm having a hard time believing in them. On a typical site, when I hit F12 and proceed to Network tab, I usually see ten times greater values. I fear that those statistics are either undercounting something, or 500k is just so many domains that the long tail of lightweight sites drags the average down, making values not representative of the real situation. I wonder how those stats would look if the average was weighted by the number of visits.
5 days ago you submitted https://www.indiehackers.com/forum/what-is-best-cross-browse... (https://news.ycombinator.com/item?id=18038775) which got answered. Isn't this the same question?
Are you from the cloud? ;)
Maybe not for the first offense. That's why we should repeat it.
Of all of the things to be upset at google about this just isn't one of them for me. I'm not quite sure why this is the thing everyone is rallying against google about.
I think like most people who sell their business then see it multiply in size and value afterwards, hindsight is a bitch - he regrets it. He was tortured for years thinking about 'what if' he hadn't sold the company and been in control of its destiny. Rather than appreciating the position he's in, which is probably what he should be doing.
You are basically proposing communism in Silicon Valley, as there are no homes costing less than that :-D
If you're relying your business on something, you'd better read the damn license.
> Agreed. Do you disable your pi-hole on sites like Reddit? They vet their ads so not have any of the malicious attributes that you described.

I've still got ads blocked on reddit because they're so clickbaity as of late. They look like posts from subreddits I'm subscribed to and turn out to be an ad, no thank you.
You know, I used think the technicals mattered. Then I realized how the technology behind the technology behind bitcoin works: https://twitter.com/mikeinspace/status/1043577578357952512
Demn im more in software dev role currently
I tend to skip around videos.

When it went from "exploit this glitch" to a graph of "registering p-q alignment", I knew I would have to slow down and watch the entire thing.

Boy am I glad I did.
Cisco: Linux kernel FragmentSmack bug now affects 88 of our products
Untested behavior leading to unexpected results.. is still a bug.
There is no law at the international level. China can do whatever it wants. But, other countries can do whatever they want as well: they can stop trading with China.

But China's labor is so cheap. Exploitation is a sweet sweet drug for the west. So, it's complicated.
They could try, but ultimately Hyundai is spying without permission. Hyundai could sue the original owner for damages that arise from not being able to spy, but I'm guessing they'd go ahead and keep spying when they shouldn't. The original owner can't be held responsible for that.
I hope more companies offer a paid version of their site that completely removes Advertisements. I cannot stand ads and won't use a site if I can see them. I'm not trying to be a bad guy though, I want to use those sites legitimately. My only option is to not visit them until they offer a compromise.
Any% refers to completion percentage, not the number of glitches allowed. But yes, some categories allow for glitches and some don't.

Over the years the Super Mario Bros community in particular has become more accepting of glitches, as otherwise both TAS and human runs would have hit the limit of how fast is possible. By allowing glitches there is now always a possibility that the runs can be further improved.
Damn, so true! There you see what certain projects can do to your spelling!
i can't tell if you're joking but there is no such thing as a 'gentlemen's agreement' in international relations. nations go as far as they can and do what they feel they can get away with to advance their interests. hence, you know, espionage.
So you are building a write-only editor-less Wikipedia? Not sure how blockchain is related.
Well, that is what he did, isn't it?
As someone who uses their real name, I have faith that in the future no one will care what you wrote on the internet because virtually everyone has said something dumb or incendiary.

Also, as a rule I only use this name on sites that are clean and professional, ie: github, where I know I will only post sophisticated things that could benefit my career, unlike reddit where i just want to fuck around.
Android spyware in development plunders WhatsApp data, private conversations
Doctor Who teaches you how to regenerate from a developer into a project manager
I've heard Snowplow is good. I think it's self-hosted so it's likely more complicated to setup than a complete solution like Google Analytics. But then Google doesn't get the data.

https://github.com/snowplow/snowplow

https://github.com/snowplow/snowplow-javascript-tracker
Maybe this is a different way of putting it, but my assumption is that if there are killer apps for blockchain tech, the value created will tend to be in the equity of companies rather than tokens. In most cases where those things are being conflated (e.g. ICOs), there's no obvious reason for it. Not everything needs a bespoke ledger and microeconomy. The complexity is completely unjustified.
Pre-Facebook, WhatsApp's monetization strategy has been to charge users a nominal fee for usage ($1/year). And $1/yr with 1B users doesn't justify the price tag for Facebook. So Facebook wanted to introduce advertising.

PS: I'd be happy to pay them $1/month because a significant part of my communication happens over WhatsApp. The challenge is $1/month is probably too pricey for most of their user base.
No, you can't verify the food itself. But you can verify that a digital signature owned by the company in question signed the chain of custody for that food item, and using the blockchain, you can verify that that signature was made at a certain, retroactively immutable point in time.
There is also the issue that caching (e.g. cdn of jQuery or React libraries) can mean that, if you visit a given website every day in a month, you may only download that library once (the first time). Their estimate is definitely lowball for your first visit, but it might be a reasonable estimate for how much is actually downloaded on average.
It's a bit disappointing that, at a time all monitors have enough memory and brains to display images out of their own memories (to say nothing about doing complex image operations on incoming video in real time), they still need perfectly timed pixels.
>where iPhones have been inundating 911 call centers with unintentional "butt dials".

This happened to me just a few months ago. I'm sitting in the passenger's seat of a car and, out of the blue, I get a call from a weird Caller ID which, of course, I hang up on. I get another call, this time from a regular looking number in the local area code. I reluctantly answer it (in spite of my friend driving telling me to hang up) and it's nearby emergency services. I'm of course totally confused and ended up hanging up on them when they start asking my name etc.

It turns out there's a setting you can change to make this harder to do by accident but I had no idea until I looked it up.
I imagine huge weights hanging off the balcony of a Barcelona apartment :)
I may have over-simplified "Global Affairs" to "PR", but essentially, it means he's supposed to smooth over relations diplomatically with organizations, governments, people, etc. around the globe. Sure, that does sound exactly like who would speak to Congress, but again, like being a lawyer, global affairs doesn't make decisions for the company, it sells those decisions to other people.

Congress wanted to question the people who made decisions at these companies, and Google refused.
The most under-taught skill in machine learning
Didn't WhatsApp used to charge a dollar a year?
It specifically says he didn't settle, because he didn't want to sign an NDA.
This sounds like it belongs on r/iamverysmart/
You're asking why someone doesn't want a lower number of published npm libraries on their resume?
Bitmain Company Just Opened the Books for Its IPO
Yes you can. But having non-technical people verbalize the need to whitelist a domain is incredibly painful.