skysight-inc/HackerNews huggingface dataset:
I do intend to reply to this but there's a lot to reply to and it's late at night on a holiday weekend where I live (in Australia). So please check back again in the next 1-2 days.

FWIW, you've made quite a few assumptions about me and what I believe/defend/represent. Though maybe by "you", you don't mean me personally but what you think I represent - though like I said, I think you're way off the mark on that.

There are also quite a few sneers/snarks mixed in there, again, based on wrong assumptions about who I am and what I represent. Perhaps re-read your answer and make an effort to withdraw those if you're committed to good-faith discussion.

You also seem to vastly overestimate how much of the audience here is U.S.-based (and thus, how much U.S. politics should dominate the discussion), and how many of HN’s active participants are part of Silicon Valley’s elite. If you toned down those assumptions to a more realistic level, your comments above might turn out quite different.

For what it's worth I think you're well intentioned and I think we probably agree on a lot more than you realise, but I think you're going about things the wrong way - that is, in a way that's damaging to your own cause.
According to the article, TechCrunch hasn't had issues with their review model.
If you're using a CI that runs on every PR/master merge wouldn't it catch this without the need for git-bisect?
MDN is a wiki though, run by a nonprofit and written by the community.
A number of reviewers received units.

A subset of the reviewers experienced broken phones.

A subset of the reviewers who experienced broken phones admitted to removing a protective shield on the screen, thinking it was a temporary film meant only to preserve the screen from scratches during shipping.

Samsung was only claiming that the subset of subset of reviewers had erred. Samsung did not claim that the reviewers who experienced a broken phone but who did not remove the protective screen had erred.
If you like Matlab more than Haskell, try https://www.goodreads.com/book/show/11768822-graph-algorithm...
Please check your digits again.
I've read similar articles before, and yet I still feel the need to follow all the suggestions.

I floss daily and brush a little more than 2 minutes each time. Still get dental issues, but I feel like it would be worse without it.

Maybe just doing something makes it feel like I have some control in the process.
tl;dr - UK government distributed a press release by sending a regular email, and just putting 300 journalists' addresses in the To and/or CC fields.

I wonder what their normal process is. Same, but using bcc? Using mail merge (via Word+Outlook)? Using some CRM software?

I'm not sure why this matters anyway. Am I wrong to assume that it's in each journalist's interest to have their email address known, so that people can send them tips?
Exactly right. OOP is a historical failure. We can't be using OOP to describe [immutable] value oriented programming [roughly functional programming] and FRP, unless we devoid OOP of most of its historical meaning.

Historical OOP orthodoxy took great lengths to contrast objects to values. For example, support for values in OOP mainstream languages has been tepid. With Java still failing to fully support value objects at the language level, project Lombok notwithstanding. With Python adding dataclasses support as late as 2017. There is a reason for decades of dragging the foot: OOP orthodoxy shuns values in favor of objects, defined as "identity, [...] state (data) and behavior (code)" [0]. Insisting on "objects" as the only right way to structure programming _is_ the historical failure of OOP. No amount of late attempts at co-opting other paradigms under the OOP umbrella is going to fix that.

I for one welcome the quiet morphing of OOP into VOP/FP. Makes life as a programmer sane again.

[0] https://en.wikipedia.org/wiki/Object_(computer_science)
Standardize and simplify the raw data. I'm a big fan of external tables to schematize the text files since it makes the raw data available via SQL query without any complex code or pipeline. The database just points to a directory of text files and makes it look like a table. Then I create binary models using regular internal tables if it makes sense...to power a Python analytic for instance where I need a subset of the raw data and I need the performance of the binary engine. This gives you an easy path to use different tools without changing your data lake strategy...the way you store the raw data.

Check out Alation and DataIku for democratizing the data and offering self-service pipelines for data science. Most MPP databases have support for external tables and postgres may even support them as well.

Things can get complex, just make sure that each single point in the pipeline is simple and easy to understand.
It appears to be compatible with numbers from the OECD.

http://www.oecd.org/els/family/HC3-1-Homeless-population.pdf
An Ex-Marine Wants to Print Autonomous Vehicles for Your City
The most effective ways to curb climate change might surprise you
Random Space Filling of the Plane
Can Any Company Be a Tech Company? Inside the Journey of Cult Brand Sweetgreen
Entering 60 for loan term crashes the whole app
Shouldn't your terminal view be able to wrap the text itself before showing it to you? That seems a UI display issue rather than one to solve by changing the underlying data representation. I understand why that's not good with code but commits are almost always non-code.
Thanks for that! Hope it’s going well!
Yes. And other bits commonly associated with functional programming should also work together really well with ML. After all, most ML models are explicitly thought about as a composition of layers (ie functions).

But so far, the best ML libraries can be found in impure / imperative languages like Python.
I cannot answer your question without full understanding of what is the current usage of your data infrastructure.

Few pointers

- Who are users of the platform? If it is only used by data science team then you can rip apart the solution and work towards a more logical infrastructure where all you are doing is cleansing, normalizing and deriving features and these become your central feature repository which your team can pull and build models. You need a governance so that team is aligned on what features are present and how do they add new features to repository. At scale of 10 people it is much easier to have this all centralized, if team is scaling out then we will have to work out a de-centralization strategy.

- If you have operational reports like business reporting & investor reporting running on this infra then I would recommend keeping analytics workload separate from operational workload. They have different needs and SLA's.

One thing which worries me is you are talking about denormalization as something you are planning to do, that should have been the starting point of any HDFS/SPARK/Parquet based solution.

I can suggest tools for explorations, data quality check etc. But that requires more understanding of what your current infrastructure is solving vs what it was intended to.
Fitness Icon Laird Hamilton Stays in Shape at 55
It would take a law since as it stands it would defeat the purpose of these devices: to spy.
It is more like Chinese companies are now gobbling up trade share of US in the world. No longer smaller countries have to buy US branded Chinese goods. They can simply buy direct.
Half an os: the triumph and tragedy of os/2
And for a completely different application of differentiation to programming, see http://strictlypositive.org/diff.pdf
Philip and Alex's Guide to Web Publishing: https://philip.greenspun.com/panda/
https://godoc.org/github.com/golang/protobuf/jsonpb
I'll counter with a family anecdote. My sister and her husband own a rental home in the DC suburbs. It's within easy commute of the Pentagon and another army base. They've been able to rent exclusively to officers or senior enlisted. Price-wise, the army housing allowance is at the top of the market of the size/style of home (mid-sized 3-bed townhome). The tenants are mostly price insensitive - as long as the house is priced within their allowance and meets their needs. Their theory is a career military tenant more likely to be a good tenant than some random person. So far it's held true, but small sample size (10 years of rentals, 4 or 5 tenants).

Anyway, point being, this is like any other investment, you have to do the work up front to ensure the risk and payout are balanced. In their case, it was a no-brainer to keep the house when they moved into something larger. Almost zero chance of the home being unoccupied, better than average chance at a good tenant, etc. But, they're also financial well-off and could afford to keep a relatively expensive house in a nice area - obviously not an option for many in the middle-class.
Why not require that written replies or justifications be provided for each vote. probably because of the voter's utility of voting is cheap expressions of approval or disapproval, without requiring the effort of engaging the poster or formulating the reasons for voting at all. Hence, I suspect voting discourages engagement. For downvotes it discourages the kind of engagement that derails productive conversations (ie it inhibits flamewars by providing cheaper outlet for negatively valenced emotional responses).
> Think of commits like little emails. They have a subject that should fit in a subject cell of a table. They have a body. And they have attachments (the diffs).

In fact, git has a command[1] to convert your commits to email messages.

[1] https://git-scm.com/docs/git-format-patch
For 100 gb that might grow to 1tb:

2x NVME drives, each 1tb in size. Buy pcie adapter as needed.

Buy used 256gb RAM server off eBay.

Install drives into server. Put all data on the nvme drives and all other files on regular drives.

Everything will fit in ram after the data is touched the first time after each boot. Can't get faster than that, usually.

Create user accounts for each user, set up git etc. for code storage and to encourage reuse.
The article cites another example of this happening in a way more sensitive case. In the case of a distribution list to journalists it's not so bad, but their processes and training should prevent it from happening.
Data pipelines are typically used to translate data from whatever format the system that produces it speaks into a format that's useful for querying.

As an example you may want to take server request logs and write them to a Postgres table for querying, in which case you'd have something like this:

Server Logs -> S3 -> Lambda which reads new logs to extract key fields -> Postgres

Once that's done you end up with a database table containing rows for things like URL, source IP, response time. You'd probably also normalise URLs so that /products/123, /products/123/ and /products?id=123 come out as the same thing for analysis.
I think a lot of the argument over whether "things are getting better" as Pinker et al. claim and "things are getting worse" as Piketty et al. claim is the time scale involved. (Nearly) everybody agrees that we are living in a better world than existed before WWII. The question is are we continuing to get more egalitarian or have things begun to regress.
Win7 April 9, 2019–KB4493472 (Monthly Rollup)
Co-inventor of Erlang had died
Anecdotally, it does feel like a slightly worse problem in Python. It's got an 'easy to learn, hard to master' thing working against it. It's a little TOO accessible (if that makes sense).Hiring Python devs has always been the hardest in my experience. It's tough to separate the wheat from the chaff.
The purpose of a webcam is to spy?
I don't see much / any category theory in the two papers linked. So I'm not sure what to say.
I wish all downvoters would justify their downvotes with written replies, don't you?
It is exactly what you guessed.
spot 1 on front page https://news.ycombinator.com/item?id=19706514
Can you describe to me which elements of the thought model you find are inconsistent?

As far as where you could go to learn more, I think this book has much of the information you would be interested in, although I'm not entirely sure yet which specific elements of the operating system you're focused on. https://docs.microsoft.com/en-us/sysinternals/learn/windows-...

> if I run Windows in an enclosed VM and roll back any action which might have side effects I don’t want

I see this as a separate argument for using VMs. The stated use applies to any operating system and I agree it's more secure and a good idea. Can you do the equivalent in other operating systems with a simpler procedure? This is a genuine question, I'm ignorant to that
No problem at all. It's your Gmail account and you have the right to do with it whatever you want.

In time and after much improvements I hope to earn your trust.

A free trial is a good idea. I will set that up soon.

Also, a referral scheme has been suggested and is something I would love to work on soon too.

I am in the process of upgrading the FAQs and will add a section for where the reminders are stored. It's quite simple really, they are stored in your browsers local storage.
"You're folding it wrong" - Someone at Samsung, probably.
One of the most charming, smart, funny, and well-rounded people I've ever met.
Also it's a lot easier to send people there one-way than it is to bring them back, and there'd likely be issues with atrophy if we were able to do so. There's really no reason to design for two-way trips for now, especially considering that Mars One showed there's no lack of volunteers for one-way.
Anecdotal evidence is widely considered inferior to controlled studies, and for good reasons: Confirmation bias, survivorship bias, etc. are incredibly hard to avoid for a single person even if they're aware of them.
It’s done any time someone “with significance to the community” dies. I’m not sure when it started but it’s been a thing for many years.

Feels extremely appropriate to me, and honestly, it was the first thing I looked for after I saw a tweet about this. RIP, Joe :(
> What is important is maintaining the institutions that have been wildly successful in mediating conflict between diverse groups

As another commenter remarked as well, there is no point in maintaining mediating institutions if you're not ready to accept the fact that a mediation is a fair resolution between opposing perspectives and needs. In other words, if you have no empathy for the others, any mediation is unfair, and any institution promoting it is essentially flawed.
I'm someone who just took a computer vision course. I have other priorities (namely finals in other courses), so I haven't had much opportunity to repeatedly practice some of the more basic tasks in opencv. I wouldn't necessarily want to pour through my old assignment code to jump-start my memory on these tasks -- skimming through this now, I love how it's presented, and can see myself returning to this.

What you've linked targets a different use case. I don't need to relearn the core concepts through tutorials, and I don't need every possible config option from the docs. I just need simple, easy-to-parse demonstrations of basic use cases. This works for me.

>And then it hit me, this is just another TED talk style Medium publishing influencer.

"This" is a bit of an uncharitable way of framing that person, don't you think? Behind those blanket labels is an actual human with feelings and motivations that you and I don't actually know. Handwaving away a person's efforts like this is unnecessarily dismissive, imo. It smacks of "I don't like the motivations I've assumed from you, therefore your output doesn't matter." How would you feel it you were on the other end of that?
Meh. Houses still have windows, and people still have binoculars, but we seem to get by fine with blinds. Tape over your webcam, unplug Alexa, or turn off your phone if you want more privacy.

More importantly, there is a social norm that you don't look through people's windows with binoculars. Of course police, spies, or creeps might do it, but that's incredibly rare. Unfortunately, the social norm (and business model) of the modern web is that companies build ever-more-powerful binoculars to constantly stare. That's the real problem we need to fix.
Fantastic!

I will Roger that :) Chrome and Firefox plugins open up such a world of possibilities :)

Thank you for the suggestion!

Feel free to follow me to keep up to date!
https://twitter.com/joeytawadrous
Is there any paper or book you like that covers this topic in more depth?
Better Than Bookmarks – Toby
OpenLiberty Security Vulnerability (CVE) List
150 Prisoners Were Releases in 2018 Due to Experts Overstating Evidence
> I don’t understand why the history of the code matters so much to some people.

Having the git blame output of the line I'm changing is very helpful when determining the potential consequences of changing that line. If the history doesn't matter, then why bother with commit messages at all. You could essentially script your editor to run "git commit -a --allow-empty --allow-empty-message" every time you write the files to disk.
My only issue with that response... why the heck does the top layer of the screen appear removable? Users are used to removing protective screens from many displays. Building a product that has something that appears like a protective screen, but isn't, seems like a terrible idea.
On top of which Microsoft suit specifically calls out "Intel compatible PC operating systems"

They are talking about Companies like Dell, Gateway, Compaq, HP, who made intel hardware. What choices did those companies have for an OS for their computers? Windows effectively had a 100% monopoly. They aren't talking about consumer alternatives, where you could by a Mac.

55% isn't a monopoly, Android is a very good substitute, so not really comparable to the 90s where you needed a desktop and Office to get work done and Windows controlled 90-95% of the market.
The main differences in outcome, like the anecdote the article leads with, might be due to different micro-flora in the mouth.

I used to get plaque build up something awful, but since I started taking probiotics a few years ago for another problem, I don't seem to have that problem anymore.
I'll express an advocation for using SQL as a data pipelining language. Firstly, many SQL dialects are multi-platform and provide standardization for transformations. It's a declarative language that doesn't define how computation happens but what.

Where SQL is terrible to write is when one must pivot data. Each column transformation is defined separately (case whens). When the cardinality of a pivoted vector is high, it results in quite a verbose declaration. This problem can be mitigated for example by generating SQL programmatically with templating languages such as Jinja2. Rendering is handled nicely on platforms such as Airflow when running the rendered SQL in cloud (for example on top of Redshift or Presto cluster, BigQuery).

For writing complex transformations, UDFs and cascading subqueries are the way to go. Window functions are useful for scanning subsets of column values (useful for example in vector transformations [doing normalization, regularization etc.])

SQL is also a language with a gentle learning curve which makes it easy to learn for less software-engineering-minded people (BI people and analysts of different departments in a decentralized data science organization). It's established itself as a lingua franca for matrix transformations already for decades.

Data processing is usually done in batches of different intervals as in traditional data science nothing really needs real-time processing for single events. Then Spark shines. But I would rather make a tradeoff of using SQL and Spark side by side when handling real-time processing than losing benefits of using SQL that I listed above.

When data transformations – with some object ontology related to it other than "just maths" – are to be done real-time, then you better start thinking about building an application for that (using your favorite programming languages).

Even with Spark, around 70% of work is done in SparkSQL.
Maybe I miswrote it. I’ve been very unimpressed with all other crowbarrings of category theory into programming than this one. Other attempts feel like language for its own sake, while Pijul really seems like a Grothendieck-style compass bearing use of category theory. The point of using it wasn’t just language, but it really informed the design of the system.
Apple News+ experience reportedly disappoints some early publishers
Yes, if you make it Open Source and possible to self-host it goes from DOA to definitely possible. Would have to explore more, like how it's written, the community around it, etc... before I really commit.

Hopefully you can still make a living. I suspect "open source + commercially hosted" is a good model for something like this?
Lots of stodgy Fortune 500's have tons of Java 8 still around. RedHat will deepen those relationships by giving those companies a cheaper path than Oracle for support.
It is great advice. For the person who is giving it.
How to Make Friends While Traveling Solo
Candy-coated Elixir, which tries to hide concepts that are difficult for people who approach programming without the requisite mathematical skills, may be getting most of the attention, but serious mission-critical "nine-nines" projects are still being done in Erlang. I program in Erlang every day for a system that can't (and doesn't) have any downtime.
You tend to have both vocal advocates and vocal detractors.
>We take your privacy seriously.

I'm sure you do, but please please please -- don't use this cliché. It's superficial and off-putting.

Better explain specifically what you do for it. And then let us decide if you take our privacy seriously or not.
ŽIžek Has a Lot to Say About Christ, but Should the Church Listen?
CVE-2019-11350 Jenkins OC when an expired trial license exists, allows Cleartext
BYD is a an acronym for “build your dreams” :)
What about parts of the commit messsage that shouldn't be wrapped and having them wrapped hurts readability? If you rely on soft-wrapped, then there's no way to prevent that from happening.
Oh, and even Google has gone back to a more relational design with Spanner again.
I met some dentists the other day that waterpicks may be doing more harm to gum density, while still helping get food particles out to avoid plaque building (which itself will do harm to gum density and cause other forms of decay)

yeah well its not like my non-existent flossing habits will supplant my waterpick half-solution. But I do wonder the support for any of this wisdom.
I’d imagine a vendor bothering to put an off switch will know that a simple teardown will show if it actually disconnects the device or just signals software to do it. The effort and expense would be for nothing. Most users would never bother to care about the off switch anyway, and the ones that do will know the truth.
Especially since we don't have any practical experience digging tunnels in mars gravity - or even know exactly how it impacts geology. Would be a shame to lug a bunch of (extremely heavy) equipment out there and have the tunnels turn out unstable.
Something like:

Darwin Mail: Gmail Evolved

Darwin Mail is a better interface to the gmail account you already have:

- Restores Google Inbox features

- ....

Aside, do you need to add any trademark notices?
How the NYTimes Print Paper Comes Together
It's kicking the can a bit, but there's the "--release 8" javac flag you can use in 11.