skysight-inc/HackerNews huggingface dataset:
I'm a web developer who has been thinking about engineering hiring and culture a LOT over the last 6 months. I'm confused about employers' desire to cast a wide net, only to filter through applicants thoughtlessly. Instead, why don't engineering teams save time and energy by articulating their specific engineering values, and sharing that information up front? Be honest. Say divisive things. This will allow job-seekers to self-filter. Your goal is not to attract every software engineer. Your goal is to attract the people you are most likely to hire. (Career pages can be fluff, and job descriptions are dry and uninformative beyond a list of technologies.)

I've been working on Key Values (https://www.keyvalues.io) for many months now trying to do just this: surface details about actual team members, day-to-day processes, and a team's engineering culture. At least this way, we as engineers can be more informed when deciding where to apply, where we'll devote hours/energy interviewing. Of course engineers might be skeptical or have questions, but at least we have something to respond to.

Ultimately, neither job-seekers nor employers want to waste time and energy interviewing people they aren't culturally aligned w/. Maybe the lesson here is that engineers should seek out the teams that care about what they care about, whether it's mentorship, high quality code, or work/life balance. I know it's controversial (especially here in HN), but is salary really more important than doing work that is exciting/challenging/energizing/stimulating or feeling valued/appreciated/respected/passionate?
Some of us believe that tests increase work by 25% while only reducing defects by 60%.

https://www.microsoft.com/en-us/research/wp-content/uploads/...
I was under the impression that Apache Arrow was supposed to be the unified storage representation of data that can be used across Apache projects.

i.e HBase stores data as Apache Arrow, which can be directly queried by Spark or Hive without the need for serialization. As in eliminating the current overhead of going from HBase HFiles to Spark's internal RDD/DataFrame representation with lots of ser/deser going on on both fronts.

I think the comparisons to Parquet and ORC are surface level, I expected Arrow to become the "One storage to rule-them-all".

Did I get this wrong? Kindly correct if so.
Honestly I've never understood people's problem with LaTeX, where everyone says it si "hand crafted". Honestly just grab a template. Maybe modify it a little and tweak it, but then save that skeleton. Have one for a resume, research papers, other docs, etc and you're golden. You have to do the same thing in Word too, the difference is in LaTeX it looks like code. But IMO LaTeX looks nicer than Word every time. I can usually spot a paper written in LaTeX vs Word and there definitely is a correlation to quality.

You CAN get fancy with LaTeX, but I doubt most people will be doing those things. For every day research papers or resumes, just pick up an online template and make whatever minor tweaks you want. Then fill with text.
GSuite would be Google. I don't think an advertising company is really going to be that much better than Verizon. And if I just want 1TB of online storage I have better options. The question was about a "photo sharing" application not unlike Flickr.
As someone who does a huge amount of writing, it's always surprising how many errors still end up slipping through even though I do at least one re-read when I write something. It's basically impossible to do a good proof-reading job on your own work, especially if it's something you've gone through and reworked multiple times like (presumably) a resume.
It is even better, as the question is "What steps should I take?", which is a very "just tell me what I need to do, step by step" way to ask this question, and yet the answer doesn't give you any concrete suggestions for what to do now other than "feel am impending sense of doom".

(Though given that Google knows the only people who care are people they likely consider to be competitors--as the whole reason they bought ITA in the first place was to obtain the power that comes from vertical integration--that is likely exactly what was going through their minds when they wrote that: "let's be particularly unhelpful".)
It reminds me of an old /b/ wheeze:

There was this memetic image called either "Cockmongler" or "Grinman". Which of those names was correct? Why, whichever one the mark didn't use, of course! If the pigeon said "Cockmongler", you had a whole rant ready to copy-paste about how it was always "Grinman" and oldfags know this and /b/ is now cancerous and yadda yadda yadda. Vice-versa in the converse, of course; the point is, the other person is always wrong.

You can apply the same thing to "ship" vs "boat" or "half-staff" vs "half-mast" or "that" vs "which" or any other pair; it's a wonderful way to utterly derail any attempt at discussion involving those terms, or, possibly, the concepts they're attached to.
Very clever, but

…

2. a statement or promise strengthened by such an appeal.

Oath promises to connect over a billion people to a stable of brands that they love. The is Oath's promise, feel the .

“This is our promise to you. To connect your brand to over a billion crazy in love [in love with brands] people.“ https://www.oath.com/ [Can you kick it? Play video]

It's in the barftastic marketing-speak copy in the video.
From the article:

In an interview with Logic magazine in June, Maciej Ceglowski of Pinboard laid out all the reasons why the usual methods that the public has used to exert pressure on large companies will not work in the case of platforms like Google or Facebook.

First, boycotts are unlikely to be effective. Many big tech companies are near-monopolies. Facebook is fun because everyone you know is on Facebook. The Google algorithm works well because everyone uses it to Google things. If Amazon has put all your local stores out of business, it is not so easy to take your business elsewhere. A growing number of gig-economy jobs rely on apps built on top of these platforms. Social media networks are used for background checks on everything from job applications to renting a place to stay. They have become part of the infrastructure of everyday life – like electricity or running water.

---

Traditionally, boycotting works because you refuse to do business with whoever you are boycotting in that there is was direct link customer relationship between the boycott-ee and boycott-er. In the case of Google and Facebook, the people searching or posting aren't the customers, the ad buyers are, so you can boycott them instead. And in the case of Facebook, boycott-ers can really make it painful by using the same platform to organize. Yes, it's more indirect, so it definitely more likely to be ineffective, but I think it is still possible. If boycott-ers really wanted to turn up the heat, they could escalate by refusing to do business with vendors and major investors, or refuse provide services to C-level executives, board members, vendors, and investors. Now of course, boycotting activity should remain peaceful, and not endanger life (either through causing harm, or preventing access to life-saving medical care or necessary nutrition). However, it is totally possible to be both peaceful and to be a very painful thorn at the side of the boycott-ee. If you have a security mindset/background, it is basically "think like an attacker", but with a different set of criteria, constraints, and allowable tools.
Software code signing certificates worth more than guns on the Dark Web
World's First Rotating Skyscraper Will Morph on Command
I'm definitely curious to see if the update to npm 5.5.1 resolves most of the issues people have seen on the 5.x releases. Otherwise having an LTS release with a rough release of npm might be pretty painful for a lot of the ecosystem.
You mean "Googles are"...
I've seen burnt coffee that was roasted less than this.
Samsung Bolts Galaxy S5 Units Together to Create Efficient Bitcoin Mining
So did Equifax. All this outrage is completely unfounded.
I noticed that even these little HN checkboxes have a grammar checker. Earlier, I carelessly wrote "the the", and it underlined the second "the" as incorrect.

And yet, the comments in response to my OP are full of easily detected errors. It's like you have to make an effort to screw it up.
I'm also a developer on Arrow (https://github.com/jacques-n/), similar to WesM. It is always rewarding (and also sometimes challenging) to hear how people understand or value something you're working on.

I think Dan's analysis is evaluating Arrow from one particular and fairly constrained perspective of "if using Arrow and Parquet for RDBMS purposes, should they exist separately". I'm glad that Dan comes to a supportive conclusion even with a pretty narrow set of criteria.

If you broaden the criteria to all the different reasons people are consuming/leveraging/contributing to Arrow, the case only becomes more clear for its existence and use. As someone who uses Arrow extensively in my own work and professionally (https://github.com/dremio/dremio-oss), I find many benefits including two biggies: processing speed AND interoperability (now two different apps can share in-memory data without serialization/deserialization or duplicate memory footprint). And best of all, the community is composed of collaborators trying to solve similar problems, etc. When you combine all of these, Arrow is a no brainer as an independent community and is developing quickly because of that (80+ contributors, Many language bindings (6+) and more than 1300 github stars in just a short amount of time).
Indeed, and I think it's quite telling that the founder of D-Wave, along with some former D-Wave employees, have given up on their vision of quantum computing and are focusing their efforts on making industrial robots instead.
I was a Java dev for about a decade, and I was seriously considering a career change before I discovered Clojure. Working with Java nearly convinced me that I did not enjoy programming. Moving to Clojure was pure joy for me. I've been using it for over 8 years now, and I still enjoy working with the language immensely.
Where do you get that from? I randomly checked a few of the tweets and didn't see anything about shared. Nothing about private, either, but that seems like a reasonable default assumption.
You're such a fucking pussy, there was nothing wrong with that comment you absurd ass-hat.
the last point is more critical and difficult to do it right. Comments are vulnerable to all sorts of xss/injection attacks and the functions that scan for them will have to be updated frequently..
It's true that there is a distinction between a quantum computer build using a universal set of gates(what you probably mean), and one that uses the adiabatic model to carry out computations. The former, is difficult to construct due to decoherence, while the latter carries out computations in the ground state, neatly sidestepping the issue. Saying the D-wave computer is not a quantum computer simply because it does not use a universal set of gates is patently false, it uses a different, more restricted model true, but one that still exploits the resources of the quantum realm to carry out computations. It's also true that theoretically, the adiabatic model is less developed, and thus supremacy arguments are more difficult to make, but as long as quantum effects(i.e. superposition, entanglement, etc) are used to carry out computations, it is a quantum computer.

> The last time I checked (which was a few years ago)

A lot has changed.
Like Netezza?
Do you have other people proofread and spellcheck all of your external communication?
Not in detail, but afaik they can revoke your permit to work in health sector, if you get charges from drugs, as you are then not seen fit.

Also in bavaria, there have been charges against people for driving under drugs, even though they only posessed them and did not consume at that time ...
Thank you! I appreciate that :)
I'm not talking about the previous posters 30% drop being a small margin. I'm saying that 1% paying customers is a risk and it's likely to get lower than that, the more exposure it gets.
The 2017 15” MacBook Pro only has a 76 Wh battery, so this is mainly a design choice by Apple (smaller battery means smaller laptop) and not due to FAA regulations.

Source: https://www.apple.com/macbook-pro/specs/
> I do agree that there are problems where the "maps of facts" approach is better suited than ADTs. I'm not sure if those are the majority of problems we're solving.

This also seems like the kind of thing where row-types would allow for statically typed, fully inferred programs that are written in the style Rich is advocating.
>That's some crazy propaganda

Historically women who chose unreliable reproductive partners suffered disastrous consequences. She lacked adequate resources to provide for her child and was ostracized by society. Women, and men alike ("shotgun weddings"), directly suffered the consequences and paid the costs of such decisions. The modern welfare state spreads the cost of these poor decisions to broader society.

Nearly 40% of single parent households live in poverty, compared to just 7% of married couples. The high school dropout rate of the children of single parents is 71%. Why do these stats matter? In the 1960s when we started the "war on poverty" by creating modern welfare programs the poverty rate was 7%, now it's about 40%. The unmarried birth rate was about 5%, now it's 41%.

>Crappy maternity leave, no free childcare, no free snowsuits or diapers, formula costing money and breastfeeding costing time....

Free or subsidized childcare is available at the state level in every state that I'm aware of. SNAP and WIC provides food or formula. Sure, there's no direct subsidy specifically for snow suits or diapers, but there's low income housing, free meals at every free public school in the nation, free cell phones, subsidized broadband internet, etc.

>Sexism on their part is not the reason for poor maternal health outcomes in the US.

Correct, the root cause of poor maternal health outcomes in the US is poor health decisions on the part of mothers in the US. We can have a separate discussion about whether or not it's the state's responsibility to spread the cost of those poor health decisions to broader society, but that doesn't change the base facts. But once again, if you look at the entire thread you'll note that I was merely providing a summary of the article. I don't believe that OB/GYNs, by and large, are sexist. The article, however, is pretty clearly pushing that idea.
Sadly true
You are better than him, he's a fucking ignorant SJW who bans people who refuse to cow down to his absurd censorship. He thinks his feelings are more important than allowing people to be human and talk openly without being pussies.
A Guide to Creating Web Applications with React and Redux
We shouldn't call them "predatory journals", instead we should use words like "journals of convenience". After all, many of those involved profit.
And some idioms might make sense, but they're used in a way which deprives them of sense.

For example: "Well, that's the exception that proves the rule!"

There are a number of ways to make that make sense, such as the use of "prove" to mean "test", as in "proving grounds", so that's the exception which tests the rule, or, alternatively, the fact it is an exception is proof the rule exists in the first place. Both sensical interpretations.

Of course, it isn't used like that. It's used more like this:

A: "Women can't program!"

B: "Wrong. Look at Grace Hopper, to begin with."

A: "Well, that's the exception that proves the rule! Women can't program."

B: facepalm
Prosecutorial discretion. Given the circumstances it’s hard to imagine someone thinking that the FB edits deserve prosecution. Can you imagine convincing a jury that this deserves a felony conviction, or a judge handing down any sort of meaningful sentence? (IANAL)
We built Dremio (github.com/dremio/dremio-oss, apache licensed) entirely on top of Apache Arrow specifically for the purposes of creating a high speed analytical capabilities including MOLAP like work as well as other forms of caching/acceleration for analytical workloads. Other products/projects are also starting to adopt a similar technical architecture.
>About 54% of these men stated that if prostitution did not exist then they would be more likely to rape women who were not prostitutes. This belief was clearly held by one man who even stated: “Sometimes you might rape someone: you can go to a prostitute instead” (Farley et al., 2009).

Is there some old-timey mindset still out there that rape is somehow ok? I'm stunned by this majority of men surveyed in London admitting that they would rape a woman.
There are extensions for chrome and I'm pretty sure you can whitelist sites, is that sufficient enough?
I really need to get my photos off Flickr.
The deprecation timeline is being synced with the rollout of CT and CT enforcement headers (Expect-CT). This provides roughly the same detection (if not prevention) capabilities.
https://github.com/nodejs/node/blob/master/doc/changelogs/CH...
But if the page was fraud to begin with? Can you be done for fraud for editing an already fraudulent page?
7 > 5, so the 5 years are up.
Possible, yes. Performant or pleasant? Maybe not :)
> Therefore, it makes sense to keep Arrow and Parquet/ORC as separate projects, while also continuing to maintain tight integration.

I wonder how many people will be lost before getting to the last line.
Furthermore, I don't believe there is a LetsEncrypt equivalent for code signing.
> Here's the crux of your argument - and I honestly think it's a flawed premise: The failure of unit tests indicates something other than "Something Changed".

No, the failing tests indicate something changed, and where it changed - what external behavior of a function or class changed. Is the change the right thing, or a bug? Don't know, but it tells you where to look. That's miles better than "I hope this change doesn't break anything".

> "design your APIs before implementing them" - this only works out if we know our requirements ahead of time.

No. "API" here includes things as small as the public interface to a class, even if the class is never used by anything other than other classes in the module. You have some idea of the requirements for the class at the time when you're writing the class; otherwise, you have no idea what to write! But writing the test makes you think like a user of that class, not like the author of that class. That gives you a chance to see places where the public interface is awkward - places that you wouldn't see as the class author.

> This tells me that we're rewarding the wrong thing: the creation of passing tests, not the creation of correct code.

We're rewarding the creation of provably working code. I fail to see how that's "the wrong thing".
Institutionals use futures to hedge their other positions. What will they use bitcoin futures to hedge for? An unhedged future position is not an investment. It is a gamble.
A number of HN anecdotes vouched for this project (and it is used for the new-ish KDE Plasma Vault utility), but after further review I can not recommend it for heavy usage. There are multiple open issues reporting lock-ups (re-mount works; no data loss):

> https://github.com/cryfs/cryfs/issues/64#issuecomment-285968...

Here is a comparison of several similar options:

> https://nuetzlich.net/gocryptfs/comparison/
Being told I'm a good culture fit but don't have enough experience is equally frustrating. Especially when it's a rails dev position and I've been working on rails for 9 of the 12 years it has existed.

I eventually figured out that they meant something else - like I hadn't lead a team (bigger than 2) directly before and was interviewing for a lead dev job, or I didn't have much operational experience since the previous startup I worked at was very simple and built on Heroku. In some cases it might be that I didn't have experience with the specific JS frameworks that they were using (e.g. Angular, React, whatever).

But the impact is I come and interview, it goes well, smiles all around, and then they say no, we were looking for someone with more experience and I'm thinking... what? What experience? I have to kinda guess.

Anyway, yeah, saying no culture fit sucks because you don't know what to do with it; maybe you could do practice interviews with friends and see if they see any glaring annoying tendencies?
Yes, by definition every future has the same number of longs as shorts.
Kaggle ML and Data Science 2017 Survey Results – Dataset and Ongoing Kernels
mapdb has in roadmap to provide query api.
Not really. I never signed a SLA with my power or water company. We know they try to keep the service(s) "up"... but if they can't, they can't.

Sadly, people riot and fight over much less than the loss of an API... just wait until black friday or some team wins or loses a game.
Data frame is fairly well defined, but it's a common source of confusion. In a data frame, the columns are of heterogeneous types (string, integer, bool, double, factor or "enum", etc.). In a vector/matrix, every cell has the same type.

A short way to understand it is that R and Matlab aren't the same thing. They are not substitutes for one another.

In R, the core type is the data frame. In Matlab, it is the matrix, of which a 2D array is a special case. (Both Matlab and R have grown some of the others' functionality, but it's not good at all. You can tell which one is primary.)

Another way to say it: Julia at its core isn't an R replacement; it's a Matlab replacement. Apparently, the representation of missing values was a problem for DataFrames.jl. Whether or not individual entries in a vector are "nullable" has a large impact on how you write vectorized mathematical operations and how well it performs.

And if you notice that data frames sound like SQL tables, well that's exactly why these Apache projects are converging/overlapping :) They are coming from different points of view, but they have the same underlying data model.

One of my slogans is that "R is the only language without the ORM problem", because its native data model matches the data model of a relational database. I'm designing a shell which will feature data frames (eventually, probably not for a year or more):

https://github.com/oilshell/oil/wiki/Oil-and-the-R-Language

SQL is a very limited language, with essentially no capabilities for abstraction. Writing programs using the relational model in a Turing-complete language like R or Python is very powerful.
It's great if you want a lot of VMs or a lot of network io. It's basically a cheaper ec2.
Eh. The grammar of my OP is conversational, not formal. If I were writing formally, I'd write differently.
Yeah, but I want to have it in my home computer. Any application could use this thing.
A case for embracing the “augmentation” of human minds and bodies
Gotcha. Just some confusion around what you meant by in-memory OLAP engine. It seems that many storage format libraries get integrated into other platforms that bring the other supporting features (and the other undesirable heavyweight things you didn't want) with them.

With a little bit more poking: Apache Calcite?
I remember those, I had one of those fail too. Seagate Barracuda 7200.11 c. 2008. Found all the stuff on the Internet about the bad firmware after it failed.
It seems clear to me -- you don't need to do anything to continue your use of the API (no website to visit, no contracts to sign, etc). But that doesn't change the fact that they are ending the service.

If a developer doesn't know what "After April 10th, you will not be able to access the API" means, I don't now how they could be more clear.
Dremio looks very interesting indeed. What would you recommend for interacting with Arrow with more control, as a library? I'm interested in creating new Arrow-based data sources, not using it as an intermediary to other data sources.

On a side note - what other products/projects did you mean?