skysight-inc/HackerNews huggingface dataset:
Confluent has a newish program for taking streaming data from Kafka and sending it to multiple different types of stores called Kafka Connect:
http://docs.confluent.io/3.0.0/connect/
https://github.com/confluentinc/kafka-connect-jdbc

It supports HDFS and ElasticSearch as well.
Those sort of information asymmetry problems (in this case, you can't know the quality of the service you're buying until it's far too late) are a textbook case of market failure [1] [2]. You can improve the outcome sometimes with some smart regulation.

But in the security industry there are multiple levels of this problem:

- The end user doesn't generally know how hardened the product he buys is

- The manufacturer is rarely certain how high quality the security auditing/services he is buying

- How much to invest in securing a product is not an easy decision.

I'm of course simplifying a lot here, but you asked for the economics of those problems, and hopefully this was interesting to some.

[1] http://www.sfu.ca/~allen/leffler2.pdf
[2]https://www.iei.liu.se/nek/730g83/artiklar/1.328833/AkerlofM...
Maybe misworded, but actual access is a clear line on the spectrum that starts at reporting a potential DDOS attack on an endpoint to dumping all your users credit cards and passwords. Access to a server isn't necessarily access to a DB, but it's usually serious enough to warrant cash, no matter who you are.
The security industry has been "broken" for as long as there has been a security industry. When I left Network Associates in 1999 to start a chat company, leaving the security industry to do something non-security was already a cliche.

It's true, the 1U rackmount netsec industry does virtually nothing to prevent consumer electronics vendors from shipping terribly insecure code. I don't like the netsec industry either. But: so what?

The reality is, very few companies are buying 1U rackmount snake oil (or Nth generation antivirus products like endpoint protection tools) to stop things like Mirai. We're not even talking about the same budget. The "security industry" is not in fact chartered with stopping things like Mirai. So Mirai is a weird complaint to level at it.
SEEKING WORK - Dublin, Ireland. Remote

I am a freelance consultant working remotely from coffee shops around the world.
I am experienced in refactoring spaghetti code and building and launching MVPs. I love to write solid scalable code , but also be involved in the overall product design, marketing and pre-launch, launch and post-launch strategy.

I am a full stack developer, but prefer working with PHP (Symfony 2 and Laravel) as a server side tech or using Firebase with Angular or Ionic. I am also the creator of the Firebase newsletter (http://bestoffirebase.com/).

I am flexible and quick learner. My main motivation is launching successful companies so I will not accept projects that I can not deliver a solid ROI.
You can contact me via:

Email: sergiovariu@gmail.com or Skype: mythriel.dan
Teradata | Teradata Unity | San Diego, Toronto | Onsite | Full-Time

Teradata Unity is heading to the cloud, and we're seeking good people to help us get there. If you want to be part of a team that is driving change within Teradata and with our customers, this is it!

We're looking for skilled, passionate people who enjoy highly technical challenges and play well with others. Tech stack includes

- Python
- C/C++
- Java
- Node.js
- Angular
- AWS
- Azure
- Scrum
- Linux
- Test Automation
- Test Scripting

for multiple positions

- architects
- developers
- testers
- automation
- devops
- scrum masters

at a wide range of experience levels that probably include yours. For more information about these opportunities or how to apply, please contact me: david.glick [at] teradata.com.

Teradata Unity is an enabler for the Teradata DBS, providing capabilities such as high availability, synchronization, fail-over, routing and other critical services that allow customers to get their work done when bad stuff happens.
I'm not alone in writing a proof of concept "Forum" which was just a view on a private NNTP server.
SEEKING WORK - San Francisco - Remote OK - Travel Possible

Experienced software developer with a history in startups.

Proficient in:

* Python ['django', 'flask', 'google.app.engine', 'pyramid']
* Javascript ['backbone','node','firebase','react'];
* Clojure '(compojure om)
* Ruby ['rails', 'sinatra']
* Go {'appengine'}
* Haskell, Prolog (and other esoteric)

We've helped entrepreneurs develop their MVP, as well as large companies develop core features. We provide services such as feature development, product management, and software auditing.

Previous engagements include 2U, Fuze, DriveShift.com, Sosh, Getaround, Codecademy, Factset, Wakemate, drip.fm, and Swiftstack, among others. Currently represented by http://www.10xmanagement.com

For more info see our page at http://turbines.io, or talk to us at hn@turbines.io
I apologize you keep getting downvoted.
Location: Tunisia

Remote: YES

Willing to relocate: YES (May need work VISA)

Technologies: PHP, Laravel, WordPress, JavaScript, Node, Sails.js, Python, C#, HTML, CSS, jQuery, GIT, Heroku, Firebase, REST, MQTT, MySQL, SQLite, IoT

Currently learning: vue.js, Go, LaTeX, Cryptography

Résumé/CV: https://raed.it | https://raed.tn/lab

Github: https://github.com/RaedsLab

Blog: https://raed.it/blog

Linkedin: https://www.linkedin.com/in/raed-chammam-262713a2

Email: raed.chammam+hn@gmail.com

====

I am a recent graduate (MSc & Engineering) looking for a interesting first opportunity.

I am highly motivated to contribute and learn within a dynamic team.

Checkout some of my academic/personal projects and send me an email talking a bit about what you do.
What stage was Google Cloud at in 2014 that AWS was being recommended by Eric Schmidt?
I like to random these Kompakt Pop Ambient records early in the day, all instrumental type of thing.

https://www.youtube.com/results?search_query=pop+ambient
I hope the accounting firm explained why there might be a problem and how to fix it. That would be the mark of a trusted advisor. "Oh, you might have cancer! Bye!"

The reason for your problem is that a human working in the USA is "doing business". And if the human is a company's employee, then the "doing business" attribute belongs to the employer. This is standard principal-agent theory.

There are a couple of ways around this. One is the income tax treaty. It says, interpreted, "you don't have to worry about US tax if you don't have a _permanent establishment_ in the USA". That magic phrase is jargon and means an office or factory etc. a single human wouldn't necessarily be a "permanent establishment".

Unfortunately the Canada/USA treaty was amended in 2010 to put companies like yours at risk. (Ask Mr Google about the Fifth Protocol). Now, a single human's presence can be a "permanent establishment" subjecting the employer to income tax.

There is a day-count test. Too many days in the USA for that human and the Canadian employer is doing business in the USA. The reverse is true for US employers with Canadian-located employees.

So a sane employer will not rely on the treaty.

A sane company will spin up a little US corporation, wholly owned by the Canadian corporation. The only thing this US corporation does is hire the US employee and provide the results of that employee's labour (see what I did there?) to the Canadian corporation.

The US corporation runs at break-even profitability. It pays no tax but spawns a buttload of tax paperwork on both sides of the border. By "buttload" I mean that I wouldn't be surprised if it adds $10,000 per year to overhead to do this.

You can question the sanity of your diplomats and government bots now. The US and Canadian diplomats who negotiated the Fifth Protocol made it more expensive to hire people across the border.

I am an international tax lawyer. But right now I am eating a carne asada burrito at Lucky Boy.
Better how? You definitely get way better scrolling and zooming under Windows.
No paper I can find. This press release seems quite premature given that the researchers haven't written up their results. Even raw simulation data plus raw architectural docs would greatly improve the situation.

Maybe the patent lawyers are gumming up the works?
Basically some developers need to go to jail for gross negligence.
All of those trackpads are not usable.
Any brand preference? The varieties of "cheap" are many.
> We live in a post-file-system-compression world.

You'd think so, but allow me to point at my steamapps folder saving 20% disk space even with the not-very-good compression that NTFS offers. If it could use a better algorithm and a block size of 2MB instead of 64KB, it could nearly double that.

Hard drives have always been growing in size. We have always been in a 'post-file-system-compression' world. But people want to do things like fit on an SSD, so compression continues to be useful.

I just wish it didn't ultra-fragment files on purpose.
> I would react to stories like this with skepticism, whether told by the interviewee or interviewer, especially when accompanied with a pretentious attitude ("Get out"),

Do you know how to read? Apparently not. I said explicitly that he conversations are a bit longer that that.

My comment was described as a short summary to illustrate a point. Instead of taking it at face value, you've read all kinds of nefarious emotions into it, and read magical interpretations into the technical portion, too.

This is called "projection".
A Formal Security Analysis of the Signal Messaging Protocol
As wikipedia mentions, don't cite wikipedia itself. The first reference on the site prefers 'Transatlantic' too: http://www.motherjones.com/kevin-drum/2011/08/oh-old-timey-m...
Why Premium DNS Is No Longer Optional
I'm asking: why would you make a bounty conditional on "access" at all? What's the win? A bug is a bug. If it has the potential for access, it's worth the bounty. All a demonstrated access requirement does is encourage strangers to violate the privacy of your customers. It seems like an incredibly reckless idea.
Shift Technology | Paris, France and Singapore | FULL-TIME | ONSITE | Sysadmin, frontend and backend developers

We're a start-up that provides a SaaS solution to insurers to automate fraud detection. We've raised €10m from Accel and other investors and already have clients in 7 countries.

Our main challenges are making sense of a lot of heterogeneous data, analysing it accurately and efficiently and presenting the results to the user in an intuitive way.

Tech: Windows, .NET (C#), SQL Server, JavaScript, React, d3.js, VMware, Azure, Git

We're looking for a lead systems administrator, web developers (including lead) and backend developers in Paris as well as a backend developer in Singapore.

More details at http://www.shift-technology.com/jobs/ Contact hnjobs at shift-technology dot com
Antirez/Bigdis (2010)
Texas resident here. There's a guy who's been riding a Segway around my neighborhood looking for weather damage from recent storms, and his pitch to homeowners is that they don't need to replace the entire roof, just the section where things are--or will soon be--leaking.

It's probably more efficient to replace the entire roof at once, and insurers would almost certainly prefer the entire roof to be the same age, but asphalt does have some advantages for situations in which nearly every storm tears up just a few shingles.
Don't understand why this was flagged. HN had no problems piling on Thiel when he announced his support for Trump, and we're not allowed to post something where the man is defending his viewpoint.

This smacks of intellectual dishonesty and flagging this post just goes to further show that Thiel is right regarding diversity in SV. All of this is relevant discussion because of his affiliation with HN and tech as a whole.
Impraise (YC S14) - Amsterdam, The Netherlands - ONSITE - Frontend, Backend - http://impraise.com

Impraise is a web & mobile app for real-time feedback, recognition and coaching at work. We are fundamentally changing the way people share feedback and learn at work. We make it very easy for employees to give and receive feedback from colleagues. We also help managers to understand how to improve the performance of their teams. Ultimately, we help people develop their professional skills and become better at their job.

Our stack: Ruby / Rails, React, GraphQL, AWS, Docker, etc...

More details on the job offers: http://jobs.impraise.com/
> Solving the core problems is good for society, but society doesn't reward this behavior.

I'd like to think that we can solve collective action problems like this as a society and be rewarded for it.

We have to figure out how to fight this problem the way we fought smallpox and polio.
That'll work until the database of device credentials is breached from company X which provides call center support services for manufacturers A through Z and needs said credentials at hand.
Researchers Claim Wickr Patched Flaws but Didn't Pay Rewards
Externalities are usually solved through pigouvian taxes.

But since we can't really know in advance what product will/won't be secure (or at least it's incredibly difficult in the constantly goalpost moving security industry) the only way I can see this happening is if, say DYN could sue the IoT manufacturers for negligence or something of the like.
I use an Ergotron adjustable standing desk and find it works well to hold MacBook, external monitor, Lenovo keyboard, and lab notebook. It is sturdy and switching between sitting and standing works well for me.

https://www.ballicom.co.uk/33-397-062-ergotron-workfit-t-sit...
Courex - www.storeviva.com | VP Engineering | Singapore | Full/Flexi-time/Onsite

# What the company does

Courex is a 7 year old ecommerce logistics company driven by technology. We help our customers manage their supply chain so they can focus on selling. We do the following
- last mile delivery
- warehousing
- omnichannel integration

Our operations is driven by technology. Some interesting stuff
- We run a hybrid crowd-sourced(uber style) + fixed fleet model.
- We built an automated parcel dimension measurement machine using Kinect
- We have autonomous robots coming in 2017 to pick and sort parcels

Experience a different sort of scale. Not bits and bytes, but parcels, machines and people. Your work affects the real world.

# What the job entails

We are looking for someone to lead the inventory management or omnichannel products. Our tech stack is Node.js/PHP/Scala/Ruby/Haskell. We allow our engineers to work from home a few days every week.

# Contact

No formal qualifications needed. Please email zan+scala@courex.com.sg if you are interested.
The City Trilogy ( https://www.amazon.com/Trilogy-Modern-Chinese-Literature-Tai... ) is my personal favorite Chinese/Taiwanese SF story. Some people I've recommended it to pass on it because of some of the translation issues[0], but if you read Romance of the Three Kingdoms and you've read a decent amount of translated work already[1], The City Trilogy is a work on that can be enjoyed on levels like Star Wars or Dune. (and I make that broad comparison intentionally)

[0]A couple of key word choices, most prominently galaxies instead of what should really be systems or planets. the translator made can really pop literal minded people out of the story, and I think that you have to have the mindset that the composition of language is better and more evocative in the original than the translation.

[1] I've found, totally anecdotally, that a few of my Christian friends who have spent a good chunk of their reading time reading translations are able to enjoy translated works better than those who have not. I've also found, again anecdotally, that few people like the first few translated works they read, and enjoy the later ones better.
Well, I would say that we did spend considerable time and energy among peoole with vast experience from designing various kinds of languages before we ended up going down the path towards what became YANG. If you poke around the IETF mailing list archives I think you will find ample amounts of justification before we were given the green light from the IAB.

I meant to say "easily readable in it's native encoding". I.e. Looking at the source in your favourite text editor.
The United Island Hopper famously has 6 stops throughout the Pacific between Honolulu and Guam visiting 7 different islands.

(http://www.cntraveler.com/story/the-united-island-hopper-sev...)

HNL > MA > KWA > KSA > PNI > TKK > GUM
You can use Adblock to remove the invasive next/previous article arrows, and you can use your favorite inspector to set the .theme-page-wrapper max-width to 600px. Now it's almost like a page designed for a human to read!
Pharmacist is the medical job that is already completely obsolete and could be eliminated if not for unions and inertia.

Pharmacists almost never do compounding anymore. They just take pills off a shelf and hand it to you. If manufacturers and doctors could agree on standard drug regimens, counting out pills would be unnecessary as well (or could be replaced by minimum wage labor or robotic/vending machine-like devices). Most pharmacies have a computerized drug-interaction checker, so even that minor function of the pharmacist is unneeded.

I wonder how recent pharmacy graduates feel about spending years of studying and training and major expense for what turns out (in today's world) to be a clerical job?

I expect that within 5 to 10 years, pharmacist will be one of those jobs like telephone operator or travel agent that used to employ hundreds of thousands of people, but is now only seen in old movies.
Boston, MA • ONSITE • Senior Node.js Engineer • Starry (starry.com)

At Starry, we’re aiming to make Internet better for everyone with easy-to-use Wi-Fi products and a radical wireless Internet service.

As a full-time Senior Node.js engineer, you would be responsible for the development of RESTful web services via Node.js as well as single-page web applications, in addition to building development tools, data aggregation & processing pipelines, performance optimizations, internal applications, and third-party API integrations.

Full job description here: https://starry.com/careers/senior-nodejs-engineer

Please send resumes and a link to your Github to kevin@starry.com
New 15-inch MacBook Pro appears to offer fastest SSD performance on the market
Location: Calgary, AB, Canada

Remote: Yes (experienced)

Willing to relocate: No but can be onsite up to 50%

Willing to travel: Yes

Technologies: Java EE, SQL (Oracle, SQL Server, MySQL, PostgreSQL), NoSQL (MongoDB, Redis), JPA, Hibernate, Spring, SOA, REST, GWT, AWS, HTML5/CSS, Weblogic, Linux, integration & messaging, BI/reporting tools & data warehouse, data modelling, design patterns, performance tuning, HA/DR, agile, code reviews, application & solution architecture, requirements gathering, user training, vendor management, demos & presentations.

Resume/CV: https://drive.google.com/file/d/0B-1uY7D2mUMOa2JNYjZCMFFORkU...

LinkedIn: https://www.linkedin.ca/in/murraybodor

Email: murray.bodor (at) gmail (dot) com

About me: 25 years of experience using technology to solve complex business problems. Excellent communication, client-facing and consulting skills. Bachelor of Business, major in Information Systems.
As someone into calligraphy, I agree entirely. People claim it is faster to write - but there is no way I can write faster than I can type and in the past 12 years, I've had zero reason to write at all, outside of practicing calligraphy (Chancery Italic to be specific).

If the only supporting argument is cursive is "faster" and you must write, not type, then you will absolutely not beat shorthand. Learn Gregg shorthand [1], not cursive. If you want your handwriting to "look nice", treat it as an art form, because that is what you are doing when aesthetics supercedes practicality.

[0] https://calligraphyalaphbets.imgur.com/

[1] https://en.wikipedia.org/wiki/Gregg_shorthand
This is in fact untrue. You would not have needed a new license for a replacement motherboard if that really happened. At worst you might need to make a phone call to MS, though even that is an unusual case.
PlanGrid (YCW12) | San Francisco | Full-time, On-Site | Visa | https://www.plangrid.com/

We’re building software that is changing the construction industry (think GitHub for construction, but our ambitions are bigger). Our users love our app because it helps them build real things more efficiently.

By joining our team you can influence product decisions and work on interesting technical challenges (our client apps work with GBs of data). Our engineering teams are small; whatever team you work on, your impact will be huge!

We’re looking for new team members on our client teams: Android, Web, iOS, Windows.

We’re also looking for QA Automation engineers, data scientists and engineering managers.

You can see our job postings and apply here: http://grnh.se/8fcutd you can also reach me personally a benji@plangrid.com.
First, it's important to legally separate yourself from a company so that you can dictate where and how work is completed.

In the U.S. this requires establishing a S-Corp, LLC, or C-Corp.

Second, don't consider it freelancing. Professionals are independent consultants or contractors. They manage their own sales, marketing, invoices, billings, healthcare, tools, and benefits.

Third, working remote is actually your home office. Deduct a portion of your rent/mortgage to sub-lease space for your office.

There are easily 10 more items I could add to this list, but these 3 establish a legal point of no return for making a career working remotely.
But most of those safety standards are meant to protect the device and its user during a normal use, not against malicious attempts to destroy it or pervert its usage.
Apple, Inc. | Cupertino

Apple’s Siri is looking for exceptional engineers, designers, and project managers well versed in machine learning, natural language, speech recognition, server automation, and/or mobile software development. Siri is used on countless iOS, tvOS and watchOS devices and handles over a billion requests per week.

If you’re passionate about systems administration, music, home automation, productivity or one of a variety of our open positions, you’ll be right at home!

Apply online or send a resume and a feature request to brittanyd@apple.com.
This sounds like an insurance problem.

You've got events that occur rarely enough to an individual (company) that it's hard to work out what the best course of action is using the limited data that an individual can gather.

If there were, say, a half dozen major security companies that everyone subscribed to one of, and they each published their statistics showing how many of their customers suffered various kinds of security breaches, this market might look much less broken.

You could potentially get to that state by having some major existing insurance companies offer "digital threat insurance", and require anyone who claims on it to be using the security services provided by one of their vetted providers.

Yes, you'd be building the sort of major corporate bureaucracy that HN hates, but you'd also be properly aligning everyone's incentives, and shifting the responsibility for the Hard Problem of determining who was selling real security software to a smaller number of better-resourced people. Perhaps there's a reason why major corporates are the norm in big, serious markets.

Edit: disclaimer, I'm an armchair theorist and have no skin in the game - perhaps this already exists or there's a good reason why it doesn't work