skysight-inc/HackerNews huggingface dataset:
As much as I want to agree with the article I really can't. All of the things that people claim as "bloat" are basically necessary for a website to work in a modern fashion...

Layout frameworks (eg Bootstrap) tackle the problem of developing a site that's readable at resolutions from 320px wide on a two year old phone up to a 5K iMac. That is not a trivial task, especially if you need UI components.

Application frameworks (eg Angular) make it much faster, and consequently a nicer experience, to maintain user state, load content, navigate around template driven pages, etc.

Media content has grown with resolutions and pixel densities. 10 years ago we were looking at websites on 1280x1024 displays, with no rich media. Today a consumer facing website has retina quality video. That's going to impact the page weight.

Being wasteful is a minor problem; everyone has fast broadband. Everything is cached at various layers from the browser to the service worker to the CDN to the origin server. Browsers are really fast. With some clever "cutting-edge-even-though-its-been-around-for-years" stuff like http2 you can fetch things in parallel.

Obviously websites should be optimised. No one should be downloading media or libraries that aren't used. Animations should be hardware accelerated. Sites shouldn't be running in debug mode (ahemAngularJSahem). But all in all, what we get in a browser these days is far better, far faster, and far more functional than websites were a decade ago. We could go back to the "works without JS, stateless on the clientside, roundtrip to the server and a whole new page for every click" world I learnt web development in, but I really don't want to. It was rubbish.
If we're still stuck on Earth in the time frames discussed, then we deserve to die.
I'm still looking for a way to have my genome sequenced (SNP analysis), while staying anonymous.
They are specifically targeting companies who follow VirusTotal's distribution feed, from what I can tell. This gives them all files submitted to VT and their corresponding reports, but they're not sharing their analysis of these files.

If you're not an AV and you just rely on VT reports, this shouldn't affect you.
Most meetings (by far) could be done in minutes. Instead (and I have 1000s of anecdotes literally) people like to pleasantly do things, make jokes, laugh a lot etc. Do painfully long introductions (while everyone was in the mail and already checked Linkedin etc). But worse: ill prepare or not at all and just improvise. Worse yet: see it as a break or even (half) day out. There is place for this, but that's not something that should be the norm. It's teambuilding, sales etc and it's important. For normal meetings, when prepared, meetings can be done in minutes; send an agenda upfront, let people do a few rounds of discourse about those points in the agenda via mail/slack and give them a chance to do some research. Then discuss and decide efficiently.

There are enough exceptions but that's not most meetings. Most meetings are not about a critical company policy or about a critical technical dilemma where core infrastructure has to be changed. Etc.
Yeah 500 MB could be enough if technology regressed (which it isn't going to). You're going to need a bigger plan regardless as 500 MB is nothing and mobile internet features are become more rich and ubiquitous.

The growth of website size has been fairly steady, if anything the growth has flattened over the last year or so. It is up to the infrastructure to keep up with that.

In the last year or two we've had the introduction 4G with 2-4 times the speed of 3G and you expect to have the same usage allowance?
Not Even Scientists Can Easily Explain P-values (2015)
What happened? Why is lendingclub doing bad? From the outside it looks like a good business model. One that should do better I thought.
I have some money in Prosper too, and this concerns me if it's true. Is there any further discussion of this that you could point me to?
Node has been able to interoperate with C/C for some time, via node-gyp and node-ffi.
Transgenerational epigenetic inheritance ?

https://en.wikipedia.org/wiki/Epigenetics#Transgenerational
We also owe the OpenBSD team OpenSSH, which greatly benefits from their attention to detail and commitment to small improvements towards better security.

Of course software is never perfect, but it's nice to know the (small) subset of OpenBSD developers working on OpenSSH are still working on keeping the proverbial doors locked.
But how many loans was that? If that's $25 in 1 million loans, then there are other peers on each loan. Whereas if it's 22 thousand 1k loans, it's definitely just an alternative route to institutional lending.
“Silicon Valley” Tech Actually Made by Massachusetts Companies
What usually happens as one of the 'solve your real problem' people is context. You searched for a path and ended up with a path of A->B->C->D->#block->F but you only tell the group about D->#block and all the readers are guessing how you constructed a path to get to D. The destination of F is often also not clear and missing from the problem description. Even if the reader can approximate a route from A->...->D->#block->F they have a chance of applying their own experience, because often D->#block is a true dead end of the hopeful path of A->F.

Too many systems have contextual inputs that only make the solution apparent with adequate context, so really we are hoping for A and F.
Probably worth noting as well how many software products OpenBSD has contributed back to the overall free software world; things like OpenSSH, (edit: NOT OpenSSL), a more secure ntpd and inetd.

Even if you don't run OpenBSD, you benefit from it.
Lending club is an experiment that had never been tested in anything but a booming economy with near zero interest rates.

Any change in those circumstances is an unknown.
Do you think you're disagreeing with me somehow?

Probably. I think the following is still controversial:

My read on the current situation is that the evidence strongly indicates that sugar is a major problem

There are multiple possible causes, or a combination of any number of such causes

- Excessive sugar

- Excessive fat

- Combination of fat and sugar

- Excessive calories

What is the root cause? I currently tend to think that the problem started to really accelerate when a lot of processed foods manufactured to be extremely palatable by hitting just the right combination of fat and sugar, entered the market.

For references, see https://en.wikipedia.org/wiki/Bliss_point_(food) and the book "Salt, Sugar, Fat" by Michael Moss.

https://en.wikipedia.org/wiki/Michael_Moss
I stopped investing in lendingclub once I realized the taxes on my gains. Interest is basically counted as income, which makes capital gains in stocks much more attractive.

What I did notice that I was pretty bad at picking notes. Lots of handpicked ones flopped and a lot of random/automatic ones are still going.
Does this work with github enterprise?
Ah, I read that you did "cave diving" not "caving" -- that explains it :) That does indeed look like a really fun system, thanks for sharing.
People simply do not have time to read the ingredients on every product they buy. Maybe force producers to show amount of sugar lumps on the label.
I think this line was meant mainly to refer to his closed source iPhone, OS X, and Windows use. Perhaps he means his Linux usage is one of the more mainstream distributions that readily facilitates installation of binary kernel blobs (e.g. wifi, video), or 3rd party closed source software.

He may also be calling Linux insecure due to it being less uncompromisingly about security. Same could be said about FreeBSD--they aren't necessarily insecure, but they are not as explicitly focussed on that.

OpenBSD invests a great deal here. They have their own fork of Xorg (or was that XFree86?) that runs not as root. As far as I know that's unique amongst libre *nixen.

EDIT: this is what I get for starting a response, getting coffee and resuming my reply. We don't have to speculate what the author of is post intended, and his response is better than mine ;-)
> a tomb of knowledge called something like, 'Principia Mathematica

freudian slip? ;-)
End of the day, OpenBSD is a great example of the value of competition, and the necessity to maintain market rules that encourage it.

How awesome is it that we have dedicated operation system geared towards the niche of the market that cares deeply about security?
He fleshes out the toxic waste metaphor most fully in this talk, which he gave, rather boldly, at a big data (Hadoop) event. It's text and images but there's a video link at the top to the actual talk if you prefer it that way:

http://idlewords.com/talks/haunted_by_data.htm

That's quite a good talk. The takeaway is to treat data, especially personal data, as a liability rather than an asset, to discard data by default, and to retain only with a very specific goal in mind, and even then to transform the retained data into some kind of useful aggregate and discard it.

It doesn't contain the YouTube metaphor, which is included in this http://idlewords.com/talks/internet_with_a_human_face.htm
It's likely they are using an engine based almost entirely on run-time heuristics - that is, stopping malware when it behaves suspiciously. VirusTotal does "scan-time" analysis of files where the file is never run, only checked against AVs. If they have no "traditional" signatures, they wouldn't be compatible with this method.
Video Platform Software Developer | Atlanta, Georgia | ONSITE | techjobs@playonsports.com

PlayOn! Sports is a rapidly growing startup and the nation's largest producer and distributor of high school sports events. We are hiring a Software Developer to join our team.

You will work on building our video processing platform that sits behind our suite of products for producing and viewing high school sports events on the web, mobile devices, and television. This position develops both desktop and server-side components for manipulating video, including compositing graphics, encoding video, transcoding video, post-production workflows, and integration with CDNs. Responsibilities include writing code, building automated tests, contributing to system architecture, mentoring developers, reviewing code, and contributing to development methodologies and standards for the team.

Requirements

* 5+ years experience developing software in C#, Java, Scala, JavaScript or Ruby

* Experience building desktop applications

* Good understanding of video processing software, standards and methodologies such as ffmpeg, Libav, DirectShow or AV Foundation

* Experience working on a public-facing web site with a large audience

* Knowledge of HTTP / REST and modern web standards

Preferred Skills / Experience

* BS in Computer Science or equivalent

* WPF, Xamarin, Silverlight, and Visual Studio

* Cloud experience with AWS, including ec2, dynamo and lambda
* Git or similar VCS

* Practical experience with continuous integration processes and products such as Snap CI and Jenkins

* Good understand of design patterns and related libraries such as MVVM, MVC and Prism

* Strong communication, teamwork and interpersonal skills
Certainly a problem they're aware of, and they're trying to get as many breaking changes done in 3.0 as possible. There may or may not be more in 4.0, but they will definitely be smaller.

> What does this mean looking forward? Well, Swift 2 to Swift 3 is going to be an unavoidably disruptive change for code since Cocoa renamification is going to land, and we’re going to be building impressive migration technology again. As such, we should try to get the “rearrange all the deckchairs” changes into Swift 3 if possible, to make Swift 3 to 4 as smooth as possible. While our community has generally been very kind and understanding about Swift evolving under their feet, we cannot keep doing this for long. While I don’t think we’ll want to guarantee 100% source compatibility from Swift 3 to Swift 4, I’m hopefully that it will be much simpler than the upgrade to Swift 2 was or Swift 3 will be.

http://ericasadun.com/2016/02/29/getting-ready-for-swift-to-...
Frayokit News: ISIS THROWS a MAN OFF FIV-STOREY-BUILDING FOR BEING GAY
Maybe. That seems like it should be relatively easy to measure with a caching proxy, right?

In my experience, most site slowness is related to slow loading ads. Since installing an ad blocker a few months ago, I really haven't had any complaints about web speed.
Yes, exactly. What I think the poster was suggesting is that, in theory, now is a good time to be investing in LC loans -- because the rates will be driven up due to the lower availability of capital on the platform. If he was suggesting something else then I'm in the same boat as you, hehe. ;-)

I do tend to think that the institutional investors/hedge funds are quite likely to "know more than you do" however, which could instead mean that this is an early signal & would be a foolish play.
Ask HN: What's a good tool for creating a PST/Mbox email search engine
Gmail might be better than any other system for searching through your email, but it still lacks the precision of a decent search system for your email. Is there a decent package out there that will enable you to upload your PST or Mbox file for searching? I'm trying to avoid culling through hundreds of packages claiming to do this.

Thank You.
No loans just don't get funded
In what case would you be able to fool Prosper or LendingClub but not a traditional credit card company? Couldn't they just adopt similar lending standards? I always viewed p2p as just a more efficient way of mimicking the lending and interest-collecting functions of a bank/credit card company.
When you say "make a living" - how does that compare to a "typical" US developer salary/benefits - say around $120K total compensation? (and yes, I know that's far below a SV total compensation, but you wouldn't have to live in SV for this kind of lifestyle business).
Why we only hire noobs
I don't have formal CS knowledge so everything I say might be wrong.

I came to realise that you only gain grounding by working with a stack/framework/set-of-tools every day. Everything else (reading a book, etc.) is just scratching the surface.

Since you can't know everything about everything, I'd say that the best way to learn is to build something. But it's one thing to build your own CRUD test-app to learn Rails and another thing to design an app that will need to stash 20 million entries per day in a DB. The choice of the DB becomes, suddenly, a complex matter. Same if you need to handle 100.000 req/s ... You can't really learn these things on your own.

The best thing IMHO to get good grounding is to never stop learning.
> how many software products OpenBSD has contributed back to the overall free software world; things like OpenSSH, OpenSSL, a more secure ntpd and inetd

One of them is not like the others -- OpenSSL is not an OpenBSD project and the code quality is markedly different :-)
Maybe it's a reaction against single language / framework conferences? There seem to be quite a few of those: Laracon (for Laravel), DjangoCon, PyCon, EuroPython, etc. Maybe it's good to have a technical conference covering multiple languages, especially for people who don't have time or budget to attend all the different language conferences?

[Personally I can see value in both approaches to conferences, though.]
Epigenetics may influence gene expression, but as your link says others are skeptical that it constitutes an independent information vector. Epigenetic activities may themselves be encoded in genes.

Epigenetics as a concept can also be abused into a sort of neo-Lamarckism.
Hey, I'd love to hear more. What email can I reach you at?
Polyglot: an universal grpc client
OpenSSL does not come from OpenBSD (the LibreSSL fork does).
In HPC?
Google’s testing a significant change to the way it shows search results
JS is mostly 'unsuitable' because of the lack of integration into GPGPU.

Does that mean that using an already trained model would be slow? If I wrote something to train a model on a GPU, could I then export the data to use with JS in a browser?
What bonds? Lc pays around 7%. I've never seen a bond over 1%
Let me guess... You have shares of LC.
Yes, the OpenBSD team's willingness to roll up their sleeves for software that I consider core to a functional Internet is pretty remarkable. Even though the last OpenSSL vulnerability also affected LibreSSL, in the past others haven't.

EDIT: Morning brain made context shift unclear. They do OpenSSH and now LibreSSL. Also pf and more too.
I don't know how anyone can lump Linux in with Windows when it comes to security from NSA spying and then say OpenBSD is a good alternative.

HN seems to love the anti-Linux FUD though. Anything that further fractures the OSS community is upvoted fast.

I like the BSDs too, but there are a ton of reasons Linux is the most popular kernel in the world, it's not just because the NSA makes it so.
How to fight churn?
What would you have Krispy Kreme do? Pivot to Kimchi Kombucha?
FocusFixed: Photography Competition
http://focusfixed.com is a great platform for online photography contests in India. Win cash prizes and gift cards by uploading your photos. It absolutely free to use.
90% of website size is media (images, audio, video, etc).

That's a commonsense assumption that, in my understanding, used to be true. But the article goes to great lengths to point out that it isn't true anymore. Some of the bloated multi-megabyte examples don't include any media at all.

If you look at what the unblocked version pulls in, it’s not just videos and banner ads, but file after file of javascript. Every beacon, tracker and sharing button has its own collection of scripts that it needs to fetch from a third-party server.

The javascript alone in "Leeds Hospital Bosses Apologise after Curry and Crumble On The Same Plate" is longer than Remembrance of Things Past.
Automating Machine Learning processes
Exactly. This is all about getting to root causes.

I learned this working in a manufacturing environment for several years the was implementing the Toyota Production System and all the things that are a part of it like Kaizen, Kanban, etc.

After I left I thought it was too bad that all that good process was locked into the manufacturing world. I've seen it creep in more and more, often under the classification of UX with understanding user flows and actual problems of usability on a site (another area where asking why 5 times is very helpful to get to the root of a user's feedback).

I've also seen what I call "kanban flavored agile" be one of the most effective engineering processes for environments with ever changing requirements who don't need the rigid deadlines of sprint-based planning. When I saw it in manufacturing it was all about "just in time delivery" meaning a factory could easily switch production lines when suppliers missed deliveries (or delivered defective goods) or a machine broke down, etc. Which when you compare to the sorts of things that happen most every day in a typical software organization doesn't sound all that different.
They didn't do OpenSSL, though I believe they started the LibreSSL fork. Still, your point is a good one.
I wish search engines would start banning Forbes too: very often they're one of the top results, but their implementation of interstitial is broken and lands you on their home page instead of the page which search engine links to. And I don't even use ad blocker!
I am also finding the new font color a bit odd - it is like I have already clicked on the links. Maybe it would take some time before I get used to it - if they wont change it again, that is.
Creating a news ticker feed with ffmpeg and imagemagick
I'm a big fan. I love the statically inferred type system, generics, & optionals. Also really like a lot of the functional programming concepts + value types but still enjoy being able to fall back on OOP. It feels like the best of both worlds. I can't wait till we have language native concurrency techniques, so I can start writing swift in backend code.
Paul Boghossian on the Concept of Genocide [pdf] (2010)
I made an app with Swift (my only iOS app). I like it. I like clean, easy-to-read languages where I can get stuff done quickly and reading code isn't a huge pain and using a new library isn't a huge pain. Swift seems to fit those preferences so far.

The debug messages were confusing. I never used Obj-C so I'm not sure if that's iOS or Swift that causes confusing error messages.
"Translators use this kind of tool every day,"

Can you name a few of them?
Mobile-first is designing for a mobile interface. I quiet clearly stated "economise to the scale of mobile data". That is, supporting users on heavy mobile data restrictions.

Users, regardless of device used, are primarily on wifi and that is what is designed for. In modern countries most users don't really have data restrictions low enough to come into effect through websites so going into the future this will not be a problem.
Is there a data standard,other then SVG SMIL for saving vector animations?
My favorite thing about Swift is that is seems to get out of the way - and when it gets in the way it's usually with a nifty language feature (like the { $0 + $1 } closure syntax). I'm very excited for the future - between Go and Swift we now have two compiled fast languages that are almost as expressive as their slower dynamic/interpreted cousins.

As an aside, I like that Apple is betting the farm on ARC. I wish I could have been a fly on the wall when they were discussing ARC versus GC.
Video: Make Ruby Great Again
Hopefully my side business won't tank! Plug for LendingClub mobile apps:

iOS: https://itunes.apple.com/us/app/lendingclub-order/id10461141...

Android: https://play.google.com/store/apps/details?id=com.jamesys.le...
Having just read The Website Obesity Crisis[0] I was instantly intrigued by the video loop at the top of this article, so fired up Chrome's network inspector.

Not only is it 6.7Mb, but it's sent using streaming (Status: 206 Partial Content), and for me at least, every time the video reaches the end, it's loaded again, and not from cache.

I didn't actually read the article, but according to Read-o-meter[1] it would take around 18 min, during which time the 15 second video would play 72 times, consuming 482MB of data!

0 - http://idlewords.com/talks/website_obesity.htm#crisis

1 - http://niram.org/read/

Edit: Ha, caught out by my own dev setup, ie: disable cache when dev tools is open. My bad, feel free to ignore everything I said :)
Along with lmm's comment, where would all the extra doctors come from? You can't cut hours worked in half (or close to it) without doubling your staff to meet the demand. US hospitals (especially ERs) are already running over patient capacity in many US cities
Free Deep learning class using TensorFlow
Just fyi we actually have multiple operating systems dedicated to security.
Three main things:
- memory space for printers and sound cards changed in Vista, so when you have some constellation of printers and you change the printer in dialog whole program just crash, because it is trying to touch restricted memory or something.

- running Paradox in network is quite difficult. Whole database was written in 80s before things like tcp/ip was thought as a good thing and all the networking part was hacked inside and it shows. Because of weird architectural choices made 20+ years ago I am not able to migrate out to sane database without rewriting whole application. (250+k lines of code)

- BDE could be quite unstable in various scenarios and you spend quite a lot of time fiddling with memory space, memory size and other variables to make it work.