skysight-inc/HackerNews huggingface dataset:
(Founder here).

Could you describe your use-case? This is an interesting question and I'd love to hear more about what you are thinking of.

There are two main parts to most machine learning workloads: training and prediction (though in online scenarios they can be mixed). The training is what tends to be memory intensive, as it involves looking at historical data. Prediction, especially in real-time, is typically less memory intensive and more suited to your scenario. It is possible with MLDB to have training and prediction on separate instances to optimize hardware cost.

Our focus to date has been on getting large real-world use cases to fit, for both training and prediction, on a single commodity server with decent amounts of RAM (4GB and up), especially for training. Performance there is good; you can train user scorers or recommenders over hundreds of millions of users with 20 billion historical actions in minutes on a single server. We haven't focused much on the absolute memory footprint and there is some overhead; you will need a server with a good amount of memory, a couple of gigs, to have a pleasant user experience.

(edit): The team tells me it will work decently down to 256MB of RAM or so, for carefully designed automated workloads. For interactive use you will want more RAM.
I want the slug to be able to change and I'd prefer not to have to keep track of every variation ever assigned to that piece of content.
Batteries would help. It will take a lot of them. At least 300,000 Tesla Powerwall battery packs would be required to load balance that variation in wind. That's about a billion dollars, which is not unreasonable.

The price would of course go down for quantity, and putting the individual cells into larger units. Let's wave our hands and say 900M -> 500M.

But per https://en.wikipedia.org/wiki/Tesla_Powerwall the $3,000 7kWh daily cycle units have a lifetime of "only" 5,000 cycles. So half "a billion dollars" every 13.5 years, ~100K/day.
Poorly written story based on 3 anecdotes and misused facts from BLS. I am on sabbatical in NYC for the year, and I've seen "the party" occur in common spaces, like parks.

For the last 20 years in nyc, people right out of college have always used public spaces (parks, bars, clubs) as venues for their parties.

On any fair-weather Saturday during spring-fall in Morningside park, there are 100s of people having parties with outdoor bbqs, lounging, bubble-making, etc.

Same in central park. A friend of ours had their post-wedding party in central park around a huge oak tree; maybe 80 people showed up. The same couple hosted at least 3 parties during the year in their 1bd Village apartment (900 sq ft).

It seems contradictory that the guests of parties expect "bourgeois cheese and beer" and yet themselves have limited budgets.
From Syria to Sudan: How do you count the dead?
You presume the collectors of that $11B and those that benefit politically and financially indirectly (revolving doors) want to "learn."
> "only be out $15."

It very likely won't involve alcohol. There's almost nothing in the states you can do in public involving alcohol that will put you out < $15 and satisfy the notion of 'event' that anyone wanting alcohol would agree with.

The "going out with friends and getting drunk" for $15 might fly in other countries, but probably not here.
This is a brilliant initiative. Thanks for sharing open sourcing it. https://github.com/stared/tagoverflow#tagoverflow
Yes it's a shame, looked great indeed!
So pretty much Time Machine?
I thought aluminum smelters couldn't really shutdown production.

I remember it was big news in New Zealand when Tiwai Point (which uses 15% of the power nation wide) shut down some of it's production during the 2008-2009 power shortage (caused by a drought in the hydro power lakes.

Graph: https://upload.wikimedia.org/wikipedia/commons/e/e2/Electric...

You can also see the other major drought in 1993.
I sort of understand the SDSL, but what is amazing is the diversity of the example implementations - verifying programs targeted eventually for the Greenarrays chips in Forth, and an OpenCL-based SDSL. Racket seems to be pushing outside the academic realm - almost.
Damn sweet initiative. Signed up!
I'm a bit shocked that anyone could believe there was actually $600M of software to build. I know prices are inflated by the whole federal contracting guidelines but I'd say these contracts were at least two orders of magnitude greater than what they would have been in the private sector. And nothing against our friends to the north, but why wouldn't we bid more of this out to US companies? Perhaps those that satisfy the WO-MO requirements?
Human innovation is 'lightbuld' moment first, then lot of trial-and-error.
FunScript for sure is not perfect and have many rough edges - getting started as new user is hard, getting started with different type of project even as experienced user is not perfect (for example Atom plugin requires completely different approach than normal web application), it has problems with "OO" features of JS so using it with frameworks which requires such approach is bit hacky, generated code is not perfect.

But i still like it and managed to create fancy stuff with it - Ionide, React.js + Material UI applications etc. Wouldn't recommend using it on production ( unless You want to commit really hard into FunScript project and probably fix lot of this stuff) - WebSharper is providing more complete, richer solution and commercial support if needed
Why are costs so much higher in NY though?
Because they do not want to answer calls from non-technical consumers upset that the rate on their bill has gone up significantly.
“Children at Play” signs imperil kids (2011)
So what you're saying is that you hate America and the idea of individual freedom?

See what I did there? When we twist each other's words and don't even try to understand each other, a medium such as this becomes less than useless.
Location privacy issues in car sharing services
I find it interesting that this audit only covers administrative contract oversight. The failings uncovered seem to have been of the variety "Contractor A didn't submit monthly reports for February and March". I don't claim that contracts of that size should have poor administrative oversight, not at all. Even movies with big budgets mention the assistant producers and accountants in the credits.

But what about technical oversight? Were there design-review meetings where somebody said "our system emits data in HL7" and somebody else said, "we haven't defined the XML schema for our data acceptance module yet." In a meeting like that somebody in tech oversight should have said "wait! is it HL7 or XML? Who is going to sort this out?"

(I have no idea whether this actual issue came. Probably the stuff that actually came up, or should have, is far more intricate.)

The purpose of administrative monthly reports' "issues" section is to track stuff like like this. That's why contracts require them. If the government can make the Apollo program work, the government can figure out technical oversight. It just takes the will to do so.
From what I understand one of the main value propositions of Node in regards to async is that async is the default in the entire ecosystem. In fact, I vaguely recall Node's creator explain that he chose javascript precisely because it didn't already have an existing server-side ecosystem, so it could be async everywhere from the start.

But by all means correct me if I'm wrong.
That's what Spring Boot is for.

Everything is autoconfigured and set to sensible defaults. All the dependencies in the starters are levelled and guaranteed to work together.

Spring Boot on Gradle is the closest thing Java has to adding lines to a Gemfile in a Ruby system. Especially when you add other Spring automagical libraries (Spring Data REST, Spring Cloud...).
>With that said, as a user of a tool/library/service, why should I care what language it's written in?

Because it tells you a lot with what other ecosystems is compatible, how much of a fuss it would be to interface with it (in case it's a library and you use e.g. Java, you'd normally prefer a pure-Java implementation instead of a C+JNI one, etc), if it's a good fit for your existing dependency management, if you know the language to go in and fix an issue or adapt it, etc.
> This isn't a force of nature, and it's not extra hard on millenials.

Older people are more likely to own their homes (even in expensive cities like SF), so higher rent absolutely hits millenials harder.
its a joke software and governments here in Australia checkout out this mess.

1.5 billion on a Public transport metro card system
https://en.wikipedia.org/wiki/Myki#Issues_and_criticisms

1.2 billion on a payroll systems WTF!!
http://www.theaustralian.com.au/business/technology/queensla...
Rack is actually best compared to Node's 'connect' middleware. So Node + connect + Express offers a very barebones framework (similar to Sinatra for Ruby, as I understand it). And while there are efforts to create bigger, more rails-like frameworks that build on top of node (and usually connect, and sometimes even express), as far as I can tell there's nothing quite ready to be compared to RoR.
Indeed. The rise and fall of RISC designs coincides with a period where CPU and memory speeds were much better matched, and there was an extreme premium on the number of gates consumed by your design, to fit it all in a single economically manufacturable (i.e. small) silicon die.

I say "fall" because ARM had an additional advantage, the market which they were targeting couldn't afford ceramic packages, only plastic, and they didn't have the simulation capability to confirm their 2nd design would hit their power dissipation target (they were in fact using chips from their 1st design), so they were very conservative and hit their target with a very large margin to spare, maybe a factor 10?

So with that extra advantage, and a good business model (better than any competitor at the critical times? Certainly MIPS), they got more and more design wins where power was a consideration. In 2001 at Lucent I worked on a power constrained monster board that provisioned something like 300 modem lines, it had specialized ADI chips to do the heavy lifting, they were controlled by a bunch of ARM chips, and it had one housekeeping MIPS chip that was standard for these boards. And they pretty much own the mobile market that isn't tied to x86 by an existing software base, or that needs more horsepower than they're currently offering.
The Builder pattern includes setting sensible defaults on the built object before building it. You configure the built object in the constructor of the Builder, before anyone starts updating fields.

You can achieve this through constructors or setters; Builder itself is agnostic.
It's been awhile since I've been to Ireland (10 years) but I remember the cost of alcohol being very high, not just in tourist areas.

I also notice police being very proactive against drink-driving - in the centre of Dublin at least.
Lessons from Gurgaon, India's private city (2014) [pdf]
This is the certificate in question:

https://crt.sh/?id=9314698
The article tip toed around the hatred "everyone who doesn't party" (which the article admits is the VAST majority of the population) has against the tiny minority who party. Mixing hyper militarized cops with high school drinking parties isn't much of a win, so the 5% or so of the party population get kicked out of the middle class pool either financially or via criminal charges before they get into their later 20s where journalists ponder why that social group mysteriously disappeared. Mix the poverty of permanent declines in economic standard of living with increasing fines to be "tough on crime" and mandatory minimums and the risk just isn't worth it both for the people who hold the party and the drunk drivers who attend, and people with risk taking disabilities are destroyed before the late 20s that the journalist is writing about.

Another cultural curiosity is I'm old enough to have been born into sports nerd dominated culture, but the times they are a changin' and the journalist is apparently completely divorced from sports nerd culture, doesn't know anyone who brings over a couple beers to watch the game with a dozen or so guys, or tailgates. The rise of liability lawsuits and anti-drinking culture might be behind a drop in tailgating. I've heard some stadiums ban tailgating entirely! Anyway its interesting that sports nerd culture has declined so incredibly far that the author doesn't even consider mentioning it. For folks too young to have ever experienced it, a ball game on TV used to be a perfectly good excuse for multi-hour long house parties even for people who aren't interested in sports, it wasn't strictly a jock thing; I guess the canonical stereotypical example would be the superbowl party where most of the party goers don't care much about the game but its a convenient holiday between new years and spring break or memorial day (valentines day doesn't count, its for couples not house parties)
That's exactly how I'm using Node currently. While RoR would be smarter and faster if budget/time was an issue, I currently have the luxury of building a relatively simple site+CMS for a client with total freedom and a lot of time on my hands.

After battling Rails' conventions and getting a bit sick of learning a lot of things that are only useful in the Rails world, I figured it might be nice to do everything almost from scratch (Express.js as a shortcut though). I'm using RethinkDB without an ORM, although over time I suspect my approach will become more ORM-like over time and I might just switch to one of the existing RethinkDB ORM's.

It's loads of fun being able to understand most steps of the process of building a complete website that includes authentication, a database, a CMS, and whatnot, especially after relying on Rails' magic for a lot of things. I guess I just really prefer the explicitness of it all.

That said, if money and/or time were an issue, or if the end product would have to be worked on by other developers, I'd probably go for RoR or Django. The amount of stuff it 'just' takes care of is much more than one might assume at first, and the amount of pitfalls in the category 'not knowing what you don't know' are not insignificant (XSS, for example).
Countless hours of simulation tell me that in a world of limited resource induced competition, coordinated action is of paramount importance. Any trait (gene) that improves coordinated action is of benefit.

Of course, my hours of simulation are playing chess, Risk, Warcraft, and numerous other games -- but there's a reason those concepts are so often the core of games: they parallel real life and our desire to win at life.

Even modern psychology is fairly light on things that are proven. Insisting on proof to discuss psychological origins that we can't really test on real proto-humans before we even discuss it is just an attempt to shut down unpleasant ideas, like the idea that most religious beliefs are myths.
This article is about migration of Bantu-speaking people 5000 years ago, not innovation in general, and isn't really applicable to scientific/technological discoveries. Perhaps link to the original paper without the clickbaity title:

"Bantu expansion shows that habitat alters the route and pace of human dispersals"
http://www.pnas.org/content/early/2015/09/09/1503793112
Why does the https redirect to http? Symantec can't afford to give itself a certificate?

the java server pages application that serves the main site has extended validation https://www.symantec.com/index.jsp

but connect doesn't. It seems like https://www.symantec.com/connect/ redirects to http://www.symantec.com/connect/

r.port="https"===o[0]?"443":"80"

Why can't Symantec afford to put ssl on its connect site? It is not like they have to pay anyone for a certificate...
Like helicopters? I know what you mean, I just had to point it out though :)

Using drones would be interesting, but how situationally aware can you be flying one? With an overhead crane you can maintain sight line almost always, and when you can you have people flagging but you still have a good sense of location because of boom and line placement.

With a drone can you see how close your props are to the surroundings? I'm not sure how good they are at self leveling, but that's pretty important as well. There a lot of small but important details about dropping a line into an area you can't see so it does have some hurdles to overcome but is possible.

It would be interesting if it could be automated. Using beacons to locate where the load has to go then setting it to hit a certain altitude before moving over into position. Then you don't have to worry about someone looking at a screen or flaggers giving the wrong signal. If it was fast enough it could make up for not being able to lift heavy but do more trips instead.

Hauling sheets of plywood up to roofers or packs of shingles would be a nice simple way to do this without lots of complexity.
Note: it's extremely easy to increase the density of optar (by editing two constants in the source). optar is configured for 200dpi by default (based on real-world testing).
"easy contract?" I doubt it. Ten million users on the go-live date? Interchange of health-care data from system to system? Getting Oracle's identity / authentication management system integrated as a door-one requirement? Hostile congresscritters doing everything in their power to torpedo the project? The only difference between this and a typical giant cluster#uck is the vast and visible scale.
> but doing it in London and in such a high-profile way didn't really seem like their modus operandi

They carried out the Dubai murders in a high-profile hotel also covered with CCTV, with fake British, German, and Australian passports. I wouldn't put this past their "modus operandi".
Increased land prices mean higher taxes for homeowners too.
Purpose, autonomy and mastery
None at all with syncthing. It's awesome, but doesn't cover my use case. And symcthing does say "Syncthing replaces proprietary sync and cloud services with something open, trustworthy and decentralize" - except as you say it doesn't.
It's dysfunctional because the balancing of supply and demand can be done cheaper and more effectively as part of the grid. But the grid operators often have poorly aligned incentives and so don't bother to do this.

When looked at from a holistic view, the grid should pay much more for distributed solar production. If it was valued correctly then consumer battery storage would rarely, if ever, make economic sense.

Hawaii have been refusing to allow more solar to be added to the grid, instead of investing on the network upgrades to make it work. Australia are charging high electricity prices for overbuilding the network and not properly valueing the contribution of solar. Various other places are trying to introduce punitive charges for domestic solar. It's good that consumer storage exists as it puts market pressure on these dysfunctional organisations, but decent regulation would have sorted this out properly with far greater efficiency.
No, Hawaii's issue is that they are literally burning oil for electricity while penalizing solar-power for homeowners.
AWS Premium support is a joke. I never got a reply under 1 hour time, like they promised.
An unplanned, no warning shutdown of a smelter would be bad - it ruins the rather large and expensive carbon electrodes used to melt the aluminium. Probably not so good for the crucibles and other equipment that might get frozen up.

Planned shutdowns are another matter entirely.

In terms of instantaneous interruptible load, wood pulping mills are king. There are some enormous wood chippers in NZ's north island that can be remotely turned on and off by one of the generating companies.

some marketing speak here.

http://energyforindustry.co.nz/experience/interruptible-load...
Ask HN: How does instagress get permission
Instagram requires users to have a proper business case in order to use their API to like/follow people. Instagram says you shouldn't use this to automate likes and follows. However, instagress seems to sell automated likes and follows - how does this happen? Is instagress secretly a facebook company?
Our app is mostly dependent on AWS's DynamoDB and we're facing problems with it. I can confirm the outrage of it.
Maybe that's why so many millennials are living at home, or why the stigma of not leaving the nest is gone

http://greyenlightenment.com/why-millennials-are-still-livin...

why make the landlord rich when you can use the saved money by living at home to build your own financial future
You'll have to be more specific than "in the states" because when I do that, it feels like an "event" to me.
Implementing Levenshtein Automata
A recent HN discussion referenced a paper that analyzed architectures in terms of ... addressing modes, as I recall. The thesis as I recall was something like, the more difficult or delayed it was to pre-fetch data, the harder it was to make it fast, and the rank ordered ISAs were a good match what I recalled happened in the market. E.g. the VAX ISA was quite bad, and DEC indeed really struggled to make it fast, and didn't bother trying to make a 64 bit version of it.

If you're primarily comparing the two major survivors of this battle, as the interesting paper you linked to does, less competitive ISAs that didn't make the cut would already be removed from serious consideration.

Heck, the great success of both the Intel and ARM ISAs was largely a matter of historical accident than intended design, e.g. the 8086 was designed to be compatible with earlier 8 bit designs and to fit in a 20,000 active gate budget. As I've described elsewhere, the ARM was designed to hit a power dissipation target (which it did by a huge margin), and since then the compact Thumb ISAs have been added to it.
Taxi drivers snarl up Brussels in anti-Uber protest
In the last 5 minutes my paid dynos have just gone completely offline. Heroku's status page is doing a very poor job of reflecting that.
Interpreting history is a valid way of getting insight. Not everything is rigorous.
The solution proposed to fix this mess is insane. A '96 hour training course' at the end of which you are able to handle 100+ million projects? That's 2 weeks of work + change. Does anyone think that they could end up qualified to handle contracts of that size after a generic 2 weeks course?

Of the people that enroll in this program, what % fail? If it's serious, the % of people qualified should be at most 50% - yet it's obviously going to be just a rubberstamp where you put in the hours, then get the certification.

As someone who firmly believes in the power of the state to do good, these things make me go insane. The solution to failures of this magnitude are not to pile on more useless regulations and certifications, or to put even more emphasis on useless credentialism. Healthcare.gov got fixed when they gave carte blanche to highly qualified engineers and managers that gave up very lucrative jobs to help fix things.

I am convinced that lots more people would be willing to give up their cushy tech jobs for a job where they genuinely made a huge difference in the lives of people, provided you got rid of all this completely meaningless hoop jumping. Give clear lines of responsibility, take a serious look at your hiring process, and jesus, if your solution to a 600+ million dollar failure is to mandate a 2 week course... you really need to think things over.
Want to see this in the wild it seams to me that doing it in a room with camera sensors are reducing the complexity to much.

Not to mention the usefulness.

The scenario i would like to see is: I am out hiking and want to get over a river, take my drone out of my backpack attach a rope and let it build a bridge.
What is done with the pictures we upload? Are they stored or discarded afterwards?
The fears that a product design career holds, and 3 methods to conquer them