skysight-inc/HackerNews huggingface dataset:
I agree, I totally buy that it's possible there's an unstated reason to worry about the sum of allocations over time. Though, in an article of this length and depth, not spending a sentence or two and stating that reason seems like an obvious omission. And a reason is given, so I don't know why there'd be another separate hidden reason:

"Currently this import process has to take place outside of business hours because of the impact it has on memory usage."

That statement is pretty confusing to me; if the high watermark is 16MB, there's no memory usage problem to begin with. And if saving 25% CPU time is enough to go from after hours to during business hours, it won't take much to push the jobs back to after hours, right?

The hyperbole in the title & headlines combined with the vague issue of memory usage also leads me to believe this might be more about exposure for the blog post than fixing a problem. That's perfectly fine, but it's also okay to discuss and question what we're presented with, right?

It all feels to me like optimizing to the wrong metric. If you really want a parser to go fast, then eliminate line buffered input and block read the thing. Then eliminate all other memory allocations and process the file in memory. That will increase the memory usage in this case substantially, but it will be much faster than the improved version v11 they ended up with.
I was hoping CRISPR/Cas9 (or some similar system) was going to answer many prayers. Maybe this means it's less likely?
How do I do something like:

{
# comment with a note about the value of foo
"foo": "bar",
# comment with a note about the value of baz
"baz": "qux"
}

Without driving myself and future readers insane with fooComments and bazComments?

What if I need a multiline comment explaining a yak-shaving story for why a key is set to a certain value?

What if the object in question is a set of keyword arguments, and adding new fields changes the behavior of whaever is parsing the document?
I am probably missing something here. Isn't the article just rediscovering what a scanner is? Wasn't this resolved eons ago by scanner generators like flex?
Sure; a semi-automated monetization machinery run amok, then.

But the fact that sales drones at Google are handed broken procedures and ordered to chase forced monitization at cross-purposes of certain prominent users - still doesn't mean there's any editorializing working against the Blender foundation in order to further sketchup.

I'm sure Google management would be thrilled if they were able to organize half such a conspiracy to straighten out their own chat apps.
Blizzard application installs root certificate: https://news.ycombinator.com/item?id=15982161

I can say that I wasn't even aware about it, it installs absolutely silently. So if you care about it, check it from time to time, because that random application may install it at any time!
Or when the place you need to put the comment doesn't happen to be inside an object literal.
Ask HN: How do I get software development clients from silicon valley?
I'm running a young software development company in Estonia. Hiring developers from eastern Europe, writing web and mobile apps, servers etc. I have clients from USA, they are introducing me to their partners already, but I can't find any traces of people from California so far.

I'm interested in this because of two reasons:

1. This is an extraordinary community with huge software development demand

2. We are incentivising best of our developers to start their own projects and therefore we are looking for potential business partners and connections in all sorts of domains.

Thank you for your attention. I hope this doesn't look like a self-promotion post, I'm really looking for confident advice.
Using virtual environments in Python
Especially when there are so many other forces that probably are causing people to go to movies less. Other entertainment options (no streaming in 2002). Bigger/better TVs in many homes.

Honestly, you could tell me I could go to a local movie theater for free and it wouldn't change my behavior (to rarely go) one bit.
> The EPA has set drinking water levels for PFOA and PFOS of 70 parts per trillion.

Per trillion? Seems like pretty nasty stuff.
+1 on the Millionaire Next Door. Read it in my mid-20s 25 years ago, glad I did.
From 2010: Transfusion independence and HMGA2 activation after gene therapy of human β-thalassaemia https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3355472/
C still has it's place. It's not glamorous, but it works. COBOL has no decent replacements. Yet. Some have tried. Almost all have failed. Old does not mean useless. If it works, then it's not wrong.
I first encountered this adage in the ad industry.

"Your headline should never be a yes or no question, because people will always say 'no'".
Lucasfilm puts Obi-Wan film “on hold” after underwhelming Solo debut
Also, the doctors I know basically give up their 20s and early 30s in the American system. But that might be due to existing doctors making sure supply stays low so their prices stay high, and so they can do that by making credentialing lengthy and difficult.
We would need to look at world energy consumption to make a proper comparison, no?
Excerpt:

A major environmental health study that had been suppressed by the Trump administration because of the “public relations nightmare” it might cause the Pentagon and other polluters has been quietly released online.

The U.S. Centers for Disease Control and Prevention published the controversial 852-page review of health dangers from a family of chemicals known as perfluoroalkyl substances, or PFAS — manmade chemicals used in everything from carpets and frying pan coatings to military firefighting foams — on its website this morning, and will publish a notice in the Federal Register tomorrow.

The study upends federally accepted notions for how much of these chemicals are safe for people — recommending an exposure limit for one of the compounds that is 10 times lower than what the U.S. Environmental Protection Agency has maintained is the safe threshold, and seven times lower for another compound. The stricter exposure thresholds are similar to those established by state health agencies in New Jersey and Michigan. All told, the report offers the most comprehensive gathering of information on the effects of these chemicals today, and suggests they’re far more dangerous than previously thought.

Source: (ProPublica) https://www.propublica.org/article/suppressed-study-the-epa-...
As a general rule of thumb: Never use yet another non-markup language designed by people who claimed to be designing yet another markup language from the very outset, then after somebody awkwardly pointed out that what they'd designed wasn't actually a markup language, they invent a backronym to contradict that embarrassing historical fact.

It just makes me wonder what the hell they thought they were doing all that time...

It's like designing a tool called YACC, and ending up with Yet Another Interpreter Interpreter!

It's like a standard for storing all your pornography in a folder called "Definitely Not Pornography".

https://en.wikipedia.org/wiki/YAML

>Originally YAML was said to mean Yet Another Markup Language, referencing its purpose as a markup language with the yet another construct, but it was then repurposed as YAML Ain't Markup Language, a recursive acronym, to distinguish its purpose as data-oriented, rather than document markup.
Is he seen as eccentric? I see him as a stimulant-addled psychopathic killer with the conscience of a starving shark. Otherwise I’m in agreement with the rest of your post.
American and United ask US not to fly detained children on their flights
I picked up on that too.
Drone swarms light up China’s night skies like fireworks of years gone by
That's not a very informative definition, and it's inaccurate. See https://en.wikipedia.org/wiki/Flâneur for the relevant idea.
I appreciate your humility and professionalism in a discussion thread that holds a lot of criticism; suffice it to say, I should have practiced a bit more humility and a bit less "Monday morning quarterbacking" in my original post. And I should have read your comment on YAML's history. To right the record: you got _so_ much right with YAML, and it's unfair for me to cherry-pick this example 20 years later. Sincere apologies...

As the saying goes, "there are only two kinds of languages: the ones people complain about and the ones nobody uses." YAML, like any language, isn't perfect, but it's withheld the test of time and is used by software around the world—many have found it incredibly useful. Sincere thanks for your contribution and work.
How Predictive Analytics Can Improve Your Mobile App
How would you even quantify damages of that kind?

Should it be zero if they don't know how much? Or a billion?
Theoretically you should be able to use ws://127.0.0.1 from https context but I'm not aware if it's already well supported in the browsers.
I have not seen this before, thanks for sharing.
Rebooting AI
That's blatant insider trading. He'd have to have done it with someone else's help.
One story about how PFOAs screwed up a town in WV, and how DuPont tried to cover it up:

https://www.nytimes.com/2016/01/10/magazine/the-lawyer-who-b...
Well, I think there may be too many peers using pretty limited number of exit nodes to access HN (or any other popular site), currently 1109 hosts, source: https://www.dan.me.uk/tornodes
Again, something can be racism and something else.

> Maybe they grew up in a town full of white people, and maybe all of their friends and coworkers are white.

This is not an accident. All-white contexts in America are the result of personal and systemic racism. People who grow up in those contexts are, unsurprisingly, more likely to be personally biased and will regardless do things that further systemic racism.

People in that condition have a choice: they can either overcome their upbringing or they can continue to support white supremacy. If they do the latter, well, then they've made a choice. You can accept that if you want. I don't.
Its not fragmented enough, and prices are still dirt cheap.

AV subscriptions are 20-50 dollars per month.
> It's not necessarily the wrong decision to forgo an existing well-tested tool in favour of a hand-rolled solution, if you don't have any experts on that existing tool in your org.

It will, however, lead to other problems, especially:

- reinvention of the wheel (aka: time waste)

- starting from scratch: technologies like OSPF, BGP, or (when we're at higher levels) my/pgSQL vs noSQL are sometimes decades old and battle tested. Which means that there are a lot more edge cases that have been discovered and fixed/documented, as well as best practices that have evolved. Same goes for security. Or even fundamental stuff like ACID criteria (which many of the noSQL friends have had to re-discover and learn)...

There's a reason yuge enterprises and government offices still run on mainframes (or, mainframe software on modern hardware): the stability and resilience of these beasts with uptimes in year-scales is something the hipster crap crowd is enviously looking at. And there's a reason that redesign projects in these areas fail so spectacularly: there are decades worth of domain knowledge and experience encoded in these systems. It's impossible to recreate this in a year or two, especially when outsourcing the work to body shops.

Only thing I wonder is: it should be, by now, common knowledge (or: state of the art) that outsourcing yuge projects to body shops, especially foreign ones, leads to disasters. So why are managers and politicians not prosecuted or otherwise held responsible when screw-ups originate? After all, when one e.g. designs a building that violates fire code and people die as a result, or one grossly ignores security best practices, the responsible persons can get charged, too...
Note that you can also report it to the issuing CA if the vendor doesn't take action, and the CA will revoke the certificate.
As someone who has been working almost daily with Lambda and other AWS serverless services for close to 2 years, it astounds me to see so much FUD and misinformation among one of the smartest technical communities that I know.

Serverless is about making as much computing power as you demand available on demand with a "pay only what you use" price model without demanding that you maintain the underlying systems. In addition, embracing this model tends to allow you to break out of the request driven model of needing to call APIs for everything. Instead, you enable a whole host of new event driven interactions between application components.

Even this article misses one of the more interesting advantages: scalability under varying load. AWS Lambda may cost more than an equivalent EC2 instance if run constantly, but it scales up and down almost instantly without adding cost. You just pay for the compute time. So, burst traffic is no sweat (up to your account limits or function configured limits). If your application has highly irregular load, Lambda can keep it more responsive while saving you money too.

And it is nothing like paying for shared hosting or other single unit, where you still have no horizontal scalability.
I disagree with this, but not because MeFi users are wont to flame or bait or argue in bad faith by default.

I paid for a membership almost a decade ago and haven't been on Metafilter in probably 6 years now. Even back around 2012 it was getting to the point where there was a clear ideological bent - namely a postmodernist, anti-capitalist, anarcho-socialist-lite, ideology. That would be all well and good except arguing from any other pov, if only for argument sake, would get piled on and not discussed in a way conducive to productive conversation.

Seems to be happening everywhere on the web now - including HN. Just this week someone argued that this statement I posted was "almost racist":

I also don't think this is desirable as a framework for AGI - as humans, despite our intelligent status, are quite unstable and sub-optimal in groups.

How someone gets "racist" from that statement is really mind boggling. Not exactly a great environment for discussion.
Show HN: A chrome browser extension for the Watir Chrome Engine
I got blindsided by another obscure yml phrasing rule. Sometimes people couldn't pay online using our service and I couldn't figure out why. I tested the hell out of the payment module on our dev and UAT environments, but I just couldn't reproduce the issue.

Eventually I tracked it down to an ID inside a yml file. Turns out the live environment was running in 32 bit mode which interpenetrated the number as a string.
I was nodding along with you--yes, the population explosion is destroying the environment--until I realized, with mixed bemusement and horror, that you were in favor of this.

Just for starters: Why is "the Industrial Revolution happened" an argument against trying to do better in the future?
I think it means you work whenever you want as long as the job is done on time. If you're working remote with little supervision, then it makes no sense to stick to an 8 hour 9 to 5 schedule, unless that's your optimal working window.
well there is also toml and hocon (json supersets) which are "yaml like"
Have you already negotiated with them? (@techjuice brings up a great list of points which could be negotiated). Is the contract signed? Is 100k their first offer?

You could contact 10x Management (they offer "Agent on Demand"[1] which was discussed on HN[2]) for help / guidance. I've been represented by them for 5 years and they do tremendous work (they're professional agents / negotiators..!)

Email me if you want more info (email in profile). I'm Canadian and have been doing nothing but contract work for US customers for the past 5 years.

[1] http://www.10xagentondemand.com/

[2] https://news.ycombinator.com/item?id=16494677
Why have these weekend "culture" posts started bleeding into wednesdays?
Tesla is priced like it already is Toyota and GM. (and Honda and Ford too)
Pure assertion on your part.
Trudeau says pot will be legal as of Oct. 17, 2018
Speciation is happening faster than extinction
Translation for metric units users:

66 °F ≈ 18.9 °C

+10 °F ≈ +5.6 °C

98.6 °F = 37.2 °C
I'm aware it typically doesn't come from a place of "not my problem." It usually is well meaning. But it tends to be counterproductive.

My two adult sons live with me. When I'm seriously suicidal in a way that could genuinely lead to my death, they don't leave me alone. We arrange things such that one of them stays with me at all times.

Most suicides happen while alone. Just physically being there serves as a deterrent.

My medical condition is a large factor in my suicidal tendencies. So they do two things for me when I'm suicidal:

1. They take physical care of me.

2. They refuse to engage overly much with the crazy stuff because they know that it is essentially a medical side effect and the cure for that part of it is time and physical care.

And I'm trying to make conversation and generally agree with some of your points. I have no idea how well I'm succeeding. I'm just very tired today.
I see a lot of folks who speak like libertarian-minded young men jumping up and down about how the CPSC action is, like, the stupidest thing ever. I don't recall seeing anyone who identified as working in an emergency room or doctor's office saying so.

On the other hand, I do recall seeing Youtube videos of young males literally putting these magnets in their mouth to emulate tongue piercings, etc.
I imagine CRISPR/Cas9 still has great potential for addressing specific genetic disorders (which are usually localized to a single, known gene), but the more transhumanist stuff about making smarter, longer-lived people is still a ways off.
They produce the most batteries in the world and have the most extensive global charging network and the most advanced solar panel tech. They're the number one horse in the race to dominate the post-oil world.
Just today, I was thinking the same thing, but about compile-time type checking. "You don't need it, because you're a good programmer? Great. But not everyone on your team is as wonderful as you. Do you want to be able to catch their errors at compile time?"
So, I'm not a lawyer, but the 10th Circuit ruling doesn't read like this is over to me, it reads like this may be a temporary reprieve for Zen magnets.

> As a result, the FDO is vacated, the Initial Decision is reinstated, and the matter is remanded to the Commission with directions to provide an impartial tribunal for Complaint Counsel’s appeal from the Initial Decision. In particular, the Commission is instructed to conduct the appellate review without the participation of Commissioner Adler.

The court found no issue with the decisions of the CPSC, but with one of the commissioners having made a decision prior to the decision making process. So yes, Zen can sell their magnets, but the CPSC should reconduct its review - and I don't see anywhere that suggests that given the same data they have today, they can't or won't make the same decision.
Leaking information about the inefficiency of Tesla's production line could be construed as whistleblowing. Tesla is a public company and shareholders have right to know of issues that can have an impact on the viability of the company.
That is pretty specific to the role. I have done contract work where I just had to get stuff done in and couldn't bill more than 40 hours a week. Other roles were up to 45 hours a week but had to have ass in seat in office mon-friday 8-5
It is the best book on personal investing I've ever read, and I recommend it wholeheartedly.
I had to stop using Keybase after this issue [1] cropped up: when you re-install your OS, you lose access to the "device" and have to provision a new one, even though the machine is the same, and even in possession of an uncompromised private key.

Apparently this happens a lot [2-7... probably more]. Unfortunately, this renders Keybase unusable for me because, even though I still have my private key, I cannot access my laptop's Keybase when I install it.

[1]: https://github.com/keybase/client/issues/3460#issuecomment-2...

[2]: https://github.com/keybase/client/issues/3559

[3]: https://github.com/keybase/keybase-issues/issues/1952

[4]: https://github.com/keybase/keybase-issues/issues/1985

[5]: https://github.com/keybase/client/issues/4260

[6]: https://github.com/keybase/client/issues/2357

[7]: https://github.com/keybase/client/issues/2675
This is what people don't seem to get, exploding messages aren't an airtight solution to the risks of sharing sensitive information with someone. You're always taking a risk when you do that. Exploding messages change the default way that sensitive information is handled, and changing the default can have a profound impact, for all the reasons you lay out.
Works just fine in Safari and Firefox Nightly for me. Consider reporting your browser configuration to the author? [1]

[also notice that it is in no way affiliated with Flutter and done by somebody in the community]

[1] I can't find any way to contact the author, but here is his blog post about the Studio https://medium.com/@pmutisya/flutter-studio-version-2-41cce1...
Are We Initiating the Great Anthropocene Speciation Event?
I left contracting and took a full time position for this reason.
Sure I did. Because it's a minor crime and many of the people are involved are fleeing real danger. That's plenty enough reason to take a nuanced approach to dealing with the minor crime.

Most of the world has agreed to simply not charge refugees with entry crimes:

https://en.wikipedia.org/wiki/Convention_Relating_to_the_Sta...

But they aren't great.
All I'll say to this is that there is a lot of information on this topic that a large part of the population isn't aware of. For example, the concepts of gender expression, identity, and body. There's plenty more to think about and learn, like how this statement above might breakdown when you start talking about someone who is intersex.

I'd say some great places to start might be:

- Understanding Gender: https://www.genderspectrum.org/quick-links/understanding-gen...

- Gender Revolution (Netflix documentary w/ Katie Couric): https://www.netflix.com/title/80186731
Services and Utility functions and using them effectively in my GSoC project
Openhole Fishing
It’s Not Always Clear What Constitutes Sexual Harassment. Use This Tool
TOM: Initial release	23 February 2013; 5 years ago

Drupal 8 file format discussion was in 2011, predating it by two years. https://groups.drupal.org/node/159044
There's government CA in Kazakhstan issuing certificates for people and for some government websites. They have software for people, so their website can talk to USB tokens. This website connects to that software via secure websockets at 127.0.0.1. And they bundle private key for 127.0.0.1 issued by that CA inside that application. Is it bad? I guess there's no point to report it to them, because they are CA and developers. It's not browser CA, it's some kind of "private" CA (users must import their certificate as a trusted root to work with their website and software).
> I mean that the inherent complexity of the task at hand doesn’t go away and might even be harder to solve with a simple language.

I see this so often everywhere. "Yes, but with this simple framework/database/language you don't have that complex problem anymore!". No, it just ignores the problem completely so eventually it will bite you and you now have to solve the complex underlying problem in the wrong domain.

Problems never go away, you just move them to a different place. The trick is which place to move them to.
Where I'm at, while there are a couple AMC theaters, the place is heavily dominated by Edwards/Regal theaters. While yes, there would be more places that accept MoviePass, effectively for me, there wouldn't be much difference between availability. In fact, if the Edwards/Regal one were to offer something similar to AMC (allowing IMAX and other premium showings), it would be more appealing to me.