skysight-inc/HackerNews huggingface dataset:
For our current projects we use our open source Apache Spark framework Arc (https://arc.tripl.ai/) for feature prep then depending on the type of model we will either:

- use builtin Spark ML models

- call a model running as a service

- write files for a model to ingest (for a legacy project)

- develop a custom plugin or UDF (for calling via SQL)

We have built in stages for running Spark ML models in the framework as well as HTTP and Tensorflow Serving stages to call services. We recently ran a series of models for NLP that were in Python and Ocaml via the HTTP stage sending payload either in JSON or other formats that the services needed. The text extraction via OCR (tesseract) had been done as a prior Spark stage. This design allows us to call these more custom ML models but keep them part of a larger Spark job and use SQL and other features when needed. The services where deployed in AWS Fargate to allow for scaling. For other jobs we are deploying our Arc jobs using Argo for orchestration. We spin up compute on demand vs running inside a persistent cluster.

For training we use Jupyter Notebooks where possible. We have a plugin that generates Arc jobs from these notebooks.

For special cases we can add custom plugins or UDF functions to extend the framework. I have done similar plugins to run XGBoost models in Spark for example.

Whilst we try to be prescriptive around the ML stack for Data Scientists this approach has allow flexibility where needed and for different teams to own their part of the job. This is particularly useful in larger teams where development is more federated.
> For usability while balancing security, cache PIN for at most a day.

https://github.com/DataDog/yubikey/blob/master/gpg.sh#147

This statement has no effect when using Yubikey - the PIN is cached by the key itself and it will remain unlocked indefinitely until it's physically unplugged. See https://dev.gnupg.org/T3362
I was thinking of writing the bindings to Pytorch directly to C++ for F# now that would be the killer thing to bring on to .net . It’d be like writing As close as writing Python but order of magnitude improvement for performance. But that’s a lot of work and I don’t do much ml work lol so meh Someone should do it
There Is a Point Where a Person Can't Do Anymore
They removed the + operator because they wanted people to be able to search "G+", "Google+" and "Google +" in addition to Google Plus. Interesting that they haven't reverted it yet, though, considering that Google Plus is now utterly defunct.
Morning tends to be more concentrated. You've got people going to work, kids walking or biking to school, people taking their dogs out for the first walk of the day, deliveries starting, people heading out to shop for things they'll need that day, and things like that.

Evening isn't as concentrated, because there is much more variation in when people come back than in when they go out.

If we only can do one of them in the light, morning probably makes the most sense because of it having more traffic volume and more traffic diversity.
He forgot one alternative besides fission: fusion! And I'm not talking about Iter, that's probably still decades away, but much smaller sized portable fusion generators.

https://en.wikipedia.org/wiki/Lockheed_Martin_Compact_Fusion...

The smaller scale might simplify things.

Borrowing from the analogy in the article, fusion is a magnetic field management problem.
Decentralized VPN Written in Go
e.g. to serve as a police officer

You can't legally work in any job as an illegal immigrant - it's a Federal law: https://www.law.cornell.edu/uscode/text/8/1324a
How many people live on this planet is not a matter of personal preference. Neither individual nor collective. I thought that was obvious.
Might be and might be not. Many revolution started on country level. In fact the whole word “revolution” are from that. And some change like Roland and Margaret started or even Chrysler or may be Apple 2nd life is how a large org can change course.

It is by definition larger. But may be not so different when an idea caught up, you do not know the end but still try.

There are many government process, role, citizen ... within one Gov

Read the 3 lens approach.
yeah, the same happens for me - i have a relatively recent vizio tv, and the hulu app is terrible - video skips and freezes or the whole app crashes. I've taken to just using my mediapc to run hulu in a chrome tab instead. Both devices are hooked to the same ethernet hub, and other things like prime video and netflix run just fine on the vizio.
Come now. These factors swing by about 1C combined.

[1] https://skepticalscience.com/print.php?r=448

[2] https://www.sciencedirect.com/topics/earth-and-planetary-sci...
> I can't think of a launch of this scale

Well that's the problem isn't it. They chose a scale they couldn't handle ergo, they fucked up.

A more sane approach would be to start by launching in smaller countries and then slowly scale up.
The scale on the right for temperature is a change of about 2 parts per 255 degrees Kelvin. The scale on the left is about 3 parts in 1361. It's not clear whether the much smaller variation in irradiance would be expected to cause the much larger change in temperature. Seems unlikely, since the power radiated by a black body varies as the 4th power of the temperature (Stefan-Boltzman law).

Relies on - "Reconstruction of spectral solar irradiance since 1700 from simulated magnetograms"

https://arxiv.org/abs/1605.02039
Yes! We are primarily a macOS shop, so I don't see us supporting Linux very much, but you are more than welcome to fork :)
What you said is just absolutely wrong. On every level. You are just repeating the propaganda of the landlord lobby.

First off, the number of building permits did actually increase more twofold (by number of apartments) between 2012 and 2018 (the first rent control law took effect in 2015)[1].

Secondly, the rent control law doesn't apply to newly constructed buildings. So suggesting it would somehow decrease incentive to build new apartments is ludicrous. In fact the opposite is true. If you want to have higher rents, you need to construct new buildings.

[1]: https://i.imgur.com/sPgCyTn.png - screenshot because direct links don't work on that page. Source: https://www.statistik-berlin-brandenburg.de
I think the progress in de-carbonizing electricity is promising - California was already at less than 50% fossil fueled electricity production in 2018 [0]:

Carbon-emitting generation:

35% Natural Gas

3% Coal

11% "Unspecified" (lets be pessimistic and assume all of that is fossil fuel)

Non-carbon emitting (or carbon neutral):

11% Large Hydro

9% Nuclear

31% "Renewables" (solar, wind, small hydro, etc)

Yes, transportation is still almost entirely fossil fuel based. Many homes and businesses use natural gas for heat. Industry uses fossil fuels as well in significant amounts. None of these can be ignored.

But de-carbonizing electricity is a crucial first step.

[0] https://ww2.energy.ca.gov/almanac/electricity_data/total_sys...
S3 Antivirus Scanning with Lambda and ClamAV
Japan Microsoft
* 2018/06 => 2019/06 Sales +32%
* Operational profit & profit ratio is worse y by y.
2018/06 => 2019/06: -26%

Selling products by low price is meaningless. Productivity should be measured by profit per employee, not sales per employee.

https://gurafu.net/jpn/microsoft-jpn
I agree that his technological arguments are basically wrong, so out goes the rest of what he’s saying.

Pennsylvania is a fossil fuel economy now, through fracking, and we are idiosyncratically beholden to it in our federal election. Russia, Indonesia, Brazil, Ukraine, Venezuela, Mexico, Norway, Denmark, Sudan, the Middle East and Iran... these are all volatile fossil fuel and mineral extraction economies, they do not export much else to us besides a declining pool of cheap labor or in Denmark’s case, cheese.

Many countries aspire to be mineral economies, not the other way around, life is much simpler that way. That some places extract minerals from the earth, and others “extract minerals” by converting their control of the worldwide supply of attention into ads, and that the Earth extractors are in Pennsylvania and other parts of the world while the Attention extractors are in San Francisco and Los Angeles, is also a big part of the issue.

It is indeed more complicated than “who’s to blame, consumers or producers?” This forum is constantly full of people whose opinions boil down to, “I should get paid for my thing, and everyone’s else’s thing can go suck it.” It isn’t workable. This guy isn’t advancing a workable politic for global action against global warming.

And yet neither is solar power, despite obviously fixing the carbon problem. They do not make solar panels in Indonesia or Iran or Saudi Arabia or Mexico or Brazil or Sudan, that’s a billion people right there who depend on fossil fuel economics. What do you think their opinion is about solar panels? Making solar panels is hard, squeezing oil out of the ground is easy.

And if there’s anything history has taught us, people will fight violently to protect not their profitable means of making money, but their easy means of making money. That’s the problem dude.
So now you propose paying for having kids? So only rich or afluent people will have kids. Poor people not only will keep having kids but will also remain poor as they now have to pay? Do you even think before you propose policies?
{$BIG_N_TECH_CO}'s customers are the advertisers.

They are serving their customers, and they're doing it well.
Interesting. This hasn't been my experience, so not sure what's going on yet...
> Phone users can currently disable the IDFA, but have to do so manually; Android users aren’t even given this option

This actually false. You can change your Ad ID on Android. I just looked (and checked)If you go to Settings > Privacy > Ads you can see this IDFA. At the top (it looks like a header and not an option, so I will not fully fault Mozilla because this is a dark pattern) it says "Reset advertising ID". If you press it you can see the grey "Your advertising ID" (at the bottom) change.

Additionally, there's the option "Opt out of Ads Personalization". It has the text "Instruct apps not to use your advertising ID to build profiles or show you personalized ads." I would love if someone here could clarify this for me. Is this a suggestion to apps or is this a strict and enforceable thing? As in "Hey app, you should ignore this ID that I'm handing to you" vs "Hey app, you don't get to have this ID. Sorry." Does anyone know which it is? The language suggests to me that it is the former.

Edit: This was done on a phone running Android 10
And every citizen and immigrant who intends to become a citizen man (and women in the Guard) at least 17 years of age and under 45 is a member of the Militia of the United States[1].

[1] https://www.law.cornell.edu/uscode/text/10/246
So 5 to 100, instead of adding on one or two small countries a day as their infrastructure allowed.
And on the topic of privacy and iPhone: what you can do to protect yourself from attacks:
https://blog.duple.io/how-i-can-hack-your-phone/
If those same folks leave work at six in the evening, they’re travelling two hours after sunset. Same difference. Fact of the matter is, there isn’t eight hours of daylight in winter in Seattle. You’ll spend time in the dark before or after work one way or another.
Why make it nasty like that? If you’ve got a moral objection why do you need to criticise them personally like that as well? I don’t understand why people feel the need to be so aggressive.
That guide is great --- really helped me out when I started! Then I realized why no one uses GPG in practice: this stuff is way too hard even for security experts. That's why I believe in making things as easy and usable as possible w/o sacrificing security.
Do large corporations really suck less than the DMV? YouTubers dealing with random copyright strikes, Amazon warehouse workers, Comcast users, PayPal users suddenly denied access to their income stream, medical insurance customers bankrupted by claims - and others - are all entitled to wonder if the DMV is really the pinnacle of suckitude.

To outsiders, this looks like a mythological problem in the US. There's a simple-minded - and wholly wrong - narrative of "private sector good, public sector bad".

There's certainly room for improvement in the public sector. But there's a lot more to the public sector than the DMV and the IRS, and the sector as a whole doesn't do too badly - when it isn't being interfered with politically.
> taxes are usually raised to force people to support....

Sorry, the first half of your sentence is too broad for the rest of it to possibly be true.
This is all good news. Just wondering about repairs globally as Tesla's start aging and they need to be repaired, or for whatever the current % of their vehicles require service year over year. They must have that info given the amount of telematics they generate AND that they are sole source for maintenance and repair.
> irrational politics around nuclear power

You sounds like the typical advocator of oil pipelines over protected land and I'm sure you know how that ended up. Can we build safe pipelines? Yes. Do we? No. Why? Because of the human factor, which comes down to greed, stupidity, and laxation of regulation.

This is the same exact case for nuclear. Already we see that a majority of nuclear power plants in the US are operating at almost 2x the design life and will likely get additional extensions. This is done by continued laxation of regulation.

And this is in the US where I would expect the strictest of regulation. When the rest of the world sees the US doing this, it sets a precedence for them to follow and I'm sure other countries will have even less strict regulations and inspections. It's really only a matter of time until we have another disaster.
Where is the Guardian's report on this - https://www.dailymail.co.uk/health/article-7588337/Google-ge...

As a UK based paper Guardian could at least focus on British issues
No, if a warrant is obtained using illegal evidence, then you poison the warrant and all the evidence arising from it.

Parallel construction happens way less frequently than people think it does, since it requires that there be an actual parallel path to the evidence that would have been available at the time the evidence was improperly obtained. It's basically only upheld when evidence was collected improperly through one means (i.e., a confession without Miranda disclosure), but could have been collected properly through other means available at the time of the improper collection (i.e., if the contents of the confession would have been revealed by a standard CSI search).
Unfortunately the majority of more or less useful or popular apps are also linked against various analytics/attribution platforms, often many of them at once. Mixpanel, Amplitude, AppsFlyer, Branch to name a few, plus Facebook and/or Google. In fact having any of the Google's or Facebook's SDKs means tracking, e.g. Maps, Login etc.

Somehow these platforms have no problem with identifying users across their client apps even without the IDFA. Maybe it's not 100% precise, but as far as I can tell these companies keep so much information about us away from our eyes, that even the big guys (G, FB) would be jealous.

Analytics is one big dark corner of the mobile business whose significance is not fully appreciated (yet).
Wouldn't the moral choice be to just not watch? Isn't piracy stealing? Morally: don't buy it, don't steal it and also don't view it. Reward other content providers and reduce the relevance of Disney.
>Family planning how? Who will decide who can have children and who can't? Governments? A global one child policy? That's insane

Without a steady flow of migration from the undeveloped world to the developed world, the population of the native developed world would greatly decline in the coming decades.

There are none amongst the countries breeding at the rate of replacement [0].

We've seen that when a populace has better access to medicine, improving life expectancy and especially reducing child mortality rates, gains access to contraception & abortion, becomes better educated and less religious leading to becoming more well off and having their basic needs met as defined by Maslow, that they trend towards having less and less children.

Even migrants from the undeveloped world to the developed world have shown to have gradually less children as generations go by.

So the theory would be that we could bring down the world's population over time by simply making the above abundantly more accessible to those who are currently fueling the population explosion.

[0] https://en.wikipedia.org/wiki/List_of_sovereign_states_and_d...
https://en.wikipedia.org/wiki/Berlin_Brandenburg_Airport#Pro...

It was originally intended to replace both Schönefeld and Berlin Tegel Airport and become the single commercial airport serving Berlin and the surrounding State of Brandenburg, an area with a combined 6 million inhabitants. However, it is now planned that it will not replace any, with Schönefeld Airport currently being expanded due to rising passenger numbers, and Tegel which will remain open after a referendum.

After almost 15 years of planning, construction began in 2006. Originally planned to open in October 2011, the airport has encountered a series of delays and cost overruns.

Since German reunification, air traffic in Berlin has grown greatly. In 1991, the combined passenger volume of the city's airports was at 7.9 million per year. By 2014, this number had risen to 28 million. When Berlin Brandenburg opens, it will have a capacity of 27 million passengers per year.

Summarized: when/if BER will open, if it will manage to handle immediately its max capacity (best-case scenario), it won't have enough capacity => the other airports will still be needed (until BER is expanded) :|
register_printf_function is deprecated; you should use register_printf_specifier instead.
How do you propose to fight it? Everybody acts in their self interest all the time.
Metabolic rate is not static. That 2% difference would not persist beyond a short time frame. Both bodies would down regulate metabolism to roughly the same levels given the same caloric deficit over time. One might change faster than the other, but the differences aren't as significant over longer time frames as you imply.
You might be wrong about this; you should try graphviz to find out.
"Users of xHamster upload about 7,000 videos a day".
"300 hours of video are uploaded to YouTube every minute!" [1]

I think that's the real reason.

[1] http://videonitch.com/2017/12/13/36-mind-blowing-youtube-fac...
As they want to open their factory next to the new Airport, it will basically be in Brandenburg and not in the center of Berlin (not that it would fit there). They probably will change the neighbourhood there, but automobile engineers are perceived as worker class while google techies generally are not. I also think that Google would have had no problems If they would have opened their office in Adlershof.

So to summarize:

Tesla:

- builds factory in a practically greenfield area

- employs middle-class workers

Google:

- buys old building in the middle of the "hip" leftist city district

- employs high-wage workers which will drive gentrification

So I think this will be received at least with mixed voices, but mostly positively.
Well, I'll be more tempted to fly into logan, at least for now…

But yeah, all hangs on what is "suspicion" (or what passes for it in practice), compared to say a targeted op or warrant provided by a court (even if its one of those secret courts like FISA).
The chart on that page shows the solar radiation as a (somewhat) instantaneous measure, against the global temperature which is a cummulative amount. The annual solar radiation jumps from a lower value to a higher value right about where the temperature starts increasing. It seems a reasonable theory to think that more radiation started coming in each year, and without an outlet it caused the temperature to start rising.

This doesn't mean that we haven't been making things worse, or that there's nothing we can do. But it's crucial for us to understand everything that's impacting the climate, so we can make good decisions.
> However, it thereby neglects the role of CO2 as a primary mechanism of global temperature.

From the book desription[1]:

> For example, there is an absence of any physical evidence that CO2 causes global warming, so the only argument for CO2 as the cause of warming rests entirely in computer modeling. Thus, the question becomes, how accurate are the computer models in predicting climate? What other variables could be missing from the models?

It does not neglect, but disputes. Whether that disputation is successful is above my pay-grade.

[1]https://www.sciencedirect.com/book/9780128045886/evidence-ba...
Hard to have much pity for these companies. In the good old days, they'd post a position, interview until they found one or two people who seemed like they could do the job, and hire one (or both).

These days, it's a grueling, multi-month death march. The last two jobs I was hired for boasted about their steep "hiring funnel"--for every person hired, hundreds of applicants weren't. Watching the process from the inside, I've seen sharp people being declined for the most ridiculous reasons.

In this sort of environment, prudent people become very reluctant to leave their positions, even if something new would be better.

Do you really want people? Prove it.
One Biometric API over All Android
> 1. printf may malloc so don't use it in an out of memory situation. Though I think this problem is vanishingly unlikely these days.

You can avoid this by doing something like:

setvbuf(stdout, NULL, _IONBF, 0);
I have not heard a good explanation of foundationdb's consistency model. The claims have always seemed magical.
They own Bamtech (came out of MLB and eventually powered ESPN as well as WWE and other properties).

I was having issues this morning but just with home and category pages. The “featured” links to content worked fine, but the index type pages I’m assuming were just getting hammered.
All About Updates: More Treble
The toolchain probably isn't on your computer. And the internet provides 72 options (or 99 if you consider Notepad, Subline Text, and gedit).
Yes, entirely safe, that's why nobody is living in Chernobyl and they're using robots to enter Fukashima. Totally safe....
> Who are you or any politician to decide how many kids can a couple have?

I'm someone who subsidizes families having children, my taxes are paying for their healthcare, their schools, their childcare, etc. And while I'm happy to do that because maintaining society is important I'm not happy to do it for someone pumping out 15 kids.

> I bet you this will be a political discussion in some years.

I bet you it won't, reproduction rates have plummeted in developed nations.
Same.

But I 100% acknowledge there's social gatherings and events I miss out on now because they're exclusively organised/promoted on FB. And mostly I'm OK with that.
Why? How is it different from any other aspect of government regulation? In the US at least, the government already has its finger on the scale by giving tax breaks based on number of children.
> I also think that Google would have had no problems If they would have opened their office in Adlershof.

Google probably could have moved their office location ~2 km and have been fine. But they really wanted to sit right in the hornet nest.
I think that IBM know if they get their hands dirty in Red Hat, they wont have much ROI from their investment.
Curious what your experience was. Been using harbor for a couple months and have no issues. BUT we're not using it in a very heavy environment.
Beyond the Little Blue Box: The Biographical Adventures of John T Draper