skysight-inc/HackerNews huggingface dataset:
Ask HN: How to archive online content?
Online content has a habit of disappearing. Sometimes I have a link to an article from a few years back, I go to it and there is nothing there. 404 or someone migrated the platform to a new engine, but did not bother to preserve the old stuff. Sometimes people get emotional about the content they created and take it all down. A lot of times it is all actually pretty high-quality. Sometimes YouTube takes something down for various reasons.

I would like to be able to archive things I find especially worthwhile, but the web doesn't seem to be built to make it easy. Downloading the website with a browser's in-built function "Save page" breaks it (relative links, you don't really download the whole page etc.) - something that doesn't happen with Office documents, PDFs, just about anything that is meant to be moved around. Websites seem to be heavily glued just one place.

To fix these problems I used to convert a bunch of articles to LaTeX, generate a PDF and be done with it. However, frequent LaTeX editing is tiresome. Pocket seems to be an option, but sometimes it fails to archive an article and just redirects you to the original version; what's more it is a service just like YouTube, so I really have no guarantees of preserving the things I save there.

Do you have any good semi-automatic methods for archiving online content?
Java: 1995

Python: 1991

JavaScript: 1995

> If a university wants to teach object-oriented programming, they can teach Java or C++

Or Python. Or Smalltalk. Or Ruby. Or...

IMHO you both go off the opposite ends: No, a generic "developer" isn't badly educated if they don't know C++, but that doesn't mean C++ is some irrelevant language. It's critical for some domains of computing, and widely used.
It's quite a leap from: "Any government will do things that I consider evil" to "Governments [...] are by nature evil." Especially as context suggests you don't mean this to read "Governments are by nature capable of both evil and good." [1]

The former is almost trivially true, at least in the narrow reading supported by your examples, mostly a function of their size. The latter a vast sweeping philosophical generalization that is backed up by nothing.

All your examples show is that there are instances of them failing to live up to your ethical standards (which it seems I largely share). Would you rather have no laws than imperfect laws? No justice than imperfect justice?

[1] That would make it a non-sequitur that you would single out governments but are OK with individuals and corporations using your software.
JavaScript developers- Remote job
Luminati (formally known as Hola Networks) is looking for brilliant JavaScript developers to join us.
Technologies: Full Stack, Express, React, Mongo DB.
Everyone that knows JS coding and find it interesting can apply to: dorin@luminati.io Subject: R&D

Our website: https://luminati.io/
68.5m people displaced globally – UNHCR
Post to HackerNews – Add-Ons for Firefox
ah, no, I'm not asking for a free and open market. I'm asking for a regulated market steered towards competition.

What the US has now is a free and open market, well the logical conclusion of it. (the carnivorous rats on the island model) The lack of regulation to stop consolidation is a big problem. The need right now is for AT&T to not merge with time warner.

I don't think nationalisation is what is required, I think separation of last mile infrastructure from client ISPs. This means that the Motivation for the infrastructure company is to provide stable reliable last mile connections. Because they are going to be used regardless of who is supplying connectivity, it doesn't affect investment. All of this can be achieved with private companies (indeed thats how it works in most EU countries)

This also lowers the cost of ISP startup drastically.

As for QoS, I love QoS, it means that my ADSL connection can still have low latency stuff (audio, video games) even though I share the same uplink with torrenting arseholes. But, I don't see how, with the weakness that is the FCC, they are going to legally distinguish between QoS to regulate service (ie bulk downloading via torrenting) and bulk downloading of a video on demand service.

Both have the same strain, both are video services, both can be throttled to mask the lack of investment in backhaul infrastructure. both need to be "shaped" to allow customers to use the ISP's "services" evenly.

I'd also like to point out that NN has only been a thing for <2 years.
also: do you know how many SS and SA guys answered w a variation of “i was just following orders” / “i was just doing my job” after WW2? following immoral orders and executing them does not free you from consequences of your action.
You really shouldn't have alcohol in your house at all.

It sounds like you are an alcoholic to some degree, and expecting yourself to keep it under control with the substance in your house is a little unfair.
Loom is quite a bit different than Quasar, but pron (aka Ron Pressler), is leading the way on both. Loom is essentially Quasar would have loved to have baked into the JVM. It's the solution for the bytecode rewriting hackery and resulting limitations it faced.
Isn't there a problem with shadow contrast which makes features more difficult to pick out on darker skinned faces? I vaguely recall an East Asian developer giving that reason for why he developed on Western data-sets.
https://caniuse.com/#search=dialog ? NO!
<script>
confirm("No dialog needed")
</script>
It's not legalized in the Netherlands. It's not criminalized due to an official stance of tolerance.

https://en.wikipedia.org/wiki/Gedogen

It's complicated, and there's a lot of nuance to the Dutch model, but it is distinctly different from what you have now in Canada and in numerous US states.
Best Websites to Learn Coding Online
I posted this here as I ran into it in my research for a Quora post and I thought it would be interesting to the HN audience. Would be happy to discuss with anyone else who loves this stuff as much as I do.
If the site is mediawiki based check out kiwix. They have tools to download the whole site with search index. Also tools to search/reopen and render pages from the dump.

I suppose similar tools have been created by the internet archive folk.

But you are right it should be much easier to archive stuff in 2018 and it isn't esp thanks to all the JavaScript and XHR happening.

Edit: I just took a look at kiwix (been a while) they seem to also now archive stackexchange sites not just mediawiki...so looks like they have different archiving tools for different sites.
Not GNOME, but the implications for GTK and a whole load of libraries that are being worked on to support these changes. Like especially GTK is just not a stable target. I used GTK 1 and 2, and especially the incompatible changes in 3 and removal of features are just super annoying (many examples, we already had the introduction of header bars etc., there was always a little triangle in the status bar that was just cut, lots of deprecated widgets, ...). And if you look at the plans for 4(!) there's more fundamental changes coming.

And personally I still don't want to touch Qt, but it might just come to that. I don't think I'm up for yet another rewrite with a toolkit that can't be stable for ten years. That might sound grumpy, but also consider GIMP is still working on the port to GTK 3 ...
Sounds more like bad design than automation's fault
Serverless APIs and Microservices Ecosystem Exploration
European Union's JURI committee approves universal copyright filters
>But penalising the end user is not the solution

But the UK has seen that penalising smoking, by banning it in public indoor spaces and imposing massive taxes has lead to the massive reduction in people smoking and an increase in peoples health. It's not banned, but such a penalisation is a solution.

(and the UK want to follow this strategy for sugar)
Bithumb Hacked- $30M dollars worth cryptocurrencies stolen
How many of those are theft or violence with victims, and how many of those are more like drug/alcohol infractions, or "disorderly conduct" caused by untreated mental health problems?
Yet even in Switzerland, there are companies having access to cell provider data and therefore location data "behind the carrier firewall".

https://techcrunch.com/2017/09/07/teralytics-wants-to-tap-te...

"Polzer says it’s using a variety of proprietary techniques to handle the data in a way that preserves user privacy — although he won’t go into too much detail, claiming commercial sensitivity"

Folks also call this "Security by obscurity".
Out of curiosity, wouldn't the gov just ignore the license if they really wanted to use it? Is anyone really going to stop them or even say something?
not a tutorial.
I'm so sorry that a little bit of HTML and JavaScript reminds you and other commenters under my post of web developer's Old Browser nightmares and brave endeavors of satisfying 100% of Web users at any the cost, but we're talking about Electron which ships a quite recent version of Chromium :-)
Sensible and honest advice like this saves lives
Typo. It should be "you don't need to do the same thing twice"
Although the US has a lot of influence on international culture and laws the above is simply not really true.

Drug laws in Europe vary wildly between countries, with places like Portgual decriminalising even hard drugs and places like the Netherlands having an open culture when it comes to buying and consuming cannabis and other 'less hard' drugs. Then of course there's the big difference in laws when it comes to drinking; a 16-year old drinking on the street is perfectly legal in quite a few European countries whereas in the US it would get you arrested on multiple charges.

Banking laws are very different as well: I think the recent introduction of MiFID II shows quite clearly that Europe has very different views on regulation. Hell, the new rules on investment research are pretty much opposite to the US ones.

GDPR is forcing numerous US companies into complying with European views on privacy.

OP is quite right in saying that it's a very US-centric view to think drug policy around the world is mainly caused by race relations in the US.
Here's the thing: that "how to use the result" part means that you have to get involved in politics as known by common definition and all its mess, inefficiency, terrible campaigning, and more. It's a game of slowly moving things by inches (not to say that radical thinkers and politicians don't have their effects, but rather they help pull towards a side).

You clearly care about the morality and would want to have political action based off it (in so that it was effective, etc). So given that, why is time spent on changing political mechanisms and enacting change using new technology any less important than the tech itself? In fact, why isn't it more important than the tech? I'm not trying to make the case for one side here, but more tease out that no matter the sad state of politics everywhere right now, it's still crucial to taking the tools to have any effect.

I can't say I know the specific path to change, but I think it's important we value the problem and not dismiss politics as a whole. I personally am interested and have stuff on my reading list for the role of technocratic government setups over democratic decisions for certain fields/areas of government like infrastructure. If you work and discuss ways to fix a political system you do a lot more than trying to stay out - who are you then leaving all those decisions to?

Going back to the original thread, you said this:

> I thought it's a great way to actually address the bigger problems in the world personally

If you ignore the political side, it doesn't matter if you invent the cure for cancer if all the politicians decide to burn your paper upon reading it.
I used to have the hibernate issue with my previous retina Macbook Pro. Haven't had any such issues since I upgraded to the touchbar one. Never had any trackpad issues.
> is this really how they operate,

OpenBSD is a research operating system and security is a core component of their research. Pro-actively mitigating security risks before exploits appear is one way to improve security that has worked in the past: vulnerabilities having been fixed before they appeared.

Because they give reasonable deadlines for companies to fix security bugs (~90 days), they are kept out of the loop by hardware vendors like Intel who requested 1 year to fix meltdown.

Being in the dark, if you see some suspicious behavior, either you protect yourself from it, or you might wake up the next day and Intel will have released a new "We are sorry" post and your users would be screwed.

So this is pretty much how they operate, and if an OS is as security conscious as OpenBSD, there isn't really a different way to operate.

Note that disabling hyper threading to mitigate CPU flaws isn't anything new either: this had to be done for AMD's Ryzen because of hardware bugs last year anyways - https://www.extremetech.com/computing/254750-amd-replaces-ry...
They really should’ve used some end to end encryption to protect themselves against DMCA bullshit.

As it stands they will be abused for copyright infringement and the rights holders will not only ask for the files to be taken down, but for them to preemptively prevent those same files from being uploaded again. A huge rabbit hole full of bullshit.
Track blockchain transactions LIKE a BOSS with web3.js
Your Electron version is old; if you're shipping it, you're probably putting your users at risk due to security issues in them. Check the latest versions here: https://electronjs.org/releases
> but I think anyone arguing for the detainment of children is not adding anything of value to the discussion or humanity and is worthy of being disregarded with reason.

I think it is a sensible policy.

Can you articulate why you think it is any worse than child services putting a kid into foster care when the parents go to jail for any other crime?

Illegally immigrating to the US is a serious crime but you can't jail the kids for the crimes of the parents.

The best option is to detain the kids until a relative can get them.

We have been detaining kids trying to illegally cross the border for over a decade now - if you have a better solution then voice it.
The "DAO fiasco" and Ethereum Classic is, in fact, proof that you are wrong about the lack of tamper-proofness.
Framaroot Supported Devices for Android – Huge Android Tips
Medium Joins the Ring of Social Media Platforms Censoring Crypto-Related Content
I think you're right overall. That said, VR seems to be a great fit for certain types of games, especially if they've been designed from the ground-up for VR.

As an example, I'm not sure if playing Civilization 6 in VR would be so earth shattering that I'd go through the effort (though who knows?). On the other hand, for a game like Elite: Dangerous, where essentially it's all about immersion in the experience of flying a spaceship, VR could / can be awesome. Even a simple head-tracking device can transform the setting from "hey, I'm playing a game here" to "hey, I'm sitting in a space ship here".
I concur. YouTube need to have a clear policy, explain it, give people a notice period, then implement it.

If they want everything to be monetised in order to fund the ongoing existence and development of YouTube that's entirely their choice, but they need to be very explicit about it.

Especially when they're wiping out entire channels with misleading error messages as a consequence of maybe possibly changing something that they haven't told their support people about.
It would be great if you could elaborate on this: "Sending to an Unbuffered Channel Returns As Soon As the Target Receiver Is Ready"

As far as I understand, the problem is that the printing goroutine is forced to exit when the main goroutine exits. This way it's unknown if all the submitted work was done.

It seems to me that the caption is a bit misleading, it implies that the problem occurs only with "Unbuffered" channels.
How the new World Cup ball was designed to not influence the games
Aiven.io engineers were able to offer the region one day after its release, marking their 71st region.
Google Hire – a smarter, faster way to recruit
If he's working for a contracting company, why would he lose wages? Wouldn't he still have a contract with that company? I work for a contracting company (in the EU), and if the client lets me go, I still get paid until a new project can be found.
Did it scare you when your operating system started to support it, on the basis that it would "in all likelyhood" be fine?

For a system aiming at security, it's a completely valid choice to disable things that start to look questionable, even if it's not conclusively proven yet. Just like potential software vulnerabilities are patched even if nobody has demonstrated that they actually are exploitable yet.
Tether Rival TrueUSD Is Gaining in Popularity
The government isn't an indivisible entity. It's made of lots and lots of people, bundled in very many departments. There's plenty of competition at both individual and department levels. Sure, at the very top, the President himself could just says "fuck it, we're using the software anyway". But most of the time, if someone in the government decided to ignore a license, they'd be risking their job (or possibly freedom).
The only way for it to come is via the medical route channel, as seen in the recent news story. "Think of the poor suffering innocents"
We have an entire huge system of justice and courts built for just that purpose. You are simply ignoring that this is not a new or unique problem but a pervasive and generally solved issue. Eternal vigilance is the price of freedom, but not using the tools at the disposal of our democratic society, when people abuse this freedom to lie and cheat to undermine rational discourse is just dying another death. With how entrenched outright lies are in the US right now (c.f. FOX airing people claiming that the crying children at the border are child actors) it will be a long fight back. And every step of that fight back to rationality will be accompanied by people like you standing aside going "well, their just voicing their opinion. And what's a lie anyway.". Now if this was just the US affecting the US that would be one thing, but with the US remaining the largest military superpower and the largest emitter of greenhouse gases unfortunately it's dysfunctional political discourse is being projected deep into the rest of the world...

---

Incidentally when looking up exact quotes for another reply in this thread I found this WaPo article:

https://www.washingtonpost.com/news/worldviews/wp/2018/01/10...

"Dutch journalists peppered Hoekstra with questions on unsubstantiated claims he made in 2015 about chaos that the “Islamic movement” had allegedly brought to the Netherlands.

“There are cars being burned. There are politicians that are being burned,” he said then, at a conference hosted by a conservative group. “And yes, there are no-go zones in the Netherlands.”

The comments have widely been described as inaccurate, [...]"

Right. 'Inaccurate', not even the WaPo is calling a lie a lie.
Just to humor my curiosity: According to the Wikipedia article, the NES sold 62 million units worldwide in total.
Actually, what properties would such a place have? I keep thinking that a defining problem of the present day is the absence of such a platform.

I'm even willing to dig in and help put something together. I wonder if an ask HN around:

- How people would like to interact with such a system.

- What it would need to have/do to be useful.

I mean is there even a good format for such a thing? Debates for example are explicitly two sided, but exploring a problem rarely is. You need to track what's been tried, why it might have failed, see if it's worth trying again, allow people to suggest amendments which might help.

There's so much there.
s/netflix/other commercial bulk bandwidth service/

Netflix is the example that works best, as the "man on the Clapham omnibus" can easily understand what it is, and why throttling it is bad for the customer.

Metering doesn't get round this, as that doesn't do anything much to cap peak load, there is still no reason for an ISP to invest in transit, or indeed allowing more edge caching boxes. (the customer isn't going to go away, so why put money into expanding edge footprint)

The only way capacity is going to be built is if there is an incentive (be it legal, cash or other) Why would an ISP drop paying customers _and_ invest in extra infrastructure?
How is it related to arrogance?
> Except fighting drugs requires international co-operation.

You're not wrong (well you arebecause even that doesn't work), but things like cannabis are entirely domestic so no international cooperation required. The harder stuff typically originated from places that weren't close American allies so our cooperation wasn't particularly important.
Nothing of what you said applies to EOS
this is until Sultan Erdogan closes it down. Probably you also get expelled if you don't believe in the Quran. Sad but true. Article tries hard to make Turkey appear like a good place to innovate and it's probably the worst oppression for academia in this century with a huge amount of professors in jail since 2016.
I had a similar situation where it was proven that law is law while contracting at nab, a bank in Australia, years ago.

- When I first started, it took months to get me added to the project phase to bill my time.

- When I was finally added, I couldn't bill it because that project phase was over

- Then a few months to find a solution, then I was asked to bill to the new project phase

- I couldn't bill my old time to the new project phase as it wasn't running in the time I first started.

The bank kept promising they'd work out a way for me together compensated for the time. They continued to do this after I ended the contract.

I kept chasing them, and they went quiet. Then they said they weren't paying me for the time I worked because I hadn't entered my time correctly, then blamed me for walking out the door before I'd been paid the money they owed.

I called a lawyer. nab responded as above. The lawyer told nab that Australian law doesn't care about their billing system - mentioning the specific law helped.

They paid all the money a week later. I should have asked for costs and interest too, but oh well.
What are the day to day effects you face every day due to current vs ideal immigration policy? What about most people? Do you really think that harm is more than the huge amounts of suffering this policy is causing?

Where is your judgment for importance coming from? What's your reasoning for making it such a huge priority? In a country with over 300M people, how is this relatively small amount of people having this vast of an effect? What is it affecting?

In terms of public opinion, consider this: https://news.gallup.com/poll/1675/most-important-problem.asp...

I wish there was a ranked system to see more than the single importance, but the point being that very few see it as a high priority issue.

I don't have specific data for this claim, but I think it's also safe to say the issue is a polarizing one: the group who sees it as the #1 issue thinks its a huge problem while many others see it as almost nothing. The disconnect there is exactly why I led with those questions above.
I didn't know this!

The Blender team is working on Blender 2.8 which will bring a lot of new features, including a lot of UI changes.

There was an article about some of these changes a while ago on their blog [1], and more recently a video showing a lot of these UI changes... available on the Blender Developers Youtube channel (how ironic!) [2].

[1] https://code.blender.org/2018/04/tools-toolbar-and-tool-widg...

[2] https://www.youtube.com/watch?v=ZufGqRP6Gc8&t=6s
Most likely it’s an issue with contrast and overall darker skin colour.

Can be solved by illuminating the face with IR though, which should work across all ethnicities.