skysight-inc/HackerNews huggingface dataset:
We don't want to give away too much. If anyone were to guarantee you anything that's how you know they are lying. I could care less to steal e-mails. We are changing the way people use social media, the way users engage, the language behind it all and the privacy and protection of all people. Fighting the facade of social media and the bullying/trolling on it that leads to deaths/suicide. Anxiety and depression is through the roof and this platform is an answer and a good solution to helping solve that problem.
How do I convince myself that climate change is a crisis?
I'm a recent grad from a marketing program with 50k in student debt. If climate change is as much of a crisis as I often hear, it would seem I have a duty to get seriously involved in being part of the solution. The thing do do seems to prepare for a lifestyle change unlike anything seen in hundreds of years. I should probably learn firearms, agricultural, medical, and landnav skills to get through the coming nightmare scenario. Sallie Mae will probably cease to exist in this scenario, so no need to pursue a corporate career. Manhattan is going to be halfway underwater in a decade!

OTOH, if the predictions of mass migration, food scarcity, etc are over-estimations, I should probably grab the best desk job I can and chip away at my student debt. I have never had an interest in the climate, and my hobbies and lifelong dreams lie in unrelated fields.

However, I have very little science education and can no more verify that hurricanes and wildfires are any more caused by CO2 than they are by divine retaliation for Bravo channel programming and Pride parades.

I watched the peak-oil documentary 'Collapse' in 2009. It had me nearly convinced that I should drop out, learn carpentry because SWHTF in 2015. Four years later and I know there are ever more Serious reports by Serious scientists, but things seem quite the same. Why haven't I heard about oil traders quitting their jobs and throwing their capital at getting setup for a paradigm shift?

I was raised to be worried about global warming, and think we should dump resources into cleaner energy. However but as time goes on, I'm becoming less and less convinced. Maybe as fossil fuels become scarce, supply-and-demand will appropriately encourage development of new technology.
Curious PLS-00302 component DBMS_PICKLER must be declared error from JDBC driver
This is definitely a good trait when you start. It's not good when you're much further along, say a couple of years, and something clearly isn't working.
The closest I’ve ever found is https://www.zootsoftware.com/ - famously championed by James Fallows of The Atlantic. I don’t believe its web crawling tools are as sophisticated as Devon Technologies’, but it can do a lot and has a lot of power tools to process what it ingests. I haven’t used it since 2010, so my information may be out of date.
Recent research has shown that ensembles of time series models generally outperform any single method, so my recommendation would be to use both.
> Most people don't want to share their political views

This has not been my experience.
Things really must have changed, then, because I remember when Trump supporters wouldn't shut up about winning and how much they enjoyed the taste of bitter liberal tears.

And then provide a laundry list of everything progressives, liberals, feminists and Democrats ever did to deserve this.
All the Eggs in One Basket
Certainly when your manager knows that estimates mean estimates, not deadlines. But I guess that's the dilemma in false-agile fixed price big ball of mud consultancy business, you have to give a commitment.

Would appreciate any comments on this topic.
Why does Ruby always get the shaft? It is pretty easy to learn, VERY expressive and readable, extremely easy to write tests against and works great with the web!
Are you me? This is me exactly. Google has become almost useless and I now have to append certain domains to find anything valuable.
The distinction would become rather clear if you call that function from other code, I imagine. In other languages things would happen, while here you would just get the return value to do what you want with.
In my experience, in casual forums, most discourse from people that involves explicitly voicing support for Trump in a general sense also follows the attitude you're describing. It's near-universally accompanied by very strong expressions of hatred for one of a few named groups. And of course such behavior naturally provokes the same attitude to be returned. In that sense, it makes sense to ban it outright.
It's kinda amazing that only now have I discovered how useful time series forecasting is for sysadmin/devops/SRE/whatever we call it now.

In effect, Icinga (Nagios) represents a local maxima. It's very easy to write checks without mathematical or statistical sophistication -- write a check in the language of your choice and return a status enum containing one of three values: OK, WARN, CRIT. A result there's a massive collection of checks written by others. Sure the language to configure it sucks, but mostly because it models so many things -- systems to be monitored, how to group systems, the checks to monitor systems with, who to alert, and on what schedule.

Instead of doing one thing well, Nagios does everything, kinda poorly. You can't easily schedule overrides for an on-call rotation. Event correlation is entirely manual. You have to restart the service to add or remove monitoring -- it's not prepared for autoscaling or clustering. It can't even scale itself!

There is a better way, using a layered approach. Break the task up into multiple steps: Sense, Store, Analzye, Alert, Route. Nagios effectively discards the Store step, and divy up the remaining work between checks and nagios master. Sense+Analyze+Alert are done by the client, and the Nagios master handles alert Routing.

(taking it home to the topic) Because Nagios has no Store step, analyze is limited in power. You cannot calculate standard deviations, or even rates of change. ARIMA is impossible, as is ETS. You typically define static thresholds. If there's any seasonality, you have to find a static threshold that catches real problems while minimizing false alarms.

The downside to the layered model is that there are many different solutions, and every decision point leads to a more fragmented community. How many people out there run statsite+graphite+grafana+opsgenie? A good layered approach needs to fully isolate layers, so that any integration feature or problem is limited to pairings. Usually easy for features, but for bugs, it's almost definitionally impossible to prevent a problem in an earlier layer from causing symptoms or or two layers later.

tl;dr: I've been mostly learning about ETS (holtwinters) on the job, but would love to learn more about predicting customer traffic.
By the time it reaches your house and sink though, it could have traveled through several miles of metal pipes of varying age and condition. Having a filter or RO system at the actual endpoint is never a bad idea
Thanks for the link, lots of great stuff on that site.
If you think knowledge should be free, contribute to freely available knowledge in some useful way you can.
Yeah, it’s basically a tax, but a tax going to a private individual instead of an accountable organization controlled by the community.
Seconded. Great video, very informative.
This seems like the one to watch. Not sure why but the 2016 version didn't much cover forecasting. Thanks!
Open question:

How could you create a sustainable search engine business optimizing for quality results? i.e. not tailoring results for maximizing revenue
Chinese fret as Samsung, other giants leave
Privacy Badger by EFF should do the trick. On top of that I can recommend Firefox + uMatrix.

If you want DNS-based, Pi-Hole indeed. If you want hosts based you're going to have to modify that manually (AFAIK, there are probably managers which auto update it for your OS). DNS-based is going to be network-wide, including Android TV or your wife's smartphone or... you get the idea. I got my DNS server available via WireGuard VPN. It also does DNS over TLS which adds security.

Put Google in its own Firefox Container via Google Container extension.

You still need some other measures to avoid tracking and fingerprinting. Using these will increase the amount of capcha's you're going to have to solve. I can think of e.g. CanvasBlocker, and setting privacy.resistFingerprinting to true.

There's also a Firefox extension which removes UTM from URLs. That would be Tracking Token Stripper. Not sure about avoiding AMP.
I'm sorry I was mistaken on the per-site privacy controls being removed. I can't edit the comment to fix my mistake. The controls didn't appear on a page that I thought it would, but I found another and with your css it was still there. My mistake.
> but Google _____ if you're interested in learning how others do it.

> ...and you provided essential guidance to making it a reality.

That's called essential guidance? Man, I guess I could be an educator and mentor, providing essential guidance on software. I guess people are serious when they say software is Google-fu.
I'm puzzled by why anyone would think its not ok to scrape? What you do with the data is what matters, as long as its transformed you're in the clear.

Scraping is the entire business model of every search engine.
yup, i've been a user since v0.3, when it was called phoenix. chrome's been handy for dev/testing but not as a primary browser, as google's ambitions/intentions became evident with gmail's debut.
I do. My main barrier to being more useful and community active is my limited time. As I said above, I wouldn't charge a penny if I had the time to share more knowledge.
I tend to prefer eager ML languages vs Haskell. Some lazy abstractions are a bit leaky. Performance might degrade and it's really hard to debug.

Laziness is nice, but not by default perhaps.
Why are you projecting this hostility? I don't perceive China as an enemy. I live in New Zealand. China is a major trading partner. I'm just stating facts as I see it. China has made unprecedented economic growth by leveraging existing science and technology developed in western capitalist regimes. Virtually none of the science and engineering fundamentals were invented in China. They are catching up and may overtake at some point. All of this was explained to me by a Chinese immigrant (university lecturer) back in 2011.

I suggest you try read things more objectively. Filter out the unnecessary emotion from your interpretations.
Running fine on FF 67.0.4 on win 10 here.
They don't even use Intel CPUs, it seems. Boutique vendors would be out of my price range, and the few boards supported by Libreboot seem to be circa 2009 models, presumably preceding Boot Guard. I doubt that it's something I'll be using any time soon.
I agree; human memory is good at keeping indexes, which is augmented by the internet to retrieve the full content. You only need to store enough in your mind to know what to Google for. Memorization as a skill is less valuable now than it used to be.
So nobody is going to mention that cement itself sequesters carbon dioxide?

https://www.cement.org/for-concrete-books-learning/concrete-...

http://theconversation.com/eco-cement-the-cheapest-carbon-se...

https://www.sciencedirect.com/book/9780081024447/carbon-diox...
Much more thoughtful comments are being downvoted too for instance https://news.ycombinator.com/item?id=20257728, so it's mostly luck i guess).

No one suggests to destroy environment just because. As said above, i agree that we should be assessing the impacts before doing things, but here people are simply suggesting to use water, and you are falling into inadequate emotional insults.
I think that these days the Haskell best practices recommend adding a type annotation to all toplevel declarations, to help keep error messages manageable.
Probably not a GoPro but Chinese food channels seem to fit this description fairly often. Here’s one https://youtu.be/fz_aSsuhg8Y
The most common language in every US state (besides English and Spanish)
>I'd gladly donate some local lectures on the stuff I know if I had the time.

It sounds like your time is a limited resource and you choose to allocate it to other areas of your life instead of for the good of spreading knowledge. Why then, do you think others should give their time away for free?

Not trying to be hostile, just a thought for you.
Cool story, I guess subsidies are ok now.
I work in Fintech. One of our products is "alternative data"... Where we sell financial datasets to other financial institutions, mainly hedge funds.

Typically the client will ask you to fill out a questionnaire about how you create or generate the data. There are lots of questions about web scraping.

The general sense is that these firms are more and more sensitive to purchasing data that has been scraped... Especially if it relates to individuals or social media.
Wouldn't any website reasonably be motivated to ban hateful content, and in practice usually do? Most places seem to just rely on good old human moderation and subjectivity. It's imperfect, but it would be naive to think you could write perfectly deterministic rules for identifying hateful content. It doesn't mean you should fall back to inaction.
I've raised this same point on a bunch of threads about scraping in the past, but...

Scraping is fine if you ask the company and get permission!

This may seem obvious, but so many conversations about scraping seem to start from the position that it is in some fundamental way, not allowed. This is not true.

Conversations also seem to start from the assumption that you need to scrape the whole web, which again is not true.

If you're teaching a machine learning course, perhaps you have a project on classifying... cars. Do you need to scrape the whole web to get a bunch of data about cars? No. Could you get away with scraping just Autotrader or a similar site? Maybe! Why not ask them! If you clearly state that it's for learning, that credit will be given, etc, you may find them quite amenable to it.

I work at a company built significantly around web scraping, and we have contracts with all of our scrape targets that confirm we are allowed to scrape them.
Are they 32bit cpus or 32bit windows? I recall windows inexplicably treated(treats?) 32bit and 64bit as being separate purchases for some reason (I assume money, given they limit supported core count according to which type of windows you buy).

But more seriously: why ship 32-bit only software. 64bit has been supported by all cpus intel and amd have shipped for more than a decade now. I had a consumer 64bit Athlon in 2005/6 that I could afford on a student budget. Given the perpetually increasing cpu demands of modern games, that you'd throw away something in the order of 15-20% perf by not support 64bit just seems insane.

Seriously: make 64bit your primary target, and if that hurts 32bit perf, that's those user's problem: they chose not to buy a high perf system.
And when something bad happens because of this rushed code, they'll tell you, "you have to do more testing", make sure quality is not compromised. "We can do automated tests, we can do them as long as it doesn't eat up developer time".

Makes me think that in a consultancy business, everything hinges on getting the customer to fund your development properly. Ask too much and you'll lose the contract to a competitor.

Any thoughts on this?
Ah, that seems entirely plausible (my misunderstanding I mean)
They were only marked as WIP when people noticed they were missing.
What “Worse Is Better vs. the Right Thing” is really about (2012)
> Shouldn’t the amount of funds to a dev team depend on some sort of measure of value rather than a cut of all future tokens?

A cut of future tokens is a kind of measure of value, isn't it? The more value the developers produce in terms of building a useful token, the more that cut of the tokens will be worth.
Developers, presumably, to make things like concrete and glass.
Indeed I remember this noise as well.

My experience has been that this loud, aggressive, often insensitive minority drowned out thoughtful, reasonable, well-informed Trump voters, especially in the American South, where I ran into them every night at campfires and watering holes.

The narrative that all Trump voters are part of a troglodytic, unsophisticated, callous constituency, failed by the American educational system, is pervasive throughout major media and, as far as I can tell, not a significant explainer of the results of the 2016 election.

Make no mistake: I think Trump is a total, umitigated disaster, but I think that his supporters are far more reasonable than is typically depicted.
>we'd have automatic multiplexed Twitter/G+/FB streams a long time ago.

Perhaps aggregation apps should have the client do the scraping, rather than being entirely dependent on server side scraping?

Regardless, the state of copyright and IP law in the US is abysmal. We can't trust these companies (FAANG) to keep their own press releases online for a decade, how can we let them monopolize ideas (which they fail to fully flesh out) and content? They have been shown to be inept stewards to their own content :c
Dozens of Creatures Thought to Be Extinct Found Alive in ‘Lost City’
That's the point of due process: to make a conscious judgment about intent based on evidence. In your case, any intelligent person—short of corruption—would realize you were stating an example, not encouraging me to commit a crime.

Assange broke the law—calling him a journalist is a farce and a tactic—and has to deal with the consequences. Letting him get away with it sets a precedent for interpreting the law in any way we want, effectively rendering laws useless (and creating the exact problem you've described here).

Simply put: https://www.youtube.com/watch?v=lbOtyWTRZ_g
The point is someone doing exactly what has been accused here, exactly, but to leak stories in support of whoever is in charge of various military branches. Would that same law apply for exactly the same thing? I strongly doubt it. "Unnamed official sources"

Perjury is not exactly a novel prosecution to run, nor would be something setting precedent. This (right or wrong) sets precedent in it's interpretation and effect and will create case law either way it goes. Do you see the point I'm making? I can't see prosecution hesitating for a second to prosecute someone like Assange for perjury if there was even a hint of a case for it. That doesn't make Assange right and Clapper wrong or indeed say anything at all about that. It's just a worrying thing.
So China will always win by disallowing DJI exports.
The best tool for this in my experience is callgrind with assembly notation. You can configure it to more or less mimic the cache layout of whatever particular chip you're running and then execute your code on it.

You can use the start and stop macros in valgrind.h to show cache behaviour of a specific chain of function calls, like when a network event happens, then in the view menu of kcachegrind select IL Fetch Misses, and show the hierarchical function view.

It doesn't mimic the exact branch prediction or whatever of your architecture but when you compare it to actual timings it's damn close.
No offense taken, yours is a valid criticism -- until you meet 20+ internet marketers in real life.

There are a lot of very greedy people with a lot of time on their hands but they choose to try and strangle the internet instead of bettering it. And I am left saddened that I have a family to support, health to improve, and work on having my own retirement fund. Maybe start a business or two as well.

Trust me I get it. But currently I have to think of the future and there are only 14-15 active hours a day.

Yours remains a valid remark. If we want to have useful internet then maybe a lot of personal lives have to be sacrificed.
...Americans who rarely or never follow the news are surprisingly good at estimating the views of people with whom they disagree

This is the scary bit of the article. If actually being more engaged with news gathering (in the traditional sense) means you actually have more inaccurate information then I think it clearly shows our "news" sources are broken.

I don't know that this would be any surprise to most people, but it seems that the "news" industry is not about the transmission of facts, but that of a covert (and no so covert) psyop influence operation.
> An Amazon spokeswoman denied that counterfeiting of books was a problem, saying, “This report cites a handful of complaints, but even a handful is too many and we will keep working until it’s zero.” The company said it strictly prohibited counterfeit products and last year denied accounts to more than one million suspected “bad actors.”

If it were just a handful of cases, you wouldn't have a million "bad actors" getting caught. You'd have a handful. A million people a year aren't trying this because it's unprofitable.
I think it's a hard line to draw. Did you just tell someone to Google the anarchist cookbook? Or did you tell them to Google a specific nitrate group that is easily accessible but requires specific knowledge and likely wouldn't be found by a novice searching (which novices will find a lot). I think it also matters if you explicitly know they are going to commit a crime vs just being curious (you do have to know how to commit a crime to defend against it). I don't think it is simple.
This was a fun read, but hating on a language that doesn't even have a minor version yet feels unfair!
As the CTO of a DaaS startup in stealth mode working on our MVP, expect to take a year or more. We also offer SaaS that centralizes workflow around using the data, enterprise customers expect a level of polish and reliability that is not expected from the next facebook/airbnb clone, desk procedures, train the trainer programs and other ISO processes can't be revamped every single release. Keep fighting the good fight.
> Yeah, manpages feel like the equivalent of being served a book on a subject where I just want to know a quick incantation.

Because manpages are from a time when reading the manual was expected behavior, searching for a quick incantation more often than not results in learned helplessness because you don't actually learn anything, just the specific spell for the specific situation.

I'm as guilty as anyone of trying to solve the immediate problem with a magic spell at times, but bropages embrace this willful ignorance.
The price of freedom is eternal vigilance. The point is the rule of law is worth standing up for when it is threatened, surely. The rule of law isn't gravity, it doesn't continue to exist if nobody cares. Without it, life looks quite different.
I really don't see how Amazon is any different to Pirate Bay here.

I take it there aren't too many pirate movies being sold so that Hollywood won't get involved.