skysight-inc/HackerNews huggingface dataset:
Originally I intended to make the crawler code available under an open source license at GitHub. However, as I better understood the cost that crawlers impose on websites, I began to have reservations. My crawler is designed to be polite and impose relatively little burden on any single website, but could (like many crawlers) easily be modified by thoughtless or malicious people to impose a heavy burden on sites. Because of this I’ve decided to postpone (possibly indefinitely) releasing the code.

Given that there are plenty of existing, open-source crawling engines out there, I don't see how this decision is really accomplishing anything. Concretely, Apache Nutch[1] can crawl at "web scale" and is apparently the crawler used by Common Crawl.

There’s a more general issue here, which is this: who gets to crawl the web?

This, to me, is the most interesting issue raised by this article. In principle, there's no particular reason that, say, Google, has to dominate search. If somebody clever comes up with a better ranking algorithm, or some other cool innovation, they should be able to knock Google off their perch the same way Google displaced Altavista. BUT... that's only true if anybody can crawl the web in the first place... OR something like Common Crawl reaches parity with the Google's of the world, in both volume and frequency of crawled data.

The first scenario is definitely questionable. Sure, you can plug the Googlebot user agent string into your crawler, but plenty of sites are smart enough to look at other factors and will reject your requests anyway. (I know, I used to work for a company that specialized in blocking bots, crawlers, etc.)

It really is a bit of a catch-22. Site owners legitimately want to keep bad crawlers/bots from A. consuming excessive resources, and B. stealing content, from their sites. But too much of this will lock us into a search oligopoly that isn't good for anybody (except maybe Google shareholders).

[1]: https://en.wikipedia.org/wiki/Apache_Nutch
Another service that does the same thing: http://urlhosted.graphicore.de/

From http://urlhosted.graphicore.de/about.html: "urlHosted is an experimental web app that misuses the part after the "#" of a URL to store and read data."
Hft does provide a service: taking on financial risk. This is a hard concept for people not in finance to understand, but think of it like insurance if that helps you.
Parallelisation in Python – An Alternative Approach
The information many hft players operate on has nothing to do with the market in question.
I've tested on a later iOS but not 10.2. I'll have a look later today - it's possible I'm missing a polyfill. All you should need to do for it to work is to enter something in the main text input and hit "search".
So what makes Rust impossible to port to OS/2?
If you're suggesting that because a system draws from a group of people consisting of both sides of politics (or no side of politics, then it is therefore "functional, fair and apolitical in its outcomes", then I suggest your conclusion is somewhat naive.

The idea of "I cut you choose" is an incredibly inspired one because fairness is inherently built in because no participant wants to risk getting the bad side of the slicing and therefore works very hard to make it fair.
Dying in games has very different meanings. For some, you've lost 3-10 seconds of progress. For others, you lose 3 years of time invested (and potentially money). There is also an emotional connection to death in games. Some are happy death, some are dreadful.

Take roguelike games for example, dying can be a good thing, you might have been stuck with a weapon or ability you got at the start, and by dying to get rewarded a new 'random' package which happens to be much better.
Yep, this two layer approach is also desirable since in userspace you aren't context switching to the kernel all the time and can make some assumptions to avoid certain locking and external fragmentation with the kmem. Short lived allocs are really cheap coming out of i.e. jemalloc arenas and that is important for a lot of programming ergonomics.
Why was this downvoted? React essentially uses observables, right? Child components don’t directly listen to changes in the state objects of their parents. Instead, parents know how to update their children when setState is called. Thus, the inversion of dependencies decouples objects in React in the same way observers are decoupled from their subjects in RxJS. Redux has a dependency on RXJS for a reason.
> '10 years' for each movie downloaded

...made me chuckle.

Can't say I like the guy but as a society we have learned a fair bit from making him an example thus far. With Netflix and Spotify people don't need to be downloading dodgy MP3 files and whatnot, we have moved on from that era.

Prosecuting him is a bit like if the Police came after me now for routinely riding my bike down a one-way street ten years ago when the street has been subsequently updated to have a bike lane with the on-street parking removed and a Boris bike dock added. Yes I was wrong to have broken the law but things have changed.

I think they should go fully petty on him, take all his stuff and insist that he shed a few pounds for his own health. Make the conditions of his parole dependent on him not being 'plus plus size'.

I think MegaUpload and Napster were important in getting us to where we are now, which is not the wild west it was.
Anyone else think of this from the title?

https://wiki.lspace.org/mediawiki/Iconograph
That's a good hot take, and I don't really disagree about (some of) the tendencies of this article, but this is still a pretty shady / unethical company by most measures.

> I was told it has 50 mil nic and my jaw hit the floor. Those that vape knows that's a crazy number

Since the earliest days of vaping, it's been easy to get liquids at varying nicotine levels, downright common to have them without nicotine at all, and it's been understood practically as a first principle that one can gradually taper down the nicotine levels as an effective means of smoking / overall nic cessation.

Along comes Juul, with patents for more effective nic delivery, a $16B valuation and >$1B capital, trying to reach people who aren't necessarily tuned into this niche at all, coming to market with exactly one nicotine option: ultra freaking high, apparently over double what for a long time was the standard 'highest' option available from most e-liquid vendors (18mg/mL). These guys seriously only plan to start selling "lower-dose pods" at some later point.

I'm not so sure that any significant portion of the market they're angling for (virgins to the product space) is likely to progress to "more advanced setups", not if Juul is their point of entry. In any case, Juul's rising will probably lead to higher median nic levels in the market at large, as competitors whose product would otherwise seem "weak" try to reach Juul's customers.

Makes sense, I guess, that the guys in this space getting funded would be those who are the most amoral - cranking nic levels up while aiming to deliver it with more punch, not even pretending to support tapering off nic entirely, keeping them on the tit for now while probably offering unspecified lower levels in the future. On one hand they talk about their noble mission to get people off the hated cigarettes and their outreach to keep everything above-board and 21+, on the other they make sure social media is carpet bombed with cool young guys + gals vapin Juuls.

Don't get me wrong, I'm not outraged or clamouring for them to be legislated to their doom or anything. I'm truly impressed by how brazen and full of shit these guys are.
Nanotech
I won the lottery while doing my PhD in the US. PhD was really a good time but I should basically have left immediately after I finished. Total waste of time afterwards.
The growth in fundamentalist groups since 1998 has not faded. The foundation for Islamic identity politics is much sturdier in 2018.
In practice i’d consider the UK a 2 party state as well. FPTP basically results in either Labour or Conservatives leading government. The other parties are geographically limited. Eg the Scottish Party cannot win outside of Scotland, same for the 2 Irish parties, and although LibDems should not be geographically limited, in reality you can almost consider them the London party.

Go check the Dutch or Belgian systems. They have proportional representation and our (NL) current government is a coalition of 4 parties. (Yes, it moves slower, but also results in a more nuanced government and more gradual change)
oh..
this remember me when I had a Mario game on a 5" floppy that bottedup directly from the bios.
Vaccinations have probably let the weaker and slower people survive.
Upgrade your React UI with state machines
OK, I understand why someone might need to maintain and deploy an OS/2 app deep within some enterprise backend, but why on earth is anyone trying to browse the web with it?
Of course Conal no longer likes the name Functional Reactive Programming for what he did. And "Reactive Programming" was never really a good name for the non-continuous case either, it's really just a variant of dataflow programming.

Sigh.
Looks like a student joke. I just dont know how many files were deleted in such a jokes during education )
This is fantastic and hilarious and clever. They could apply this to sponsor a child charities to increase donation frequency, duration and amount by having it draw pictures and write back in a very personal and child-like way based on donor sent pictures and letters. Your welcome.
If you want to know the difference between Dropbox and other DMCA protected services and Megaupload you should read the indictment[0]

Some highlights:

* The DMCA takedown tool didn't remove copyright content but rather only shortcode links to that content. The copyright content remained on the servers and uploaders could generate new links without re-uploading the content

* On the other hand when child porn or terrorism material were reported, they were correctly removed

* Megaupload knew and could see most of their referral traffic was from warez sites and talked about it internally

* They incentivized copyright content uploaders with payments and poached them from other warez file lockers

* They removed uploader names of copyright files from public pages to make it harder for investigators to track upload groups

* Employees of Megaupload would share warez/music/movies in internal emails with each other by searching Megaupload (a tool only available internally)

* In emails to uploaders that were part of their rewards program (where you get paid more the more your content is downloaded or viewed) they used scene release file sizes to describe reward steps

* In large payments to uploaders they'd leave internal comments like "lots of popular DVD rips", "keygens", "loads of pdfs - looks like scanned magazines" etc.

* Internal emails would ask about finding particular releases and ask someone to use the internal search to locate them - ex. “the sopranos is in French :((( fuck.. can u pls find me some again ?"

* Internal emails openly talked about which warez linking sites they liked the most - problems with viewing copyright content, fulfilling requests for copyright content, etc.

* They were booted from AdSense, other ad networks and multiple payment gateways/providers for knowingly provided paid access to copyright content

There is a lot more there - a lot of these aren't one off incidents. I come away from reading the indictement wondering how Megaupload and Dotcom ever thought they were going to get away with what they were doing - their attempts at protecting themselves, including their legal arguments at establishing plausible deniability and discussing the conspiracy so openly on plaintext emails on a US based server, were amateurish

[0] https://www.washingtonpost.com/wp-srv/business/documents/meg...
Life on the slippery Earth: Aztec moral philosophy didn't expect saints
Harvard University is fighting to keep its admissions process under wraps
It’s also the most reliable way to get hardware decoded YouTube on Linux.

Firefox and Chrome don’t support it last I checked, and I’m not sure if they even have GPU rendering on Linux by default.

Some players can hook into youtube-dl, so streaming is still possible.
If there’s a need for this we’ll build it. Right now we’ve had a bunch of people express concern about getting too many permission requests or about having emails they don’t want posted without their permission, but neither scenario has materialized yet.

The other option would be to have threads go live in X hours unless someone opts out. Right now our main goal is to have the permission options be clear, intuitive, and consistent so that people start to build up a mental model of how it works.
I’ll just ask Dan.
--no-osc will disable any OSD in mpv. osc=no in mpv.conf
There are already many deep-learning based image processing apps, including ones that apply style transfer.
Increased CO2 exposure is one possibility, both from increased atmospheric levels, and from more thermal insulation of buildings:

https://thinkprogress.org/exclusive-elevated-co2-levels-dire...
thank you for taking the time to write this
I use both regularly. I never notice the "downslope" of caffeine, although maybe that's my tolerance.

The neurology is totally different. Caffeine primarily affects the heart rate via adenosine (A1R) antagonism. Nicotine binds to the ion channel nAChR which is expressed all over the brain and the nervous system. Full agonists of nAChR cause convulsive seizures, while antagonists are paralytic, but nicotine is a partial agonist, producing a sort of stability.

That's why nicotine is anxiolytic: it interferes with spikes and droughts of acetylcholine, smoothing the highs and lows of neural activation. The brain responds by "sensitizing", changing acetylcholine more dramatically in response to stimuli, and increasing the density of nACh receptors. That's why nicotine withdrawal is so awful: every mood is enhanced and you can't calm down.

By contrast, caffeine, which primarily affects the A1 receptors that are expressed in cardiac neurons and smooth muscle tissue, is obviously never anxiolytic. A faster heartbeat does not produce calmness. The faster heartbeat increases the availability of energy in the brain and muscle, producing wakefulness. It has some other effects in the brain, particularly the basal forebrain, where inhibiting A1 also promotes wakefulness, but the cardiac effects of A1 dominate its practical effects to the extent that A1 agonists (opposite of caffeine) have never been implemented as sedatives because of their tendency to produce life-threatening drops in heart rate and blood pressure.

You'd think, having studied this so much, I'd be more responsible, but humans are a funny animal. Anyway, there's no way a pure stimulant is going to substitute for an anxiolytic that takes effect in ten seconds. It makes sense in zero realities.
They add $4500 per month to live in DC?
Some vaccines prevent diseases (like smallpox) that can disproportionately affect young and healthy people: https://en.wikipedia.org/wiki/Cytokine_release_syndrome

> It is believed that cytokine storms were responsible for the disproportionate number of healthy young adult deaths during the 1918 influenza pandemic, which killed 50 to 100 million people.[12] In this case, a healthy immune system may have been a liability rather than an asset. Preliminary research results from Hong Kong also indicated this as the probable reason for many deaths during the SARS epidemic in 2003.[13] Human deaths from the bird flu H5N1 usually involve cytokine storms as well.[14] Cytokine storm has also been implicated in hantavirus pulmonary syndrome.
glibc malloc has been optimized a lot during the last couple years, mostly to improve multithreaded performance. The work was done by DJ Delorie (of DJGPP fame).
Other way round : the author is a eugenicist looking for evidence. https://rationalwiki.org/wiki/Michael_A._Woodley_of_Menie
This has been very frustrating to me because it feels like many reactive frameworks for OOP languages are actively muddying the waters. I've had stuff like ReactiveX recommended to me as "FRP" and it's nothing like the form, and just wastes my time.

If actual FRP for web wasn't doing so relatively well, I would begin to fear that FRP is heading the same way OOP did after Smalltalk, a shadow of the actual thing pushed as a buzzword to sell to marketing managers with no clue or concern about the actual tech.

And god help me, I do not want to see what the C++ of FRP looks like ...
Indeed, we usually don’t recompile the compiler every time we use it either.
I'm trying to think of a better analogy. At first I thought of stagnation, like how a river that gets blocked and can't flow gets filled up with algae and gunk.

But then what you said about software staying the same while the environment changes around it immediately made me think of evolution, Like any species that can't keep up with changes in it's environment, software that is not continuously updated to fit it's.

What do you think?
> Hopefully the NZ courts will reach a wise conclusion.

The only conclusion up to NZ courts is about extradition; which has already been made. It's up to US courts now.
We've a STV system in Ireland, I'm not sure you'd classify our independents as centrist (by the Irish definition of centrist - by the US definition almost all our politicians are far left).

Overall the system works quite well, and the proportion of representatives a party has in parliament roughly aligns with first preference votes.
Yeah, I've heard that. Would love to hear recommendations on what better foreign sunscreens I can buy.
What is "mpv?"
I'm not sure what you mean, optionals are just a sum type (says so in your own article) and Ocaml support for them is first class, also option is a built in Ocaml type http://batteries.forge.ocamlcore.org/doc.preview:batteries-b...
I think this is awesome. My '2 cents' - stretch the imagination of the impressionable by implying that there is a 'little man' inside the box.

'How does it work daddy?'

'Well son, there is a little man inside the box...'

- my dad, circa some many decades ago, standard answer.

Actually my grandma on the other side of the family fully believed such things but that is another story.

You need not have a 'little man' inside the box, you could go with 'Kevin the autistic squirrel' or maybe something a bit more politically correct. You could even add temperament that way so the parent could explain with some credible make believe why 'Kevin' has drawn something random. Maybe add the randomness in so 'Kevin' gets bored/tired/petulant on occasion, adding in doodles or perhaps loving/kind words. Awareness of the purchaser's birthday and current location could add to the fun, to draw a side drawing of the Eiffel Tower if on holiday in Paris, rain clouds if it is raining etc.

The fun to be had...
In practice, I've used socket.io and redis to glue dbs and apis and queues and schedulers and clients together and the clients listen to sockets for data payloads to modify the views. View interaction sends event payloads to modify the various systems which kick off further data payloads. That is the entire concept. No article was necessary in the making of this post.
WebSub: Open protocol for distributed pub–sub communication on the internet
Simple!

0. Write oh hi :D, get link0

1. Paste link0, get link1

2. Paste link1, get link2
...

Encoding goes
E(T), E(E(T)), etc. let K be the per-char encoding overhead, so E(T) = KT: complexity is O(K^N * T) where N is number of levels and T is length of text at level 0!
Where will you publish the write up?
It's like an image containing its own SHA2 hash. How is it possible?
OS allocators allocate pages, userspace allocators use the OS allocator to allocate bytes.
how about 3,6,14,28,60,120,248,496?
The best way to setup OCaml (native) is to follow https://github.com/janestreet/install-ocaml. If you're following Real World OCaml, the stdlib they use is Jane Street's Core/Base, which is quite comprehensive compared to the one shipped with the language. Mixing and matching the book with the language's own stdlib can cause a lot of heartburn.

There is also a lot of work going on in making the OCaml native development experience easier. install-ocaml (link above) actually takes you through building and testing a project using Dune (formerly JBuilder) which is fast becoming the standard way to build OCaml projects.

If you are however interested in just the language, you can get wonderful ergonomics by using BuckleScript/ReasonML. You'll be running your code using Node, or in the browser, and you'll get access to the large and wild npm ecosystem. You'll lose out on the native OCaml ecosystem, but there are attempts to meld both together.

If none of this is your cup of tea, then you have a great alternative in F# - it is Microsoft's attempt at OCaml, and has a few great features that are not present in the original language. It comes with great Visual Studio IDE integration and sits in the .net ecosystem like Clojure or Scala does in the JVM ecosystem.

Or you can use Elm or PureScript which are statically typed functional programming languages that run on the browser, or Haskell, or even Idris.

These languages have great differences between them, but all of them are ultimately statically typed functional programming languages. Julia is not. Typed FP gives you ADT, immutability by default, functions as first-class constructs, and lets you model complex software as just pure transformations of data. These things are worth learning just for them, and once you understand the motivations behind them well enough, the occasional jank would be but minor annoyances.
Awesome Badminton Rallies 2018
Good suggestion on the noscript.

There is actually a bunch of animation and interactivity on the site though. E.g. if you click on anyone in a thread, you see their bio and their other threads. And when you hover over a user’s popsicle stick on the newsfeed it pops up, which is stupid but oddly satisfying... We tried to give it the feel of popping bubble wrap.

Anyway prerendering more stuff is on our roadmap, so once that’s set up we can reevaluate.
How do you create small animations?
I'm wondering if there is a simple way or tool to create animations like algorithm simulators or process simulations like how ML will classify a group of dots etc.

For example, today I saw an article about reactive programming, which has this image https://www.nexocode.com/blog/images/rx-debounce.gif

How would you create such animations?
GitHub is investigating reports of intermittent connection failures
They said "unlikely" not "impossible". I guess it is unlikely because no one is willing to put in the massive resources needed to port Rust to an archaic platform.

Here's a link about porting the Rust compiler to the Haiku OS: http://rust-on-haiku.com/wiki/PortingRust

Please note that Haiku is among the supported OSs of the LLVM compiler framework while OS/2 isn't. So unless you want to re-create a Rust compiler from scratch you would first need to port LLVM to OS/2.
Would 100 Mbps (down) be acceptable?

If so, explore your cable modem and see if it's possible to manually configure the link speed to 100 Mbps (leave duplex set to auto-negotiation, though). This should cause your link to always auto-negotiate to 100/full and, at that point, bufferbloat (in that direction, at least) should (in theory) be much less of an issue (or potentially even non-existent!).

Unfortunately, some cable modems have very few configuration options that can be controlled or modified by the end user (they download their configurstions via TFTP at startup, as you probably know) -- especially when it comes to ISP-provided (or, worse, "ISP-customized") cable modems.