skysight-inc/HackerNews huggingface dataset:
If you go to their first tutorial, "Tutorial 1: Basics", you will see this comment in the code:
"# Make a sentence object by passing a whitespace tokenized string"

In that simple example you posted, they already did the tokenization manually, as it's pretty trivial. But yes, in many cases, you have preprocessors that do the tokenization. In some libraries, you actually have a class/object_type for tokens, but it's pretty common to just preprocess and take every space as a token separator.

In some contexts and cases, it's possible to see tokens like "social_network", where multiple words are considered a single token.

In that first tutorial, they also mention they have a tokenizer if you need it:
"In some use cases, you might not have your text already tokenized. For this case, we added a simple tokenizer using the lightweight segtok library."

So for your example you would simply run the tokenizer first, then the named entity recognition.

EDIT: apparently you can do this directly:
"sentence = Sentence('The grass is green.', use_tokenizer=True)"
>>I would be happy to have Taiwan rule China.

So convince the Chinese in mainland China and we can solve this without a shot being fired. Boeing etc will profit from this but Taiwan isn't going anywhere. Eventually a pro-China party will win and via...

I wonder if USA has a way to brick the weapons we sold /are /will be selling to Taiwan if China takes over? No doubt Chinese spies are in all branches of Taiwan politics and military.
It mentions in the tutorial that you can input space tokenized sentences directly or have it tokenize it for you, see https://github.com/zalandoresearch/flair/blob/master/resourc....
I hope I'm not misunderstanding the comparison, but for me the takeaway seems to be: make the users job easier. That has always been what we're trying to do, hasn't it? Stop forcing them to enter _so_ _much_ _data_ by hand, manually. It's tiring for them. They don't want to do it. They will do what they can to avoid it. They will make mistakes or enter random data just to get it done. Using "ML" or whatever to classify things automatically is generally "good enough" and makes everyone much happier. Except the execs that seems to always want "perfect data" to analyze. Hopefully as we get better and better tools to do this (and it seems even simple categorization is usually sufficient, anyway), we will stop forcing people to do this stuff.

And I hate to pick at specific points that are more cursory to the article, but I can't help myself:

> Duplex feels like an extension of the gig economy; this is about college grads not wanting to waste their time negotiating with grunts.

I understand the sentiment here, but I don't think that's what's happening here. If there were a better way to do this sort of thing without "hacking" the human interaction I think we'd do it. I think Duplex has come about because many companies still insist on wasting everyone's time by forcing people to make time-consuming phone calls to perform very simple tasks. I don't think is about helping college grads not have to interact with "grunts".
I came to the comments specifically to make a similar point and was glad to see people already addressing it. I (diagnosed ASD) watched the video on Wikipedia and thought it was weird he had the same neutral expression each time.
There are two interpretations of this, one of which is irrelevant to IQ and psychometrics and the other of which has no evidence despite several people spending most of their career looking for it.

Math, music, chess, story telling and social intelligence are all skills, all of which can be improved from a low base. In all of them higher g will be helpful because there’s very little where higher g isn’t helpful. If you want to learn about the science of skill building it’s better known as the study of expertise. K. Anders Ericsson founder the field. He wrote a popular book, Peak: Secrets from the New Science of Expertise

https://www.amazon.com/Peak-Secrets-New-Science-Expertise/dp...

If you want the academic treatment there’s a Cambridge Handbook of Expeetise and Expert Performance.

https://www.amazon.co.uk/Cambridge-Expertise-Performance-Han...

If you want to read about how multiple intelligence theory á la Gardner has no empirical support start here.

http://www.faculty.mun.ca/cmattatall/Multiple_Intelligences_...

> Multiple Intelligences, the Mozart Effect, and Emotional Intelligence: A Critical Review

> This article reviews evidence for multiple intelligences theory, the Mozart effect theory, and emotional intelligence theory and argues that despite their wide currency in education these theories lack adequate empirical support and should not be the basis for educational practice. Each theory is compared to theory counterparts in cognitive psychology and cognitive neuro- science that have better empirical support. The article considers possible reasons for the appeal of these 3 theories and concludes with a brief rationale for examining theories of cognition in the light of cognitive neuroscience research findings.

If you want attempts at something that kind of looks like multiple intelligence from people who actually know psychometrics look
up the work of Robert J. Sternberg. Criticism below

http://www1.udel.edu/educ/gottfredson/reprints/2003dissectin...

> Dissecting practical intelligence theory: Its claims and evidence

> Sternberg et al. [Sternberg, R. J., Forsythe, G. B., Hedlund, J., Horvath, J. A., Wagner, R. K., Williams, W. M., Snook, S. A., Grigorenko, E. L. (2000). Practical intelligence in everyday life. New York: Cambridge University Press] review the theoretical and empirical supports for their bold claim that there exists a general factor of practical intelligence that is distinct from ‘‘academic intelligence’’ ( g) and which predicts future success as well as g, if not better. The evidence collapses, however, upon close examination. Their two key theoretical propositions are made plausible only by ignoring the considerable evidence contradicting them. Their six key empirical claims rest primarily on the illusion of evidence, which is enhanced by the selective reporting of results. Their small set of usually poorly documented studies on the correlates of tacit knowledge (the ‘‘important aspect of practical intel- ligence’’) in five occupations cannot, whatever the results, do what the work is said to have done— dethroned g as the only highly general mental ability or intelligence.
Is this a valid back of the envelope sort of calculation?

World Debt is $250T

World GDP is $80T https://www.visualcapitalist.com/80-trillion-world-economy-o...

Central bank interest rates are around 1 or 2% for the west ( https://au.investing.com/central-banks/ ), a lot higher for others

So at the moment servicing that debt is doable - for the west anyway. If interest rates go up then things might get tricky.

However the debt seems to keep going up, so if the debt keeps increasing and the interest rates go up then things will turn nasty. There are no doubt some countries now that are effectively dead man walking and if interest rates go up could start crashing which could collapse the whole house of cards. I suppose rampant inflation will remove the debt.

Total wealth of the world is $317T (https://en.wikipedia.org/wiki/List_of_countries_by_total_wea...) so everyone could liquidate and have some money left over.

So as long as the assets of the world make enough to service the interest on the debt things will keep chugging along. The real problem I suppose is how much of the world has to work to service the interest bill.

Or is that ridiculously naive?
If I made that in a semester it would have been fine. That was about 1.5-2 years.
> as soon as I become aware, they fade almost instantly

I have this too. I feel that, for example, if I visualise a room of people I know but when I actually go and look at any detail then the situation goes. My hypothesis is that my immediate memory doesn't have the detail I'm wanting to look at so pushes me away rather than make something up or just give nothing.

The seeing with closed eyes is, I think, just the same but a local location.
That's my own experience as well. I would guess that this is how most people experience 'imagination'.

Same with faces: I guess nobody can really 'see' a face in their imagination, at least not for more than a few seconds of high-resolution short-term memory. They can, however, use their knowledge about nose shapes etc. to construct a symbolic model of the face in their mind.
I am surprised you managed to find all of those quality pictures from free stock photo webs.

Just wondering, what sort of API do you think can get you monthly subscriptions?
Great effort!

Assuming the video creator is here, here's a quick tip to make the video even better: zoom in and crop.

Currently you seem to be showing the entire app window. Try only showing the feature you are highlighting. This makes the video better for small devices and on computer screens when the viewer hasn't gone full-screen.
Columbia’s Jeffrey Sachs Quits Twitter After Criticism of Huawei Article
That may very well be, but IQ is still the best we have right now and, more importantly, is much more coherent and reliable than astrology is.

The possibility of its use being continued in a lay manner even after we have a better model shouldn't stop us from using it right now. In fact, you could use the same argument to argue against any other current scientific knowledge.
Top 5 Smart Home Devices for 2019
I'm curious.

How many coders here also can't picture things in their mind visually for longer then a quick flash?
My only problem with Autodesk products is they refuse to support Linux. I hated having to have Windows just for one shitty piece of software.
Stickman Ski Now Available on Android and IOS
For comparison that's not much compared to professional critics. Many are now on letterboxd with thousands of ratings and reviews per critic. 200-300/year is the usual rate.

A big festival screens 200 movies in two weeks, a programmer will probably see ~400 for this event, half of them plus many get rejected. Plus they go to other festivals to see 30-55. In two weeks.
Steamboat Willy was 1928. In 1998 when the latest copyright changes were made it was 70 years old when copyright was extended from 75 years to 95 years. So frankly it's not unrealistic to say we're no closer to Mickey Mouse being out of copyright than we were in 1998.
That's interesting, thanks.
I'm not sure I would trust a (f)MRI analysis, but I expect it could be tested for. Experiment designers can come up with very cunning methods to tweak these things out.

There are experiments showing that some people who are cortically blind can make decisions based upon the vision of which they have no sense experience. The McGurk effect demonstrates people having an experience that isn't real. In fact the McGurk effect also shows how difficult things get with terminology when you 'hear' something different to what you hear. It's the same problem I mentioned above. If you feel like you are hearing 'da' when your ears receive 'ba' what are you actually 'hearing'?
When I say completely rewrite, I mean rewrite a class, method or library which is what we're talking about (since you probably started writing in python/clojure). Sorry, it was poorly phrased.
This. Great copy and clean UI for the website does a real good job of explaining the product. I personally, dislike watching videos to understand the product, until unless maybe if it is a physical product.
I think John Stewart’s show was a little more intelligent. His discussion with Jim Cramer comes to mind - he actually convinced him and Jim changed his show noticeably afterwards.

These newer shoes exist mainly to speak to the already converted.
I would like to see topic classification applied to message forums, such as Hacker News, so that I could stop manually bookmarking and tagging. Algolia is indexing and offering search capabilities and ought to take the lead on this. If they don't, they may be disrupted by a provider who does.
In other words: "when a measure become a target it ceases to be a measure"
Hundreds of tutorials and books have taught people to save example files into the temp folder going back to the DOS days leading them to believe it’s a directory they own and control rather than one shared by anybody.

Also I suspect badly designed cleanup utilities would complain about SQLite files that cannot be deleted because they’re in use leading to web searches.
Virtualizing Cuda Environment Using Nvidia-Docker and Deploying APIs
MySQL 8 vs. PostgreSQL 10: Deep dive
What is Ryuk, the malware believed to have hit the Los Angeles Times?
Code and Data Are the Same Thing (2011)
This is missing a scenario. If you hit Game over and go do something again, your character still remembers things.

E.g. if Stefan jumps instead of Collins then you die, but if you try again, Stefan will still remember the conversation, but Collins will still be alive. And if you decide to bury your father, Thakur will send Collins over to help you out, who sees the knife and hears you confess to the murder and offers you to kill him. If you kill him, the game ends again with Stefan arrested and both Collin and the father dead.
what ifs...would have China eventually attacked Hong Kong, like Argentina did to Falklands Islands?

NATO doesn't cover faraway islands...
That’s fine, but I surely would not have my publicly listed phone number connected to something that could ring and wake me at night.
Lisp is the ultimate "wizarding" programming language.

But when I miraculously was called upon to maintain an enterprise code base in Common Lisp, it was an absolute joy. Because whenever they encountered a roadblock in maintenance, the Lisp wizards who had come before me just wizarded up a solution. One of the things that stuck out was that it had its own custom test framework, that was head and shoulders above XUnit, Mocha, or any other commonly-used test framework. Adding a new test was virtually a one-liner; the test would generate test data , send it to the server, and check the server's response against an XML template provided by the test case.
There is no Supreme Court footage at all. They refuse to allow cameras in the chamber.

There’s no law enforcing this except those which give the judges full control over their proceedings. They could let CNN in tomorrow if they so decided.
Well one part they don't discuss is ridership numbers increased as the number of in town jobs increased, not because they built out their systems. Plus when factoring in increased rail ridership much can be found in decreased bus usage. In some cities they reduce routes to force the issue.

Plus none of these systems brings in enough in fares to cover a majority of their expenses let alone put a dent in their deferred backlogs. Instead the new angle is to go after rider sharing services with new fees and you can bet the scooter invasion is ripe for taxation.

I do find it interesting they talk about the recent surge in EV scooters as being a benefit. I wonder who led that charge. I was amazed that just one company has twelve thousand scooters in the NYC area! Public planners cannot easily factor those in and given NYC weather where to these end up in winter?

If you want to see the statistics as reported to the Federal Government on ridership numbers and cost per mile check out the spreadsheets at [1] the FTA

California transit numbers show a decline and that two thirds and more are by bus in a 2018 June report. Plus the percentage [2]. A large share of the systems need replacement and this is not factored into new taxes. Throw in the transit only reduces emissions per mile when compared to solo drivers but worse those numbers are moving close to parity as cars become more efficient

Mass transit is a good idea but technology is rapidly displacing it and it only appears cheap because riders don't pay but a fraction of the cost. In fact most are paid by people who cannot even make use of it

[1] https://www.transit.dot.gov/ntd/data-product/monthly-module-...

[2] https://lao.ca.gov/Publications/Report/3860
So if you work at Walgreens, and save all your extra money, which amounts to $37 a week...
A little while ago I watched a series called The Brain with David Eagleman and one thing that really stuck with me was how the eyes and brain interact.

The eyes are not connected straight to the main brain, they feed into a 'frame buffer' which creates an image. The brain then looks at what is in the 'frame buffer' and can also add/feedback into it.

This is partially why psychosis can seem so real. One part of our brain feeds into the 'frame buffer', the other part of the brain interpreting what you see can't tell the difference between input from the eyes and feedback from the brain. Those spiders you are seeing are as real to you as if you really do see them with your eyes.

This also goes some way to explaining how the 'gorilla walking through the basketball game' illusion works and other visual tricks such as not seeing the blackout when your eyes move - you really didn't see that cyclist etc.

(I've explained that in my simple language from recollection as it's how I easily understand it.)
Create Your Own Node.js Module in Under 10 Minutes
JWTs are radioactive. Proceed with caution.
I never mentioned leftists, I said words to the effect of assuming a blank slate is one of the implicit assumptions of left-leaning world views. Taleb can share such a belief without explicitly being on the left.
"Notwithstanding paragraph (1), an owner or operator of a social media service that displays user-generated content in an order other than chronological order, delays the display of such content relative to other content, or otherwise hinders the display of such content relative to other content, if for a reason other than to restrict access to or availability of material described in paragraph (2)(A) or to carry out the direction of the user that generated such content, shall be treated as a publisher or speaker of such content."

Can someone explain the legal implications of this? What does this mean for algorithmic feeds?
I used to be a games programmer, not an artist, but have always created mental models to help problem solving.
I've often wondered about this, because I can't see how simple categorisation across 4 axis can be either scientific or unscientific. It's just categorisation, it doesn't make predictions.

I enjoy reading the different type descriptions, unlike horoscopes (which are basically barnum phrases) they do seem to describe me with a high degree of accuracy.

Then again, I stopped at this point, and never dived deeper into all that Jungian shadow self stuff which I fully accept started to sound like pseudo-scientific drivel.
A few counter-questions to poke at your hypothesis:

Are you able to imagine sound? To me, imagining and hearing sound, and imagining and seeing images are equivalent relations. It seems obvious to me, but of course since we're talking about the literal differences of the way human minds can function here, I can see how it might not be to some.

Do you dream at all? I can still picture a lot of scenes from my most vivid dreams.

Do you read fiction? It's hard to imagine what's that like if I can't, well, paint a picture of the scenes you're trying to imagine, like in a movie.

(edited to clarify the last sentence)
Agile Retrospective Tool with AI and Machine Learning Capabilities
This is just wrong, the web is an app platform. It's even more obvious now with WebAssembly support.
In my country roads get maintained and fixed. Its not perfect (never settle) but potholes? You can search for weeks and you won't find them.
It’s a great guide - but there are two main limitations.

First, this is the DFM guide specifically for Seeed. Every factory will have a different set of specs depending on equipment (assembly, test, and inspection, and familiarity of operating personnel), throughout requirements, yield requirements and price points, rework allowance, and so on.

Second, these typically assume for wide tolerances. Operating environment or design may necessitate relaxing some parameters in order to allow others to tighten (aka the tolerance stack up).

Dealing with both cases effectively in volume production is what requires experience beyond the manufacturer provided DFM guide.

Someone who learns this guide inside and out will be able to DFM with Seeed but not necessarily anyone else.

More generally, the DFM guidelines for ceramic RF materials would be wildly different than for Kapton flex connectors or for standard FR4 material.
I think individuals on the left have a variety of beliefs on the subject.
Multi armed-bandit as a service
"Build one to throw away"

- the mythical man month
How much New Year celebrations cost to the World?
Now you would be out of New Year hangover and done with the celebrations! How much New Year celebrations would have cost to the world? And Environment?

How it matters and what changes it brought to your life?

Would it had been easy for you to live without it?

More than to anyone else, I'm asking these questions to myself.

I'm not against meeting your friends, family, relatives, having a good food together, laughing etc.

But fireworks???
It's simply the planning of it. A lot of the 100 mile expansion is not planned to start until 10-20-30 years from now. I guess that's due to financing.
The App That Wasn't (Yet)
Yes, the story of Myers-Briggs is really amazing -- how a system developed by two people with no training in psychology just invented a system with no more basis than astrology and convinced the corporate world to use it. There was a recent book "The Personality Brokers" by Merve Emre that tells the story.
People want IQ to be wrong. People like the idea of someone who did bad at school but is still a successful and productive person. Such people surely exist, but successful people overwhelmingly do well at school and have natural aptitude. You can deny it all you like, though.
Hackers used fake wax hand to fool vein authentication security
Not changing my fundamental mindset about money. 99% of the time, it's better to focus on the long-term goal of increasing your income, rather than saving a small amount of your current income. Extreme frugality is almost always a waste of time and earning potential.

For example: 15% of $150,000 is more than 40% of $50,000. This is also why living in a HCOL but making proportionally more money is financially smart. If you can only save 10% of your income, that 10% number will be far higher if your total salary is higher.
The Darknet Diaries podcast has an episode on this called 'The Crypto Wars': https://darknetdiaries.com/episode/12
>> diminishing returns after 130 iq

There's evidence higher IQ leads to better outcomes all the way up the scale.

The graph below shows scores vs outcomes for students scoring in the top 1% of a maths test. It's not flat as your anecdotal caveat would predict:

http://4.bp.blogspot.com/-4b8ThyfDgzs/U29nQEBAQTI/AAAAAAAAE4...

You're 18 times more likely to get a STEM doctorate scoring at the 99.8th percentile vs 99th.

Or a paper linked earlier in the thread: https://www.jstor.org/stable/41038598?seq=1#page_scan_tab_co...
Courier font has been in public memory for a very long time (but most certainly people didn't know its name). It is much more known than IMAP is, and most importantly, has been for decades

It's an industry standard for screenplays, and I think we all remember having seen a screenplay in a movie or picture, with this weird monospace font.

You are certainly an outlier here.