skysight-inc/HackerNews huggingface dataset:
Ask HN: Best real day-to-day language data sets?
Hi there, I've used Cicero's work to run some NLP code against in the past so I could practice some latin. I am now looking for something more mundane, which reflects real day-to-day usage of languages.

I am particularly interested in data sets for german, but I think I can use Folha de Sao Paulo's texts for brazilian portuguese (it's one of the biggest newspaper and media portal in Brazil and has a respected language manual).

Any suggestions for other languages? Scraping data sets would be OK!

PS1: I don't consider NLTK-level data sets really useful here

PS2: for english I suppose the whole internet and NLP frameworks are enough already

PS3: data sets don't need to be tagged in fact, anything ressemblying a corpus will suffice as it would be used for X-as-second-language :-)
Oh, huh! I missed that entirely, now I'm curious too. HTTPS should make that difficult, but China has been known to employ all sorts of weird shenanigans-- perhaps they're running a "trusted' MitM as part of the great firewall?

I know that certain companies (like Google and Microsoft) will actively censor themselves to continue to operate within China, but I figured Wikipedia would be against that practice on principal. Now I'm curious as to how it's done.
he's talking about amazon and other cloud providers classifying their money spent on infrastructure as capex, not their customers.
One major factor not mentioned here is that the number of college graduates in a field is not just determined by how many apply to it, nor the author's #6 (reactionary faculty that fail large amounts of people). There is also how many people are accepted in the first place.

If a university has 100 spots for CS, then even if twice as many people apply for CS in one particular year, there will still be 100 people (but with higher SATs, presumably). There is some flexibility here, but it is limited - those 100 people require a certain number of faculty and grad students to teach them. They need a large-enough building with the proper facilities (you can send students to classrooms in another building sometimes, but it's not optimal). The campus can't just accept more than the students they planned for without preparation, and those plans are made long in advance.

If a university sees a field is popular, it may work to eventually be able to accept more applicants. But it might not decide to do so - popularity among students isn't the only factor considered, there are many others, like ease of acquiring funding and grants, likelihood of undergrads becoming graduate students (and whether the university wants more or less of those), etc., all of which require multiyear planning and also have various political factors.

tl;dr It's worth seeing if we can find data on the number of applicants, and not the number of graduates. It's possible the number of applicants has been increasing.
Bugger GA (whatever) thingies. I've got some super glue - stick all Lego bits together on their longest axis: problem solved as posed but probably not as intended.

The large thing between my ears beats the crap out of a GA thingie any day, provided that the problem is loosely defined 8)
When it mentioned Node.js I prepared myself to get disappointed that it wasn't written in Erlang but instead I was delighted to find that it was written in Rust :)
This is exactly why I stopped obsessing over how recently my beans were roasted. I take my coffee pretty seriously but I cannot tell the difference between days and weeks with coffee beans.
For committed governments like China, TLS may just be an extra hurdle but they can get around it if they want. Basically China could simply implement a massive proxy that terminates TLS.

If your internet traffic is going to flow through infrastructure that a curious government owns, then you'll know that they're monitoring the traffic but there is no way to keep them from seeing what you're doing.
This has to be worth a try.
Buy some Litecoin, of course.
Xplain: Basic 2D Graphics Rasterization
because the artwork is of a nude 10 year old.
Annotated Algorithms in Python, Free EBook [pdf]
I believe this is because LuaJIT is 5.1-only.
Via https://www.reddit.com/r/programming/comments/6e0m7p/full_fr...
Fetty Wap – 679 (Violin Cover)
What a joke of a website. Every historian will point to slavery as the reason for the South's secession, supported by literally every primary document of the secessionists. You post a website created by a kook that says otherwise. This is why many people immediately assume the speaker is stupid if they have a Southern accent.
Gosh, there's so many. But these come to mind:

1. Neuromancer - William Gibson

2. Snow Crash - Neal Stephenson

3. Hackers - Heroes of the Computer Revolution - Steven Levy

4. How to Measure Anything - Douglas Hubbard

5. Godel, Escher, Bach - Douglas Hofstadter

6. The Pragmatic Programmer - Andy Hunt and Dave Thomas

7. The Soul of a New Machine - Tracy Kidder

8. Code - Charles Petzold

9. The Shockwave Rider - John Brunner

10. Ambient Findability: What We Find Changes Who We Become
Book - Peter Morville

11. Don't Make Me Think - Steve Krug

12. The Design of Everyday Things - Donald A. Norman

13. The Mythical Man-Month: Essays on Software Engineering - Fred Brooks

14. Decline and Fall of the American Programmer - Ed Yourdon

15. Cube Farm - Bill Blunden

16. The Philip K. Dick Reader

17. The Cuckoo's Egg - Clifford Stoll

18. The Prince - Niccolò Machiavelli

19. The 48 Laws of Power - Robert Greene

20. The Atrocity Archives - Charles Stross

21. Business @ the Speed of Thought: Using a Digital Nervous System - Bill Gates
I wasn't aware of the search bar on HN either. Would be nice if it was at the top of the page rather than the bottom.
using this google search pattern "site:http://lecturer.ukdw.ac.id/~mahas/ type:pdf" you will find other pdfs hosted on this directory like this: http://lecturer.ukdw.ac.id/~mahas/dossier/SzeliskiBook_20100...
For example, the word for computer is "electric brain". You might be able to guess that if you knew that 電means electric and 腦 means brain

Or you could be like me, idly sitting in a Malaysian restaurant, reading "馬來" and trying to figure what "Horses Arriving" has to to do with curry.
Then you have the german ß (sharp S) which does not have an upper case version. While ISO added one for whatever reason the official upper case is two letters consisting of either "SS" or "SZ". So you have three different ways to upper case ß one which is guaranteed to be wrong in any official context and two which lower case to "ss" or "sz" and not back to ß. That is one big ouch, especially to the ISO standard adding that invalid upper case variation. Languages are messy, best don't try to transform your input text in any way.
An innocent-looking river in Yorkshire reportedly has a 100% fatality rate
In Antarctica, Scientists Are Lured to a Frozen Desert
Except that the resulting breakage would be _surprising_. It would be especially surprising to Clojure developers, who are are even more likely to want to rely on immutable data structures.
Google Smart Reply Answers Email for You
That needs a NSFW warning. Fuck.
With Less Than 1 Year to Go Companies Place Different Priorities on GDPR
Have a look at the ideas SGI 'explored' with 'IRIS Explorer'. This was ahead of its time and ahead of even SGI hardware. However you could layer up lots of interesting datasets in ways that would otherwise require programming at some other level.

http://www-sldnt.slac.stanford.edu/hepvis/Papers/Web/9/x1602...
Check out https://github.com/jondeandres/moon-redis
I've used Piwik for a few sites, I love that you don't need the JS crud to use it, makes the overhead almost unnoticeable.
Eh, the 1 egg is already kind of a fudgy number anyway. Especially using anything but standard store bought eggs. The farm eggs I get can be very small to double the size of a small one easily.
I am amazed by the number of responses that aren't "find a mental health professional to talk to".

Talk to your wife, then talk to your doctor. Don't wind up dead or making a rash decision that would seem silly when you're in a healthier frame of mind.

I have had the experience of wanting to kill myself on a Friday, and then thinking "boy that was stupid" by Monday.

Please seek help, before it gets worse. There is no shame in this.
Seems like you could get gstreamer and some subtractive elements working pretty quick...
Where I work we have a custom made system that was inspired by Yahoo Pipes. We are in the slow process of rewriting it.

Also this reminds me of and IoT solution I was shown recently.

https://nodered.org/
Critics of this plan argued that this move would just result in more
total censorship of Wikipedia and that access to some information
was better than no information at all

I'm no critic of this plan but I still don't understand why this wouldn't result in more total censorship. Someone explain please?
7 Days Free Email Course on Fundamentals of Digital Marketing
I'm farther from an expert than you. I tried (and failed) to find a less confusing way...

One thing I see people doing when they have real gnarly type signature is to concentrate the horror in one place and paint a veneer of simplicity elsewhere:

type Get stateType returnType
= forall monad.
(SpockState monad ~ stateType, MonadIO monad, HasSpock monad)
=> monad returnType

Then elsewhere:

getBlockChain :: Get BlockChainState [Block]
getLatestBlock :: Get BlockChainState Block

This may only help superficially as type errors will still be hard-to-understand.
Very nice article! :)
Pipes was awesome. Would it have killed them to just let it go free instead? Yahoo engineering did a lot cool of stuff.
https://www.merriam-webster.com/dictionary/dyke

"chiefly British spelling of dike"
No, TLS is not vulnerable to a MITM unless a) your client trusts the certificates issued by the attacker, or b) the attacker successfully forges the certificate of the website you are trying to visit.

That is, assuming you don't click away your browser's security warning.

https://security.stackexchange.com/questions/8145/does-https...
> quantitative theory of differential equations

Any idea what this is referring to? It's a pretty vague description...
Because it's more appropriate as an embedded DSL, or low-level on which to create a DSL, than a general programming language?
Looks good :) Will wait for my Day 2
I was just looking at love2d, I don't know much about it. My son is 8 and is very bored with Scratch. A once over the documentation makes me think love2d might be a good fit for a next step from Scratch. How is the love2d community and is it active?
Is China Finally Waking Up to Ethereum?
I feel like they should be attached and not stacked?

https://imgur.com/gallery/W13nR

Fwiw: 10.3cm
Factories don't have to be nasty. I have one, with 6 automated machines and 10 people. We have fun, try to make the automated machines build everything. It can be demanding at times, but so are startups.

Programming welding robots, laser cutters , CNC milling machines and making whatever you can dream up is pretty fun. I was in Las Vegas last week walking through the fancy hotels and casinos admiring all the laser cut steel they use in architecture now. It was fun to tell my wife that I could make the giant metal cards at the ARIA poker room, exactly the same on the new machines I just got. She was quite impressed. We are planning our backyard remodel using all the machines at work. Should be quite spectacular when complete.
One of my professors actually made the opposite point: that in CS, the compiler will give you an error. You can fix it and move on to the next. While in math (he was a math prof), the paper doesn't object to your writing nonsense. If you have an error early on in your work, all the rest might be nonsense, and you only find out much later after a human grades it.

tl;dr at least in CS you get immediate negative feedback
Dude, this is neat. Itch.io is a great site, I've bought a few things through it.

I like how your HN profile page mentions only MoonScript and not itch.io, though, in that the former is an open source project and the latter is a company :)
Matchbox Cars Design and Production (1965) [video]
I like the idea, but I want it to be embeddable and since I'll mostly be embedding this in some syntactically C-like language, I would like the scripting syntax to not look so out of place. I updated my previous post to say as much.
If a censor can't tell which specific parts of wikipedia someone is trying to access, then they will be more likely to simply block the entire site.

HTTPS encrypts the URL and the content, but does not mask the DNS lookup nor the server being connected to.
That 5% is deadweight on the cap table. The investors don't want 5% of the company owned by a founder who is no longer employed by the company.
Floating or fixed?
I haven't personally taken organic chemistry, but several of my friends who have taken both organic chemistry and algorithms have said that algorithms is by far the harder of the two. So I tend to disagree that biology and organic chemistry are harder than anything in CS.
Is it just me or the "trillion dollar" figure is completely unrealistic? I mean, even if there are no price wars (and they are inevitable), there isn't any realistic possibility to capture all of IT spend. With price wars in the picture, we'll see a race to the bottom which will erase much of the margin, and make some of the "table stakes" capabilities unprofitable to some of the players, further cutting into the profits.
The love2d community is definitely still active, especially on IRC. Some of the nicest folks I've ever spoken to over the internet.

I can't recommend the language or its community highly enough.
New to sleeping with people, I find the actual sleeping part the tricky bit. Not my expectation at all.
MenuChef  Create hamburgers' menu like a chef
I got my girlfriend a 5x5x5 for her birthday and she accused me of swapping tiles when she got stuck on the last two. Almost ended the relationship.
> in this profession a lot of online research is required to even do a simple things

Or you could look at the documentation. People did simple and complex things with computers for decades before google existed.
Ah, I think this is a better though! If you got this working, feel free to open up a PR. Or I can look into it when I get time.
it's a power stuggle governments and central banks can't afford to lose. and it'll be a recurring scheme to rob those don't understand the stake. it's about who is/will be the monetary policy maker, governments/central banks, or the market controlled by speculators? what are the exact differences between gold and tokens?
Is that the main problem with GA or are there other problems? I have been thinking of a Google problems mailing list for while now.
I doubt the floating point errors are going to make much of a difference with the numbers the average register has to deal with. Javascript can represent integers up to 9007199254740991 accurately, so if you do all your calculations in cents your register can process a little over 90 trillion dollars before things get problematic.
Lua is a great language and MoonScript improves on it even further. I used MoonScript to write a load balancer with OpenResty recently, and World of Warcraft interface code six years ago. :)
Oh, Zapier is a programmer's nightmare.
It isn't but if you live in China and want to use the internet, you'll likely be forced to use a proxy that MITMs and serves its own certificate....My point is that TLS is not a solution to prevent government interference when the user has to rely on the government infrastructure for access.
> People are more reluctant to make wide sweeping changes such as renames because they're worried about the ensuing conflicts.

I disagree. People generally don't do project-wide find&replaces because it's just not all that common to want to rename a global symbol.

> Projects limp around with broken indentation (tabs/spaces), trailing whitespaces, dos newlines, etc - because fixing whitespace is against policy. Why? Conflicts.

You seem to have completely missed the point of my comment. I'm not saying projects limp along with bad whitespace. I'm saying projects that decide upon whitespace rules typically do a single global fixup and then simply enforce whitespace rules on all new commits. That means you only ever have one conflict set due to applying whitespace policy, rather than doing it over and over again as you suggested.

> You're applying the perceived diff to 1 version, which often differs from the actual diff as it may include subtle differences that aren't easily visible.

Then you're using really shitty merge software. Any halfway-decent merge tool will highlight all the differences for you.

> Without git-mediate? At best you bring up build errors. At worst, revive old bugs that were subtly fixed in the diff you think you applied.

And this is just FUD.

It's simple. Just stop using Notepad.exe to handle your merge conflicts and use an actual merge tool. It's pretty hard to miss a change when the tool highlights all the changes for you.

> You're talking out of your ass here.

And you're being uncivil. I'm done with this conversation.
Some screenshots from old Yahoo pipes that show a bit how that worked: https://imgur.com/a/p6uf0
I forgot to emphasize that I'm particular about syntax. I amended my comment accordingly. I also don't like the global-by-default bit, but maybe my ideal language could be a syntax layer atop Lua?
One has to be careful and read the paper and understand the systems brought under review.

The fine article states, "Does all that hard work on formal verification verify that they actually work in practice? No."

The systems under investigation (Ironfleet[0], Chapar[1], and Verdi[2]) are not general-purpose "formal verification" languages and tools. They allow you to develop a high-level specification in a formal logic and extract an implementation from it.

The conclusion is odd. The systems produce implementations that are free of errors (so long as the specification itself is correct). The study finds that the majority of errors happen at the interface between the verified and unverified components of the system. This is reason why "formal verification" doesn't actually work in practice.

The article mentions The Amazon Paper[3]. It's a fine retrospective of Amazon's use of TLA+ and formal methods to find errors, produce correct designs, and test ideas. Yet the paper isn't about TLA+ or formal methods in general.

If you're interested in the analysis I'd read the paper first before this summary and draw your own conclusions.

Update links:

[0] https://www.microsoft.com/en-us/research/publication/ironfle...

[1] https://dl.acm.org/citation.cfm?id=2837622

[2] http://verdi.uwplse.org/

[3] http://research.microsoft.com/en-us/um/people/lamport/tla/fo...
"Cultural centrality of
Silicon Valley"?! Excuse me, who's culture? Most of us in the field don't care about Silicon Valley and nearly no one outside the field cares. Sounds like someone needs to get out of their bubble.
However, when considered as an alternative to classic equity financing, token sales yield a >100X increase in the available base of buyers and a >1000X improvement in the time to liquidity over traditional methods for startup finance. The three reasons why: a 30X increase in US buyers, a 20–25X increase in international buyers, and a 1000X improvement in time-to-liquidity.

these token sales are successful because people who buy into them are selling off their profits from buying Ethereum (from $0.88 in Jan '16 to $193 today >2000% return). Its a diversification play of course. Look how much the DAO raised a year ago.

Its ridiculous that the adults in the room like A16Z, USV, Balaji are falling into hypnosis.

ICO's coming out have no product, no users, just a white paper and a nice website, with an ERC20 contract address for deposits.

If you talk to anyone buying these tokens, they all say the same thing, that they're buying to flip the tokens on Poloniex for a quick buck.

A recent example is Gnosis, which raised $12.5M by selling 4.17% of their tokens at $30 each during the 1st auction round. They started trading at $60-100 a week after the sale and now are trading above $200.

Look at the charts of coins delisted by Poloniex. immediate 50%+ drop. The value of these tokens is their liquidity. Take that away and you won't see these valuations.

For traditional VC's, if companies let their shares float on exchanges, the SEC mandates financials. These tokens are designed around hopes and dreams. Most certainly a bubble but more so a game of musical chairs, make some money while the music is still playing.

Bitcoin at the end of the day grew in price from speculation BUT it had a real use, albeit in the black market. It has grown from that since 2013 but not by much.

P.S. Token sales don't even give up equity. These people are paying millions for API keys they can't yet use? I don't think so.
oh that makes more sense to me
From TFA:

"In Turkey, Wikipedia articles about female genitals have been banned; Russia has censored articles about weed; in the UK, articles about German metal bands have been blocked..."
iTunes has been shit since the day it was shipped. And it's only become worse with time.

No doubt too many 'masters' making demands on it, to say nothing of being deliberately crippled on windows.
https://news.ycombinator.com/item?id=14442127
Blockly (and all the similar visual programming languages) are so awful! They're basically writing, but much harder.

"set", "repeat", "do"? What?
There is a difference between getting a C or D average because you don't care about school, and getting that because you can't do any better. Unfortunately the two are hard to separate, and even if the grad didn't care about school - it doesn't mean they will care about work.

I was in the boat of not caring about school (although I did get a B) and it worked out - but anyone following that path should understand its an up hill climb.
I don't mean this exact case, I mean stuff like intentional slowing down of results. People don't trust results that come too quickly. We like to feel that the computer worked hard for it. E.g. Airline prices or TurboTax results.

https://www.theatlantic.com/technology/archive/2017/02/why-s...
It is provided by YC Company Algolia. Many YC companies leverage the software provided by other YC companies.

If you were a one of the first YC companies and you're core business was to aggregate, curate and influence the development of content. And you weren't able to develop a core service, hypothetically something like search. Maybe you could buy that service from some other company; like Algolia.

Potentially, it would work the same way as HN does. The site they cloned when they pivoted.
according to the paper.. the answer is subdomains.. For example, in one instance China blocked zh.wikipedia.org (the entire subdomain.. they cant see what page you're visiting), but left their other 291 subdomains unblocked.
> but you don't have to be a genius to get a CS degree

But most people don't know that.

They don't know that you can make $160,000 total comp right out of undergrad by going to a mediocre school where other students are not bright, failing every test but getting B's and C's from a generous curve (because of your competition) and studying Leetcode for a month.
Yes, I understand that. I mean, why don't these censors block the whole wikipedia.org access then?

If they don't want their population to access a Wikipedia topic/article and can't block/determine if someone is accessing it, the easiest thing to do would be just block it right away. So why they won't do it?

(PS: I'm in no way in favor of censorship, I'm just trying to understand such mindset)
Nonsense.

https://frenchinnovationweek-chicago.com/program-of-events/f...
My reason and why I went IT instead of CS was the amount of Math.