skysight-inc/HackerNews huggingface dataset:
> domestic students don't cheat as much not because they believe in norms against cheating but rather because they understand better that they will probably get caught, or they understand better how not to get caught (so they don't get caught).

Are you really making a case that the reason students don't cheat is fear of getting caught? Is there no room for students who don't cheat because:

1. they actually want to learn the material

2. don't need to cheat because they learned the material

3. have personal honor and integrity - would rather flunk out than be a cheat

4. want to earn the degree with pride

?
There are lots of Smalltalk books here, including the original ones from Xerox PARC.

http://stephane.ducasse.free.fr/FreeBooks.html

The best free implementations to play around are Squeak and Pharo.

http://squeak.org/

http://squeak.org/

Or if you want to avoid installing anything, Amber gives some taste of it.

http://amber-lang.net/

Now, regarding the LINQ like stuff, in Smalltalk doing this type of stuff was already possible back in those days.

|a|
vec := #(1 2 3 4 5 6).
sumPairs := (vec select: [:x | (x \\ 2) = 0]) inject: 0 into: [:l :r | l + r].

Yes, that is what I was thinking of. The other part, immutable data and such, isn't that possible to practice in large teams. But I do make use of it in personal projects.
there are several. we (microsoft) are also trying to get an api into cpython so that anyone can use to build JITs for python. our sample implementation is at:

https://github.com/Microsoft/Pyjion

pycon 2016 talk:

https://www.youtube.com/watch?v=1DAIzO3QXcA
Humans probably have a monopoly on music-with-words for the foreseeable future...
Why the downvotes? There are other articles (on HN recently!) that postulate that aging is evolved.

Now yes cancer itself, as mutation caused, can't really be a trait of the host (I go as far as to consider cancer cells a separate parasitic species). And since many cancers are immortal, and the aging relates to a secession of cell division in some sense they are opposite extremes with normal development in the middle. But in being opposites they are related---end games / limitation for multicellularity.
> all social stratas and races commit crimes at the same rate

Some communities have bars on their windows and others leave their doors unlocked.
Good point. It should also tell us about the US's own highly bureaucratic, test driven educational culture. http://www.counterpunch.org/2016/06/03/anti-intellectualism-...

Dan Falcone: Yeah, I’ve seen this type of thinking before. The school that I’m in now is changing the department. It’s including more advanced placement test-driven subjects whereas it used to be a place where you could go to –

Noam Chomsky: – Think about things.

So we have people out to grab a business certificate from a big bureaucracy. (If that's what an "education" means now for many, because their job/compensation prospects are such a headache, I couldn't care less about most forms of cheating. It's not the problem to solve. Even people I know with fancy degrees have to put up with shitty workplaces.)
> “Terrible schools” is at least partly a upper-middle-class-white code for “schools full of poor minority kids”. A significant proportion of white kids living in the city go to private schools

Right. Talking to a wealthy, pretty liberal, upper class white person who sent their kid to a private school. Whatever the "code" they spoke I don't know. They were pretty blunt and factual. They did the research and it turned out that poor minority kids in schools did correlate strongly with disciplinary issues, high teacher to students ratios, overall bad scores for the school.

Their kid was in a public school for a few years, then they switched to a private school.

Knowing them for 5+ years, nothing indicated they were racist or had some kind of agenda against the poor. In this case they simply wanted a better school experience for their kid.

While I don't doubt there are plenty of racist upper middle class white people who deliberately make that the central point of choosing schools, many also just look at the facts and draw conclusions.

I don't have the resources to afford that for my family, so my kid is going to a public school, and that's fine. But those who are wealthy simply have more choices it seems.
Access all your saved Android and Chrome passwords online (Google Smart Lock)
Those puzzles might serve an ancillary goal of finding people willing to conform, are good at doing what they are told and have the ability to do unconventional programming tasks on a whim.

All of those are characteristics that the company might be looking for.

In short those tests aren't checking for just aptitude, they are checking for the personality characteristics of people willing to do them and tolerate the absurdity - like a cult.

I once applied as a JavaScript developer to a local company and they gave me a test in Cake PHP. This was after a face-to-face interview with the owner.

I finished most of it but their was one thing I couldn't figure out. His response via email was along the lines of " You really should learn this stuff". This was after answering a bunch of granular questions about JavaScript and passing those preliminary questions.

But I guess its my fault and I "really should learn this stuff" (j/k)

:/
A brilliant and thought provoking video on career development for IT professionals
Not so different as to justify angrily denouncing an article you didn't read. Though at least you were honest about that.
> At the moment it's just a number

It's not at all just a number. One of the world's leading publications has printed that headline and story; to the great majority of people, the number will be insignificant next to the headline.

> It's also not a huge stretch that the students who flew across the world to study in the US have more at stake, and might be more likely to cheat.

In fact, it's completely speculative to draw that conclusion, to conclude that they are cheating, and to conclude a causal relationship. I challenge you to show us some factual basis for it.
I'm pleasantly surprised to see the audience on HN be aware and considerate of the socio-cultural differences.

To add a few other points to the list -

1. The pressure is also to literally survive, and can sometimes extend to their families. It's not uncommon to find Indian students coming to the US to alleviate their families' financial condition by studying here and consequently getting a job here. A lot of times their families would have mortgaged their apartments/houses to get a loan to fund the education. I was such a student about 3 years ago. If I would have failed, not only would my parents not have an apartment anymore, but it would also be difficult for us to survive as a family (my parents earn very little).
I realize this was a calculated risk and no one forced me(us) into it, but it was very pressuring regardless.

2. While cheating is frowned upon at a run-of-the-mill Indian university, it's not dealt with as severely as at American universities. Consequently it can be a little like you were careless enough to be jaywalking in a foreign country you're visiting and finding out they're going to imprison you for it later.

3. The immigration rules here don't help as well. You have a limited amount of time for which you can stay in the US after finishing up studies to find a job. Failing to find a job in that time results into having to go back. Sometimes you have to go back even if you found a job but didn't get through the H1 lottery.

Let me firmly state that having said all of that, I don't condone this behavior, and am unreservedly against it. I'm just glad people here on HN already have additional perspective into why this happens and I'd just like to add to it since I feel I can.
That seems like an interesting avenue to peruse. I would imagine you would end up reimplementing a lot of what Calc has already solved. I'm thinking about mapping cells to cell references (A1:C57), how to handle VLOOKUP, sheets etc. If I had to do this, my approach would probably be to take the headless Calc code and strip out the parts that are unnecessary.
It seems fairly debilitating in late stages. The Tasmanian devil's one seems to be threatening the species, which is rather serious.
The GP's point is if you're doing code deserialization, the definition of security is different. The data format having RCE bugs won't be as much of a concern, while trusting the data source will be much more of a concern.
Ask HN: Password Schema Site
Do I have a special character? Do I need numbers? An uppercase character?

Is there a site that tracks all the, often ridiculous, password schemas in use on different websites?
Please don't respond to a comment you think is wrong by getting personally nasty. That's worse than being wrong, and takes things further in an unwanted direction.

Edit: Your comments have been breaking the HN guidelines egregiously and often. We ban accounts that do this, so please read the rules and follow them when commenting here. That means posting civilly and substantively, or not at all.

https://news.ycombinator.com/newsguidelines.html

https://news.ycombinator.com/newswelcome.html

We detached this comment from https://news.ycombinator.com/item?id=11844948 and marked it off-topic.
Google and Amazon are slowly killing the gadget as we know it
Extraordinary?

http://blogs.wsj.com/moneybeat/2015/02/16/study-finds-invest...

http://www.nber.org/digest/sep03/w9873.html

http://www.theguardian.com/money/2009/oct/18/racism-discrimi...

And again that is 5x more discovered cheating, what number of cheating occurred undiscovered for all groups? I'm not saying people don't cheat, because they do, I'm saying look at the environment to understand what other impacts on the number might occur.
TL;DR: forking Clojure to fix namespaces.

> Because namespaces are mutable, even if I were to perform a rename correctly, the old name is still present in the namespace.

First, ns-unmap your old name (a refactoring tool should do that for your, I guess). (edit: Clojure is a Lisp-1).

> What if we gave Namespaces and Vars version numbers? When a Namespace is re-defined (the ns form is evaluated) then the Namespace's version is incremented. When a def is evaluated, the version of the Var bound by the def is set to be the version of the Namespace in which that Var exists.

Your environment could keep track of definitions and usages of your symbols (see for example slime-who-calls, etc.). That would be a good improvement for Clojure.

There is another problem: define namespace N, define variable N/x, using it in another namespace M, remove namspace N. Then, an old name x is referenced from M which does not exist in any namespace. Also, you redefine namespace N with a new x, and now old-x and new-x are different objects. I don't think version numbers would help you here.

I am just thinking aloud, but when remove-ns is called, you could re-parent orphaned names from that package to a global "orphans" table. When you intern a symbol in a namespace, first you try to see if you can recycle objects from "oprhans" based on their fully qualified name. So that new-x and old-x are in fact the same name object.
Or, you just use a global map to store fully qualified names in the first place. Maybe the metadata attached to orphaned symbols should be cleared in this approach, to avoid keeping irrelevant data about a name when it is reused.

But again, you should be careful when you rename namespaces. Maybe the best answer is to simply be aware of the possible pitfalls.
> Unless you're storing an HMAC alongside your pickled blob, and verifying that HMAC on the deserialization side, you should not trust pickle for anything.

I dislike such strong statements. When I use pickle, it's often a dump of where a computation is up to, or a simple cache. How can that be exploited? Someone would need to be meddling on my filesystem, in which case I'm already screwed. What risks am I opening myself up to? Why should I not trust it for my use case?
what if further JS will intersect with TS syntax ? IMO Typescript is "no go". We need clean break with transpile step (eg. Dart) or annotations.
At the very least keep your on-duty Ops entertained.
In our ongoing Small RNA - mRNA interaction study, we are also seeing p53 and a few other genes heavily being the regulators or are being regulated disproportionately between Cancerous vs. normal tissues.
I can't read it (the web workaround didn't work). I can read the headline, which cannot be justified, so I disagree.

EDIT: I'm surprised to see you taking sides in a discussion. I don't think I violated any norms of HN.
If someone is able to modify my local files and wants to change the code I'm running, what is it about pickle that makes me vulnerable? They'd already be in a position where they could change my actual code.
Heh, reminds me after a decade I finally got a new laptop and yet I have yet to start playing games again. Will fix that with this :).
MySimon – Comparison Shopping – Unique Gift Ideas – Compare Prices
I didn't take your post as criticism, but rather a spark, or conversation starter, to think about self-imposed limits in art via tools or physical handicaps.

I had immediately thought of the demoscene, especially Inigo Quilez [1], and his creation Shadertoy [2]. It is amazing to see what people create with these tools.

Thanks for the link on 'first-order jails'. I thought I had the gist of it, until I read your link. I especially like the back and forth about higher order vs. first order re: Haskell and graphical user interfaces. I am curious how it applies to Praxis, which has a node editor, but you can hop into the code which is in Java. It is built from the ground up for distributed, non-glitch livecoding.

I am an experimenter, and although I fancy myself reading about logic and computing, I am only passingly familiar with it WRT your reference. I learn a lot about it from my studies with Shen [3], and recently Idris. [4]

Extempore, and its programmng language xtlang, are driven by livecoding needs, but it is basically a general systems programming language at this point. I believe Andrew started with S7 scheme like CM (Common Music) did. The original creator, Andrew Sorensen, and Ben Swift who works on it too, are courting, or are being courted by the HPC world. The need to have a language that could handle time well, or 'temporal recursion' for music creation, lends itself well to HPC concerns. Xtlang is fast. C fast. It uses LLVM in the back.

Blender3D has a nice node editor for building up procedural textures and shaders too as in this tutorial. [5]
I find that the node/gui approach keeps me focused on what I am trying to emulate or build. I don't like it for programming like in LabView though, and I don't like node-based programming in the few incarnations I have seen. OTOH, Brainfuck is TC, but I wouldn't want to be in that 'first order jail'-free environment either ;)
REVELATION: I do like J, which some people say looks like line noise! [6]

[1] http://iquilezles.org
[2] https://www.shadertoy.com/
[3] http://shenlanguage.org/
[4] http://www.idris-lang.org/
[5] http://www.chocofur.com/6-shadersamptextures.html
[6] jsoftware.com
Ask HN: What are some ways to work with large amounts of data quickly?
I've been wondering about companies that work with large amounts of data. Analytics, reporting and that kind of thing. How do they select such large amounts of data especially when they are time based, and do it so quickly? From my understanding there are two main challenges.

A) Selecting the data from the DB very quickly. My guess is that there is quite a bit of tuning of the DB done here. Would love to know how to make that possible.

B) Working with all that data. If I do get all that data I can't possibly store hundreds of thousands of records in the memory till I process it. What might be the recommended way to deal with it?

Any reading resources I can be pointed to would also be super helpful :).

Thanks!!
Sublime TS support is top notch https://github.com/Microsoft/TypeScript-Sublime-Plugin
Thanks for the suggestion, but for some reason it didn't work.
personal story 1: Back then at college I was once a grader for a computer science course. I reported two students' projects that matched all too perfectly and turned out one student tricked another into giving the project as a "reference" and ended up copying the whole thing. My college has zero-tolerance policy towards any kind of cheating, therefore the cheating student was booted out. These two seemed to be close friends and it was probably devastating to their mutual trust and friendship, not to mention one's academic path was basically over due to the cheating incident.

personal story 2: I took a CS course with a Matlab project as the final project. When it was close to the deadline many of my classmates including me got an email from our TA, at least the sender's name is our TA's name, saying that we needed to submit the project through email by midnight. Some of us grew suspicious that the sender's email address was a gmail account and did not end with ".edu", and the deadline never changed on the official course calendar. It turned out it was indeed someone that faked TA's identity and sent out those emails, since anyone who enrolled in the class can see their classmates' email addresses if shared. There were still some students who finished the project early and ended up emailing their project to that fake TA account. The perpetrator was never caught.
(If you are from my university and majored in CS, you probably heard of this incident. It caused quite a bit of stir)

As a former grader to many college courses, cheating involves a mix of both international and domestic students. If one's educational background does not stress the consequence of cheating, he/she is likely to cheat. In this case, some cultures do not really punish students for cheating aside from scolding.

Also, giving some 5.1/100 or 1/100 ratio is pointless. Wait until you get your PhD and you will know academic dishonesty happens all the time regardless of where you are from. It's just some cheating is more clever than the other.
I asked about lock-free data structures from 2 major open-source libs, but Larry found major issues with them. He may consider some of these data structures in the future. I opened a bounty for this.

See closed github issues for gilectomy.
80% of cancers can be prevented and 70% are associated with HPV? Do you a source for that?
> can't just drop out.

This is terribly discriminatory to thousands of other intl students who wanted to, but never made it to a US university. That's not social sensitivity, it's pandering.
I'm a little confused; what's going on in the part of the main if condition after the &&? It looks like the author intended to check if any of e.which, e.charCode, or e.keyCode equal 9, but obviously that's not what would happen.
It's worth noting that many large cities don't stack up in these regards.

The medium cities do often strike a balance; but at costs—often limitations on career growth.

Coming from New England, Boston most recently and Portland, Maine before that; I'm loving the San Francisco area (aside from poor public transit)—but I'm already married and tired of being a big fish in a little pond in respect to my career (this was moreso the case in Portland than Boston for sure).

Maine for example has no nightlife, no tech scene, no venture capital / investment to speak of, is a monoculture, you need a car and "cities" are hours apart, is being ripped apart by the tea-party, has massive drug problems, and there's no dating life to speak of—people tend to pair off pretty quickly.

Oh and don't get my started on recent winters; the weather in SF is mild in comparison to massive nor'easters that are trying to kill you. New England was basically out of commission for an entire month when we had 9' of snow dumped on us last year.
As an alternative to...?
> Both men and women hold much more favorable views of women than of men. Almost everybody likes women better than men. I certainly do.

Well yeah, in the current cultural climate (at least in the US), saying that women are better in X way than men is acceptable, but doing the reverse usually means you're sexist. Similarly, saying you like men more than women in the same way the author just said he likes women more than mean would mean that you're a misogynist.

There are relatively sensible reasons for why this is so, but still, on the surface it's kind of silly.
Or it's ease of detection. Viz repetition between students in written assignments of characteristic ESL mistakes that are glaring to native speakers.

Where I went to school, for each CS course (eg algos 201, 301, etc) all programming homework was submitted with a department run submission utility. After submission, all programs for all time were compared for cheating. My guess is they did some basic comparisons of the AST.

The CS department produced well over 10x the cases of academic fraud as the rest of the college. We got lectured each and every semester about it. There were even locked disposal boxes in the CS labs to dispose of printouts; I got busted for cheating one semester because someone had stolen a printout I'd used to figure out bugs in an algorithm and copied the code! Fortunately, the other student had been caught cheating repeatedly and his programs regularly failed to work while I'd never come close and my program worked. The professor gave me the benefit of the doubt.

However, do I really believe CS produced 10x the cheaters? Of course not. They were just easier to detect.

That said, I was stunned at the amount of cheating in graduate courses. One professor teaching math stats was in the habit of posting distributions for each question on the tests. For a particular question, the distribution was bimodal -- I was one of two people in the middle, and the rest of the ~30 students got nearly 0 points or full credit. The question rested on a really neat integral trick, but if you didn't see it (on a timed test), or used the obvious substitution, it was about two pages of work. If you saw the trick, the problem fell apart.

I had been helping one of the students who got full credit for that question with her homework and her calculus was not her strong point. There were ex-physics students in the class who had won integration contests and I kind of expected them to get a trick like this, but not her. So I privately asked her how the hell she got that question. It turned out she had already seen the test -- the 15-ish Chinese kids in my class passed tests down between years, and the professor just twiddled numbers in them instead of rewriting tests. My solution, since I was graded on a curve with them, was to make sure I got to see the tests too. I'm not really sure if I'm proud of that, but you can't be graded on a curve when half the class sees the tests ahead of time.
It would be amusing if a Liberian flagged space ship was the first to land people on Mars.
> It seemed like getting a US degree was the important part, not learning the material

I think this describes very many students of many backgrounds.
PageRank still "learned" from the data, and it wouldn't be able to do that without a ton of data. So while the data wasn't the most important thing to get Google off the ground, it was arguably equally important as the algorithm.

Though as others have said, after the start gun went off, a lot of other factors came into play because PageRank, like other algorithms, is easily gamed on it's own.
This should be marked (2004), not (2014).
Apart from PageRank not being based on ML, there's also the fact that Google did better search than those other services which also had the data, and it does better search than Bing now though Microsoft has no shortage of data, processing power, or money to acquire more of both.

Generally how much data you need for ML varies with the problem and to say that it's all in the data and large server farms is perhaps a nice talking point for VCs but can be completely true, completely false, or anywhere in-between depending on the problem.