skysight-inc/HackerNews huggingface dataset:
Yes. A previous employer of mine was apparently logging a PB of log data a day between all departments, it isn't something that is just tossed up and somehow works in a month.

Do you have infrastructure in place to store all of that? How are you storing all of this content coherently so that you can go back and audit records of systems at a point in time you are concerned about? Do you have an internal Hadoop cluster configured (not trivial) and the hardware to ingest and process these logs? How are you actually logging everything? Do you have dedicated and qualified people to write this software and maintain it? When someone has su -'d to root, how are you logging everything they type coherently? Is your regex smart enough to ingest and contextualize multiline commands as root and add them to your report? What if no actual "bad" commands on your list were typed as root? What if I as a luser copied the "bad" commands to /tmp/kittens.txt, then su -'d to root and ran them there? Is this somehow captured? Are you 100% sure syslog is running 100% of the time on all hosts you are concerned about? Can't I as a sysadmin kill the syslog pid before I commit a crime? Are you using redundant syslog hosts? Are you using TCP and not the default UDP so that syslog doesn't drop packets under load?

Like I said, this isn't as simple as everyone thinks...
It is about kernel development, but I think this small issue I've pointed to is symptomatic of the general problem.

These names are short, but not memorable or easily discoverable.
An automatic LaTeXed letter creator sounds pretty good, but if I have to enter a 5 line To and From address every time, I'm not going to use it.
Standard datatypes and generics (including hash tables, dictionaries, vectors, sets, sequences, streams, etc.):

http://docs.racket-lang.org/reference/data.html

Additional datatypes (including imperative queues, growable vectors, orders and ordered dictionaries, splay trees, skip lists, interval maps, binary heaps, integer sets, bit vectors, etc.):

http://docs.racket-lang.org/data/index.html
Well there are several reasons, but this is the coolest: https://en.wikipedia.org/wiki/Island_of_stability

Basically, current theory suggests that once they get to 120 protons or so, they'll start finding stable isotopes again (ones that don't decay for minutes or more). A handle on a door affords pulling, and a hypothesis affords testing, and all that.

Edit: I should add that 115 might actually be within the island, but you'd need far more neutrons, which is currently not feasible.
Game Development: Chemistry Set of the Internet Age
boyer-moore doesn't make sense if you're searching the same data set over and over again - it doesn't do any pre-processing on the data, which is why it can't be better than linear time.
I don't think they are allocated sequentially (and there aren't that many unique cards/versions). But IIRC Gatherer's using the IDs from the internal "Multiverse" DB, which also includes all the brainstormed card ideas that never made it into an actually-released set, which would tend to inflate the numbers.

Edit: and they are not allocated sequentially. These two cards have only ever appeared in the 2014 core set, and have sequential collector numbers in the set but not sequential IDs:

http://gatherer.wizards.com/Pages/Card/Details.aspx?multiver...

http://gatherer.wizards.com/Pages/Card/Details.aspx?multiver...
What Your College Degree Will Be Worth After 20 Years
Some of my friends made good money playing the market: They bought during the summer drought and sold just after Christmas, when the kids had gotten money as presents.
The Less We Exist [video]
Hey this is so cool! I documented it in Mashape - https://www.mashape.com/community/magic-the-gathering#!docum... .

I can transfer it to your official Mashape account. You can continue documenting it there (on top of managing users, getting analytics, etc). Let me know! - chris@mashape.com
Linus on Linux, 22 - and 5 - Years Later
what is the real recourse here? you can't out them because of their connections in the community and needing to do business with their business partners in the future? I wish someone like David Cohen or PG would out them publicly and let the court of public opinion do the rest.
Thanks for spotting that, I got distracted in the middle of typing my reply. The legal principle happens to be the same in both states.

If you're interested, there are basically 4 different 'fault' theories, summarized here: http://www.latitudesubro.com/misc/contributory_negligence.pd...

You absolutely don't want to get injured in AL, DC, NC, MD, or VA, as you'll have a hard time recovering if any aspect at all of the injury could be considered your fault.
Whoa! Now that's how you teach anything command-line to non-programmers. Someone should do something like this for unix commands and the like.
At last year's AWS Public Sector Summit, I watched a demo of Xceedium's access control appliance [1]. It's deployed as a jump host and acts like a DVR for SSH/RDP. The CAC crowd was very interested.

[1] http://www.xceedium.com/solutions/privileged-identity-manage...
A law that isn't currently enforced is a dangerous one. What would happen if all cops started pulling over anyone driving +5 over the speed limit?
Cook brewing up Java developers
Can we officially retire this discussion, apres anniversary?

https://news.ycombinator.com/item?id=3474526
I don't understand why the trie would take quadratic memory. I would expect it to be high-constant linear. Can you explain?
anything committee driven is bound to be uncreative imho...
A constructive proof would satisfy!
I'm a CS student, but the fact that I've made so little progress with the confines of the classroom is what made me contemplate this idea in the first place. I could try for an internship during the summer, but I'm concerned about getting a good one. I'm smart, willing to work hard, and love to learn, but I feel I'm at a disadvantage since my skills are still so limited.
Hello, half-mile away neighbor.
How does biology explain the low numbers of women in CS? (2009)
This is a great example of Assange's "secrecy tax" degrading the effectiveness of the organization.

So leaks payoff twice -- once in direct transparency, and again by damaging the ability of the organization to act.

http://cryptome.org/0002/ja-conspiracies.pdf

The more secretive or unjust an organization is, the more leaks induce
fear and paranoia in its leadership and planning coterie. This must
result in minimization of efficient internal communications
mechanisms (an increase in cognitive "secrecy tax") and consequent
system-wide cognitive decline resulting in decreased ability
to hold onto power as the environment demands adaption.
Linux Foundation and OpenBEL collaboration has potential to advance
Well, I had my share of bad public school teachers. That said, tons of bad private school teachers too.

And I've heard stories of horrible homeschooling that would give one the chills (not to mentioning crushing any social skills the child could gain).
Then a few years later, Chicago burned down and was rebuilt speedily.

Contrast that to the pathetic state of our country today, where we couldn't rebuild TWO BUILDINGS and restore the New York skyline in over a DECADE. And we still haven't, and never will.
Don't forget that that's $117k plus full government benefits, including pension (who has those any more) and job security pretty much for life.

You might be able to do better than that all told on the outside. You might not.

It's "don't have to worry about too much" money (though with inflation it's less that than it used to be), but not "I'm rich" money.
The filter bubble thing is overstated. There are times when you want a filter bubble, when you found a piece of information and want to dig deeper on related subjects, a "conversational" interface that has at least short term memory offers big benefits. Do you really want to ask questions to an entity which acts like it has anterograde amnesia? Can you imagine Captain Picard having to continue to remind the computer of the enterprise about context?

Google's 'long term memory' offers lots of benefits too, and 90% of the time, the filter bubble is the correct answer. Like when I search for a particular business on the desktop, and then later I search on my mobile device in Google Maps, and the very first auto-suggest after typing 1-2 characters it the business I searched for yesterday. This is awesome given how irritating it is to enter stuff on mobile devices, especially when in motion, the fewer characters typed the better.

Most of the privacy issues can be solved just by opening up an incognito window. You can choose with 1 stroke whether you want a bubble or not.
I think it's a US thing though. Obviously I know that in US English the word has both meanings, but in the UK a troll is something that hides under a bridge, and the fishing is trawling.

Took me a while to figure out the humour inherent in the double meaning when I first came across it (in the 90s)
Digital, meet physical: Amazon brings real-world purchases to Android apps
Yay!

Millions might have perished from the global warming and it's adverse weather and sea-line effects, but we could explore Greenland, so who cares about that.
this is highly atypical.

here are the syllabi for two other similar classes at Cal:
http://inst.eecs.berkeley.edu/~cs188/sp12/information.html
http://inst.eecs.berkeley.edu/~ee122/fa12/grading.html

here are syllabi for the the first two intro cs classes:
http://inst.eecs.berkeley.edu/~cs61a/fa13/about.html (this class has 1000 people in it)
http://inst.eecs.berkeley.edu/~cs61b/fa13/handout0.pdf
Airbnb and its enemies: Who's afraid of a $10-a-night sofa?
Scientific writers do write like programmers code. There are as many as ~15 authors on a paper. The scientific paper has intensive markup, often in Latex. And collaborative writing like GoogleDocs doesn't work b/c 3 different authors will make changes to the same sentence and you need to be able to see all three changes next to each other. Not to mention figures, equations, etc...

MS Word and Libre office aren't powerful enough for scientific writing and aren't universally embraced or consistent across operating systems.

Github for writers is desperately needed. Draft doesn't do nearly enough

Source: physical science graduate student
My wife is a novelist.

The collaborative editing would be useful in the later phases of a book -- i.e., working with an editor and copyeditor, it's be great to have a really efficient way to review changes made to the actual text (instead of reviewing a hard-copy with hand-written corrections, and then hoping those corrections are accurately hand-merged into the text...).

But for most of the life of a manuscript, it's just the author working completely solo (from what I've seen). In the standard flow, there's no editor until the book (in a fairly complete and polished draft) is sold to a publisher. A literary agent may read drafts along the way, but normally wouldn't touch the text, just write up higher-level feedback.

On the other hand, the task of designing a narrative that flows well at the scope of a novel is really hard, and can take a lot of large-scale trial and error to improve. She usually does have several "branches" of her current project, as well as large chunks that she has cut from the current draft but doesn't discard (and sometimes may be re-added).

Her first published novel shed more than 300 pages that were never re-added on its way to the final version... it's hard to keep track of all that. It wasn't like "drop this chapter", generally, more like "remove this subplot from the hundred or so places it shows up".

I'm not sure how well the git model would address the problems -- the big problem is scale, and visualizing large structures made up of lots and lots of tiny little words. They are plenty of pain points worth attacking, though, except that most writers don't have much cash to spend on tools.
Could you elaborate on the bad experiences? And any idea which class it was?
why are TA's so hard to come by this semester? is it due to the size of the 61 series?
Read this: 9 candid startup comments by Y Combinator’s Paul Graham
is there a glassdoor for startup accelerators?
Thanks, this is good advice. I'd consider an internship, but I'm concerned that most of the good ones wouldn't accept me since I'm still lacking in several areas. I'm willing to put in the work to learn quickly on the job, but I feel like I'd probably fail a technical interview.
Comic Book drawer.

Then into adolescence: tattooer, anthropologist/teacher, coder(coders 'can be different' and coding felt like a game)

Now: I'm a developer and I'd like to get free to be creative in coding, writing, drawing

What sucks about being a dev is that when you're learning it you just feel like creating and the work is nothing like it.. I guess I'm somewhat good at it because I'm good with abstractions, have always been very logic and like learning(thus 'teacher'). So, I'm still far but the spirit is the same... Seeking your passions is hard as fuck, no wonder people give up.
The HTML5 progress Element
Here:

http://magiccards.info/search.html

(magiccards.info does most of this already, albeit not with a JSON API)
The key here is that patents are supposed to be non obvious to those "skilled in the arts" and herein lies the rub: who are those skllled in the arts? In my previous career (wireless and IC) I saw most patents as trivial for someone skilled in the arts: they were mostly byproducts of routine engineering design work. They were novel only in the sense that you are probably the first to work on a specific form. Yet they could appear rather deep and profound to the untrained eyes as you need a lot of training to be skilled in the arts in the first place. Can patent examiners truly judge the novelty of these patent applications?

And the funny thing is: if you come up with some real algorithm for some real hard problem it is unlikely that your algorithm can be protected by a patent, certainly not in its general form. The true algorithmic nature of your solution is likely too abstract and mathematical for a patent as patents do not protect laws of nature (physics and math qualify as laws of nature).
please note: FRP is an idea, and while theres some interesting tools out there for FRP, it is not always the right solution, and in many respects, "FRP done Right" is still an open research problem.

That said, have fun and try things out! Share what you learn, and either way, it'll be time enjoyably spent.
Thanks, looks good. HN was built before heroku and app engine then. Nowadays, putting a db-backed site on them is pretty easy zero-admin affair.
In most of the world, and in most of the United States, your thoughts are owned by your employer. If you want to eat, have a roof over your head, raise a family, you almost always sign away the rights to your thoughts.

The exception is California. And that's why Silicon Valley is in Silicon Valley.
Complex Analysis: Mathematica Notebooks
And yet he supports FWD, a stealth superpac whose only mission is to get as many cheap temp. engineers as possible in the country.

Foreign founders are SOL, no company is going to hire he who will disrupt them out of the market, and those who get in are doomed to menial positions with no change of getting ahead in the company.

The real losers will be local engineers who will be priced out of the market, downwards I mean.
Man-Made or not, At least they have existed. That should be enough to add it to periodic table. There is always a non zero probability that they might exist somewhere else in the universe.
Xdebug – Professional PHP Debugging
Also see: http://www.washingtonpost.com/blogs/worldviews/wp/2013/07/30...

Describing how Bradley Manning using 'wget' was considered computer fraud because it was not on the list of approved programs.
Maybe this is should be rather then will be.
Because a trie works great for prefix searches, but we want substring searches, so we'd have to modify the trie to be more like a suffix tree, in it's simplest form inserting each possible suffix into the trie and doing a prefix search over that. For each word, adding up the length of each suffix gives quadratic memory.
Attack-driven defense
How to draw polygon using HTML5 Canvas
Leaked: damning internal email trail from inside the WikiLeaks Party
Chinese "black PR" firm controlled hundreds of verified Weibo users
One that take several order of magnitude more energy to create that it can store? I am in!
We are looking for a way to do that but we haven't found any quick but accurate enough way to do that for the moment. I am confident we would find one day :)
Haha maybe my previous comment is off-topic, but it's because I want to read stories more like http://matt-welsh.blogspot.com/2010/11/why-im-leaving-harvar...
That looks totally legit. :|
I don't suppose you'd provide snapshots of the database that's backing this API?
New iPhones coming on Sep 20th?
Latex has line comments and since it is compiled into a document you can place line breaks anywhere. It does break the flow of the sentence though.

I've used Latex+vim+git to write scientific papers recently. It is unfortunately much too complicated for my colleagues to adopt. They're holding onto MS Word which is far inferior in terms of markup, citing, and VCS.

I've been converting my Latex documents to ugly word documents for collaborating and editing. The MS Word editing isn't great either. The strikethrough method breaks up flow. I've also had problems deleting side comments in Libre office. And the MS Word experience isn't always the same on Macs.
Image painting on mouse click [Java Game/Applet]
Personal observation:
Internal security best practices in spy organizations are rarely 'overlooked'. It is all about trade-offs. II think the more important question is "why would the NSA have lax internal oversight on both user-privledges AND audit-logs?"

The answer is that it is much easier for black bag operations to be scrubbed from potential oversight when an individual holds the power to run the hidden|illegal analysis and clean their own log trails.
I wonder... what are the expected values for you to water it?
The racism of pg is subtle, but still racism, not so much from him but from his acolytes and zealots who even now in this thread can be seen taking his word as gospel and demote anyone who fits their interpretation of pg's words as an untouchable

Now these new untouchables will be rejected from many other accelerators who do nothing but copy whatever YC does in the vain hope that they too can land the next dropbox and airbnb, and rejected because they talk "funny"

At the same time expect to see a lot of teams made mostly of either foreign and domestic engineers who aren't "that good" when it comes to public speaking being indirectly coerced into accepting a dumb white bro as CEO just to get past the initial selection process of any accelerator.
Android VP Leaves Google for China’s Xiaomi
He certainly has. Would you be able to send me an email? I'm cjbarber@stanford.edu

I scoured the web for your email but wasn't able to come up with anything
The Augmented Reality America’s Cup
This is very nicely done. Wish this was available when I was developing CardSplice as it would have saved me some time.

Shameless plug for CardSplice[1] since hacker news is talking about MTG. I had a ton of fun developing this awesome app that lets you quickly feed Magic Cards behind your mobile and uses some advanced image processing and OCR to detect the cards and upload the list into the cloud. Amazing for draft deck building and organizing.

Anyways, thanks for the MTG web service.

[1] http://www.CardSplice.com
Spying on all of the email isn't simple either. When there's a will and a bottomless font of taxpayer money in the name of national security, there's a way.
Am I the only one who finds it funny that the article quoted Oracle's Enterprise Manager docs?
Woz: Apple may have built a non-iPhone phone
The mouse with one button, they finally gave in and have two now.
The Solution to Oversleeping
Amazon Extends Affiliate Program to Android App Developers
It is the good 'ol "No Lone Zone". Nuclear ICBM sites have those. You need our accountabil-a-buddy with you at all times.

Here is an example placard from a Titan II site:

http://www.flickr.com/photos/mattblaze/4182509642/

(By Matt Blaze)

Not a bad concept. But your accountabil-a-buddy has to be at the same level as you technically. One can easily fool or mislead non-technical people. "Q: What are you doing?" "A: Rebooting the flux capacitor"
On the other hand, individuals have prevailed against corporations. See Nissan Motors vs. Nissan Computer.

But I would agree; talk to an attorney if you are concerned. Most will give you a 30-60 minute consultation for free. Get a referral from a trusted friend if possible.
Not only that but the game is completely different to Magic. It comes from an earlier time, before the idea of "turn cards sideways to show they've been used" took hold. It has a very different economy and the two sides play completely differently.

The LCG data-pack model is great for people playing constructed formats, but it does make drafting more of a challenge. Mature LCGs are also quite difficult for latecomers to get into, especially if key packs go out of print.
Josh, thanks for your input.

I'm afraid that it's a bit hard to answer your question in a public forum. If any Ycombinator readers are on the Berkeley campus and want to chat with me, I'm at 739 Soda Hall.
This is cool. However, I wonder why the author didn't switch to a Lucene-based server such as Elasticsearch or Solr, for which you can find decent Go clients (or use the REST api directly). The NGram tokenizer lets you do infix search out of the box. By the way, the author says Lucene is "bloated." That's just nonsense, like saying MySQL is "bloated." LinkedIn and Twitter use Lucene to handle insane numbers of QPS with real-time updates. There is no excuse for not trying a search server before deciding to hack something new.

My impression from reading the post is that they went from an extremely inefficient solution straight to one that seems way overengineered for the company's scale. The app has only 28 ratings on iTunes, which means that it's not greatly popular ($150/month is not much more than my personal AWS bill).

My guess is that the highest ROI of this code (besides the joy of hacking) comes from the HN page views. Usually, optimizing software to this level is a bad idea for a small startup. You're not Twitter, Github, DropBox. Code less and grow your business more.
It's not really double protection, because patents and copyright cover different things. Copyright only protects the exact expression of what some software does. Patents cover the functionality of that software. In fact, since software per se is not claimed, the claimed functionality could be implemented entirely in hardware and still be covered by the patent.

No amount of copyright can protect the functionality, because 1) there are countless ways of implementing the same functionality and copyright only protects your specific way, and 2) copyright cannot legally cover functionality anyway.

As such, providing source code in a patent is of little value. (Although I have seen patents containing source code.) As long as you can reimplement the method being claimed by reading the patent with little undue experimentation, it has met its "enablement" requirement.
I'm using latex+vim+git for this purpose currently. I put two spaces after a period to signal the end of a sentence in Latex. Which helps me break the document up by sentences with vim.

If you're using markup then encouraging the period-double-space could be a harmless way of easily breaking the document up by sentences
Clojure's persistent vectors and hashmaps are both the same data structure, the hash array mapped trie, which can be implemented both simply and efficiently. If you look at the Java code in the Clojure source, there are no tricks, beyond the cleverness of the HAMT itself.