skysight-inc/HackerNews huggingface dataset:
I've also been using it for a few months and I tried a restore. What I found out is that the large zip files they create don't work. They warn you about creating zip files over a certain size, but I tried it anyway. I couldn't get it to unzip successfully on Mac OS X or Solaris using a variety of programs.

I'm also skeptical of their data integrity. From reading about there setup it seems that they have no checksumming and their only redundancy is RAID. So bad blocks or multiple disk failure could cause data loss. It's still worth it for my because it's so cheap, but I wouldn't make it my only backup.
Wow, this is amazing advice. But can you please plot the career path of someone who will be making $250k+ at age 28? It seems like an incredible claim.
Yes, it's lazy. The sieve outputs on a channel, which blocks until you read it. It will only generate more numbers as they're consumed. Same thing with the filters.
from:

http://sites.google.com/a/chromium.org/dev/spdy/spdy-whitepa...

"To target a 50% reduction in page load time. Our preliminary results have come close to this target (see below)."

The bigger chunk of which seems to come from header compression.

SPDY is targeted to be placed between HTTP and TCP.

It 'only' requires changes to the client and the webservers.

That makes me a little skeptical about the value of their tests, I can't imagine they got the top 500 websites to change their server architecture to allow this test to take place.

They are very much focused on the latency issues but the only references they give are for things related to page load time, which are affected peripherally by latency, but latency is much more of an effect on single connections.

And the only gain from that would be to compress the headers.

If header compression is that much of a deal then I would suggest to add optional header compression to the http standard, not to place layers in between http and tcp.

And that layer would have to add 0 overhead all by itself on single connections or the results would be negative instead of positive.

You can't really support this unless the client supports it as well, think of it as a specialized gateway function inside the browser that knows how to tunnel HTTP over SPDY to hosts that support it, the key factor is interleaving frames of content from different sources. Essentially a packet multiplexer/demultiplexer if I read it all right, that will pack all the requests on the sending side and unpack them at the receiving end to go to their respective handlers.

By the way, the 'server pushes resources before the client has asked for it' is what has been making my webcam software functional for the last 15 years or so.

I clued in to that in '95 or so using the server-push technology and figured out that since I already knew that the next request would be for another frame of the same cam why not send it right now instead of waiting for the browser to ask for it...
Sorry if I started sounding like I was making this a Java vs. Clojure approach. I wasn't. My original point is that there are no compelling reasons for me to use a language like Clojure over a language like Ruby. Clojure's biggest selling point, having high-level primitives to parallelize with, is meaningless to me because it is so slow, and it's other selling point, increased productivity, doesn't doesn't mean much to me either because I feel like I can be just as productive in Ruby or Python. I can make those my glue languages. I was originally responding to a post by someone asking "Why Clojure over Ruby?"

By the way, I think combining multiple languages on the JVM is a great idea and it was what prompted me to investigate Clojure in the first place.
Vendors like this is what makes me want to get out of IT.
Droid Grabs Chunk of U.S. Mobile Internet Usage at Launch
Ex-Madoff computer programmers arrested - U.S. business- msnbc.com
>> "Why a whole post about this? Because, these days, we're all using multi-core computers. For the most part, the way that we're making things faster isn't really by making them faster: we've been running into some physical barriers that make it hard to keep pushing raw CPU speed. Instead, we've been adding CPUs: my laptop has 2 processors, and my server has 8 processors."

I don't know about this... Laptops have had 2 cores for quite a while. Are we really going to see 8 core laptops? I'd bet the other way - more CPU intensive work will be done on servers, and laptops/desktops will end up as low powered thin clients to the web.
Hmm. My usage, and that of my colleagues, certainly conforms to the description given. As does the version on WikiPedia (fount of all knowledge (remove tongue from cheek)) and other on-line dictionaries.

Perhaps it doesn't match your meaning, but it doesn't mean either of us is right. Or wrong. The article is describing a stereotype, giving it a label, and it happens to match very closely with people I know. And me.

Call it what you will. Perhaps "Geek" more closely fits with your model:

http://en.wikipedia.org/wiki/Nerd

http://en.wikipedia.org/wiki/Geek
> Goroutines all run in the same thread

Rob Pike's presentation says something quite different. It says that gccgo "allocates one goroutine per thread" and that 6g has "good goroutine support, muxes them onto threads".

The language FAQ says:

"Goroutines are part of making concurrency easy to use. The idea, which has been around for a while, is to multiplex independently executing functions—coroutines, really—onto a set of threads. When a coroutine blocks, such as by calling a blocking system call, the run-time automatically moves other coroutines on the same operating system thread to a different, runnable thread so they won't be blocked. The programmer sees none of this, which is the point. The result, which we call goroutines, can be very cheap: unless they spend a lot of time in long-running system calls, they cost little more than the memory for the stack. "
>> "The quickest way for a 'dramatic' speedup of the web is to install an ad blocker."

Because most websites would go out of business and there wouldn't be much left to browse?
Forty Years' War: Medicines to Deter Some Cancers Are Not Taken
iPhone or Droid? XKCD gives the definitive answer
But the old iron is almost completely reliable. Forget "five nines" of uptime; we're talking a one and two naughts. CPU modules, disks, and I/O peripherals can be hot-swapped with no interruption to service. Furthermore, the I/O bandwidth on those suckers is through the roof. Likely that's partially because a mainframe computer system consists of a CPU which does the heavy lifting and a whole bunch of satellite computers -- actual computers -- whose whole purpose in life is to drive I/O devices and relay information between them and the mainframe CPU.

When your application has to be up and has to service an entire department or organization for decades on end, the IBM mainframe platform is pretty much the only choice.
If I read the article right the main questions are:

What is the simplest self reproducing system?

What are the parameters needed for such a system?

Can such a system lead to an evolution cycle?

I like the approach he lays out. I've always been curious about what it would take to write a simulation where the evolution happens in code space instead of attribute space.
It's a shame they don't have a Linux client or an API or i'd be quite tempted to give them a spin.
Another fun fact: a shot of espresso generally has slightly less caffeine than a regular cup of coffee.

Not sure why, but I'd always assumed a shot of espresso was like a concentrated giant cup of regular roast. However, a regular sized cup of espresso is a different story...
Does anyone know of a brand of coffee thats 100% robusta?
I think one of the nicest things about this are its origins in CSP. By using channel communication for synchronization between threads you eliminate all the hassle of worrying about mutexes and shared memory.

And they have a nice choice operator called select which allows the language to read from multiple channels at the same time and make a random choice about competing channels to send to. See this example:

var c, c1, c2 chan int;
var i1, i2 int;
select {
case i1 = <-c1:
print("received ", i1, " from c1\n");
case c2 <- i2:
print("sent ", i2, " to c2\n");
default:
print("no communication\n");
}

for { // send random sequence of bits to c
select {
case c <- 0: // note: no statement, no fallthrough, no folding of cases
case c <- 1:
}
}

The style corresponds to the CSP choice operator where the bottom select is doing something like

P = ( 0 -> P ) OR ( 1 -> P )

OR there is the CSP non-deterministic choice operator. Either branch can go ahead.

CSP doesn't make a distinction between sending and receiving on a channel (it doesn't have channels, merely the parallel, or interface parallel, operator to combine processes). Essentially sending is offering to synchronize on a single value and receiving is accepting to synchronize on any value: run those in parallel you get a communication channel.
That blew my mind for a bit too. It's not lazy in the sense of postponing evaluation, it just blocks until something reads or writes from the channel. This could go on forever assuming you have something that reads from the channel in an infinite loop (as it looks like it's doing in main(), actually...), but the generators themselves only loop when the channel is interacted with.
Always Check The Small Print…or not.
Lunascape Orion: Gecko, Webkit, and Trident in one browser
Nothing quite does what CICS or IMS or TPF does. Certainly nothing open source. The programming model is radically different to anything in the Linux application world (think, writing database applications in a shader language, is the closest analogy).

Sure your typical mainframe shop would prefer it if there was a competitive market, but for really serious OLTP, nothing touches a mainframe still.

Also, arguably, the "it's all a database" approach is superior to files and filesystems. It's what Be had and what Microsoft has been struggling with for 20 years.
Hackers on happiness & tiny houses, plus The Story of Stuff
Actually, with i7's hyperthreading (which is in iMacs now and a few laptops) common desktops effectively have 8 "cores" to play with. There are 4 hardware, and 4 virtual, it still shows up as 8 completely usable cores in activity monitors and such.
Ticketmaster - still dogging us with fees, but a great social media presence
Be Chill. It’ll make you smarter.
Suppose self-driving cars are developed by then? A lot of car trips would be rendered unnecessary. Instead of driving a 2 ton car to the grocery store to get a carton of milk, the store would send a 100 pound driverless go-kart to deliver it. And imagine if you had your walls covered with monitors streaming HD video in real time. Video conferencing would be almost as good as face to face contact, again rendering a lot of car and plane trips unnecessary.
That was my thought as well: Google would just concentrate on getting first class drivers for the machines it ships with and let the community hack together any other support that it cares to.
The ADD stems from ignoring all topics that are not relevant to your current project. It appears to be ADD to most people, but in reality, it is simply ignoring irrelevance. "What do you think of the green dress?" "That is nice." "What about blue?" "Yeah, that is good." "What did I just ask?" "Uh...." "You have some kind of ADD!"
Another good resource for the same is Practical Common Lisp by Peter Seibel [http://gigamonkeys.com/book/]. Like these lectures its free to read online :-)

[Edited for spelling]
Possibly. But then again, I don't see any ads on HN, and I do remember a version of the web that did not have advertising on it. It also had a significantly better signal to noise ration than the current one does.
You've lost me. At what point are you charged money?
Can anyone familiar with lisp, tell us, how good this is ?
It is not an OS is it? It's the userspace set of Google libraries and applications, to put it more precisely. I wouldn't call it a PC operating system as the article suggests.
How to Make $15M by scamming the poor
Just remember that 1.25% of a pre-funded startup is worth very little. If you're able to bootstrap for 5 years and sell the thing for $10MM you're looking at something like $100K. If you raise money and sell for $50MM you'll end up with something similar (after the dilution and liquidation preferences). The cost of taking a half-salary can add up quickly.

For more data, check out http://compstudy.com/. It's an annual survey of startup compensation. This year there were over 1000 companies that participated in the survey and there was a huge jump in pre-VC funded companies.
There is an OS called QnX that does this by using synchronized (for the most part) interprocess communication using messages.

Makes you wonder what you could do if you extended the channel concept to the OS level and to machine-to-machine communication.

I guess you'd end up with Plan-9 sooner or later.
Here's a thought experiment. Take Donald Knuth, assume that he doesn't have a cave, has great social skills and no control issues. Would you consider him a nerd?

Instinctively, I would say yes.

The essence is being competent. All those other things are just side effects. Very common side effects, which is why they became part of the stereotype, but still optional.
> When I told them I was quitting, they offered me a giant (>25%) raise, but I couldn't stomach the thought of staying after accepting another offer

You got offended and walked instead of actually negotiating at the point it seemed they recognized your value. Why the conflict avoidance? You should have asked for what you wanted, pointed to your track record of success to justify it and helped them do the math about how it benefited them. And if you were smart push for something that aligned your incentives with the decision-makers on growth instead of salary.

So now the hard part. You use words like "my project" and "helped" which suggests you aren't the only one on the team. And complaining about getting 2% of a company founded by someone else is pretty ridiculous. What you're really saying is that you don't think the company has decent prospects which will make your stake worth anything, which may be the underlying source of this angst.
For Sale: 3BR/1BA Single Family House in Buffalo, KY, $135,000
Browser Based iTunes
It's like a 'generator' in many other languages.

As soon as it has produced a result it will wait for the consumer to catch up, then generate another result and so on.
New & Interesting Insights Into Google Rankings & Spam from Pubcon
Low Order Approximations to English - A Programming Experiment
IANAL, but I think you're right. They really can't tell you what to do with public data even if they provided it to you, because as you said you can't copyright facts. Feist Publications vs. Rural Telephone Services is the most relevant case:

http://en.wikipedia.org/wiki/Feist_Publications_v._Rural_Tel...

It gets hairy though because you are agreeing to their terms of use in return for the API key, and I'm not sure how that factors in. They're well within their rights to refuse service to you, but if you were able to scrape their data without agreeing to their terms, it may be legal.

Of course there's a million other places to get this data, and I'm not suggesting you scrape theirs. But I don't think there's anything stopping you legally, just some FUD in their TOS.

Would be very curious to hear from the site owners on this topic.
The biggest problem is that a centralized archive is at the mercy of copyright holders ex-post-facto. I defy you to find more than a few recent articles from the NYTimes.com on archive.org. Things get taken down all the time.
My bet would be the exact opposite. There will be a push to get more power on the computers we have on our desks and in our pockets, and the only way to increase that is to add more cores.

Once there is a good solution to using lots of cores we might even see a reversal of the gigahertz races, where more slower cores are cheaper than a few faster ones.
It does make more sense after understanding that.

There's still the ever-increasing number of concurrent goroutines, but what just helped me accept that a bit is the fact is that each goroutine does not necessarily map to one thread (it actually does in one of their compilers - there's two - but that's an implementation detail).
It's a decent introduction. If you're aware how functional languages work, you might get more out of following a tutorial targeted towards more 'advanced' users. However, these videos aren't very long, so I'm sure you won't lose a lot of time by watching them.
I think he meant to say that goroutines all run in the same process - they share an address space.
I highly recommend that you watch the film mentioned: "The Story of Stuff".

It is a very detailed look at how companies drive consumerism to keep the economy going at the expense of third world countries.
Agree 100%. He has some good things to say, but its more anecdotes and bits of motivation than specific, actionable advice. Still valuable in its own right though.

I personally get a lot out of Seth's perspective, but I can certainly understand that his posts are not what most HN readers are looking for.
Cha Cha Cha Change, TSA Style
How to sink pirates
Ask HN for comments: Popular math article: Sailing Hydrofoils
There are enough on-topic things to talk about here; off-topic things should be taken to a different site.
Have a look at how the large majority of the top 500 web servers are set up and see if you disagree.

A large portion of them could be sped up by simply configuring them properly, using nothing but the facilities that are available today.

I'm not sure if this link will 'live' for other others, but it is an analysis of cnn.com, it shows the homepage clocks in at a whopping 1.1M!

http://www.webpagetest.org/result/091113_2YFS/

And has tons of caching and compression issues.

Feel free to try out any other 'large' website and you'll find that only very few of them actually come in green across the board.
I'm writing this article, and while there are a few things left to do I thought I'd float it here (if you'll pardon the pun) to ask what you think is missing. What more do you want to see? What details should be added or expanded?

Hacker News wasn't my initial target audience, but I've realised that it's a good target audience that won't hesitate to tell you when you've got something wrong.
Alwayswriteagain: The Toast of Birmingham
Signs From Above
Short but sweet - "what the value of my MBA"
Very nice article from a first-time entrepreneur.

My experience is that most first-time entrepreneurs confuse action with activity, one is a vector and one is a scalar. If we start with a technical solution and then look for a problem, we are a scalar looking to become a vector. If we focus on a problem and a set of customers who are willing to pay for a solution (any solution), we start with a definite direction and will succeed when we can get enough wood behind that arrow.

Unfortunately, it is too easy to keep yourself intellectually occupied with scalar activities. I should know, I have spend way too many years being a pure technologist looking for a problem.

In retrospect, wealth creation is a vectorial activity.

Good luck everyone.
Novell launches Pulse, an enterprise app that speaks Google Wave protocol
well obviously; I was just pointing out that it was optional in case it wasn't apparent!
Tell HN: Buenos Aires Meetup on Wednesday
I recently moved to Buenos Aires for a few months and noticed that there are a few developers/entrepreneurs here who read HN. Let's get together.

When:
Wednesday, Nov 18 @ 8PM

Where:
Voulez Bar
Cerviño 3802 - Ciudad de Buenos Aires
Tel: 4802-4817
http://www.guiaoleo.com.ar/detail.php?ID=2934

Also:
If you're thinking of coming, could you please email me? (Not required, but it might help.) mail at awarner dot com
Hey Rich,

My silliest nitpick is commenting on ideas. It's chronologically backwards. New comments show up at the top, but the commenting form is at the bottom.

But more to it's core, I don't like how votes are rationed. If the management doesn't keep on top of ideas or if the forum is too active, then users have to start compromising their opinions. It feels unfair to users that want to contribute but can't. I'm not saying I would accept how Votebox works without modification, but I do like how votes are kept under control without it feeling like I can't really contribute past a certain point.
Murdoch Vs. Google
Wordpress.com to start geotagging blogs
Murder of Lehman Brothers- Best Lehman Book Review From The Deal
Playing devil's advocate, I think there's a difference between what you would do and what the average consumer would do.

There's also a difference between something that might be better in the short-term (say over 2-3 years) and something that is good for the long haul.

But I feel the same way as you do, mostly. I'm just more willing to make that trade off for say, a Kindle, knowing that in the near future I'm jumping to an open platform as quickly as possible.
The decade of Steve Jobs, CEO of Apple
Why too much fiddling with open source software is bad for business
My Nightmare Interviews With Google
Yes. I wouldn't have bought nearly the amount of music that I have bought if it weren't for illegal file sharing I did when i was younger. I discovered most of my favorite artists through illegal downloading, and since then I've spent hundreds that I wouldn't otherwise have spent going to shows and buying music.
Pagetest A website page checker focusing on speed, use it to improve your sites
aren't whitespace, brainfuck* and ook! the same languages (just differently named keywords)?
Thanks, I've never seen such a clear explanation of why a displacement hulls length in sail boats is a large factor in the theoretical top speed of the boat.

edit: ok, I've read the whole thing now, maybe there is a way to tie this in with hysteresis for contrast ?
no, you can't. you see the just the silhouette of the code, not the while code itself - because when selected, tabs and multiple spaces rougly look the same.
Source: http://news.ycombinator.com/item?id=939090
What's the context? Is this an exploit?
Twitter doesn't care about us...
Linkage: http://www.storyofstuff.com/

Have not watched the video, but this is a great article. I find downsizing living to be such a relief; it's almost like having a burden lifted. One thing that drives me kinda nuts to have too much "stuff" to worry about. Quantity of possessions grows to accumulate in the space a person lives; smaller space = less room for frivolous items. Makes a lot of sense.
I was about to switch from Verizon just before I heard about the Droid (it was time to upgrade, and Verizon has a crappy line-up of phones). This saved me as a customer for them.
I know several parents of small children, and all of them have trouble getting their kids to eat.

Likewise. My hypothesis is that the kids didn't like to eat food that was hard to chew. Hot dogs: yes, steak: no. Beets: yes, carrot sticks: no.

The standard joke was that children would eat any food that had been "nuggetized". All we need now is a home nuggetizer to test that hypothesis.